-- Logs begin at Mon 2022-10-17 12:02:44 UTC, end at Mon 2022-10-17 14:34:03 UTC. -- Oct 17 12:37:38.431378 n-d-853316-12 systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 12:37:38.441345 n-d-853316-12 devstack@n-api.service[111649]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 12:37:38 2022] *** Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: nodename: n-d-853316-12 Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: machine: x86_64 Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: clock source: unix Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: pcre jit disabled Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: detected number of CPU cores: 4 Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: current working directory: / Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: detected binary path: /usr/bin/uwsgi-core Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: your processes number limit is 47680 Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: your memory page size is 4096 bytes Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: detected max file descriptor number: 2048 Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: lock engine: pthread robust mutexes Oct 17 12:37:38.443684 n-d-853316-12 devstack@n-api.service[111649]: thunder lock: enabled Oct 17 12:37:38.445216 n-d-853316-12 devstack@n-api.service[111649]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 12:37:38.445216 n-d-853316-12 devstack@n-api.service[111649]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 12:37:38.484463 n-d-853316-12 devstack@n-api.service[111649]: Python main interpreter initialized at 0x55cf285799c0 Oct 17 12:37:38.484463 n-d-853316-12 devstack@n-api.service[111649]: python threads support enabled Oct 17 12:37:38.484463 n-d-853316-12 devstack@n-api.service[111649]: your server socket listen backlog is limited to 100 connections Oct 17 12:37:38.484463 n-d-853316-12 devstack@n-api.service[111649]: your mercy for graceful operations on workers is 90 seconds Oct 17 12:37:38.484876 n-d-853316-12 devstack@n-api.service[111649]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 12:37:38.484876 n-d-853316-12 devstack@n-api.service[111649]: *** Operational MODE: preforking *** Oct 17 12:37:38.485162 n-d-853316-12 devstack@n-api.service[111649]: *** uWSGI is running in multiple interpreter mode *** Oct 17 12:37:38.485162 n-d-853316-12 devstack@n-api.service[111649]: spawned uWSGI master process (pid: 111649) Oct 17 12:37:38.485382 n-d-853316-12 systemd[1]: Started Devstack devstack@n-api.service. Oct 17 12:37:38.486559 n-d-853316-12 devstack@n-api.service[111649]: spawned uWSGI worker 1 (pid: 111650, cores: 1) Oct 17 12:37:38.486559 n-d-853316-12 devstack@n-api.service[111649]: spawned uWSGI worker 2 (pid: 111651, cores: 1) Oct 17 12:37:38.486559 n-d-853316-12 devstack@n-api.service[111649]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 12:37:39.160308 n-d-853316-12 devstack@n-api.service[111651]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 12:37:39.162849 n-d-853316-12 devstack@n-api.service[111650]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 12:37:40.262571 n-d-853316-12 devstack@n-api.service[111651]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 12:37:40.262571 n-d-853316-12 devstack@n-api.service[111651]: from cryptography.utils import int_from_bytes Oct 17 12:37:40.263178 n-d-853316-12 devstack@n-api.service[111651]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 12:37:40.263178 n-d-853316-12 devstack@n-api.service[111651]: from cryptography.utils import int_from_bytes Oct 17 12:37:40.263496 n-d-853316-12 devstack@n-api.service[111650]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 12:37:40.263496 n-d-853316-12 devstack@n-api.service[111650]: from cryptography.utils import int_from_bytes Oct 17 12:37:40.263913 n-d-853316-12 devstack@n-api.service[111650]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 12:37:40.263913 n-d-853316-12 devstack@n-api.service[111650]: from cryptography.utils import int_from_bytes Oct 17 12:37:42.773171 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 12:37:42.773864 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 12:37:42.773957 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 12:37:42.774339 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 12:37:42.774598 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 12:37:42.774988 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.775317 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.775642 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.775961 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.776296 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.776608 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.776931 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.777252 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.777581 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.777844 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.778183 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.778509 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853316-12 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.778835 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.779144 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.779460 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.779776 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.780081 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.780403 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.780708 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.780793 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 12:37:42.781154 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 12:37:42.781244 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.781500 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 12:37:42.781630 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.781864 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 12:37:42.781980 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.782105 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 12:37:42.782241 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.782516 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.782631 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.782840 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.782930 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.783161 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.783252 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.783532 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.783620 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.783846 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.783944 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.784159 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.784245 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.784468 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.784567 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.784782 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.784948 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853316-12 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.785146 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.785347 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.785535 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.785663 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.785787 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.785910 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.786040 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853316-12 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.786193 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.786351 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.786540 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.786739 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.786881 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.787027 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.787167 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.787319 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.787465 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.787613 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.787752 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.787883 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.788009 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.788155 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.788333 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.788573 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.788727 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.788882 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.789039 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.789182 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.789333 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.789468 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.789618 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.789812 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.789975 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.790105 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.790280 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.790442 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.790586 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.790746 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.790876 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.791002 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.791132 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.791295 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.791434 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.791607 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.791758 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.791923 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.792023 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853316-12 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.792245 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.792344 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.792497 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.792626 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.792751 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.792935 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.793079 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.793347 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.793433 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.793656 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.793751 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.793959 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.794054 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.794303 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.794394 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.794612 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.794699 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.794958 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.795061 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.795220 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.795569 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.795797 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.795885 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.796103 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.796199 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.796418 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.796516 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.796718 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.796804 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.797024 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.797109 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.797331 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.797432 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.797646 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.797733 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.797948 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.798059 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.798335 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.798461 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.798595 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.798684 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.798878 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.799001 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.799315 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.799416 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.799639 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.799717 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.799961 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.800072 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.800213 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.800401 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.800487 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.800715 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.800804 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.801026 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.801130 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.801336 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.801430 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.801655 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.801766 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.801961 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.802049 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.802289 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.802379 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.802542 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.802628 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.802849 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.802937 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.803158 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.803251 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.803471 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.803576 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.803781 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.803895 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.804091 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.804196 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.804400 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.804494 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.804704 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.804797 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.805016 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.805112 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.805322 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.805417 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.805670 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.805779 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.805941 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.806039 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.806276 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.806384 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.806590 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.806732 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.806899 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.807035 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.807211 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.807360 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.807497 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.807622 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.807819 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.807976 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.808104 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.808236 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.808412 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.808504 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.808726 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.808815 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.809038 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.809156 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.809343 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.809440 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.809603 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.809700 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.809904 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.809999 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.810230 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.810321 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.810574 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.810669 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.810853 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.810953 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.811158 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.811246 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.811464 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.811557 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.811764 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.811852 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.812071 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.812163 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.812377 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.812464 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.812680 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.812767 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.812985 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.813071 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.813291 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.813379 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.813596 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.813683 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.813902 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.813991 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.814226 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.814316 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.814532 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.815144 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.815381 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.815503 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.815717 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.815865 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.816032 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.816175 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.816324 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.816448 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.816642 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.816790 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.816927 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.817054 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.817216 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.817338 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.817537 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.817697 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.817833 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.817969 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.818119 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.818360 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.818506 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.818679 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.818819 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.818949 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.819093 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.819266 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.819387 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.819524 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.819646 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.819776 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.819950 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.820111 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.820282 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.820439 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.820575 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.820707 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.820844 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.823498 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.823670 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.823786 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.823895 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.824000 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.824106 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.824211 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.824327 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.824433 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.824538 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.824657 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.824771 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.824878 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.824996 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.825110 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.825216 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.825320 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.825424 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.825528 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.825646 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.826295 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.826380 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.826449 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.826525 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.826525 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.826759 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.826843 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.826922 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.827007 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.827094 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.827181 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:37:42.827261 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.827337 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.827493 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.827589 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.827678 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.827765 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.827936 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828028 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828116 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828195 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828287 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828368 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828445 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828522 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828609 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828687 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828782 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828861 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.828939 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829022 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829111 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829240 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829401 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829538 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829623 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829700 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829778 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.829922 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.830011 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.830325 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.830957 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.831185 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.831304 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.831503 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.831635 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.831815 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.831909 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.832152 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.832246 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.832466 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.832554 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.832776 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.832869 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.833102 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.833187 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.833427 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.833522 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.833738 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.833824 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.834056 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.834142 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.834405 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.834494 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.834725 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.834815 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.835040 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.835138 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.835357 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.835443 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.835664 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.835751 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.835969 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.836098 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.836276 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.836362 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.836580 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.836665 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.836890 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.836991 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.837196 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.837283 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.837515 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.837602 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.837825 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.837921 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.838143 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.838260 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.838476 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.838563 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.838787 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.838875 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.839103 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.839189 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.839414 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.839552 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.839725 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.839882 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.840034 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.840163 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.840349 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.840481 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.840660 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.840784 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.840968 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.841113 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.841255 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.841394 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.841581 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.841730 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.841894 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.842040 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.842282 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.842433 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.842580 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.842723 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.842845 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.842969 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.843084 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.843221 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.843349 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.843493 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.843665 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.843826 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.843974 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.844130 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.844269 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.844358 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.844603 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.844693 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.844899 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.844996 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.845228 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.845329 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.845531 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.845616 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.845868 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.845962 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.846239 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.846331 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.846572 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.846659 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.846942 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.847029 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.847256 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.847343 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.847565 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.847651 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.847869 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.847971 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.848190 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.848275 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.848496 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.848583 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.848801 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.848888 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.849113 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.849206 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.849415 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.849561 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.849719 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.849849 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.850026 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.850114 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.850357 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.850457 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.850663 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.850748 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.850971 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.851057 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.851278 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.851378 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.851584 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.851670 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.851889 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.851976 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.852196 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.852291 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.852529 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.852613 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.852839 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.852924 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.853150 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.853237 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.853473 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.853559 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.853799 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.853896 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.854114 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.854239 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.854442 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.854529 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.854750 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.854837 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.855053 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.855148 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.855354 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.855442 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.855653 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.855740 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.855960 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.856055 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.856262 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.856400 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.856564 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.856659 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.856865 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.856954 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.857165 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.857255 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.857464 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.857559 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.857780 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.857875 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.858086 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.858220 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.858413 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.858511 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.858716 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.858818 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.859023 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.859110 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.859361 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.859462 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.859666 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.859764 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861230 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861354 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861448 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861590 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861665 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861747 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861823 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861896 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.861971 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862038 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862103 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862280 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862280 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862441 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862531 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862620 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862699 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862776 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862860 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.862940 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.863200 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.863289 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.863573 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.864289 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.864289 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.864452 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.864452 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.864619 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.864619 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.864921 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.865128 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.865755 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.865755 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.865904 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.865982 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866060 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866137 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866307 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866394 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866462 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866462 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866577 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866654 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866739 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866894 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.866982 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.867208 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.867295 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.867517 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.867611 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.867823 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.867909 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.868131 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.868217 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.868439 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.868528 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.868750 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.868835 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.869062 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.869157 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.869368 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.869455 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.869686 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.869770 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.869992 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.870089 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.870332 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.870488 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.870628 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.870769 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.870944 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.871112 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.871272 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.871419 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.871563 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.871706 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.871853 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.872013 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.872176 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.872268 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.872480 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.872573 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.872786 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.872881 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.873108 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.873196 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.873417 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.873503 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.873725 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.873824 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.874030 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.874116 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.874364 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.874452 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.874668 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.874773 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.874980 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.875069 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.875295 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.875381 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.875605 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.875700 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.875915 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.876001 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.876220 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.876359 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.876536 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.876625 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.876845 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.876939 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.877668 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.877763 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.877993 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.878207 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.878342 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.878532 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.878682 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.878859 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.879023 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.879180 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.879339 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.879487 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.879629 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.879802 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.879931 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.880184 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.880351 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.880447 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.880528 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.880726 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.880816 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.881037 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.881124 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.881342 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.881430 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.881648 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.881737 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.881953 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.882040 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.882334 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.882580 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.882682 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.882935 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.883069 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.883240 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.883328 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.883558 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.883721 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.883868 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.883955 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.884183 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.884289 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.884493 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.884581 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.884801 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.884889 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.885121 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.885208 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.885434 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.885520 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.885743 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.885839 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.886049 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.886134 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.886381 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.886476 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.886695 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.886790 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.887006 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.887102 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.887325 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.887422 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.887633 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.887727 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.887943 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.888030 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.888257 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.888365 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.888555 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.888713 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.888864 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.889028 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.889183 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.889341 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.889662 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.889748 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.889972 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.890059 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.890315 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.890398 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.890628 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.890718 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.890956 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.891051 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.891272 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.891383 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.891583 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.891672 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.891893 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.891988 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.892203 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.892341 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.892548 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.892636 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.893421 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.893564 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.893808 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.894121 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.894256 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.894457 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.894809 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.894895 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.895121 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.895231 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.895428 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.895515 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.895738 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.895838 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.896043 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.896131 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.896350 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.896486 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.896656 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.896744 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.896961 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.897049 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.897275 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.897369 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.897579 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.897667 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.897891 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.897981 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.898221 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.898313 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.898542 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.898638 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.898848 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.898935 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.899152 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.899239 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.899456 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.899551 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.899756 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.899843 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.900062 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.900148 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.900388 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.900531 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.900703 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.900819 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.901011 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.901108 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.901318 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.901424 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.901631 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.901726 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.901941 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.902048 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.902270 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.902398 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.903864 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.903979 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.903979 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904128 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904128 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904284 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904363 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904440 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904518 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904594 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904681 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904762 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904839 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904917 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.904995 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905080 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905168 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905247 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905333 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905413 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905498 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905579 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905799 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.905893 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.906099 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.906234 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.906437 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.906585 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.906747 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.906834 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.907049 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.907139 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.907351 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.907446 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.907660 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.907747 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.907967 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.908054 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.908271 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.908460 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.908617 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.908764 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.908929 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.909072 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.909239 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.909389 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.909543 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.909694 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.909855 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.909998 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.910205 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.910310 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.910510 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.910613 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.910844 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.910939 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.911208 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.911328 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.911520 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.911607 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.911837 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.911998 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.912155 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.912300 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.912453 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.912579 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.912722 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.912855 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.913021 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.913170 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.913326 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.913470 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.913615 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.913774 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.913913 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.914091 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.914245 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.914427 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.914530 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.914747 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.914836 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.915073 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.915161 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.915389 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.915476 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.915692 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.915779 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.916000 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.916088 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.916303 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.916392 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.916608 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.916696 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.916912 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.917010 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.917214 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.917310 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.917517 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.917604 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.917821 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.917907 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.918132 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.918292 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.918459 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.918553 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.918764 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.918858 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.919066 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.919163 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.919399 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.919494 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.919707 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.919795 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.920018 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.920113 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.920645 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.920801 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.920945 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.921083 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.921239 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.921385 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.921549 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.921698 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.921856 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.922001 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.922207 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.922357 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.922504 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.922597 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.922726 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.922817 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.923041 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.923133 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.923350 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.923436 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.923654 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.923755 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.923961 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.924115 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.924330 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.924450 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.924650 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.924785 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.924961 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.925087 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.925281 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.925404 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.925601 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.925698 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.925922 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.926018 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.926251 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.926343 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.926564 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.926663 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.926876 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.926972 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.927184 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.927357 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.927493 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.927673 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.927803 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.927987 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.928112 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.928298 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.928425 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.928620 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.928735 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.928938 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.929046 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.929259 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.929359 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.929579 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.929674 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.929889 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.929986 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.930270 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.930438 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.930580 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.930745 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.930909 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.931047 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.931182 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.931340 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.931487 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.931632 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.931777 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.931934 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.932093 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.932245 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.932391 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.932532 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.932624 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.932735 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.933043 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.933145 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.933348 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.933441 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.933657 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.933749 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.933963 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.934055 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.934295 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.934389 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.934608 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.934699 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.934923 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.935015 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.935241 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.935339 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.935546 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.935705 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.935958 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.936050 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.936269 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.936357 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.936579 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.936675 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.936888 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.936980 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.937193 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.937334 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.937497 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.937665 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.937806 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.937894 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.938126 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.938243 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.938452 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.938553 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.938762 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.938914 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.939054 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.939236 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.939395 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.939541 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.940229 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.940335 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.940523 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.942728 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.942867 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.942972 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943058 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943146 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943216 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943304 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943386 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943465 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943553 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943634 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943731 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943813 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943893 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.943974 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944051 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944131 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944210 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944288 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944375 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944456 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944548 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944636 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944724 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944811 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944898 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.944979 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.945067 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.945148 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.945273 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.945454 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.945586 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.945765 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.945889 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.946077 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.946228 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.946423 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.946551 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.946731 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.946865 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.947039 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.947184 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.947364 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.947596 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.947693 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.947917 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.948005 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.948227 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.948314 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.948550 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.948722 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.948876 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.948965 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.949183 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.949286 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.949484 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.949575 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.949799 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.949887 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.950102 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.950210 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.950431 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.950529 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.950740 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.950825 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.951043 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.951137 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.951354 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.951452 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.951662 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.951752 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.951968 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.952055 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.952271 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.952364 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.952572 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.952660 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.952892 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.952992 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.953196 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.953327 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.953516 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.953603 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.953829 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.953974 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.954149 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.954321 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.954487 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.954573 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.954789 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.954889 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.955109 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.955196 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.955988 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.956169 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.956301 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.956483 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.956614 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.956789 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.956926 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.957096 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.957239 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.957438 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.957574 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.957746 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.957835 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.958067 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.958303 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.958419 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.958507 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.958750 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.958838 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.959061 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.959162 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.959396 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.959482 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.959707 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.959805 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.960018 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.960107 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.960326 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.960414 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.960644 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.960730 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.960970 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.961056 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.961273 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.961359 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.961579 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.961666 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.961888 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.961977 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.962214 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.962306 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.962522 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.962625 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.962827 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.962916 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.963136 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.963223 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.963440 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.963535 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.963744 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.963832 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.964047 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.964134 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.964369 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.964470 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.964676 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.964770 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.964999 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.965085 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.965308 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.965407 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.965617 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.965871 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.965959 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.966224 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.966313 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.966545 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.966634 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.966864 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.966950 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.967179 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.967275 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.967491 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.967579 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.967807 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.967892 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.968121 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.968216 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.968434 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.968528 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.968749 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.968836 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.969071 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.969179 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.969384 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.969470 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.969706 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.969806 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.970023 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.970124 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.970356 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.970445 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.970673 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.970760 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.971036 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.971179 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.971354 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.971511 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.971654 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.971905 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.972003 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.972234 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.972323 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.972548 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.972635 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.972860 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.972949 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.973171 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.973265 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.973484 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.973611 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.973797 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.973887 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.974107 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.974213 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.974445 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.974535 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.974757 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.974847 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.975066 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.975153 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.975378 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.975478 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.975702 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.975817 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.976019 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.976116 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.976347 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.976452 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.976664 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.976756 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.976977 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.977100 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.977290 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.977392 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.977602 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.977715 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.977918 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.978011 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.978276 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.978478 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.978568 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.978798 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.978886 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.979140 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.979238 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.979468 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.979563 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.979783 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.979870 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.980977 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981104 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981190 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981270 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981359 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981448 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981585 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981676 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981756 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981843 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.981924 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982003 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982091 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982203 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982286 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982365 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982529 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982631 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982846 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.982948 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.983981 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.984094 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.984094 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.984234 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.984303 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.984368 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.984447 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.984711 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.984783 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.985422 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.985524 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.985606 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.985685 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.985783 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.985864 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.985955 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.986037 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.986116 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.986356 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.986546 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.986670 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.986771 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.986873 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.987006 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.987185 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.987417 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.987521 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.987604 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.987758 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.987920 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.988058 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.988231 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.988370 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.988540 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.988683 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.988858 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.988988 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.989180 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.989308 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.989490 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.989622 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.989806 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.990117 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.990225 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.990475 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.990572 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.990788 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.990876 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.991099 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.991195 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.991409 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.991496 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.991726 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.991820 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.992037 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.992133 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.992345 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.992433 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.992651 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.992736 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.992956 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.993054 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.993270 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.993356 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.993576 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.993661 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.993878 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.993973 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.994217 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.994321 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.994512 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.994608 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.994820 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.994916 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.995129 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.995243 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.995437 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.995533 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.995741 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.995834 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.996065 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.996157 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.996368 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.996468 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.996669 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.996759 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.996971 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.997062 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.997278 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.997381 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.997584 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.997676 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.997886 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.997986 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.998208 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.998312 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.998516 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.998620 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.998829 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.999124 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.999213 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.999430 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.999517 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.999738 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:42.999825 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.000047 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.000142 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.000399 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.000487 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.000707 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.000800 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.001012 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.001100 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.001317 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.001404 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.001623 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.001710 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.001926 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.002026 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.002826 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.003057 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.003151 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.003231 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.003449 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.003546 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.003762 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.003884 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.004079 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.004233 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.004426 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.004587 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.004734 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.004883 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.005043 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.005268 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.005356 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.005601 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.005689 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.005923 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.006010 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.006278 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.006395 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.006599 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.006688 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.006902 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.006988 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.007206 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.007303 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.007510 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.007602 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.007833 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.007930 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.008143 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.008307 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.008456 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.008544 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.008765 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.008852 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.009074 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.009172 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.009382 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.009478 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.009691 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.009780 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.009999 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.010087 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.010335 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.010427 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.010644 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.010771 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.010953 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.011049 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.017293 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.017293 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.017510 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.017615 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.017700 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.017883 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.018601 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.018752 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.018901 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019065 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019214 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019364 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019503 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019604 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019688 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019782 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019864 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.019942 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020021 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020099 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020187 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020268 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020347 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020426 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020504 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020590 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020690 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020773 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020859 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.020941 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021010 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021076 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021150 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021230 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021297 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021297 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021421 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021497 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021565 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021637 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021717 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021785 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021850 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021927 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.021995 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022067 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022133 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022220 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022288 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022372 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022441 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022506 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022506 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022622 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022688 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022762 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022836 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022902 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.022974 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023039 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023113 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023225 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023311 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023393 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023473 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023551 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023643 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023724 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023802 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023880 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.023957 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024035 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024123 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024191 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024264 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024331 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024416 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024495 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024582 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024662 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024741 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024826 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024906 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.024997 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.025078 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.025156 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.025265 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.025352 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.025566 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.025664 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.025874 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.025961 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.026208 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.026314 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.026501 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.026598 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.026802 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.026899 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.027105 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.027193 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.027407 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.027557 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.027709 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.027798 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.028018 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.028106 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.028434 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.028730 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.028833 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.028925 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.029010 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.029093 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.029212 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.029306 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.029513 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.029605 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.029841 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.029930 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.030184 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.030278 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.030511 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.030599 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.030868 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.030982 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.031148 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.031237 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.031468 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.031567 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.031778 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.031876 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.032090 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.032224 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.032407 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.032504 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.032720 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.032818 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.033026 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.033113 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.033337 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.033450 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.033677 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.033768 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.033993 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.034081 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.034338 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.034453 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.034655 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.034767 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.034970 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.035080 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.035293 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.035381 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.035614 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.035705 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.035944 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.036031 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.036274 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.036363 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.036586 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.036677 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.036913 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.037018 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.037232 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.037400 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.037549 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.037628 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.037860 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.037948 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.038208 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.038314 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.038523 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.038619 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.038833 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.038966 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.039142 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.039241 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.039451 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.039547 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.039706 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 12:37:43.039794 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.040079 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.040391 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.040703 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.041019 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.041335 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.041662 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.041990 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.042336 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.042666 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.042993 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.043346 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.043661 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.044009 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.044339 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.044653 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.044967 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.045273 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:37:43.045772 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 12:37:43.195229 n-d-853316-12 devstack@n-api.service[111650]: INFO dbcounter [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Registered counter for database nova_api Oct 17 12:37:43.201752 n-d-853316-12 devstack@n-api.service[111651]: INFO dbcounter [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Registered counter for database nova_api Oct 17 12:37:43.217352 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_db.sqlalchemy.engines [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:37:43.222127 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:37:43.224564 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writer thread running {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:37:43.229028 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writer thread running {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:37:43.283421 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.context [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) {{(pid=111650) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 12:37:43.286397 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.context [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) {{(pid=111651) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 12:37:43.287335 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:37:43.287807 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:37:43.289388 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:37:43.290132 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:37:43.290289 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:37:43.290609 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:37:43.290701 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:37:43.292230 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:37:43.292616 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:37:43.292958 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:37:43.293401 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:37:43.294656 n-d-853316-12 devstack@n-api.service[111650]: INFO dbcounter [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Registered counter for database nova_cell0 Oct 17 12:37:43.295696 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:37:43.297708 n-d-853316-12 devstack@n-api.service[111651]: INFO dbcounter [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Registered counter for database nova_cell0 Oct 17 12:37:43.299631 n-d-853316-12 devstack@n-api.service[111650]: INFO dbcounter [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Registered counter for database nova_cell1 Oct 17 12:37:43.302399 n-d-853316-12 devstack@n-api.service[111651]: INFO dbcounter [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Registered counter for database nova_cell1 Oct 17 12:37:43.306922 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_db.sqlalchemy.engines [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:37:43.308598 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_db.sqlalchemy.engines [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:37:43.310335 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:37:43.313576 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writer thread running {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:37:43.314452 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:37:43.319350 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writer thread running {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:37:43.456027 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writer thread running {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:37:43.458719 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writer thread running {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:37:43.465441 n-d-853316-12 devstack@n-api.service[111650]: INFO dbcounter [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Registered counter for database nova_cell0 Oct 17 12:37:43.469048 n-d-853316-12 devstack@n-api.service[111651]: INFO dbcounter [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Registered counter for database nova_cell0 Oct 17 12:37:43.475252 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_db.sqlalchemy.engines [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:37:43.476999 n-d-853316-12 devstack@n-api.service[111651]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:37:43.480998 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writer thread running {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:37:43.482109 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writer thread running {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:37:43.822740 n-d-853316-12 devstack@n-api.service[111651]: WARNING keystonemiddleware.auth_token [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 12:37:43.823920 n-d-853316-12 devstack@n-api.service[111650]: WARNING keystonemiddleware.auth_token [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 12:37:43.832325 n-d-853316-12 devstack@n-api.service[111650]: WARNING keystonemiddleware.auth_token [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 12:37:43.833270 n-d-853316-12 devstack@n-api.service[111651]: WARNING keystonemiddleware.auth_token [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 12:37:44.177349 n-d-853316-12 devstack@n-api.service[111650]: WARNING keystonemiddleware.auth_token [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 12:37:44.181394 n-d-853316-12 devstack@n-api.service[111651]: WARNING keystonemiddleware.auth_token [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 12:37:44.183448 n-d-853316-12 devstack@n-api.service[111650]: WARNING keystonemiddleware.auth_token [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 12:37:44.187458 n-d-853316-12 devstack@n-api.service[111651]: WARNING keystonemiddleware.auth_token [None req-a7ec893f-9dd3-4673-bd30-3e2126cf41da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 12:37:44.188814 n-d-853316-12 devstack@n-api.service[111650]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf285799c0 pid: 111650 (default app) Oct 17 12:37:44.191542 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:37:44.192741 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001815 Oct 17 12:37:44.193162 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Mon Oct 17 12:37:44 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:37:44.193551 n-d-853316-12 devstack@n-api.service[111651]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf285799c0 pid: 111651 (default app) Oct 17 12:39:09.564488 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:09.565970 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001928 Oct 17 12:39:09.566576 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:09.580391 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=3 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:09.582813 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_cell0:SELECT=3 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:09.584134 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_cell1:SELECT=3 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:09.586665 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:10.533695 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-df55aed3-0f27-4a4e-9b3f-aea803927b98 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:10.567702 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-df55aed3-0f27-4a4e-9b3f-aea803927b98 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.993792 Oct 17 12:39:10.568443 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:39:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:39:13.299690 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:13.300814 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-d3d817df-a0a4-4af8-a7af-ba8f5e1f7475 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001751 Oct 17 12:39:13.302869 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:13.829666 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-416f59eb-f99a-44e1-b1d3-7e03028c0645 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:13.885564 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-416f59eb-f99a-44e1-b1d3-7e03028c0645 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.577604 Oct 17 12:39:13.886112 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:13.900608 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writing DB stats nova_api:SELECT=3 {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:13.901616 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writing DB stats nova_cell1:SELECT=3 {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:13.903550 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writing DB stats nova_cell0:SELECT=3 {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:13.904607 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:14.123979 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-77daedf4-9a5c-4249-ab12-cb38ed6b4e25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:14.197987 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-77daedf4-9a5c-4249-ab12-cb38ed6b4e25 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302742 Oct 17 12:39:14.198647 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 12:39:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:39:16.934289 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-416f59eb-f99a-44e1-b1d3-7e03028c0645 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:16.935459 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-416f59eb-f99a-44e1-b1d3-7e03028c0645 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 17 12:39:16.935864 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:17.788561 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-65063bf9-98e0-465b-89ec-e574c5a9148a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "swap": 0}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:17.858442 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-65063bf9-98e0-465b-89ec-e574c5a9148a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.915331 Oct 17 12:39:17.861642 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:17.876090 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-1fac3b5e-9ebb-4b79-9e46-cfdd795cb10b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:17.943448 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-1fac3b5e-9ebb-4b79-9e46-cfdd795cb10b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071804 Oct 17 12:39:17.944575 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 12:39:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:39:20.923882 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-65063bf9-98e0-465b-89ec-e574c5a9148a admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:20.925058 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-65063bf9-98e0-465b-89ec-e574c5a9148a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001857 Oct 17 12:39:20.926283 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:21.695947 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-7ac77ae6-2b26-4da8-8579-6c94c3279323 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:21.723920 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-7ac77ae6-2b26-4da8-8579-6c94c3279323 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.790711 Oct 17 12:39:21.724582 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:21.738495 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-7b6487f1-d680-4bee-b57d-e155d741cdf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:21.767482 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-7b6487f1-d680-4bee-b57d-e155d741cdf4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034012 Oct 17 12:39:21.768612 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 12:39:21 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:39:24.638669 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-7ac77ae6-2b26-4da8-8579-6c94c3279323 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:24.639701 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-7ac77ae6-2b26-4da8-8579-6c94c3279323 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 17 12:39:24.640117 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:25.189150 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-1aeb49f4-e3f6-463a-91f5-3e541eb052ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "vcpus": 2, "ram": 2048, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:25.209276 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-1aeb49f4-e3f6-463a-91f5-3e541eb052ef admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.561792 Oct 17 12:39:25.209836 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:25.222599 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-416ddbca-a318-4f7f-a5f4-ab81e8a694a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:25.255941 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-416ddbca-a318-4f7f-a5f4-ab81e8a694a4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037658 Oct 17 12:39:25.256612 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 12:39:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:39:28.146193 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-1aeb49f4-e3f6-463a-91f5-3e541eb052ef admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:28.148048 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-1aeb49f4-e3f6-463a-91f5-3e541eb052ef admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002324 Oct 17 12:39:28.154426 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:28.685360 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-d6f33a7b-dead-4c95-9e30-b9e7a8dbcd48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "id": "d4", "ram": 4096, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:28.707720 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-d6f33a7b-dead-4c95-9e30-b9e7a8dbcd48 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.551374 Oct 17 12:39:28.720997 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-2e7d51b4-59d4-442f-998d-7fba35f93f97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:28.726031 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:28.753314 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-2e7d51b4-59d4-442f-998d-7fba35f93f97 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036013 Oct 17 12:39:28.754903 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 12:39:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:39:31.538808 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-d6f33a7b-dead-4c95-9e30-b9e7a8dbcd48 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:31.539832 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-d6f33a7b-dead-4c95-9e30-b9e7a8dbcd48 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 17 12:39:31.540237 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:31.980471 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-2e478803-8238-429a-9b8c-f5362e18b58f admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:32.007996 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-2e478803-8238-429a-9b8c-f5362e18b58f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.461161 Oct 17 12:39:32.008552 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:39:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:39:34.729441 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-d6f33a7b-dead-4c95-9e30-b9e7a8dbcd48 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:34.730616 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-d6f33a7b-dead-4c95-9e30-b9e7a8dbcd48 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Oct 17 12:39:34.731026 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:35.164623 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-c3fbc164-0f6b-4829-8dba-d1568c25cb9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1"}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:35.187251 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-c3fbc164-0f6b-4829-8dba-d1568c25cb9e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.449505 Oct 17 12:39:35.187806 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:35.200945 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-5d980c91-dfa5-4d0e-837c-96fa7886c524 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:35.232142 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-5d980c91-dfa5-4d0e-837c-96fa7886c524 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035166 Oct 17 12:39:35.232733 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 12:39:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:39:38.054672 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-c3fbc164-0f6b-4829-8dba-d1568c25cb9e admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:38.055670 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-c3fbc164-0f6b-4829-8dba-d1568c25cb9e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 17 12:39:38.056072 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:38.512324 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-4e587785-a06d-4078-b0c0-d93309c77619 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "rxtx_factor": 1.0}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:38.532166 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-4e587785-a06d-4078-b0c0-d93309c77619 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469611 Oct 17 12:39:38.533530 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:38.546096 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-ea3095a4-0458-4e50-a22c-f14ee5647cfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:38.572942 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-ea3095a4-0458-4e50-a22c-f14ee5647cfb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030452 Oct 17 12:39:38.573729 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 12:39:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:39:41.537949 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-4e587785-a06d-4078-b0c0-d93309c77619 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:41.538952 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-4e587785-a06d-4078-b0c0-d93309c77619 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 17 12:39:41.539379 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:42.049082 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-c6f0c4b9-34c1-495f-aaee-a2f9bc0c297f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "swap": 0, "ram": 4096, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:42.073306 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-c6f0c4b9-34c1-495f-aaee-a2f9bc0c297f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.527171 Oct 17 12:39:42.076845 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:42.086135 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-139abbc4-1b9b-4e5d-a5d7-0c410411fcef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:42.091192 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:42.122586 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-139abbc4-1b9b-4e5d-a5d7-0c410411fcef admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039885 Oct 17 12:39:42.123288 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 12:39:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:39:44.853295 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-c6f0c4b9-34c1-495f-aaee-a2f9bc0c297f admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:44.854339 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-c6f0c4b9-34c1-495f-aaee-a2f9bc0c297f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 17 12:39:44.854749 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:45.287144 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-ff46162a-5229-43f5-94fb-43e36901113f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:45.306971 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-ff46162a-5229-43f5-94fb-43e36901113f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444755 Oct 17 12:39:45.307529 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:39:45.320406 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-30049715-8372-41e2-9d99-8393b5119953 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:45.325511 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:39:45.349136 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-30049715-8372-41e2-9d99-8393b5119953 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032409 Oct 17 12:39:45.349763 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 12:39:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:39:48.131513 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-ff46162a-5229-43f5-94fb-43e36901113f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:39:48.133152 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-ff46162a-5229-43f5-94fb-43e36901113f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Oct 17 12:39:48.133724 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:39:48.644123 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-88b7a728-d121-44d7-a168-1169dea1938e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:48.676115 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-88b7a728-d121-44d7-a168-1169dea1938e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.535910 Oct 17 12:39:48.684590 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 12:39:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 12:39:48.690286 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2f9828d2-3648-462c-9885-bc4a77af4d4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:39:48.720656 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2f9828d2-3648-462c-9885-bc4a77af4d4f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034520 Oct 17 12:39:48.721028 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 12:39:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:40:14.363144 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-88b7a728-d121-44d7-a168-1169dea1938e admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:14.364072 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-88b7a728-d121-44d7-a168-1169dea1938e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 17 12:40:14.364476 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:40:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:40:14.374778 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:40:14.753375 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-71e6a329-ef54-4210-b622-cb8e18cbb22a admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:14.772290 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-71e6a329-ef54-4210-b622-cb8e18cbb22a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401943 Oct 17 12:40:14.772825 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:40:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:40:16.083915 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-88b7a728-d121-44d7-a168-1169dea1938e admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:16.085165 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-88b7a728-d121-44d7-a168-1169dea1938e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Oct 17 12:40:16.085565 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:40:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:40:16.634829 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-78d8001e-dcc8-4726-b6d6-e623f8d23a0b admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:16.640139 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.wsgi [None req-78d8001e-dcc8-4726-b6d6-e623f8d23a0b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-78d8001e-dcc8-4726-b6d6-e623f8d23a0b admin admin] Request method failure captured: Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: Accept: application/json Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: Accept-Encoding: gzip, deflate Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: Connection: keep-alive Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: Content-Length: 0 Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: Host: 10.222.0.27 Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: Openstack-Api-Version: compute 2.92 Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: Openstack-System-Scope: None Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: User-Agent: python-novaclient Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Auth-Token: gAAAAABjTU0vIkqmcsx62PTV6cHu78spCGiHyyhD5-sQg4CPlPKuD3xCB0oks69_1muPsJs8Rg65jvmKRVVoMb-eEeXijgvaOtQWho5eagDEH9_M2HRKVoBKPLOfhTe6iHHGYEEwC-qT2VQ3Z-pwTL1A3TAoxP_GjFACPS4tBDokmFrQi_R_SlM Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Domain-Id: None Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Domain-Name: None Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Identity-Status: Confirmed Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Is-Admin-Project: True Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Domain-Id: default Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Domain-Name: Default Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Name: admin Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Role: reader,member,admin Oct 17 12:40:16.644428 n-d-853316-12 devstack@n-api.service[111651]: X-Roles: reader,member,admin Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5171c95ca2414b6894d0ce81839e0ac4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant: admin Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant-Name: admin Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-User: admin Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-User-Domain-Id: default Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-User-Domain-Name: Default Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-User-Id: 853ef3e9652c4b75af698179e25dde7c Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: X-User-Name: admin Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: method: > Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: exception: Flavor 42 could not be found. Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: action_args: {'id': '42'} Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:40:16.646065 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:16.647189 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.648579 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-78d8001e-dcc8-4726-b6d6-e623f8d23a0b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:40:16.649947 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-78d8001e-dcc8-4726-b6d6-e623f8d23a0b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393783 Oct 17 12:40:16.649947 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:40:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:40:16.655549 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-e68626e7-ff39-4786-a3dd-dd265457a3c1 admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:16.660278 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:40:16.680315 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-e68626e7-ff39-4786-a3dd-dd265457a3c1 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028364 Oct 17 12:40:16.680866 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 12:40:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:40:16.691985 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2a4f1595-f05f-4214-85fc-595b0211049c admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:16.714784 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2a4f1595-f05f-4214-85fc-595b0211049c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027414 Oct 17 12:40:16.715327 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 12:40:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:40:16.725787 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-adeb62ea-0ebd-41e8-ae61-4d6e2a8c4d05 admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:16.731451 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.wsgi [None req-adeb62ea-0ebd-41e8-ae61-4d6e2a8c4d05 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-adeb62ea-0ebd-41e8-ae61-4d6e2a8c4d05 admin admin] Request method failure captured: Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: Accept: application/json Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: Accept-Encoding: gzip, deflate Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: Connection: keep-alive Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: Content-Length: 0 Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: Host: 10.222.0.27 Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: Openstack-Api-Version: compute 2.92 Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: Openstack-System-Scope: None Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: User-Agent: python-novaclient Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Auth-Token: gAAAAABjTU0vIkqmcsx62PTV6cHu78spCGiHyyhD5-sQg4CPlPKuD3xCB0oks69_1muPsJs8Rg65jvmKRVVoMb-eEeXijgvaOtQWho5eagDEH9_M2HRKVoBKPLOfhTe6iHHGYEEwC-qT2VQ3Z-pwTL1A3TAoxP_GjFACPS4tBDokmFrQi_R_SlM Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Domain-Id: None Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Domain-Name: None Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Identity-Status: Confirmed Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Is-Admin-Project: True Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Domain-Id: default Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Domain-Name: Default Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Name: admin Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Role: reader,member,admin Oct 17 12:40:16.734854 n-d-853316-12 devstack@n-api.service[111650]: X-Roles: reader,member,admin Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5171c95ca2414b6894d0ce81839e0ac4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant: admin Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant-Name: admin Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-User: admin Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-User-Domain-Id: default Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-User-Domain-Name: Default Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-User-Id: 853ef3e9652c4b75af698179e25dde7c Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: X-User-Name: admin Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: method: > Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: exception: Flavor 42 could not be found. Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: action_args: {'id': '42'} Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:40:16.737135 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:16.738947 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:16.740888 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-adeb62ea-0ebd-41e8-ae61-4d6e2a8c4d05 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:40:16.742830 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-adeb62ea-0ebd-41e8-ae61-4d6e2a8c4d05 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014532 Oct 17 12:40:16.742830 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:40:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:40:17.958776 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2a4f1595-f05f-4214-85fc-595b0211049c admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:17.959783 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2a4f1595-f05f-4214-85fc-595b0211049c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 17 12:40:17.960177 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:40:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:40:18.482677 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-a5fb21c5-0ac9-40e9-afc6-a076c16039e1 admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:18.488076 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.wsgi [None req-a5fb21c5-0ac9-40e9-afc6-a076c16039e1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-a5fb21c5-0ac9-40e9-afc6-a076c16039e1 admin admin] Request method failure captured: Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: Accept: application/json Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: Accept-Encoding: gzip, deflate Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: Connection: keep-alive Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: Content-Length: 0 Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: Host: 10.222.0.27 Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: Openstack-Api-Version: compute 2.92 Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: Openstack-System-Scope: None Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: User-Agent: python-novaclient Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Auth-Token: gAAAAABjTU0xrz4YIr2mYCkR2yhJie6rd5IU0qfGqaPeZMkfpjjuV1t1X2av7tTqC8AjTrlF1EWMrm9BL4yhao0vgIzMpyQbzEmvASCHYYn9dNFZvREDK7Dc2Lr9JvKNEtFOnThGBRNJ4GDdPhLaPcOE5QAsrbAc4lJIz70yx8QScQlRrzTBqTo Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Domain-Id: None Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Domain-Name: None Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Identity-Status: Confirmed Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Is-Admin-Project: True Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Domain-Id: default Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Domain-Name: Default Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Name: admin Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Role: reader,member,admin Oct 17 12:40:18.489581 n-d-853316-12 devstack@n-api.service[111650]: X-Roles: reader,member,admin Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5171c95ca2414b6894d0ce81839e0ac4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant: admin Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant-Name: admin Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-User: admin Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-User-Domain-Id: default Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-User-Domain-Name: Default Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-User-Id: 853ef3e9652c4b75af698179e25dde7c Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: X-User-Name: admin Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: method: > Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: exception: Flavor 84 could not be found. Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: action_args: {'id': '84'} Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:40:18.491119 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:18.492098 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.493519 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-a5fb21c5-0ac9-40e9-afc6-a076c16039e1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:40:18.494807 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-a5fb21c5-0ac9-40e9-afc6-a076c16039e1 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388952 Oct 17 12:40:18.494807 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:40:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:40:18.501309 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-14aba483-ead0-45c7-bd75-3ef428f42f66 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:18.516853 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-14aba483-ead0-45c7-bd75-3ef428f42f66 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019687 Oct 17 12:40:18.517394 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 12:40:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:40:18.526792 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-802c1632-63d5-481f-84a6-57bd8b3302ad admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:18.542496 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-802c1632-63d5-481f-84a6-57bd8b3302ad admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019142 Oct 17 12:40:18.543123 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 12:40:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:40:18.552465 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-f6f38672-ce15-45fc-b5ad-4faf1e2bd3ef admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:18.557440 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.wsgi [None req-f6f38672-ce15-45fc-b5ad-4faf1e2bd3ef admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-f6f38672-ce15-45fc-b5ad-4faf1e2bd3ef admin admin] Request method failure captured: Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: Accept: application/json Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: Accept-Encoding: gzip, deflate Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: Connection: keep-alive Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: Content-Length: 0 Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: Host: 10.222.0.27 Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: Openstack-Api-Version: compute 2.92 Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: Openstack-System-Scope: None Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: User-Agent: python-novaclient Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Auth-Token: gAAAAABjTU0xrz4YIr2mYCkR2yhJie6rd5IU0qfGqaPeZMkfpjjuV1t1X2av7tTqC8AjTrlF1EWMrm9BL4yhao0vgIzMpyQbzEmvASCHYYn9dNFZvREDK7Dc2Lr9JvKNEtFOnThGBRNJ4GDdPhLaPcOE5QAsrbAc4lJIz70yx8QScQlRrzTBqTo Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Domain-Id: None Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Domain-Name: None Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Identity-Status: Confirmed Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Is-Admin-Project: True Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Domain-Id: default Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Domain-Name: Default Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Name: admin Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Role: reader,member,admin Oct 17 12:40:18.558998 n-d-853316-12 devstack@n-api.service[111651]: X-Roles: reader,member,admin Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5171c95ca2414b6894d0ce81839e0ac4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant: admin Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant-Name: admin Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-User: admin Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-User-Domain-Id: default Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-User-Domain-Name: Default Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-User-Id: 853ef3e9652c4b75af698179e25dde7c Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: X-User-Name: admin Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: method: > Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: exception: Flavor 84 could not be found. Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: action_args: {'id': '84'} Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:40:18.560479 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:18.561528 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:18.563573 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-f6f38672-ce15-45fc-b5ad-4faf1e2bd3ef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:40:18.564776 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-f6f38672-ce15-45fc-b5ad-4faf1e2bd3ef admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011353 Oct 17 12:40:18.564776 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:40:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:40:19.805109 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-802c1632-63d5-481f-84a6-57bd8b3302ad admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:19.813657 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-802c1632-63d5-481f-84a6-57bd8b3302ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 17 12:40:19.813657 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:40:20.387333 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-88161560-25b6-4e5e-9c36-0616099e1bf9 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:20.393420 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.wsgi [None req-88161560-25b6-4e5e-9c36-0616099e1bf9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-88161560-25b6-4e5e-9c36-0616099e1bf9 admin admin] Request method failure captured: Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: Accept: application/json Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: Accept-Encoding: gzip, deflate Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: Connection: keep-alive Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: Content-Length: 0 Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: Host: 10.222.0.27 Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: Openstack-Api-Version: compute 2.92 Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: Openstack-System-Scope: None Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: User-Agent: python-novaclient Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Auth-Token: gAAAAABjTU0znhn2F2b29JFO0SZdDSBb9ppaD4G3-MCaVoGUJue5q_T11q8AhRVuTDwydl8vFQULzxs9lTmNUc3WB3KuPZgTQ6X4C-qUZKsglEZKHjxlfXGluPC_daMLlG_K9lk_X3WX_oDrEeYytjV6VcQyRdXIzbptmWldAuA28cYH84FOB3s Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Domain-Id: None Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Domain-Name: None Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Identity-Status: Confirmed Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Is-Admin-Project: True Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Domain-Id: default Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Domain-Name: Default Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Project-Name: admin Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Role: reader,member,admin Oct 17 12:40:20.394976 n-d-853316-12 devstack@n-api.service[111651]: X-Roles: reader,member,admin Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5171c95ca2414b6894d0ce81839e0ac4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant: admin Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-Tenant-Name: admin Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-User: admin Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-User-Domain-Id: default Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-User-Domain-Name: Default Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-User-Id: 853ef3e9652c4b75af698179e25dde7c Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: X-User-Name: admin Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: method: > Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: exception: Flavor 451 could not be found. Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: action_args: {'id': '451'} Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:40:20.396550 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:20.397590 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.399096 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-88161560-25b6-4e5e-9c36-0616099e1bf9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:40:20.400357 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-88161560-25b6-4e5e-9c36-0616099e1bf9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.449764 Oct 17 12:40:20.400357 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 12:40:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:40:20.407987 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-1dfcd2ed-4fb1-46a0-958d-81df4ba385ca admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:20.425055 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-1dfcd2ed-4fb1-46a0-958d-81df4ba385ca admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021037 Oct 17 12:40:20.425609 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 12:40:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:40:20.435462 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:20.451420 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019402 Oct 17 12:40:20.451998 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 12:40:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:40:20.461816 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-6ed4c995-aabd-491d-8806-203c18056165 admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:20.467287 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.wsgi [None req-6ed4c995-aabd-491d-8806-203c18056165 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-6ed4c995-aabd-491d-8806-203c18056165 admin admin] Request method failure captured: Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: Accept: application/json Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: Accept-Encoding: gzip, deflate Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: Connection: keep-alive Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: Content-Length: 0 Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: Host: 10.222.0.27 Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: Openstack-Api-Version: compute 2.92 Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: Openstack-System-Scope: None Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: User-Agent: python-novaclient Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Auth-Token: gAAAAABjTU0znhn2F2b29JFO0SZdDSBb9ppaD4G3-MCaVoGUJue5q_T11q8AhRVuTDwydl8vFQULzxs9lTmNUc3WB3KuPZgTQ6X4C-qUZKsglEZKHjxlfXGluPC_daMLlG_K9lk_X3WX_oDrEeYytjV6VcQyRdXIzbptmWldAuA28cYH84FOB3s Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Domain-Id: None Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Domain-Name: None Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Identity-Status: Confirmed Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Is-Admin-Project: True Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Domain-Id: default Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Domain-Name: Default Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Project-Name: admin Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Role: reader,member,admin Oct 17 12:40:20.469007 n-d-853316-12 devstack@n-api.service[111650]: X-Roles: reader,member,admin Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5171c95ca2414b6894d0ce81839e0ac4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5171c95ca2414b6894d0ce81839e0ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant: admin Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant-Id: 5171c95ca2414b6894d0ce81839e0ac4 Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-Tenant-Name: admin Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-User: admin Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-User-Domain-Id: default Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-User-Domain-Name: Default Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-User-Id: 853ef3e9652c4b75af698179e25dde7c Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: X-User-Name: admin Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: method: > Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: exception: Flavor 451 could not be found. Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: action_args: {'id': '451'} Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:40:20.471894 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:20.473667 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: ERROR nova.api.openstack.wsgi Oct 17 12:40:20.476120 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-6ed4c995-aabd-491d-8806-203c18056165 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:40:20.478260 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-6ed4c995-aabd-491d-8806-203c18056165 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012922 Oct 17 12:40:20.478260 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 12:40:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:40:21.722377 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:21.723425 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 17 12:40:21.723826 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:40:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:40:22.258757 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-5424e109-3a7b-493c-a530-953b6d88aa7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:40:22.279427 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-5424e109-3a7b-493c-a530-953b6d88aa7e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.414981 Oct 17 12:40:22.280020 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 17 12:40:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:40:23.513980 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:23.515045 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 17 12:40:23.516267 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:40:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:40:24.048880 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-d124b4ae-e287-4ce6-8eb4-d6e0a2cc1803 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:40:24.075491 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-d124b4ae-e287-4ce6-8eb4-d6e0a2cc1803 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.420249 Oct 17 12:40:24.076051 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 17 12:40:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:40:25.326471 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:25.327519 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 17 12:40:25.327953 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:40:25.862959 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-bed81e79-4a8e-4f8d-8629-bc2c3adcac16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:40:25.882625 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-bed81e79-4a8e-4f8d-8629-bc2c3adcac16 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.416122 Oct 17 12:40:25.883175 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 17 12:40:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:40:27.118797 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:27.119846 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 17 12:40:27.120242 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:40:27.673228 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-796d3019-2484-468a-ba72-b880a6967f6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:40:27.692877 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-796d3019-2484-468a-ba72-b880a6967f6e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.431227 Oct 17 12:40:27.693354 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 17 12:40:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 12:40:28.961144 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:28.962154 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 17 12:40:28.962568 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:40:29.525955 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-1b8d38b3-e83c-4cff-aef7-23b8f4c73f76 admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:40:29.547296 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-1b8d38b3-e83c-4cff-aef7-23b8f4c73f76 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.445882 Oct 17 12:40:29.548350 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Oct 17 12:40:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:41:27.827527 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:41:27.828543 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-e932dd10-8425-4919-b37a-d6ec91f99c0f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 17 12:41:27.828942 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 12:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:41:27.839895 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:41:28.248696 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-c64cd672-632c-4491-adbc-60b4ea2a5057 admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:41:28.270990 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-c64cd672-632c-4491-adbc-60b4ea2a5057 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.435508 Oct 17 12:41:28.271556 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:41:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:41:28.293290 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=14 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:41:28.299233 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-4cf3c566-ccdf-4a94-9e71-dcb71ec9b1ad admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:41:28.307099 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-4cf3c566-ccdf-4a94-9e71-dcb71ec9b1ad admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015220 Oct 17 12:41:28.307647 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Oct 17 12:41:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:41:28.320462 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-b27f7677-608a-479f-b404-5eeba2900bd0 admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:41:28.329211 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-b27f7677-608a-479f-b404-5eeba2900bd0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012262 Oct 17 12:41:28.329773 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Oct 17 12:41:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:41:28.341863 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-1ac6383a-16fe-4961-99d3-67aecb947760 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:41:28.349843 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-1ac6383a-16fe-4961-99d3-67aecb947760 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011413 Oct 17 12:41:28.350428 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Oct 17 12:41:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:41:28.362332 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-82e27f07-8096-4567-937e-de0c2600f61f admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:41:28.369759 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-82e27f07-8096-4567-937e-de0c2600f61f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010998 Oct 17 12:41:28.370347 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Oct 17 12:41:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:46:56.520151 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-1ac6383a-16fe-4961-99d3-67aecb947760 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:46:56.521163 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-1ac6383a-16fe-4961-99d3-67aecb947760 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Oct 17 12:46:56.521552 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:46:56.665055 n-d-853316-12 devstack@n-api.service[111650]: DEBUG dbcounter [-] [111650] Writing DB stats nova_api:SELECT=6 {{(pid=111650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:46:56.806760 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-c6d361ac-952f-4335-b1c7-0d064409d38d admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:46:56.811489 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-c6d361ac-952f-4335-b1c7-0d064409d38d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:46:56.811968 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-c6d361ac-952f-4335-b1c7-0d064409d38d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:46:56.812394 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-c6d361ac-952f-4335-b1c7-0d064409d38d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:46:56.813110 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-c6d361ac-952f-4335-b1c7-0d064409d38d admin admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:46:56.813554 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-c6d361ac-952f-4335-b1c7-0d064409d38d admin admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:46:56.813984 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-c6d361ac-952f-4335-b1c7-0d064409d38d admin admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:46:56.853072 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-c6d361ac-952f-4335-b1c7-0d064409d38d admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.189199 Oct 17 12:46:56.853639 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 12:46:56 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:46:57.933936 n-d-853316-12 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-1ac6383a-16fe-4961-99d3-67aecb947760 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:46:57.934968 n-d-853316-12 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-1ac6383a-16fe-4961-99d3-67aecb947760 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 17 12:46:57.935360 n-d-853316-12 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 12:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:46:58.136837 n-d-853316-12 devstack@n-api.service[111650]: DEBUG nova.api.openstack.wsgi [None req-b29555d7-9654-45f8-ab3c-483c63cf5111 admin admin] Calling method '>' {{(pid=111650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:46:58.140282 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-b29555d7-9654-45f8-ab3c-483c63cf5111 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:46:58.140782 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-b29555d7-9654-45f8-ab3c-483c63cf5111 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:46:58.141256 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-b29555d7-9654-45f8-ab3c-483c63cf5111 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:46:58.141986 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-b29555d7-9654-45f8-ab3c-483c63cf5111 admin admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:46:58.142461 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-b29555d7-9654-45f8-ab3c-483c63cf5111 admin admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:46:58.142869 n-d-853316-12 devstack@n-api.service[111650]: DEBUG oslo_concurrency.lockutils [None req-b29555d7-9654-45f8-ab3c-483c63cf5111 admin admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:46:58.166045 n-d-853316-12 devstack@n-api.service[111650]: INFO nova.api.openstack.requestlog [None req-b29555d7-9654-45f8-ab3c-483c63cf5111 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.081210 Oct 17 12:46:58.166623 n-d-853316-12 devstack@n-api.service[111650]: [pid: 111650|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 12:46:58 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:47:44.399940 n-d-853316-12 devstack@n-api.service[111649]: Mon Oct 17 12:47:44 2022 - graceful shutdown triggered... Oct 17 12:47:44.400477 n-d-853316-12 devstack@n-api.service[111650]: Gracefully killing worker 1 (pid: 111650)... Oct 17 12:47:44.400069 n-d-853316-12 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 12:47:44.401301 n-d-853316-12 devstack@n-api.service[111651]: Gracefully killing worker 2 (pid: 111651)... Oct 17 12:47:44.527342 n-d-853316-12 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=4 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:47:45.401148 n-d-853316-12 devstack@n-api.service[111649]: worker 1 buried after 1 seconds Oct 17 12:47:45.401148 n-d-853316-12 devstack@n-api.service[111649]: worker 2 buried after 1 seconds Oct 17 12:47:45.401856 n-d-853316-12 devstack@n-api.service[111649]: goodbye to uWSGI. Oct 17 12:47:45.402736 n-d-853316-12 systemd[1]: devstack@n-api.service: Succeeded. Oct 17 12:47:45.403304 n-d-853316-12 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 12:47:45.406139 n-d-853316-12 systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 12:47:45.423697 n-d-853316-12 devstack@n-api.service[127527]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 12:47:45 2022] *** Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: nodename: n-d-853316-12 Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: machine: x86_64 Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: clock source: unix Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: pcre jit disabled Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: detected number of CPU cores: 4 Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: current working directory: / Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: detected binary path: /usr/bin/uwsgi-core Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: your processes number limit is 47680 Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: your memory page size is 4096 bytes Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: detected max file descriptor number: 2048 Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: lock engine: pthread robust mutexes Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: thunder lock: enabled Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 12:47:45.459063 n-d-853316-12 devstack@n-api.service[127527]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 12:47:45.499804 n-d-853316-12 devstack@n-api.service[127527]: Python main interpreter initialized at 0x557e8ced19c0 Oct 17 12:47:45.499804 n-d-853316-12 devstack@n-api.service[127527]: python threads support enabled Oct 17 12:47:45.499804 n-d-853316-12 devstack@n-api.service[127527]: your server socket listen backlog is limited to 100 connections Oct 17 12:47:45.499804 n-d-853316-12 devstack@n-api.service[127527]: your mercy for graceful operations on workers is 90 seconds Oct 17 12:47:45.500220 n-d-853316-12 devstack@n-api.service[127527]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 12:47:45.500220 n-d-853316-12 devstack@n-api.service[127527]: *** Operational MODE: preforking *** Oct 17 12:47:45.500495 n-d-853316-12 devstack@n-api.service[127527]: *** uWSGI is running in multiple interpreter mode *** Oct 17 12:47:45.500495 n-d-853316-12 devstack@n-api.service[127527]: spawned uWSGI master process (pid: 127527) Oct 17 12:47:45.500703 n-d-853316-12 systemd[1]: Started Devstack devstack@n-api.service. Oct 17 12:47:45.501589 n-d-853316-12 devstack@n-api.service[127527]: spawned uWSGI worker 1 (pid: 127539, cores: 1) Oct 17 12:47:45.501698 n-d-853316-12 devstack@n-api.service[127527]: spawned uWSGI worker 2 (pid: 127540, cores: 1) Oct 17 12:47:45.501778 n-d-853316-12 devstack@n-api.service[127527]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 12:47:46.169590 n-d-853316-12 devstack@n-api.service[127539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 12:47:46.170268 n-d-853316-12 devstack@n-api.service[127540]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 12:47:47.344203 n-d-853316-12 devstack@n-api.service[127540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 12:47:47.344203 n-d-853316-12 devstack@n-api.service[127540]: from cryptography.utils import int_from_bytes Oct 17 12:47:47.344926 n-d-853316-12 devstack@n-api.service[127540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 12:47:47.344926 n-d-853316-12 devstack@n-api.service[127540]: from cryptography.utils import int_from_bytes Oct 17 12:47:47.345249 n-d-853316-12 devstack@n-api.service[127539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 12:47:47.345249 n-d-853316-12 devstack@n-api.service[127539]: from cryptography.utils import int_from_bytes Oct 17 12:47:47.345668 n-d-853316-12 devstack@n-api.service[127539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 12:47:47.345668 n-d-853316-12 devstack@n-api.service[127539]: from cryptography.utils import int_from_bytes Oct 17 12:47:49.780812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 12:47:49.781380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 12:47:49.781534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 12:47:49.781901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 12:47:49.782206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 12:47:49.782577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.782908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.783236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.783559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.783895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.784210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.784533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.784854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.785183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.785973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.786820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.786949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853316-12 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.787232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.787548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.787864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.788193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.788504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.788831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.789143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.789650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.790102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.790444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.790761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.791105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.791422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.791735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.792071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.792373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.792698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.793011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.793418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853316-12 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.793739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.794053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.794406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.794823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.794932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 12:47:49.795296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.795369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 12:47:49.795448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.795665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 12:47:49.795767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.796032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 12:47:49.796133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.796288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 12:47:49.796382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.796680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.796794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.797002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.797105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.797324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.797425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.797651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.797762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.797948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.798040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.798283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.798391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.798598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.798739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.798918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.799058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.799229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.799361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.799517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.799651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.799787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.799930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.800058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.800236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853316-12 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.800380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.800565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.800697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.800879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.801017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.801807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.802015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.802015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.802401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.802401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.802662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.802802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.802938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.803076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.803212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.803620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.803753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.803909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.804047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.804187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.804429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.804568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.804689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.804808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.804990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.805111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.805307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.805432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.805621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.805752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.805948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.806098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.806287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.806419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.806620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.806843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.806970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.807090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.807309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853316-12 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.807438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.807579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.807819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.807941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.808080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.808227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.808366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.808530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.808670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.808832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.808962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.809151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.809291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.809475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.809619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.809789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.809953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.810091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.810260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.810425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.810567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.810748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.810927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.811075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.811214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.811376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.811509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.811643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.811780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.811916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.812046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.812233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.812384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.812523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.812661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.812828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.812970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.813137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.813275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.813445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.813585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.813747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.813884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.814054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.814217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.814386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.814626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.814751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.814874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.815003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.815131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.815272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.815410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.815651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.815790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.815919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.816055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.816194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.816323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.816450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.816584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.816924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.817434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.817578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.817707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.817852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.818051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.818224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.818369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.818506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.818633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.818768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.818908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.819035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.819169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.819305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.819443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.819589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.819719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.819854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.819982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.820107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.820242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.820380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.820521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.821992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.822111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.822280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.822392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.822517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.822635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.822746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.822871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.822982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.823090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.823264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.823383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.823587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.823719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.823925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.824052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.824235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.824354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.824471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.824619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.824811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.824949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.825076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.825202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.825387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.825519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.825695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.825832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.826003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.826142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.826336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.826476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.826640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.826779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.826949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.827091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.827256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.827399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.827564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.827690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.827872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.828629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.828775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.828913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.829049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.829187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.829326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.829469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.829608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.829737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.829873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.830001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.830142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.830318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.830456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.830592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.830720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.830856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.830994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.831122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.831249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.831384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.831522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.831657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.831797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.831933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.832069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.832210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.832495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.832495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.833123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.833123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.833382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.833529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.833658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.833796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.833923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.834060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.834331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.834473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.834609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.834609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.834935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.835069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.835213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.835349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.835477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.835612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.835741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.835875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.836017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.836148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.836282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.836411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.836538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.836665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.836801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.836938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.837066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.837202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.837330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.837471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.837609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.837745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.837881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.838009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.838248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.838405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.838545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.838762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.838896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.839031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.839174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.839305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.839446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.839583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.839719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.839855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.840026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.840160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 12:47:49.840340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.840488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.840654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.840787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.840967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.841108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.841306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.841447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.841622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.841766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.841948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.842090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.842287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.842420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.842595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.842728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.842916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.843057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.843230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.843375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.843543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.843683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.843855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.844001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.844163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.844305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.844470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.844610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.844777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.844936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.845090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.845230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.845399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.845533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.845721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.845866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.846043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.846206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.846380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.846518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.846707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.846838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.847014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.847144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.847329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.847468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.847644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.847777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.849056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.849214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.849354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.849484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.849622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.849753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.849889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.850019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.850146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.850315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.850465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.850602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.850738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.850867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.851001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.851138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.851267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.851403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.851538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.851666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.851796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.851934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.852062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.852189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.852325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.852484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.852624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.852799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.852933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.853114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.853247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.853431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.853564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.853753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.853893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.854066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.854219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.854406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.854552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.854735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.854873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.855061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.855193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.855368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.855507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.855680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.855809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.855999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.856140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.856313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.856455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.856619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.856749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.856929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.857066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.857236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.857377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.857543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.857673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.857846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.857977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.858155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.858331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.858472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.858602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.858780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.858913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.859095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.859236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.859400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.859501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.859704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.859810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.860033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.860151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.860345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.860438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.860652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.860746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.860962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.861116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.861269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.861414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.861583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.861724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.861898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.862030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.862228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.862365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.862556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.862704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.862872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.863003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.863182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.863322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.863532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.863728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.864689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.864823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.864952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.865077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.865206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.865348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.865485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.865613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.865746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.865874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.866014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.866227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.866363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.866551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.866690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.866865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.867008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.867180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.867311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.867509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.867699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.867835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.867956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.868137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.868269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.868447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.868581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.868766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.868905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.869111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.869407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.869407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.869660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.869802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.869932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.870059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.870212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.870343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.870482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.870626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.870756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.870927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.871059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.871234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.871374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.871541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.871682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.871849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.871981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.872294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.872426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.872565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.872702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.872842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.872971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.873107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.873242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.873385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.873514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.873648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.873777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.873939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.874090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.874317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.874464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.874631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.874774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.874976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.875123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.875316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.875448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.875629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.875770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.875948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.876094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.876263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.876394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.876575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.876712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.876890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.877036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.877204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.877341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.877513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.877643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.877823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.877963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.878141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.878347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.878476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.878609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.878783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.878922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.879123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.879396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.879730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.879864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.880001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.880142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.880271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.880405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.880534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.880661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.880797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.880927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.881061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.881199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.881326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.881508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.881639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.881765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.881921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.882095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.882257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.882397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.882568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.882706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.882878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.883011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.883193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.883333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.883504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.883644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.883815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.883947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.884122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.884265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.884431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.884563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.884750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.884881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.885065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.885210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.885375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.885505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.885690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.885828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.886011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.886144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.886393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.886533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.886668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.886796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.886964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.887101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.887280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.887413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.887598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.887736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.887914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.888044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.888229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.888361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.888542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.888679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.888856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.888987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.889168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.889327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.889463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.889745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.889887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.890015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.890142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.890309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.890438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.890647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.890787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.890922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.891051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.891185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.891314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.891454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.891590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.891727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.891905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.892207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.892346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.892510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.892641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.892823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.892956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.893149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.893283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.893463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.893595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.893788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.893937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.894194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.894335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.894448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.894566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.894760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.894999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.895471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.895584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.895694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.895804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.895931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.896051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.896163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.896272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.896382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.896491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.896655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.896780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.896966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.897093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.897272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.897399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.897585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.897705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.897897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.898017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.898227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.898378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.898536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.898664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.898851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.898979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.899323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.899607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.899910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.900103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.900231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.900450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.900594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.900776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.900905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.901101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.901236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.901428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.901560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.901734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.901874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.902063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.902222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.902409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.902557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.902742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.902875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.903062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.903204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.903381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.903523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.903701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.903841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.904007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.904138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.904328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.904467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.904634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.904764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.904943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.905224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.905364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.905549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.905687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.905865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.906005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.906219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.906369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.906507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.906650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.906811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.907043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.907170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.907299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.907436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.907574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.907710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.907853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.908019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.908159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.908325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.908459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.908643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.908777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.908957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.909090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.909266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.909407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.909573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.909705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.909985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.910136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.910287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.910946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.911521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.911666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.911805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.911936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.912065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.912203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.912343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.912481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.912613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.912741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.912870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.913011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.913150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.913280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.913409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.913545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.913677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.913858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.913999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.914130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.914308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.914430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.914572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.914723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.914861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.914998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.915134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.915271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.915384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.915503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.915693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.915852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.916006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.916127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.916339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.916460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.916685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.916816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.916996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.917124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.917306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.917425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.917618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.917735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.917927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.918045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.918258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.918390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.918565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.918689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.918876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.918993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.919185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.919323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.919550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.919698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.919828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.920117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.920256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.920384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.920522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.920653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.920781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.920989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.920989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.921245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.921382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.921511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.921639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.921781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.921911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.922052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.922211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.922499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.922640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.922793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.922933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.923107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.923241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.923421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.923567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.923729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.923869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.924042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.924176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.924353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.924494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.924671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.924805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.924980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.925120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.925287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.925429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.925595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.925742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.925907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.926636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.926997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.927143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.927334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.927456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.927570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.927688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.927815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.927937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.928057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.928168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.928310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.928711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.928941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.929107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.929247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.929389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.929518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.929660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.929875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.930006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.930319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.930464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.930585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.930696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.930820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.931003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.931138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.931312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.931444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.931621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.931770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.931928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.932144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.932351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.932481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.932621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.932751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.932889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.933026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.933156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.933299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.933429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.933558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.933687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.933815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.934012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.934155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.934355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.934646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.934780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.934961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.935212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.935355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.935602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.935707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.935912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.936100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.936274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.936440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.936583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.936781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.936903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.937123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.937230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.937462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.937555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.937828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.937919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.938145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.938337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.938472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.938673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.938789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.939002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.939096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.939360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.939461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.939701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.939824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.940005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.940187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.940362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.940529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.940637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.940851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.940944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.941239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.941332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.941561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.942342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.942473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.942571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.942668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.942761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.942853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.942939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.943239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.943330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.943555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.943648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.943870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.943971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.944191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.944290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.944506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.944606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.944820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.944912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.945134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.945236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.945447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.945548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.945760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.945852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.946077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.946205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.946416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.946557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.946725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.946887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.947055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.947221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.947372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.947626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.947727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.947960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.948061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.948282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.948375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.948597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.948689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.948907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.949012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.949268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.949359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.949591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.949684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.949938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.950067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.950296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.950549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.950645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.950730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.950877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.951043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.951196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.951369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.951514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.951728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.951821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.952050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.952233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.952422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.952534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.952747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.952865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.953072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.953181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.953409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.953521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.953742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.954057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.954245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.954407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.954590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.954716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.954915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.955015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.955251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.955344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.955629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.955741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.955937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.956037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.956261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.956371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.957184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.957353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.957487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.957913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.958884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.959047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.959208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.959377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.959526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.959691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.959843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.960028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.960398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.960643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.960966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.961281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.961363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.961641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.961736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.961908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.961998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.962783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.962912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.963941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.964044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.964263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.964355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.964591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.964693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.964919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.965027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.965228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.965320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.965537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.965630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.965852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.965954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.966181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.966329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.966493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.966675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.966821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.967046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.967163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.967395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.967497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.967735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.967836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.968048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.968153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.968356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.968522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.968685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.968874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.968969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.969213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.969308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.969531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.969632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.969849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.969950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.970261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.970375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.970616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.970945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.971039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.971124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.971203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.971487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.971800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.971920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.972108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.972212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.972419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.972542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.972767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.973579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.973672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.973828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.973927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.974272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.974413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.974612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.974797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.974905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.975189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.975310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.975520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.975628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.975841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.975936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.976178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.976277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.976500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.976595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.976828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.976929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.977139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.977232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.977447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.977540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.977762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.977855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.978073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.978238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.978445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.978556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.978721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.978882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.979037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.979372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.979487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.979574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.979649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.979900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.980014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.980287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.980390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.980551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.980652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.980878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.980985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.981193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.981302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.981502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.981602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.981815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.981914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.982122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.982490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.982593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.982798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.982899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.983128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.983229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.983442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.983549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.983770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.983876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.984086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.984192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.984404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.984503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.984725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.984823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.985040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.985146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.985356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.985464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.985674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.985774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.985991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.986091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.986327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.986428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.986647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.986755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.986964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.987073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.987284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.987384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.987685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.987840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.988011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.988171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.988336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.989087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.989666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.989801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.990002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.990097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.990352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.990457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.990681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.990790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.990998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.991104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.991319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.991426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.991637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.991745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.991954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.992052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.992278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.992388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.992602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.992700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.992922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.993020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.993244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.993360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.993567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.993667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.993884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.993992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.994223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.994338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.994545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.994653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.994892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.994998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.995215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.995313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.995523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.995630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.995841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.995940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.996158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.996371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.996482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.996743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.996877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.997072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.997183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.997391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.997519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.997707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.998022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.998368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.998669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.998781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.998990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.999089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.999318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.999440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.999658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.999760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:49.999982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.000091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.000301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.000415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.000619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.000912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.001020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.001522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.001666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.001844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.001968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.002368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.002549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.002707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.002874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.003028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.003209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.003555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.003658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.003746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.003914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.004046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.004238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.004708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.005037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.005243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.005397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.005614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.005766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.005944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.006102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.006287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.006392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.006591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.006688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.006916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.007012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.007234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.007330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.007577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.007772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.007896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.008125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.008230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.008443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.008538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.008772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.008874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.009102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.009212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.009422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.009516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.009733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.009827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.010050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.010154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.010384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.010477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.010696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.010821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.011016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.011289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.011419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.011631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.011736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.011940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.012054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.012257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.012358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.012573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.012674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.012881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.013114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.013250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.013462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.013582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.013793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.013952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.014105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.014241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.014438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.014542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.014746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.014849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.015053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.015147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.015363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.015464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.015671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.015784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.015980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.016081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.016287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.016417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.016601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.016734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.016908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.017045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.017317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.017420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.017629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.017732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.017947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.018041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.018298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.018395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.018630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.018725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.018941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.019045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.020471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.020584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.020677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.020761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.020835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.020835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.020965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.021045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.021127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.021203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.021302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.021557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.021669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.021906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.022001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.022250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.022359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.022595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.022790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.022937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.023130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.023441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.023552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.023706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.026417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.026535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.026627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.026703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.026785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.026867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.026941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.027961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.028996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.029085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.029159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.029265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.030677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.030780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.030899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.030994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.031923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.032005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.032713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.032820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.032906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.032988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.033065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.033152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.033228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.033309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.033706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.033805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.033897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.034217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.034429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.034590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.034773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.035058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.035286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.036073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.036332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.036500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.036675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.036675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.036675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.037140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.037296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.038713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.038882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.039054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.039211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.039364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.039526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.039689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.039862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.040027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.040183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.040337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.040490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.040654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.040817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.040981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.041138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.041292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.041445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.041599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.041778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.041942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.042096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.042274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.042429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.042582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.042754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.042754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.043058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.043221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.043375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.043528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.043700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.043866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.044020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.044174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.044328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.044488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.044652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.044815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.044987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.045295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.045459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.045622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.045780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.045940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.046111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.046478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.046641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.046814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.046980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.047142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.047304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.047458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.047611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.047779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.047944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.048098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.048259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.048425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.048587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.048754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.048915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.049071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.049232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.049396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.049559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.049723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.049878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.050040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.050215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.050386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.050559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.050726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.050896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.051113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.051769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.051991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.052236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.052481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.052726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.052890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.053044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.053199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.053619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.053853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.054111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.054449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.054606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.054780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.054946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.055101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.055101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.055101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.055725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.055891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.056628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.056628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.056628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.057648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.057804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.057969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.058125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.058125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.058125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.058598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.058762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.058918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.059081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.059247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.059410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.059565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.059733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.059888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.060050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.060205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.060366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.060541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.060712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.060874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.061037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.061203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.061358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.061531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.061687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.061895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.062057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.062230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.062390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.062558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.062715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.062876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.063037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.063192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.063367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.063534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.063698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.063854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.064008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.064169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.064332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.064496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.064651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.064805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.064958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.065120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.065298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.065622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.065795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.065951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.066113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.066327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.066494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.066674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.066837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.066992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.067159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.067322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.067322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.067639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.067795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.067957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.068120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.068120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.068120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 12:47:50.075925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 12:47:50.076166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 12:47:50.128361 n-d-853316-12 devstack@n-api.service[127539]: INFO dbcounter [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Registered counter for database nova_api Oct 17 12:47:50.142647 n-d-853316-12 devstack@n-api.service[127540]: INFO dbcounter [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Registered counter for database nova_api Oct 17 12:47:50.151650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_db.sqlalchemy.engines [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:47:50.158768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writer thread running {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:47:50.164982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_db.sqlalchemy.engines [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:47:50.173320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writer thread running {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:47:50.216473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.context [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) {{(pid=127539) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 12:47:50.220571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:47:50.221051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:47:50.222754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:47:50.223678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:47:50.224129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:47:50.226204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:47:50.228263 n-d-853316-12 devstack@n-api.service[127539]: INFO dbcounter [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Registered counter for database nova_cell0 Oct 17 12:47:50.232594 n-d-853316-12 devstack@n-api.service[127539]: INFO dbcounter [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Registered counter for database nova_cell1 Oct 17 12:47:50.241069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_db.sqlalchemy.engines [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:47:50.241555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.context [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) {{(pid=127540) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 12:47:50.242318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_db.sqlalchemy.engines [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:47:50.245556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:47:50.246036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:47:50.247646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:47:50.248397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:47:50.248840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:47:50.249478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writer thread running {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:47:50.250875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:47:50.251939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writer thread running {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:47:50.252881 n-d-853316-12 devstack@n-api.service[127540]: INFO dbcounter [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Registered counter for database nova_cell0 Oct 17 12:47:50.258236 n-d-853316-12 devstack@n-api.service[127540]: INFO dbcounter [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Registered counter for database nova_cell1 Oct 17 12:47:50.265945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_db.sqlalchemy.engines [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:47:50.269741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_db.sqlalchemy.engines [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:47:50.274041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writer thread running {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:47:50.408059 n-d-853316-12 devstack@n-api.service[127539]: INFO dbcounter [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Registered counter for database nova_cell0 Oct 17 12:47:50.416999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_db.sqlalchemy.engines [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:47:50.422071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writer thread running {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:47:50.422683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writer thread running {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:47:50.433333 n-d-853316-12 devstack@n-api.service[127540]: INFO dbcounter [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Registered counter for database nova_cell0 Oct 17 12:47:50.443342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_db.sqlalchemy.engines [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 12:47:50.448076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writer thread running {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 12:47:50.751305 n-d-853316-12 devstack@n-api.service[127539]: WARNING keystonemiddleware.auth_token [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 12:47:50.759251 n-d-853316-12 devstack@n-api.service[127539]: WARNING keystonemiddleware.auth_token [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 12:47:50.782826 n-d-853316-12 devstack@n-api.service[127540]: WARNING keystonemiddleware.auth_token [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 12:47:50.790549 n-d-853316-12 devstack@n-api.service[127540]: WARNING keystonemiddleware.auth_token [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 12:47:51.112055 n-d-853316-12 devstack@n-api.service[127539]: WARNING keystonemiddleware.auth_token [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 12:47:51.116808 n-d-853316-12 devstack@n-api.service[127539]: WARNING keystonemiddleware.auth_token [None req-730172d3-9e80-41e1-8a9e-e2df11fc2fde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 12:47:51.122120 n-d-853316-12 devstack@n-api.service[127539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e8ced19c0 pid: 127539 (default app) Oct 17 12:47:51.148932 n-d-853316-12 devstack@n-api.service[127540]: WARNING keystonemiddleware.auth_token [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 12:47:51.155070 n-d-853316-12 devstack@n-api.service[127540]: WARNING keystonemiddleware.auth_token [None req-ed923d5d-a9ae-4276-9ed8-bb792299a30f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 12:47:51.160300 n-d-853316-12 devstack@n-api.service[127540]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e8ced19c0 pid: 127540 (default app) Oct 17 12:48:31.689712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:31.691047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:31.692894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:31.693747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:31.710813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:31.711674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:31.712452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:31.713856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:32.878807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b2fe3f4-5c76-4d08-a82a-637a39171628 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Calling method '.version_select at 0x7fa8229a6790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:32.881833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ebcf31f-b81a-4b3a-8281-8e80b545a1e9 tempest-AZAdminNegativeTestJSON-1055159038 tempest-AZAdminNegativeTestJSON-1055159038-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:32.883513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6ebcf31f-b81a-4b3a-8281-8e80b545a1e9 tempest-AZAdminNegativeTestJSON-1055159038 tempest-AZAdminNegativeTestJSON-1055159038-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '43db5e2138ad4fd1922646ecc9b70ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2134353e357e47689568041bd0e1049a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:32.883924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b2fe3f4-5c76-4d08-a82a-637a39171628 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:32.884489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b2fe3f4-5c76-4d08-a82a-637a39171628 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:32.885003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b2fe3f4-5c76-4d08-a82a-637a39171628 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:32.885833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b2fe3f4-5c76-4d08-a82a-637a39171628 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:32.886378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b2fe3f4-5c76-4d08-a82a-637a39171628 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ebcf31f-b81a-4b3a-8281-8e80b545a1e9 tempest-AZAdminNegativeTestJSON-1055159038 tempest-AZAdminNegativeTestJSON-1055159038-project] Request method failure captured: Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8d9l1wRCtTDmTJEC78Z6CWC5oTTB4zzQhqN-6VfoOh3E1BRSXlbjrTKXlCIEREXpqQWiKKSLqZlCL_5mlaJHKb8ANJaO_cgBvGlZu28yEjL4BWS4DUXg4vx2OeBgiwRFnsKojz5v6X6bZWFAQz0RMOu3FeYtjVhihTeik0BpWSexk Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2134353e357e47689568041bd0e1049a Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1055159038 Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:48:32.886745 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2134353e357e47689568041bd0e1049a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2134353e357e47689568041bd0e1049a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2134353e357e47689568041bd0e1049a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2134353e357e47689568041bd0e1049a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AZAdminNegativeTestJSON-1055159038 Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2134353e357e47689568041bd0e1049a Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1055159038 Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AZAdminNegativeTestJSON-1055159038-project Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 43db5e2138ad4fd1922646ecc9b70ae5 Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AZAdminNegativeTestJSON-1055159038-project Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 12:48:32.888105 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:32.889030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 12:48:32.890272 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:32.891239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b2fe3f4-5c76-4d08-a82a-637a39171628 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:32.891326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ebcf31f-b81a-4b3a-8281-8e80b545a1e9 tempest-AZAdminNegativeTestJSON-1055159038 tempest-AZAdminNegativeTestJSON-1055159038-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:32.891326 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ebcf31f-b81a-4b3a-8281-8e80b545a1e9 tempest-AZAdminNegativeTestJSON-1055159038 tempest-AZAdminNegativeTestJSON-1055159038-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.183822 Oct 17 12:48:32.893905 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 17 12:48:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1191 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:32.934018 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b2fe3f4-5c76-4d08-a82a-637a39171628 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 1.253727 Oct 17 12:48:32.935029 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 17 12:48:31 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:33.198810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa8228588b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:33.205792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) {{(pid=127540) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 12:48:33.206550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.207076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.207713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.235712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.236187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.236760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.250856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.251529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.252102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.258541 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40ee0ffa-ba5a-4ad1-8afb-96963e8927b7 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.362384 Oct 17 12:48:33.263317 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:32 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:33.373826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9cb1b08-0403-47b5-aea2-c64f7ff1a4e0 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1455989838", "id": 319105949, "os-flavor-access:is_public": "False"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:33.429055 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d9cb1b08-0403-47b5-aea2-c64f7ff1a4e0 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.492101 Oct 17 12:48:33.430473 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2/4] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:32 2022] POST /compute/v2.1/flavors => generated 428 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:33.474514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d24fbabe-5182-43c1-9caa-d832ce157dfc tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1169176273", "ram": 512, "vcpus": 1, "disk": 10, "id": 478076275, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:33.531185 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d24fbabe-5182-43c1-9caa-d832ce157dfc tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.270586 Oct 17 12:48:33.532363 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3/5] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:33 2022] POST /compute/v2.1/flavors => generated 413 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:33.593588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '.version_select at 0x7fa82285eaf0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:33.600472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) {{(pid=127539) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 12:48:33.601378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.601856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.602343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.630084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.630812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.631543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.656565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5ae9629-1ad0-47bd-9933-8bbc43fb0f8f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Calling method '.version_select at 0x7fa82282d4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:33.657390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.657890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.658362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.661918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5ae9629-1ad0-47bd-9933-8bbc43fb0f8f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a307c10db4c842b3ad39aaa161cccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a5505171f406eb225cdda6ab6366b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5ae9629-1ad0-47bd-9933-8bbc43fb0f8f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Request method failure captured: Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8dZX3237bWwCKZ7Lr--EId3riKHVxMlEsL95fh_JSav9Ndvs3VnXVThdHKy_rTx24z2mNrTqviDOdnmzK1-g35dHDahJ12neFUhZpE5aUXELBho28A-H_7sDXyCENu8PI_Cox1fsvqOtSJ2PBEcAYT3kGV7nL0iMleu_3xudveyu8 Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:48:33.664495 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_638a5505171f406eb225cdda6ab6366b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: a307c10db4c842b3ad39aaa161cccacf Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 12:48:33.665458 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:33.666057 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 12:48:33.666938 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:33.668647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5ae9629-1ad0-47bd-9933-8bbc43fb0f8f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:33.668789 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09bd5768-1466-48d2-b445-71a0f79f37da tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.233907 Oct 17 12:48:33.668923 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a5ae9629-1ad0-47bd-9933-8bbc43fb0f8f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.132590 Oct 17 12:48:33.668923 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4/6] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 17 12:48:33 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 134 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:33.678874 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 17 12:48:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:33.735606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Calling method '.version_select at 0x7fa82285eb80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:33.740229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.741255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.742422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.761450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.761933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.762398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.775687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.776156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.776592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.782826 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34c8a075-e56d-4d67-81d9-c134e4016975 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.102426 Oct 17 12:48:33.783595 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4/8] 10.222.0.27 () {60 vars in 1208 bytes} [Mon Oct 17 12:48:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:48:33.788354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa822848e50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:33.789941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.790445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.791024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.796289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf786ec9-0424-4a1e-bcca-62e325432981 tempest-FlavorsV255TestJSON-1411996123 tempest-FlavorsV255TestJSON-1411996123-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1718366576", "id": 2039068373, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:33.805959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.806485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.806915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.819068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:33.819559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:33.819998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:33.824446 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf786ec9-0424-4a1e-bcca-62e325432981 tempest-FlavorsV255TestJSON-1411996123 tempest-FlavorsV255TestJSON-1411996123-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.156712 Oct 17 12:48:33.825316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 5/9] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:48:33 2022] POST /compute/v2.1/flavors => generated 449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:48:33.831701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de66c725-1117-4746-b551-47d67f336ff6 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6451c34dd5914e8790b1762d8ff13c95"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:33.835027 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8dd0fd0-06d1-437b-932a-9a2631574b3f tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.050575 Oct 17 12:48:33.836047 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 5/10] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 17 12:48:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:33.841284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fda7cfdc-c558-4495-89c5-d71c7c285ce3 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:33.890643 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fda7cfdc-c558-4495-89c5-d71c7c285ce3 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/478076275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053458 Oct 17 12:48:33.894582 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 6/11] 10.222.0.27 () {60 vars in 1221 bytes} [Mon Oct 17 12:48:33 2022] POST /compute/v2.1/flavors/478076275/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:33.901581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e9f3080-0b84-45c0-bd10-4e5b36334e96 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Calling method '.version_select at 0x7fa8227d75e0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:33.903659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e9f3080-0b84-45c0-bd10-4e5b36334e96 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a307c10db4c842b3ad39aaa161cccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a5505171f406eb225cdda6ab6366b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e9f3080-0b84-45c0-bd10-4e5b36334e96 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Request method failure captured: Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hosts/n-d-853316-12/reboot HTTP/1.1 Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8dZX3237bWwCKZ7Lr--EId3riKHVxMlEsL95fh_JSav9Ndvs3VnXVThdHKy_rTx24z2mNrTqviDOdnmzK1-g35dHDahJ12neFUhZpE5aUXELBho28A-H_7sDXyCENu8PI_Cox1fsvqOtSJ2PBEcAYT3kGV7nL0iMleu_3xudveyu8 Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:48:33.908435 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_638a5505171f406eb225cdda6ab6366b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a307c10db4c842b3ad39aaa161cccacf Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'n-d-853316-12'} Oct 17 12:48:33.909606 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:33.911169 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 12:48:33.912073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:33.912970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e9f3080-0b84-45c0-bd10-4e5b36334e96 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:33.912970 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e9f3080-0b84-45c0-bd10-4e5b36334e96 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-853316-12/reboot" status: 403 len: 111 microversion: 2.1 time: 0.013912 Oct 17 12:48:33.912970 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 7/12] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 17 12:48:33 2022] GET /compute/v2.1/os-hosts/n-d-853316-12/reboot => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:33.921027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e817bc6-2913-46ab-98d2-645f30fb82c6 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-4357233", "name": "tempest-test_aggregate-473221319"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:33.942208 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de66c725-1117-4746-b551-47d67f336ff6 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/319105949/action" status: 200 len: 96 microversion: 2.1 time: 0.115230 Oct 17 12:48:33.943171 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 6/13] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 17 12:48:33 2022] POST /compute/v2.1/flavors/319105949/action => generated 96 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:33.943768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-9e817bc6-2913-46ab-98d2-645f30fb82c6 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid 696277be-723b-4f7b-aee1-fd0d07e025ae for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:48:34.018063 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e817bc6-2913-46ab-98d2-645f30fb82c6 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 218 microversion: 2.1 time: 0.105177 Oct 17 12:48:34.019104 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 8/14] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 17 12:48:33 2022] POST /compute/v2.1/os-aggregates => generated 218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:34.029287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa822743790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.031346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.032334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.032950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.052845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.053337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.053769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.068524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.069006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.069442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.075331 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b469fc1-eaf3-4347-a5bd-cb4afda58f08 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.054606 Oct 17 12:48:34.078307 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 9/15] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:34.131362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0e96168a-d0d4-4e14-948b-9c2651479f36 tempest-FlavorsV255TestJSON-899996877 tempest-FlavorsV255TestJSON-899996877-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.150193 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0e96168a-d0d4-4e14-948b-9c2651479f36 tempest-FlavorsV255TestJSON-899996877 tempest-FlavorsV255TestJSON-899996877-project] 10.222.0.27 "GET /compute/v2.1/flavors/2039068373" status: 200 len: 449 microversion: 2.55 time: 0.205704 Oct 17 12:48:34.150924 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 7/16] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Oct 17 12:48:33 2022] GET /compute/v2.1/flavors/2039068373 => generated 449 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:48:34.155810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-38011496-0d84-49cb-aa00-80a97d08eb6d tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Calling method '.version_select at 0x7fa8227f6790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.192093 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-38011496-0d84-49cb-aa00-80a97d08eb6d tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-38011496-0d84-49cb-aa00-80a97d08eb6d tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Request method failure captured: Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8f8HKBqOK7xWUSwekXaHKsH4X2rDu2JFUtOo9C4J_JIuXm48tDE-T_PjsWTGIYULfSVgw-9ketFS-U_F-2tgsox8ofyKZ65xb8zrKr0RHCqDRn8myL5AlXoz2wdiQHFg-Bmvp2BTIn25cmLnMAV0PY_MTUYcXmre5A25HSK2oUN5A Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:34.199185 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09e1fe78645548dd8863afd5b30d0bb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 409ce7b039c14ba0bf0650af81db2654 Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'nonexistent_hostname'} Oct 17 12:48:34.200192 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:48:34.200822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 12:48:34.201849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-38011496-0d84-49cb-aa00-80a97d08eb6d tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-38011496-0d84-49cb-aa00-80a97d08eb6d tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.048605 Oct 17 12:48:34.203022 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 8/17] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:48:34.265261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad2534a0-6acc-4397-9139-163bf591ebb5 tempest-FlavorsExtraSpecsTestJSON-690419829 tempest-FlavorsExtraSpecsTestJSON-690419829-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.283416 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad2534a0-6acc-4397-9139-163bf591ebb5 tempest-FlavorsExtraSpecsTestJSON-690419829 tempest-FlavorsExtraSpecsTestJSON-690419829-project] 10.222.0.27 "GET /compute/v2.1/flavors/478076275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.203084 Oct 17 12:48:34.284218 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 10/18] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/flavors/478076275/os-extra_specs => generated 66 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:34.289464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ab92ff7-be82-4c3a-bd73-047f7d2a7bd9 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.303931 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5ab92ff7-be82-4c3a-bd73-047f7d2a7bd9 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.018560 Oct 17 12:48:34.304749 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 11/19] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:34.309562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e0478c8-8b1a-40dd-94b3-85975a4d6c60 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa822770dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.311792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0478c8-8b1a-40dd-94b3-85975a4d6c60 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.312525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0478c8-8b1a-40dd-94b3-85975a4d6c60 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.313002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0478c8-8b1a-40dd-94b3-85975a4d6c60 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.331153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0478c8-8b1a-40dd-94b3-85975a4d6c60 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.331584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0478c8-8b1a-40dd-94b3-85975a4d6c60 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.332063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0478c8-8b1a-40dd-94b3-85975a4d6c60 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.338566 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e0478c8-8b1a-40dd-94b3-85975a4d6c60 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.032538 Oct 17 12:48:34.350250 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 12/20] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:34.350250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9d4f1f20-d0c2-4a4f-881b-420847aba822 tempest-FlavorsV255TestJSON-1411996123 tempest-FlavorsV255TestJSON-1411996123-project-admin] Action: 'update', calling method: .version_select at 0x7fa822d69d30>, body: {"flavor": {"description": "new"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:34.388280 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9d4f1f20-d0c2-4a4f-881b-420847aba822 tempest-FlavorsV255TestJSON-1411996123 tempest-FlavorsV255TestJSON-1411996123-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/2039068373" status: 200 len: 450 microversion: 2.55 time: 0.047850 Oct 17 12:48:34.388877 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 13/21] 10.222.0.27 () {62 vars in 1219 bytes} [Mon Oct 17 12:48:34 2022] PUT /compute/v2.1/flavors/2039068373 => generated 450 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:48:34.393564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-888a2c20-a779-43aa-a745-dd778377e939 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Calling method '.version_select at 0x7fa8227d70d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.396103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-888a2c20-a779-43aa-a745-dd778377e939 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a307c10db4c842b3ad39aaa161cccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a5505171f406eb225cdda6ab6366b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-888a2c20-a779-43aa-a745-dd778377e939 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Request method failure captured: Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hosts/n-d-853316-12 HTTP/1.1 Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8dZX3237bWwCKZ7Lr--EId3riKHVxMlEsL95fh_JSav9Ndvs3VnXVThdHKy_rTx24z2mNrTqviDOdnmzK1-g35dHDahJ12neFUhZpE5aUXELBho28A-H_7sDXyCENu8PI_Cox1fsvqOtSJ2PBEcAYT3kGV7nL0iMleu_3xudveyu8 Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:48:34.397740 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_638a5505171f406eb225cdda6ab6366b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a307c10db4c842b3ad39aaa161cccacf Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'n-d-853316-12'} Oct 17 12:48:34.398988 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:34.399590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 12:48:34.400569 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.402267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-888a2c20-a779-43aa-a745-dd778377e939 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:34.403234 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-888a2c20-a779-43aa-a745-dd778377e939 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-853316-12" status: 403 len: 109 microversion: 2.1 time: 0.013301 Oct 17 12:48:34.404202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 14/22] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/os-hosts/n-d-853316-12 => generated 109 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:34.408964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-297552cf-90b8-4356-a96d-763f07d5efb8 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:34.435212 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-297552cf-90b8-4356-a96d-763f07d5efb8 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/478076275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029747 Oct 17 12:48:34.435936 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 15/23] 10.222.0.27 () {60 vars in 1221 bytes} [Mon Oct 17 12:48:34 2022] POST /compute/v2.1/flavors/478076275/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:34.441448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da85f0e9-4648-49aa-92ed-755830f9488c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:34.453662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da85f0e9-4648-49aa-92ed-755830f9488c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.454190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da85f0e9-4648-49aa-92ed-755830f9488c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.454702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da85f0e9-4648-49aa-92ed-755830f9488c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.461410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ffdef43-946a-4f01-b162-b1c0b3c58d71 tempest-FlavorsAccessTestJSON-1917744940 tempest-FlavorsAccessTestJSON-1917744940-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.494721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7ffdef43-946a-4f01-b162-b1c0b3c58d71 tempest-FlavorsAccessTestJSON-1917744940 tempest-FlavorsAccessTestJSON-1917744940-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6230 microversion: 2.1 time: 0.292209 Oct 17 12:48:34.504574 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 9/24] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/flavors/detail => generated 6230 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:34.504574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7147eac-4954-4322-a4ae-f760bf70ecc9 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa8226bbb80>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.504574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7147eac-4954-4322-a4ae-f760bf70ecc9 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.504574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7147eac-4954-4322-a4ae-f760bf70ecc9 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.506804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7147eac-4954-4322-a4ae-f760bf70ecc9 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.523789 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7147eac-4954-4322-a4ae-f760bf70ecc9 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.026941 Oct 17 12:48:34.524857 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 10/25] 10.222.0.27 () {58 vars in 1179 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:34.529788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-489c2338-4cdf-48eb-84a3-ed780ae50b8a tempest-FlavorsV255TestJSON-899996877 tempest-FlavorsV255TestJSON-899996877-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.562889 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-489c2338-4cdf-48eb-84a3-ed780ae50b8a tempest-FlavorsV255TestJSON-899996877 tempest-FlavorsV255TestJSON-899996877-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6149 microversion: 2.55 time: 0.036824 Oct 17 12:48:34.563920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 11/26] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/flavors/detail => generated 6149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:48:34.569187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf0fdee0-f8cd-44b4-9cd9-3b448f5ba7d0 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Calling method '.version_select at 0x7fa822671ca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.585505 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-cf0fdee0-f8cd-44b4-9cd9-3b448f5ba7d0 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf0fdee0-f8cd-44b4-9cd9-3b448f5ba7d0 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Request method failure captured: Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8f8HKBqOK7xWUSwekXaHKsH4X2rDu2JFUtOo9C4J_JIuXm48tDE-T_PjsWTGIYULfSVgw-9ketFS-U_F-2tgsox8ofyKZ65xb8zrKr0RHCqDRn8myL5AlXoz2wdiQHFg-Bmvp2BTIn25cmLnMAV0PY_MTUYcXmre5A25HSK2oUN5A Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:34.587164 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09e1fe78645548dd8863afd5b30d0bb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 409ce7b039c14ba0bf0650af81db2654 Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'nonexistent_hostname'} Oct 17 12:48:34.588338 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:34.589082 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:34.589928 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:34.590810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf0fdee0-f8cd-44b4-9cd9-3b448f5ba7d0 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:34.590810 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf0fdee0-f8cd-44b4-9cd9-3b448f5ba7d0 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023459 Oct 17 12:48:34.590810 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 12/27] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:48:34.595864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3b27b7e-bcf9-4301-a3fa-bb68237fe4ae tempest-FlavorsExtraSpecsTestJSON-690419829 tempest-FlavorsExtraSpecsTestJSON-690419829-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.605912 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3b27b7e-bcf9-4301-a3fa-bb68237fe4ae tempest-FlavorsExtraSpecsTestJSON-690419829 tempest-FlavorsExtraSpecsTestJSON-690419829-project] 10.222.0.27 "GET /compute/v2.1/flavors/478076275/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014915 Oct 17 12:48:34.606495 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 13/28] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/flavors/478076275/os-extra_specs/hw:numa_nodes => generated 22 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:34.617238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa8226719d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:34.619069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.619549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.619978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.643576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.644386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.645183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.658636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:34.659117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:34.659574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:34.666564 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-48aa5702-26bd-431c-a128-144828c9a012 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.053388 Oct 17 12:48:34.667594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 14/29] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:34.672189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-800857d2-d85f-4044-946a-24a74eb8e000 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6451c34dd5914e8790b1762d8ff13c95"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:34.980766 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da85f0e9-4648-49aa-92ed-755830f9488c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 309 microversion: 2.1 time: 0.542835 Oct 17 12:48:34.981677 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 16/30] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:48:34 2022] POST /compute/v2.1/os-aggregates/1/action => generated 309 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:34.986880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2224203e-776e-464b-864b-54999f0b7130 tempest-FlavorsV255TestJSON-899996877 tempest-FlavorsV255TestJSON-899996877-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.019285 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2224203e-776e-464b-864b-54999f0b7130 tempest-FlavorsV255TestJSON-899996877 tempest-FlavorsV255TestJSON-899996877-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3407 microversion: 2.55 time: 0.036152 Oct 17 12:48:35.020635 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 17/31] 10.222.0.27 () {60 vars in 1166 bytes} [Mon Oct 17 12:48:34 2022] GET /compute/v2.1/flavors => generated 3407 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:48:35.039397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4dded14e-8084-484d-811a-6a7161b69001 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Calling method '.version_select at 0x7fa821f084c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.041423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4dded14e-8084-484d-811a-6a7161b69001 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a307c10db4c842b3ad39aaa161cccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a5505171f406eb225cdda6ab6366b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:35.041998 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-800857d2-d85f-4044-946a-24a74eb8e000 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/319105949/action" status: 200 len: 21 microversion: 2.1 time: 0.372515 Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4dded14e-8084-484d-811a-6a7161b69001 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Request method failure captured: Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hosts/n-d-853316-12/shutdown HTTP/1.1 Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8dZX3237bWwCKZ7Lr--EId3riKHVxMlEsL95fh_JSav9Ndvs3VnXVThdHKy_rTx24z2mNrTqviDOdnmzK1-g35dHDahJ12neFUhZpE5aUXELBho28A-H_7sDXyCENu8PI_Cox1fsvqOtSJ2PBEcAYT3kGV7nL0iMleu_3xudveyu8 Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:48:35.043408 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_638a5505171f406eb225cdda6ab6366b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a307c10db4c842b3ad39aaa161cccacf Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'n-d-853316-12'} Oct 17 12:48:35.044644 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:35.045378 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 12:48:35.046439 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.048476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4dded14e-8084-484d-811a-6a7161b69001 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.048732 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 15/32] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 17 12:48:34 2022] POST /compute/v2.1/flavors/319105949/action => generated 21 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:35.049680 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4dded14e-8084-484d-811a-6a7161b69001 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-853316-12/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015823 Oct 17 12:48:35.050559 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 18/33] 10.222.0.27 () {58 vars in 1197 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/os-hosts/n-d-853316-12/shutdown => generated 113 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:35.055994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8dd9e8af-33c1-44f9-8d3c-7766b0e1b508 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa822743ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.058341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd9e8af-33c1-44f9-8d3c-7766b0e1b508 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.058948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd9e8af-33c1-44f9-8d3c-7766b0e1b508 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.059543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd9e8af-33c1-44f9-8d3c-7766b0e1b508 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.060218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-468dc22a-abda-4bd5-b3cd-cc8baad6a0bd tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.077524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd9e8af-33c1-44f9-8d3c-7766b0e1b508 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.078122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd9e8af-33c1-44f9-8d3c-7766b0e1b508 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.078667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd9e8af-33c1-44f9-8d3c-7766b0e1b508 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.085357 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8dd9e8af-33c1-44f9-8d3c-7766b0e1b508 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.032959 Oct 17 12:48:35.086020 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 19/34] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:35.096382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb7563fc-9ae9-4eaa-8a11-b2e796309a21 tempest-FlavorsV255TestJSON-1411996123 tempest-FlavorsV255TestJSON-1411996123-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.097046 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-468dc22a-abda-4bd5-b3cd-cc8baad6a0bd tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/478076275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039836 Oct 17 12:48:35.097980 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 16/35] 10.222.0.27 () {60 vars in 1221 bytes} [Mon Oct 17 12:48:35 2022] POST /compute/v2.1/flavors/478076275/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:35.103338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1efb8aad-99cf-47e9-b07f-12f6f1a19e80 tempest-FlavorsAccessTestJSON-1917744940 tempest-FlavorsAccessTestJSON-1917744940-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.134376 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1efb8aad-99cf-47e9-b07f-12f6f1a19e80 tempest-FlavorsAccessTestJSON-1917744940 tempest-FlavorsAccessTestJSON-1917744940-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.035126 Oct 17 12:48:35.135102 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 17/36] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:35.144879 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb7563fc-9ae9-4eaa-8a11-b2e796309a21 tempest-FlavorsV255TestJSON-1411996123 tempest-FlavorsV255TestJSON-1411996123-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2039068373" status: 202 len: 0 microversion: 2.55 time: 0.051441 Oct 17 12:48:35.144879 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 20/37] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Oct 17 12:48:35 2022] DELETE /compute/v2.1/flavors/2039068373 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:48:35.148000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac2be8d2-ca5f-4061-b8b8-f836d2657be2 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Calling method '.version_select at 0x7fa821f08820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.154734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5dca27e0-e44d-4376-a769-f0262fee2904 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa82282d430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.157009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dca27e0-e44d-4376-a769-f0262fee2904 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.157847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dca27e0-e44d-4376-a769-f0262fee2904 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.158464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dca27e0-e44d-4376-a769-f0262fee2904 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.159232 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-ac2be8d2-ca5f-4061-b8b8-f836d2657be2 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac2be8d2-ca5f-4061-b8b8-f836d2657be2 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Request method failure captured: Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8f8HKBqOK7xWUSwekXaHKsH4X2rDu2JFUtOo9C4J_JIuXm48tDE-T_PjsWTGIYULfSVgw-9ketFS-U_F-2tgsox8ofyKZ65xb8zrKr0RHCqDRn8myL5AlXoz2wdiQHFg-Bmvp2BTIn25cmLnMAV0PY_MTUYcXmre5A25HSK2oUN5A Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:48:35.165822 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09e1fe78645548dd8863afd5b30d0bb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 409ce7b039c14ba0bf0650af81db2654 Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'nonexistent_hostname'} Oct 17 12:48:35.167268 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:48:35.167881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 12:48:35.173572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac2be8d2-ca5f-4061-b8b8-f836d2657be2 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac2be8d2-ca5f-4061-b8b8-f836d2657be2 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.024055 Oct 17 12:48:35.175416 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 21/38] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:48:35.178050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4b5c537d-254a-4f0b-b204-8092e0e7bb2e tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.178222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dca27e0-e44d-4376-a769-f0262fee2904 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.178222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dca27e0-e44d-4376-a769-f0262fee2904 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.178222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dca27e0-e44d-4376-a769-f0262fee2904 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.184366 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4b5c537d-254a-4f0b-b204-8092e0e7bb2e tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/478076275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015711 Oct 17 12:48:35.189984 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 22/39] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/478076275/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:35.190576 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5dca27e0-e44d-4376-a769-f0262fee2904 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.035609 Oct 17 12:48:35.190576 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 18/40] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:35.196851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-025933df-bc3a-4d7e-8b79-2b0c57359434 tempest-FlavorsV255TestJSON-1411996123 tempest-FlavorsV255TestJSON-1411996123-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.226554 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-025933df-bc3a-4d7e-8b79-2b0c57359434 tempest-FlavorsV255TestJSON-1411996123 tempest-FlavorsV255TestJSON-1411996123-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5709 microversion: 2.55 time: 0.036694 Oct 17 12:48:35.234300 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 19/41] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/detail => generated 5709 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:48:35.242369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56ec8d2f-91e5-4605-be89-d256bf3f6293 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.272160 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56ec8d2f-91e5-4605-be89-d256bf3f6293 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/319105949" status: 202 len: 0 microversion: 2.1 time: 0.036682 Oct 17 12:48:35.276325 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 20/42] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:48:35 2022] DELETE /compute/v2.1/flavors/319105949 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:48:35.281535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43c4014d-e85a-4368-8f08-f2dd16b34a1f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Calling method '.version_select at 0x7fa8226bb9d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.283605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43c4014d-e85a-4368-8f08-f2dd16b34a1f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a307c10db4c842b3ad39aaa161cccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a5505171f406eb225cdda6ab6366b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43c4014d-e85a-4368-8f08-f2dd16b34a1f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Request method failure captured: Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hosts/n-d-853316-12/startup HTTP/1.1 Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8dZX3237bWwCKZ7Lr--EId3riKHVxMlEsL95fh_JSav9Ndvs3VnXVThdHKy_rTx24z2mNrTqviDOdnmzK1-g35dHDahJ12neFUhZpE5aUXELBho28A-H_7sDXyCENu8PI_Cox1fsvqOtSJ2PBEcAYT3kGV7nL0iMleu_3xudveyu8 Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:48:35.285536 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_638a5505171f406eb225cdda6ab6366b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: a307c10db4c842b3ad39aaa161cccacf Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'n-d-853316-12'} Oct 17 12:48:35.286768 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:35.287544 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 12:48:35.288599 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.290238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43c4014d-e85a-4368-8f08-f2dd16b34a1f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.291248 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43c4014d-e85a-4368-8f08-f2dd16b34a1f tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-853316-12/startup" status: 403 len: 110 microversion: 2.1 time: 0.017494 Oct 17 12:48:35.292011 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1194 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/os-hosts/n-d-853316-12/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:35.301553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-719bd472-e8fb-4c03-a523-c17d94a12ad1 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.341926 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-719bd472-e8fb-4c03-a523-c17d94a12ad1 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/478076275/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.048769 Oct 17 12:48:35.342773 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:48:35 2022] PUT /compute/v2.1/flavors/478076275/os-extra_specs/hw:numa_nodes => generated 22 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:35.349412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Calling method '.version_select at 0x7fa822640670>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.351487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.352724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.353165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.368865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.369348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.369943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.380461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.381350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.382049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.388146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:48:35.388786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67244b06-f946-4f72-9f6d-cafb306321a5 tempest-HypervisorAdminTestJSON-760459399 tempest-HypervisorAdminTestJSON-760459399-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:48:35.389985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.390637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.391217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.391933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.392384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.392804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.401475 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.compute.rpcapi [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 12:48:35.402381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] Releasing lock "compute-rpcapi-router" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:48:35.402647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-457096245", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "availability_zone": "tempest-test_az-4357233"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.418090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.418720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.419233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.420142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:35.420674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:35.421251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:35.442055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:35.447537 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2be1b58b-0e88-4093-bc35-a0d3ae63f99c None None] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.103385 Oct 17 12:48:35.456608 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 23/45] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:35.462490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-844c7a6d-01e9-463f-aee9-0025af8781c1 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.486786 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-844c7a6d-01e9-463f-aee9-0025af8781c1 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.028402 Oct 17 12:48:35.487581 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 24/46] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:35.493233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5656ba21-a80d-4815-8f28-14e4656a5680 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Calling method '.version_select at 0x7fa8225fa4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.510146 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-5656ba21-a80d-4815-8f28-14e4656a5680 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5656ba21-a80d-4815-8f28-14e4656a5680 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Request method failure captured: Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8f8HKBqOK7xWUSwekXaHKsH4X2rDu2JFUtOo9C4J_JIuXm48tDE-T_PjsWTGIYULfSVgw-9ketFS-U_F-2tgsox8ofyKZ65xb8zrKr0RHCqDRn8myL5AlXoz2wdiQHFg-Bmvp2BTIn25cmLnMAV0PY_MTUYcXmre5A25HSK2oUN5A Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:35.511928 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09e1fe78645548dd8863afd5b30d0bb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 409ce7b039c14ba0bf0650af81db2654 Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'nonexistent_hostname'} Oct 17 12:48:35.512944 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:48:35.513548 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 12:48:35.514448 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5656ba21-a80d-4815-8f28-14e4656a5680 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5656ba21-a80d-4815-8f28-14e4656a5680 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.024962 Oct 17 12:48:35.515308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 25/47] 10.222.0.27 () {58 vars in 1215 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:48:35.521771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c117375c-1275-4d4e-a5ae-467f305cca78 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.532130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c117375c-1275-4d4e-a5ae-467f305cca78 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/478076275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016129 Oct 17 12:48:35.532893 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 26/48] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/478076275/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:35.538465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7da52003-aacb-48d4-9ba9-f6e1e2eedc36 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1008452776", "id": 481206315, "os-flavor-access:is_public": "False"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.557048 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7da52003-aacb-48d4-9ba9-f6e1e2eedc36 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.023302 Oct 17 12:48:35.557755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 27/49] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:35 2022] POST /compute/v2.1/flavors => generated 428 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:35.562552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-10655ed1-d307-4430-9d98-433bb48579a7 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Action: 'update', calling method: .version_select at 0x7fa82260f550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-10655ed1-d307-4430-9d98-433bb48579a7 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Request method failure captured: Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-hosts/n-d-853316-12 HTTP/1.1 Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 51 Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8f8HKBqOK7xWUSwekXaHKsH4X2rDu2JFUtOo9C4J_JIuXm48tDE-T_PjsWTGIYULfSVgw-9ketFS-U_F-2tgsox8ofyKZ65xb8zrKr0RHCqDRn8myL5AlXoz2wdiQHFg-Bmvp2BTIn25cmLnMAV0PY_MTUYcXmre5A25HSK2oUN5A Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:35.567455 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09e1fe78645548dd8863afd5b30d0bb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 409ce7b039c14ba0bf0650af81db2654 Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: {"status": "enable", "maintenance_mode": "invalid"} Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:35.568608 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'n-d-853316-12', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance: Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.569829 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.571099 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.572035 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.572035 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:48:35.572035 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:48:35.572035 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 12:48:35.572035 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.573787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-10655ed1-d307-4430-9d98-433bb48579a7 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.574672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-10655ed1-d307-4430-9d98-433bb48579a7 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-853316-12" status: 400 len: 199 microversion: 2.1 time: 0.015558 Oct 17 12:48:35.575224 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 28/50] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:48:35 2022] PUT /compute/v2.1/os-hosts/n-d-853316-12 => generated 199 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:48:35.589616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-322e563d-3d0a-4c6b-871b-aca34e59a6d5 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.616921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:DELETE=5,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:35.622201 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-322e563d-3d0a-4c6b-871b-aca34e59a6d5 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/478076275/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.045430 Oct 17 12:48:35.622793 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 29/51] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 12:48:35 2022] DELETE /compute/v2.1/flavors/478076275/os-extra_specs/hw:numa_nodes => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:48:35.628507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-012330a7-f959-4f58-a379-7015b9e10f82 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.641818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-012330a7-f959-4f58-a379-7015b9e10f82 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/481206315/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.017700 Oct 17 12:48:35.642414 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 30/52] 10.222.0.27 () {58 vars in 1206 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/481206315/os-flavor-access => generated 21 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:35.648762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c035a31c-cd82-43ad-b7a9-da82fbff5e27 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Action: 'update', calling method: .version_select at 0x7fa8225e7a60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c035a31c-cd82-43ad-b7a9-da82fbff5e27 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Request method failure captured: Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-hosts/n-d-853316-12 HTTP/1.1 Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 51 Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8f8HKBqOK7xWUSwekXaHKsH4X2rDu2JFUtOo9C4J_JIuXm48tDE-T_PjsWTGIYULfSVgw-9ketFS-U_F-2tgsox8ofyKZ65xb8zrKr0RHCqDRn8myL5AlXoz2wdiQHFg-Bmvp2BTIn25cmLnMAV0PY_MTUYcXmre5A25HSK2oUN5A Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:35.652374 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09e1fe78645548dd8863afd5b30d0bb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 409ce7b039c14ba0bf0650af81db2654 Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: {"status": "invalid", "maintenance_mode": "enable"} Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:35.653462 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'n-d-853316-12', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance: Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.654203 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.655369 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.656279 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.656279 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:48:35.656279 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:48:35.656279 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 12:48:35.656279 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.656279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c035a31c-cd82-43ad-b7a9-da82fbff5e27 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.656279 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c035a31c-cd82-43ad-b7a9-da82fbff5e27 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-853316-12" status: 400 len: 189 microversion: 2.1 time: 0.010240 Oct 17 12:48:35.656279 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 31/53] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:48:35 2022] PUT /compute/v2.1/os-hosts/n-d-853316-12 => generated 189 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:48:35.664190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56fab2aa-6f8d-4009-92ea-77e1f3cd1873 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.686841 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56fab2aa-6f8d-4009-92ea-77e1f3cd1873 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/478076275/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.031228 Oct 17 12:48:35.687412 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 32/54] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 12:48:35 2022] DELETE /compute/v2.1/flavors/478076275/os-extra_specs/hw:cpu_policy => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:48:35.692627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b6d19e1-ffde-4f5f-ad53-95dc72c831ea tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.711328 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b6d19e1-ffde-4f5f-ad53-95dc72c831ea tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/481206315" status: 202 len: 0 microversion: 2.1 time: 0.022650 Oct 17 12:48:35.712845 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 33/55] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:48:35 2022] DELETE /compute/v2.1/flavors/481206315 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:48:35.718871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6fd9a0d-e4ef-47f4-95ce-25b50d9ecfe5 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Action: 'update', calling method: .version_select at 0x7fa822640a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.728661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6fd9a0d-e4ef-47f4-95ce-25b50d9ecfe5 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a307c10db4c842b3ad39aaa161cccacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a5505171f406eb225cdda6ab6366b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6fd9a0d-e4ef-47f4-95ce-25b50d9ecfe5 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Request method failure captured: Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-hosts/n-d-853316-12 HTTP/1.1 Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 50 Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8dZX3237bWwCKZ7Lr--EId3riKHVxMlEsL95fh_JSav9Ndvs3VnXVThdHKy_rTx24z2mNrTqviDOdnmzK1-g35dHDahJ12neFUhZpE5aUXELBho28A-H_7sDXyCENu8PI_Cox1fsvqOtSJ2PBEcAYT3kGV7nL0iMleu_3xudveyu8 Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:48:35.730322 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_638a5505171f406eb225cdda6ab6366b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/638a5505171f406eb225cdda6ab6366b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 638a5505171f406eb225cdda6ab6366b Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-949614924 Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: a307c10db4c842b3ad39aaa161cccacf Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-949614924-project Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: {"status": "enable", "maintenance_mode": "enable"} Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 12:48:35.731658 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'n-d-853316-12', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:35.732359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 12:48:35.733280 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.734220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6fd9a0d-e4ef-47f4-95ce-25b50d9ecfe5 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.734220 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6fd9a0d-e4ef-47f4-95ce-25b50d9ecfe5 tempest-HostsAdminNegativeTestJSON-949614924 tempest-HostsAdminNegativeTestJSON-949614924-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-853316-12" status: 403 len: 111 microversion: 2.1 time: 0.017879 Oct 17 12:48:35.735949 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 34/56] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:48:35 2022] PUT /compute/v2.1/os-hosts/n-d-853316-12 => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:35.742143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1df91151-963e-4ac7-afd9-4fbf2422e665 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.757710 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1df91151-963e-4ac7-afd9-4fbf2422e665 tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/478076275/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020566 Oct 17 12:48:35.759159 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 35/57] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/478076275/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:35.764901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67997566-0901-4da5-8e48-79e754f62538 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.791819 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-67997566-0901-4da5-8e48-79e754f62538 tempest-FlavorsAccessTestJSON-1469446239 tempest-FlavorsAccessTestJSON-1469446239-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.031365 Oct 17 12:48:35.793209 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 36/58] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:35.802519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d8da4688-77b6-43f4-bb47-627bb6fc6010 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Action: 'update', calling method: .version_select at 0x7fa8225e79d0>, body: {"status": null, "maintenance_mode": null} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d8da4688-77b6-43f4-bb47-627bb6fc6010 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Request method failure captured: Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-hosts/n-d-853316-12 HTTP/1.1 Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 42 Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8f8HKBqOK7xWUSwekXaHKsH4X2rDu2JFUtOo9C4J_JIuXm48tDE-T_PjsWTGIYULfSVgw-9ketFS-U_F-2tgsox8ofyKZ65xb8zrKr0RHCqDRn8myL5AlXoz2wdiQHFg-Bmvp2BTIn25cmLnMAV0PY_MTUYcXmre5A25HSK2oUN5A Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:35.807479 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09e1fe78645548dd8863afd5b30d0bb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 409ce7b039c14ba0bf0650af81db2654 Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: {"status": null, "maintenance_mode": null} Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 12:48:35.808630 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'n-d-853316-12', 'body': {'status': None, 'maintenance_mode': None}} Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance: Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi None Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.809292 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.810447 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.811754 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:48:35.811754 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:48:35.811754 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 12:48:35.811754 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.812191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d8da4688-77b6-43f4-bb47-627bb6fc6010 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.813623 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d8da4688-77b6-43f4-bb47-627bb6fc6010 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-853316-12" status: 400 len: 127 microversion: 2.1 time: 0.018536 Oct 17 12:48:35.813923 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 37/59] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:48:35 2022] PUT /compute/v2.1/os-hosts/n-d-853316-12 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:48:35.822100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d5665166-01e2-42f8-b813-fae3deecb38f tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.850858 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d5665166-01e2-42f8-b813-fae3deecb38f tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/478076275" status: 202 len: 0 microversion: 2.1 time: 0.035707 Oct 17 12:48:35.851450 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 38/60] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:48:35 2022] DELETE /compute/v2.1/flavors/478076275 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:48:35.857617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-972bccac-5b96-4928-a7dd-10728d61d906 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Action: 'update', calling method: .version_select at 0x7fa8225faa60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:35.860936 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.hosts [None req-972bccac-5b96-4928-a7dd-10728d61d906 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Enabling host nonexistent_hostname. Oct 17 12:48:35.869678 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-972bccac-5b96-4928-a7dd-10728d61d906 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-972bccac-5b96-4928-a7dd-10728d61d906 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Request method failure captured: Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 50 Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8f8HKBqOK7xWUSwekXaHKsH4X2rDu2JFUtOo9C4J_JIuXm48tDE-T_PjsWTGIYULfSVgw-9ketFS-U_F-2tgsox8ofyKZ65xb8zrKr0RHCqDRn8myL5AlXoz2wdiQHFg-Bmvp2BTIn25cmLnMAV0PY_MTUYcXmre5A25HSK2oUN5A Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:35.871620 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09e1fe78645548dd8863afd5b30d0bb1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09e1fe78645548dd8863afd5b30d0bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09e1fe78645548dd8863afd5b30d0bb1 Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-65993597 Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 409ce7b039c14ba0bf0650af81db2654 Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HostsAdminNegativeTestJSON-65993597-project-admin Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: {"status": "enable", "maintenance_mode": "enable"} Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.872669 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 12:48:35.873337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:35.874263 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:35.875186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-972bccac-5b96-4928-a7dd-10728d61d906 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:35.875870 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-972bccac-5b96-4928-a7dd-10728d61d906 tempest-HostsAdminNegativeTestJSON-65993597 tempest-HostsAdminNegativeTestJSON-65993597-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020586 Oct 17 12:48:35.875870 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 39/61] 10.222.0.27 () {60 vars in 1211 bytes} [Mon Oct 17 12:48:35 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:48:35.879514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25a47778-f2ed-4c59-8a4e-b83d7e451f6c tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:35.900506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25a47778-f2ed-4c59-8a4e-b83d7e451f6c tempest-FlavorsExtraSpecsTestJSON-1436694411 tempest-FlavorsExtraSpecsTestJSON-1436694411-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025337 Oct 17 12:48:35.901515 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 40/62] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:36.378048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:48:36.751125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:48:36.751821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:48:36.752547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:48:36.753262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:48:36.755592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:48:36.774785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:36.775551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:36.776288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:36.777503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:36.778350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:36.779134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:36.821065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Getting quotas for project 685b8feeef624944864f7e7a937256c3. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:48:36.837037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Getting quotas for user 630ed82be6054e91a63816cf766b91bf and project 685b8feeef624944864f7e7a937256c3. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:48:36.855154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:48:36.858625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:48:36.936394 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb3d2577-142a-4fa0-aca1-4c35b1f9eb69 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750155 Oct 17 12:48:36.951457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d8b43225-e930-4f30-9319-4da30b02818e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:36.952205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d8b43225-e930-4f30-9319-4da30b02818e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:36.956821 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 23/63] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:48:37.775175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d8b43225-e930-4f30-9319-4da30b02818e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:37.813289 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d8b43225-e930-4f30-9319-4da30b02818e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1239 microversion: 2.1 time: 0.866006 Oct 17 12:48:37.817256 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 41/64] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:36 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1239 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:38.843302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:38.843920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:38.860958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:38.861998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:38.863067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:38.864942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:38.866061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:38.867352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:39.146709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:39.190259 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-443fdd45-5b57-4d6f-8c45-e57e672d66ad tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1239 microversion: 2.1 time: 0.352687 Oct 17 12:48:39.202607 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 24/65] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:38 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1239 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:40.214791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:40.216094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:40.232121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:40.233412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:40.234513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:40.237319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:40.239157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:40.241326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:40.709243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:40.742559 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fee34476-96b0-4c0f-8490-b2882f79ecc3 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1293 microversion: 2.1 time: 0.532217 Oct 17 12:48:40.745526 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 42/66] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:40 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1293 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:41.777744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:41.778414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:41.784809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:41.796080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:41.796806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:41.800044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:41.801388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:41.804240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:42.001794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:42.021006 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e0c6b86a-b49b-43d4-833f-f0ad584223f5 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1293 microversion: 2.1 time: 0.253419 Oct 17 12:48:42.024111 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 25/67] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:41 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1293 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:43.053639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:43.055931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:43.087614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:43.094339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:43.094943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:43.100575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:43.102958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:43.104446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:43.417338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:43.434286 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b09ce0fb-52cd-47ec-8475-1f49493b3781 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1293 microversion: 2.1 time: 0.387183 Oct 17 12:48:43.441229 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 43/68] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:43 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1293 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:44.464897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:44.465532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:44.483460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:44.483955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:44.490951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:44.492301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:44.492794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:44.493811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:45.355539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:45.364737 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c8702f15-67aa-4782-8b93-5538e08f5c99 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.903610 Oct 17 12:48:45.368023 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 26/69] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:44 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:45.524449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:46.139499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Calling method '.version_select at 0x7fa821d08a60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:46.141328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:46.141816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:46.142279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:46.192002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:46.192760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:46.193384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:46.213542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:46.214368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:46.225258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:46.259790 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-edb6face-c6e6-4af7-be2c-93c1d75e803f tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.743657 Oct 17 12:48:46.261861 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 44/70] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 17 12:48:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:48:46.271950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d1311fb-478a-49eb-828f-e3713ff5f7f0 tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Calling method '.version_select at 0x7fa821bf88b0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:46.275560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d1311fb-478a-49eb-828f-e3713ff5f7f0 tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:46.276252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d1311fb-478a-49eb-828f-e3713ff5f7f0 tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:46.276898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d1311fb-478a-49eb-828f-e3713ff5f7f0 tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:46.318491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d1311fb-478a-49eb-828f-e3713ff5f7f0 tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:46.319188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d1311fb-478a-49eb-828f-e3713ff5f7f0 tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:46.319737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d1311fb-478a-49eb-828f-e3713ff5f7f0 tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:46.331381 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d1311fb-478a-49eb-828f-e3713ff5f7f0 tempest-HypervisorAdminV228Test-1462194934 tempest-HypervisorAdminV228Test-1462194934-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.063913 Oct 17 12:48:46.334661 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 27/71] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 12:48:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:48:46.400230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:46.401390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:46.410838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:46.413546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:46.416919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:46.418999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:46.420762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:46.422939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:47.047026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:47.061747 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0aebed31-d835-4bca-8d77-816bb646a089 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.669079 Oct 17 12:48:47.062566 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 45/72] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:46 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:48.085195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:48.086037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:48.088146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:48.090408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:48.118997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:48.122780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:48.133432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:48.134694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:48.135324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:48.135920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:48.654118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:48.669257 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a215163b-9ffd-40f3-86a2-148db55bfacf tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.585372 Oct 17 12:48:48.670644 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 28/73] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:48 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:49.136545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:50.098951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Calling method '.version_select at 0x7fa821cb4940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:50.103115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:50.104805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:50.108684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:50.155005 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-640e7642-79ef-4a1f-aa69-784e015c73dd tempest-TenantUsagesNegativeTestJSON-1014716034 tempest-TenantUsagesNegativeTestJSON-1014716034-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-16T12%3A48%3A49.382246&end=2022-10-18T12%3A48%3A49.382246" status: 404 len: 112 microversion: - time: 0.767416 Oct 17 12:48:50.155916 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 29/74] 10.222.0.27 () {58 vars in 1316 bytes} [Mon Oct 17 12:48:49 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-16T12%3A48%3A49.382246&end=2022-10-18T12%3A48%3A49.382246 => generated 112 bytes in 770 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 17 12:48:50.185112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:50.190112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:50.191519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:50.282783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:50.283752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:50.285762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:50.317314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:50.318936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:50.320503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:50.342007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:50.342860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:50.343506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:50.352319 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9e4653be-d15f-462c-9388-08286a3506b6 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1668 microversion: 2.53 time: 1.220532 Oct 17 12:48:50.367356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 46/75] 10.222.0.27 () {60 vars in 1243 bytes} [Mon Oct 17 12:48:49 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1668 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:48:50.911273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-156b85ea-7a58-4a99-88e5-631c498fc7cd req-5b088d62-e150-4b33-b465-6495a2f6b4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3395b13-8f84-42bf-a4fa-760d99c7f089", "tag": "0e878ffd-3794-490d-b85a-4c89ebdf0a31"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:50.949305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-156b85ea-7a58-4a99-88e5-631c498fc7cd req-5b088d62-e150-4b33-b465-6495a2f6b4a8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:50.959437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-156b85ea-7a58-4a99-88e5-631c498fc7cd req-5b088d62-e150-4b33-b465-6495a2f6b4a8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:50.962081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-156b85ea-7a58-4a99-88e5-631c498fc7cd req-5b088d62-e150-4b33-b465-6495a2f6b4a8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:51.095306 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-156b85ea-7a58-4a99-88e5-631c498fc7cd req-5b088d62-e150-4b33-b465-6495a2f6b4a8 service nova] Creating event network-changed:0e878ffd-3794-490d-b85a-4c89ebdf0a31 for instance e3395b13-8f84-42bf-a4fa-760d99c7f089 on n-h2-853316-12 Oct 17 12:48:51.096912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-27526c2b-bcac-45a6-8923-b6bfe88c9ea0 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1735586111", "id": 1030678458, "os-flavor-access:is_public": "False"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:51.123644 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-156b85ea-7a58-4a99-88e5-631c498fc7cd req-5b088d62-e150-4b33-b465-6495a2f6b4a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.750329 Oct 17 12:48:51.125028 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 47/76] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:51.138607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-27526c2b-bcac-45a6-8923-b6bfe88c9ea0 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.980092 Oct 17 12:48:51.139949 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 30/77] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:50 2022] POST /compute/v2.1/flavors => generated 439 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:51.145049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7bb47b9-990e-4787-bf27-28ba78e1c39d tempest-TenantUsagesNegativeTestJSON-1014716034 tempest-TenantUsagesNegativeTestJSON-1014716034-project-admin] Calling method '.version_select at 0x7fa821c07dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:51.153447 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d7bb47b9-990e-4787-bf27-28ba78e1c39d tempest-TenantUsagesNegativeTestJSON-1014716034 tempest-TenantUsagesNegativeTestJSON-1014716034-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7bb47b9-990e-4787-bf27-28ba78e1c39d tempest-TenantUsagesNegativeTestJSON-1014716034 tempest-TenantUsagesNegativeTestJSON-1014716034-project-admin] Request method failure captured: Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-simple-tenant-usage/75f8f988660c49e480722e31f69190a2?start=2022-10-18T12%3A48%3A49.382246&end=2022-10-16T12%3A48%3A49.382246 HTTP/1.1 Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8xnaZZsWoCUDdxGhITNXajmZKFpJz6cZ2WuhK6n73E28gmg9eSxNkokLmYHUNBqqG2eJHBtev2F_U_TAJ4ls5QuEbjVFuGXfdjtHrTAc-DnqhwKwvkHGCgdOKMVSukE5TUXqOhyGJbfuXucrhi5--ZcYqz9xXt17EB_ibkEQYYVlI Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 59e30af9bd8f4825adc020c2d8541d6c Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1014716034 Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:48:51.157417 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59e30af9bd8f4825adc020c2d8541d6c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59e30af9bd8f4825adc020c2d8541d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59e30af9bd8f4825adc020c2d8541d6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59e30af9bd8f4825adc020c2d8541d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1014716034 Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 59e30af9bd8f4825adc020c2d8541d6c Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1014716034 Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TenantUsagesNegativeTestJSON-1014716034-project-admin Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 37d1a5648ace4b1a89eddf01902b72b6 Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1014716034-project-admin Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid start time. The start time cannot occur after the end time. Oct 17 12:48:51.159553 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '75f8f988660c49e480722e31f69190a2'} Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 12:48:51.160848 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 17 12:48:51.162765 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:51.167858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:51.167858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:51.174950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7bb47b9-990e-4787-bf27-28ba78e1c39d tempest-TenantUsagesNegativeTestJSON-1014716034 tempest-TenantUsagesNegativeTestJSON-1014716034-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:51.176667 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7bb47b9-990e-4787-bf27-28ba78e1c39d tempest-TenantUsagesNegativeTestJSON-1014716034 tempest-TenantUsagesNegativeTestJSON-1014716034-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/75f8f988660c49e480722e31f69190a2?start=2022-10-18T12%3A48%3A49.382246&end=2022-10-16T12%3A48%3A49.382246" status: 400 len: 111 microversion: 2.1 time: 0.034924 Oct 17 12:48:51.183094 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 31/78] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 17 12:48:51 2022] GET /compute/v2.1/os-simple-tenant-usage/75f8f988660c49e480722e31f69190a2?start=2022-10-18T12%3A48%3A49.382246&end=2022-10-16T12%3A48%3A49.382246 => generated 111 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:48:51.188907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Calling method '.version_select at 0x7fa821d9bca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:51.195125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:51.195340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:51.196352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:51.197035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:51.197535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:51.198135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:51.201544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:51.202031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:51.202686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:51.216168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:51.217316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:51.217989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:51.283869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:51.284585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:51.285388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:51.301778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:51.302636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:51.303274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:51.324115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:51.324987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:51.325705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:51.339522 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb993761-99fe-4afb-8e42-11a7bdf72868 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 359 microversion: 2.53 time: 0.154181 Oct 17 12:48:51.350110 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 32/79] 10.222.0.27 () {60 vars in 1222 bytes} [Mon Oct 17 12:48:51 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:48:51.375783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-079c3f62-48ea-4cda-9b8d-fbdb25a72502 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:52.140950 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-079c3f62-48ea-4cda-9b8d-fbdb25a72502 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1030678458/action" status: 200 len: 97 microversion: 2.1 time: 0.780716 Oct 17 12:48:52.142509 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 33/80] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 17 12:48:51 2022] POST /compute/v2.1/flavors/1030678458/action => generated 97 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:52.178544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:52.215030 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a7976b17-89a3-439a-8bb0-11bc55281b2d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 1.072003 Oct 17 12:48:52.237854 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 48/81] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:51 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:52.247711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3292bd46-8ce0-47db-b2fa-aad9bdfd2677 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Calling method '.version_select at 0x7fa821d08e50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:52.259537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3292bd46-8ce0-47db-b2fa-aad9bdfd2677 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:52.265228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3292bd46-8ce0-47db-b2fa-aad9bdfd2677 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:52.266382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3292bd46-8ce0-47db-b2fa-aad9bdfd2677 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:52.328779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3292bd46-8ce0-47db-b2fa-aad9bdfd2677 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:52.329554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3292bd46-8ce0-47db-b2fa-aad9bdfd2677 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:52.332164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3292bd46-8ce0-47db-b2fa-aad9bdfd2677 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:52.357337 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3292bd46-8ce0-47db-b2fa-aad9bdfd2677 tempest-HypervisorAdminV253TestBase-1355063976 tempest-HypervisorAdminV253TestBase-1355063976-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/a30a0e58-e92f-4208-ba6e-4ce2c81aa91c" status: 200 len: 794 microversion: 2.53 time: 0.117276 Oct 17 12:48:52.360144 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 49/82] 10.222.0.27 () {60 vars in 1298 bytes} [Mon Oct 17 12:48:52 2022] GET /compute/v2.1/os-hypervisors/a30a0e58-e92f-4208-ba6e-4ce2c81aa91c => generated 794 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:48:52.377938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee588399-3c1d-422c-9651-88d49253b715 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:52.848867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef3c300d-3dbe-496c-8543-2fe2a6dfd8a2 tempest-TenantUsagesNegativeTestJSON-2003062906 tempest-TenantUsagesNegativeTestJSON-2003062906-project] Calling method '.version_select at 0x7fa821bf8310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:52.856739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ef3c300d-3dbe-496c-8543-2fe2a6dfd8a2 tempest-TenantUsagesNegativeTestJSON-2003062906 tempest-TenantUsagesNegativeTestJSON-2003062906-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e9245658c39a433f9ff52a63054bf7ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f8f988660c49e480722e31f69190a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef3c300d-3dbe-496c-8543-2fe2a6dfd8a2 tempest-TenantUsagesNegativeTestJSON-2003062906 tempest-TenantUsagesNegativeTestJSON-2003062906-project] Request method failure captured: Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T12%3A48%3A49.382246&end=2022-10-18T12%3A48%3A49.382246&detailed=1 HTTP/1.1 Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8t9vVhTllXeFun7qkHyUbuQw1FGCxGCdHoPAXa9JGWAis7k8VS9synn0N8uGwASGIXSLzD26YqBFe2dcLV6JnK0G0zmHz-yq4c5mljOFuhESTjpqE3PMUyxhzQ1SlmVIW_A8n8ZRztTrhAuiw9tj94QcGvU1IBmP8Kqx10RmBmoF0 Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 75f8f988660c49e480722e31f69190a2 Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2003062906 Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:48:52.866521 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75f8f988660c49e480722e31f69190a2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75f8f988660c49e480722e31f69190a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75f8f988660c49e480722e31f69190a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75f8f988660c49e480722e31f69190a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2003062906 Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 75f8f988660c49e480722e31f69190a2 Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2003062906 Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TenantUsagesNegativeTestJSON-2003062906-project Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9245658c39a433f9ff52a63054bf7ae Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2003062906-project Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: action_args: {} Oct 17 12:48:52.868082 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:52.868997 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:52.870152 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:52.871303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 12:48:52.871303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:52.873723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef3c300d-3dbe-496c-8543-2fe2a6dfd8a2 tempest-TenantUsagesNegativeTestJSON-2003062906 tempest-TenantUsagesNegativeTestJSON-2003062906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:52.875681 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ef3c300d-3dbe-496c-8543-2fe2a6dfd8a2 tempest-TenantUsagesNegativeTestJSON-2003062906 tempest-TenantUsagesNegativeTestJSON-2003062906-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T12%3A48%3A49.382246&end=2022-10-18T12%3A48%3A49.382246&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.732174 Oct 17 12:48:52.886859 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 34/83] 10.222.0.27 () {58 vars in 1335 bytes} [Mon Oct 17 12:48:52 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T12%3A48%3A49.382246&end=2022-10-18T12%3A48%3A49.382246&detailed=1 => generated 123 bytes in 743 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:53.250788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:53.251595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:53.275958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:53.278226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:53.278682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:53.288593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:53.289284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:53.289822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:53.453483 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ee588399-3c1d-422c-9651-88d49253b715 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] HTTP exception thrown: Flavor access already exists for flavor 19 and project b03fd1aebd394951b89f5d92522327fe combination. Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee588399-3c1d-422c-9651-88d49253b715 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Request method failure captured: Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/flavors/1030678458/action HTTP/1.1 Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 67 Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8uavPd4w3wlxOu4lVxteOlWOwBOQwLC5ooPM8nkrboT8S4Tug4EDPBWhJRPICpbbWIZgfmaOzNAcqoU6d7OHfx5sdCeQnES-sWG1COFHoZC7buqdiSglMPjitONx5P0kxSyiFBYCt0O4oWowxHbsq0CDCAZC0wtaRT35wv7f30mZc Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b7a5cae8072242d5a794abfb8e6cf428 Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:53.471401 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7a5cae8072242d5a794abfb8e6cf428", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b7a5cae8072242d5a794abfb8e6cf428 Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f1ddb3bf1262495cb2d8216fe9b0a6cf Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: {"addTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} Oct 17 12:48:53.473229 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: exception: Flavor access already exists for flavor 19 and project b03fd1aebd394951b89f5d92522327fe combination. Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1030678458', 'body': {'addTenantAccess': {'tenant': 'b03fd1aebd394951b89f5d92522327fe'}}} Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result.read() Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 12:48:53.474641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '19-b03fd1aebd394951b89f5d92522327fe' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 12:48:53.475636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 12:48:53.476644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 12:48:53.477663 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result.read() Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '19-b03fd1aebd394951b89f5d92522327fe' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 12, 48, 53, 435953), 'updated_at': None, 'flavor_id': 19, 'project_id': 'b03fd1aebd394951b89f5d92522327fe'}] Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:53.482154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 19 and project b03fd1aebd394951b89f5d92522327fe combination. Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:53.483098 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 19 and project b03fd1aebd394951b89f5d92522327fe combination. Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:53.484174 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:53.485431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 19 and project b03fd1aebd394951b89f5d92522327fe combination. Oct 17 12:48:53.485431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:53.486700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee588399-3c1d-422c-9651-88d49253b715 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Returning 409 to user: Flavor access already exists for flavor 19 and project b03fd1aebd394951b89f5d92522327fe combination. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:53.490655 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee588399-3c1d-422c-9651-88d49253b715 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1030678458/action" status: 409 len: 152 microversion: 2.1 time: 1.129081 Oct 17 12:48:53.494674 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 50/84] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 17 12:48:52 2022] POST /compute/v2.1/flavors/1030678458/action => generated 152 bytes in 1134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:48:53.505468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2069b91-cc7b-4bfd-a60f-ff883b40daa4 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:53.840601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:53.855285 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e51f2231-8d4d-4a0d-90f4-94975dda020a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.608676 Oct 17 12:48:53.867804 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 35/85] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:53 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:54.218403 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2069b91-cc7b-4bfd-a60f-ff883b40daa4 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1030678458/action" status: 200 len: 21 microversion: 2.1 time: 0.717584 Oct 17 12:48:54.221440 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 51/86] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 17 12:48:53 2022] POST /compute/v2.1/flavors/1030678458/action => generated 21 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 12:48:54.232565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8555f026-95b9-4dfc-bd73-285d939aa058 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:54.281210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8555f026-95b9-4dfc-bd73-285d939aa058 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1030678458" status: 202 len: 0 microversion: 2.1 time: 0.052597 Oct 17 12:48:54.301087 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 36/87] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:48:54 2022] DELETE /compute/v2.1/flavors/1030678458 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:48:54.310409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4c22d11f-c5f9-4f54-af99-1932d1ad912f tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:54.383122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4c22d11f-c5f9-4f54-af99-1932d1ad912f tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076894 Oct 17 12:48:54.386727 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 52/88] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:54.416155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7d5c61a7-3dbc-4fef-b561-047853c84313 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1703979270", "id": 985480666, "os-flavor-access:is_public": "True"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:54.452771 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7d5c61a7-3dbc-4fef-b561-047853c84313 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041825 Oct 17 12:48:54.455019 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 37/89] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:54.467330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1397d3d7-d1fe-4220-93aa-fae9ed073738 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:54.479764 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-1397d3d7-d1fe-4220-93aa-fae9ed073738 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1397d3d7-d1fe-4220-93aa-fae9ed073738 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Request method failure captured: Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/flavors/985480666/os-flavor-access HTTP/1.1 Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8uavPd4w3wlxOu4lVxteOlWOwBOQwLC5ooPM8nkrboT8S4Tug4EDPBWhJRPICpbbWIZgfmaOzNAcqoU6d7OHfx5sdCeQnES-sWG1COFHoZC7buqdiSglMPjitONx5P0kxSyiFBYCt0O4oWowxHbsq0CDCAZC0wtaRT35wv7f30mZc Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b7a5cae8072242d5a794abfb8e6cf428 Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:54.483312 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7a5cae8072242d5a794abfb8e6cf428", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b7a5cae8072242d5a794abfb8e6cf428 Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f1ddb3bf1262495cb2d8216fe9b0a6cf Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: exception: Access list not available for public flavors. Oct 17 12:48:54.484528 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'flavor_id': '985480666'} Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 17 12:48:54.485151 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:54.486317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1397d3d7-d1fe-4220-93aa-fae9ed073738 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:54.488787 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1397d3d7-d1fe-4220-93aa-fae9ed073738 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/985480666/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.024295 Oct 17 12:48:54.491897 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 53/90] 10.222.0.27 () {58 vars in 1206 bytes} [Mon Oct 17 12:48:54 2022] GET /compute/v2.1/flavors/985480666/os-flavor-access => generated 91 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:48:54.517174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc2a0985-5948-4d98-9fbd-5a322eae1e2a tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:54.575628 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc2a0985-5948-4d98-9fbd-5a322eae1e2a tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/985480666" status: 202 len: 0 microversion: 2.1 time: 0.075118 Oct 17 12:48:54.577037 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 38/91] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:48:54 2022] DELETE /compute/v2.1/flavors/985480666 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:48:54.588123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3def8126-817e-4f8f-8cc0-cd822cd7436d tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:54.650843 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3def8126-817e-4f8f-8cc0-cd822cd7436d tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066836 Oct 17 12:48:54.651968 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 54/92] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:54.682153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-28e989c5-acaf-42a9-92ce-4ab5870dea74 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1284756812", "id": 2078897423, "os-flavor-access:is_public": "False"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:54.741641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-28e989c5-acaf-42a9-92ce-4ab5870dea74 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.067118 Oct 17 12:48:54.745515 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 39/93] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:54 2022] POST /compute/v2.1/flavors => generated 439 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:54.886822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:54.888580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:54.905085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:54.906805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:54.909178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:54.911623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:54.913249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:54.914299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:55.008337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-049d8b9f-729f-4c58-9c13-a105f341897b tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:55.014810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-049d8b9f-729f-4c58-9c13-a105f341897b tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '414500b8d77a449488531bb0538e6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03fd1aebd394951b89f5d92522327fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-049d8b9f-729f-4c58-9c13-a105f341897b tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] Request method failure captured: Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/flavors/2078897423/action HTTP/1.1 Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 67 Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8pDiOk9rUlIUfJYfoxwtnoO3bmZRO-9Kx9jSbZ6sbLPB9n0LK6uXAFzvWXZTUbxzyc2AYD2obsfMIcBwRvmL6pdnRS4CoihdsZYko37AAUjOuT9outAn8lJReQj2EdcAB5BL_jSiIbKCFooU6FRRpm3AW7TfXdB1YkMb5q9Oe9Myg Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b03fd1aebd394951b89f5d92522327fe Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1470011994 Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:48:55.021770 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b03fd1aebd394951b89f5d92522327fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b03fd1aebd394951b89f5d92522327fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b03fd1aebd394951b89f5d92522327fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b03fd1aebd394951b89f5d92522327fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1470011994 Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b03fd1aebd394951b89f5d92522327fe Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1470011994 Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsAccessNegativeTestJSON-1470011994-project Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 414500b8d77a449488531bb0538e6407 Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1470011994-project Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: {"addTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} Oct 17 12:48:55.023339 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '2078897423', 'body': {'addTenantAccess': {'tenant': 'b03fd1aebd394951b89f5d92522327fe'}}} Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:55.024393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 12:48:55.025856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:55.036623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-049d8b9f-729f-4c58-9c13-a105f341897b tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:55.048473 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-049d8b9f-729f-4c58-9c13-a105f341897b tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] 10.222.0.27 "POST /compute/v2.1/flavors/2078897423/action" status: 403 len: 130 microversion: 2.1 time: 0.286027 Oct 17 12:48:55.054702 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 55/94] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 17 12:48:54 2022] POST /compute/v2.1/flavors/2078897423/action => generated 130 bytes in 304 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:55.060581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7df82dc6-3bb2-497e-a01f-8db37f89a2cf tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:55.093011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7df82dc6-3bb2-497e-a01f-8db37f89a2cf tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2078897423" status: 202 len: 0 microversion: 2.1 time: 0.036905 Oct 17 12:48:55.094487 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 56/95] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:48:55 2022] DELETE /compute/v2.1/flavors/2078897423 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:48:55.107486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1bb76db4-9d42-420d-b9d2-941cd2c04cd6 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:55.159348 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1bb76db4-9d42-420d-b9d2-941cd2c04cd6 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059357 Oct 17 12:48:55.161310 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 57/96] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:55.206007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-991509d4-99ef-47d0-928f-54f068ab514e tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-356540345", "id": 665686000, "os-flavor-access:is_public": "False"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:55.284871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:55.285497 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-991509d4-99ef-47d0-928f-54f068ab514e tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.091722 Oct 17 12:48:55.288429 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 58/97] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:55 2022] POST /compute/v2.1/flavors => generated 435 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:55.298915 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f10afd9e-e438-42bd-be77-f47afac31119 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.421244 Oct 17 12:48:55.299588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4011d954-4738-46d6-8e4b-63382d5e1ead tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:55.314598 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 40/98] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:54 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:55.572216 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4011d954-4738-46d6-8e4b-63382d5e1ead tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/665686000/action" status: 200 len: 96 microversion: 2.1 time: 0.276772 Oct 17 12:48:55.575479 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 59/99] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 17 12:48:55 2022] POST /compute/v2.1/flavors/665686000/action => generated 96 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 12:48:55.587669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a4ca90f-ced3-46ed-915f-b711543e42d5 tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:55.592372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0a4ca90f-ced3-46ed-915f-b711543e42d5 tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '414500b8d77a449488531bb0538e6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03fd1aebd394951b89f5d92522327fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a4ca90f-ced3-46ed-915f-b711543e42d5 tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] Request method failure captured: Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/flavors/665686000/action HTTP/1.1 Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 70 Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8pDiOk9rUlIUfJYfoxwtnoO3bmZRO-9Kx9jSbZ6sbLPB9n0LK6uXAFzvWXZTUbxzyc2AYD2obsfMIcBwRvmL6pdnRS4CoihdsZYko37AAUjOuT9outAn8lJReQj2EdcAB5BL_jSiIbKCFooU6FRRpm3AW7TfXdB1YkMb5q9Oe9Myg Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: b03fd1aebd394951b89f5d92522327fe Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1470011994 Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:48:55.600086 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b03fd1aebd394951b89f5d92522327fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b03fd1aebd394951b89f5d92522327fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b03fd1aebd394951b89f5d92522327fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b03fd1aebd394951b89f5d92522327fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1470011994 Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: b03fd1aebd394951b89f5d92522327fe Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1470011994 Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FlavorsAccessNegativeTestJSON-1470011994-project Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 414500b8d77a449488531bb0538e6407 Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1470011994-project Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: {"removeTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} Oct 17 12:48:55.601184 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '665686000', 'body': {'removeTenantAccess': {'tenant': 'b03fd1aebd394951b89f5d92522327fe'}}} Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can( Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:48:55.601758 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 12:48:55.602767 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:48:55.605574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a4ca90f-ced3-46ed-915f-b711543e42d5 tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:55.607763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0a4ca90f-ced3-46ed-915f-b711543e42d5 tempest-FlavorsAccessNegativeTestJSON-1470011994 tempest-FlavorsAccessNegativeTestJSON-1470011994-project] 10.222.0.27 "POST /compute/v2.1/flavors/665686000/action" status: 403 len: 133 microversion: 2.1 time: 0.026479 Oct 17 12:48:55.609287 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 41/100] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 17 12:48:55 2022] POST /compute/v2.1/flavors/665686000/action => generated 133 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:55.620454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ff46138-02d6-4739-9471-72bae3cfbca9 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b03fd1aebd394951b89f5d92522327fe"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:56.326238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:56.328464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:56.341898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:56.342432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:56.342870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:56.344098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:56.346679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:56.347125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:56.568082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=12,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:56.593097 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ff46138-02d6-4739-9471-72bae3cfbca9 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/665686000/action" status: 200 len: 21 microversion: 2.1 time: 0.975955 Oct 17 12:48:56.594202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 60/101] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 17 12:48:55 2022] POST /compute/v2.1/flavors/665686000/action => generated 21 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:48:56.604538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-805e9479-697b-407b-bffd-9cb07d407fcf tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:56.657647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-805e9479-697b-407b-bffd-9cb07d407fcf tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/665686000" status: 202 len: 0 microversion: 2.1 time: 0.056718 Oct 17 12:48:56.658640 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 61/102] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:48:56 2022] DELETE /compute/v2.1/flavors/665686000 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:48:56.667373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18e6ead0-f5fc-4801-9ece-bc1fb93dcaac tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:56.743601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18e6ead0-f5fc-4801-9ece-bc1fb93dcaac tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079800 Oct 17 12:48:56.749972 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 62/103] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:56.772446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-59758ad8-bb64-4751-b85d-3b7df304f1df tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1711463084", "id": 2436417, "os-flavor-access:is_public": "False"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:56.820304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-59758ad8-bb64-4751-b85d-3b7df304f1df tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.051218 Oct 17 12:48:56.823585 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 63/104] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:48:56 2022] POST /compute/v2.1/flavors => generated 430 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:48:56.841272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aaf823e5-13ca-4dc4-b763-e55416d78afc tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1448c5a0bf9544818703645d43610c4e"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:48:57.241868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:57.251715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:48:57.260740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-511185cf-883e-4065-a66e-5bcc27c7c4b0 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.935957 Oct 17 12:48:57.274738 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 42/105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:56 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:57.466042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-aaf823e5-13ca-4dc4-b763-e55416d78afc tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] HTTP exception thrown: Flavor access not found for 23 / 1448c5a0bf9544818703645d43610c4e combination. Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aaf823e5-13ca-4dc4-b763-e55416d78afc tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Request method failure captured: Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/flavors/2436417/action HTTP/1.1 Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 70 Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8uavPd4w3wlxOu4lVxteOlWOwBOQwLC5ooPM8nkrboT8S4Tug4EDPBWhJRPICpbbWIZgfmaOzNAcqoU6d7OHfx5sdCeQnES-sWG1COFHoZC7buqdiSglMPjitONx5P0kxSyiFBYCt0O4oWowxHbsq0CDCAZC0wtaRT35wv7f30mZc Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b7a5cae8072242d5a794abfb8e6cf428 Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:48:57.467900 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7a5cae8072242d5a794abfb8e6cf428", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7a5cae8072242d5a794abfb8e6cf428"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b7a5cae8072242d5a794abfb8e6cf428 Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029 Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f1ddb3bf1262495cb2d8216fe9b0a6cf Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: {"removeTenantAccess": {"tenant": "1448c5a0bf9544818703645d43610c4e"}} Oct 17 12:48:57.470537 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: exception: Flavor access not found for 23 / 1448c5a0bf9544818703645d43610c4e combination. Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '2436417', 'body': {'removeTenantAccess': {'tenant': '1448c5a0bf9544818703645d43610c4e'}}} Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 17 12:48:57.473737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 23 / 1448c5a0bf9544818703645d43610c4e combination. Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 23 / 1448c5a0bf9544818703645d43610c4e combination. Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:57.476373 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:48:57.479823 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:48:57.479823 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:48:57.479823 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:48:57.479823 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:48:57.479823 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 23 / 1448c5a0bf9544818703645d43610c4e combination. Oct 17 12:48:57.479823 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:48:57.479823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aaf823e5-13ca-4dc4-b763-e55416d78afc tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Returning 404 to user: Flavor access not found for 23 / 1448c5a0bf9544818703645d43610c4e combination. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:48:57.480815 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aaf823e5-13ca-4dc4-b763-e55416d78afc tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2436417/action" status: 404 len: 124 microversion: 2.1 time: 0.647568 Oct 17 12:48:57.488962 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 64/106] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:48:56 2022] POST /compute/v2.1/flavors/2436417/action => generated 124 bytes in 654 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:48:57.491552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55f6e589-5e40-4c4f-8b02-5c4af5107329 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:57.522797 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55f6e589-5e40-4c4f-8b02-5c4af5107329 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2436417" status: 202 len: 0 microversion: 2.1 time: 0.036294 Oct 17 12:48:57.523371 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 43/107] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:48:57 2022] DELETE /compute/v2.1/flavors/2436417 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:48:57.534203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1cc853c2-53c7-4465-a1b6-41ce53874574 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:57.592392 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1cc853c2-53c7-4465-a1b6-41ce53874574 tempest-FlavorsAccessNegativeTestJSON-1563939029 tempest-FlavorsAccessNegativeTestJSON-1563939029-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060297 Oct 17 12:48:57.608035 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 65/108] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:48:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:58.290124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:58.291011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:48:58.300332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:58.303430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:58.304072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:58.305254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:48:58.308023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:48:58.312004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:48:58.948388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:48:58.967759 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3bdf7dfd-7ca0-47e2-aa07-a936d3c9e527 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.681301 Oct 17 12:48:58.971918 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 44/109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:58 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:48:59.998246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:48:59.998886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:00.019321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:00.020246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:00.020711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:00.021461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:00.026554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:00.029533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:00.897763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:00.915139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff4efa07-b7f7-4ca1-85db-26649465eaa8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.922338 Oct 17 12:49:00.919393 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 66/110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:48:59 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:01.946404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:01.947373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:01.962099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:01.962627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:01.963073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:01.963786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:01.964236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:01.964661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:02.710360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:02.739169 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6fae81b9-9acb-480c-b545-995694155d0d tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.795774 Oct 17 12:49:02.739169 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 45/111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:01 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:03.651586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4b40430-d0cb-4cb2-b497-54c53e4aaec6 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Calling method '.version_select at 0x7fa821c1edc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:03.653445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b4b40430-d0cb-4cb2-b497-54c53e4aaec6 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '90f1a838c6d54701a852bbacec084e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed456faf42d34eae93091c1033815d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4b40430-d0cb-4cb2-b497-54c53e4aaec6 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Request method failure captured: Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU88OX6YVjrBL_d1uuuImZdhF2o9LnF3JQwcMgVInmLAT4CPEahOtkR3kElQ-J6BGA7uBDLXDgHuuiwBJT-F_jC0HDYp9E-e2PCz-5ar_uDDaULqoQjVvdgviF9KgFiU_2rvbeN53K4OBpcjcquDAxEcRrCyAretTzjCy9KoCo_jEno Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:03.656346 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed456faf42d34eae93091c1033815d98", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed456faf42d34eae93091c1033815d98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 90f1a838c6d54701a852bbacec084e0e Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 12:49:03.657489 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:03.658136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 12:49:03.659158 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.660641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4b40430-d0cb-4cb2-b497-54c53e4aaec6 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:03.660641 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b4b40430-d0cb-4cb2-b497-54c53e4aaec6 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.770117 Oct 17 12:49:03.664848 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 67/112] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 17 12:49:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 778 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:03.678193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1c3597eb-e107-4471-b5c6-f9ccae38dea0 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Calling method '.version_select at 0x7fa821be6550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:03.681066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1c3597eb-e107-4471-b5c6-f9ccae38dea0 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '90f1a838c6d54701a852bbacec084e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed456faf42d34eae93091c1033815d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1c3597eb-e107-4471-b5c6-f9ccae38dea0 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Request method failure captured: Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU88OX6YVjrBL_d1uuuImZdhF2o9LnF3JQwcMgVInmLAT4CPEahOtkR3kElQ-J6BGA7uBDLXDgHuuiwBJT-F_jC0HDYp9E-e2PCz-5ar_uDDaULqoQjVvdgviF9KgFiU_2rvbeN53K4OBpcjcquDAxEcRrCyAretTzjCy9KoCo_jEno Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:03.683526 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed456faf42d34eae93091c1033815d98", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed456faf42d34eae93091c1033815d98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 90f1a838c6d54701a852bbacec084e0e Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: action_args: {} Oct 17 12:49:03.684636 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:03.685296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 12:49:03.686243 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.693143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1c3597eb-e107-4471-b5c6-f9ccae38dea0 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:03.696119 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1c3597eb-e107-4471-b5c6-f9ccae38dea0 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.024338 Oct 17 12:49:03.701489 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 46/113] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:49:03 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:03.711533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aea2089-2021-493b-9160-80b738cce01c tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Calling method '.version_select at 0x7fa821a35af0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:03.713623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0aea2089-2021-493b-9160-80b738cce01c tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '90f1a838c6d54701a852bbacec084e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed456faf42d34eae93091c1033815d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aea2089-2021-493b-9160-80b738cce01c tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Request method failure captured: Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU88OX6YVjrBL_d1uuuImZdhF2o9LnF3JQwcMgVInmLAT4CPEahOtkR3kElQ-J6BGA7uBDLXDgHuuiwBJT-F_jC0HDYp9E-e2PCz-5ar_uDDaULqoQjVvdgviF9KgFiU_2rvbeN53K4OBpcjcquDAxEcRrCyAretTzjCy9KoCo_jEno Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:03.716878 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed456faf42d34eae93091c1033815d98", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed456faf42d34eae93091c1033815d98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 90f1a838c6d54701a852bbacec084e0e Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 12:49:03.718519 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:03.719543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 12:49:03.720534 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:03.724932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aea2089-2021-493b-9160-80b738cce01c tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:03.728051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0aea2089-2021-493b-9160-80b738cce01c tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021333 Oct 17 12:49:03.729561 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 68/114] 10.222.0.27 () {58 vars in 1179 bytes} [Mon Oct 17 12:49:03 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:03.765101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:03.765995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:03.777751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:03.782034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:03.783181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:03.788112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:03.789057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:03.789970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:03.798292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=81 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:04.130151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:04.140859 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a58acef0-a4d7-43f7-b5dd-7fc0cbe08d39 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.380978 Oct 17 12:49:04.141757 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 69/115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:03 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:04.836630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Calling method '.version_select at 0x7fa821b9a820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:04.838924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:04.839436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:04.840029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:04.881608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:04.888323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:04.889015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:04.901935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99010624-ab80-4e97-8f39-f1d936c826a1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:04.923350 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-99010624-ab80-4e97-8f39-f1d936c826a1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.779122 Oct 17 12:49:04.926273 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 70/116] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:49:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:04.931139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:04.931635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:04.932080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:04.955083 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d3b29352-992b-42fa-9e55-f4b96f245174 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.219731 Oct 17 12:49:04.963903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 47/117] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:49:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:04.977212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8552834a-d194-468e-98c6-53fe958776de tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Calling method '.version_select at 0x7fa821be6ca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:04.988969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8552834a-d194-468e-98c6-53fe958776de tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '90f1a838c6d54701a852bbacec084e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed456faf42d34eae93091c1033815d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8552834a-d194-468e-98c6-53fe958776de tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Request method failure captured: Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU88OX6YVjrBL_d1uuuImZdhF2o9LnF3JQwcMgVInmLAT4CPEahOtkR3kElQ-J6BGA7uBDLXDgHuuiwBJT-F_jC0HDYp9E-e2PCz-5ar_uDDaULqoQjVvdgviF9KgFiU_2rvbeN53K4OBpcjcquDAxEcRrCyAretTzjCy9KoCo_jEno Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:04.990781 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed456faf42d34eae93091c1033815d98", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed456faf42d34eae93091c1033815d98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 90f1a838c6d54701a852bbacec084e0e Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1'} Oct 17 12:49:04.991988 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:04.992652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 12:49:04.993568 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:04.994518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8552834a-d194-468e-98c6-53fe958776de tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:04.994518 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8552834a-d194-468e-98c6-53fe958776de tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021545 Oct 17 12:49:05.001769 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 48/118] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 17 12:49:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:05.010963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac0651b1-a7c9-41ee-a714-e5f13202f624 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Calling method '.version_select at 0x7fa821c70f70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:05.012578 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-ac0651b1-a7c9-41ee-a714-e5f13202f624 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] HTTP exception thrown: Hypervisor with ID '267b8353-7862-4b07-b860-8a9264050c3b' could not be found. Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac0651b1-a7c9-41ee-a714-e5f13202f624 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Request method failure captured: Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hypervisors/267b8353-7862-4b07-b860-8a9264050c3b/uptime HTTP/1.1 Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8-hNnOnDjS5f5D5vvO3pEQZH8x01ttcSsGya31tnIs7Uw_O7nhmZn6Aws2vMeIB1VV_inXURqNXKHQWRkCsOS7MgX59OUOBAqyXQ0w952DT7-80U6cXvbH_ynrS2zjN8bYjgegShE2da_P8vD1ezCIo5A5_FP8kCA6w022KV3triM Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3c513f05862f476e860413822e33275e Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-198490304 Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:05.036400 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c513f05862f476e860413822e33275e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c513f05862f476e860413822e33275e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c513f05862f476e860413822e33275e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c513f05862f476e860413822e33275e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-198490304 Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3c513f05862f476e860413822e33275e Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-198490304 Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: b6a78f3687a14dbf93afdd9b309e7da5 Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: exception: Hypervisor with ID '267b8353-7862-4b07-b860-8a9264050c3b' could not be found. Oct 17 12:49:05.037781 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '267b8353-7862-4b07-b860-8a9264050c3b'} Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '267b8353-7862-4b07-b860-8a9264050c3b' Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 17 12:49:05.038566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '267b8353-7862-4b07-b860-8a9264050c3b' could not be found. Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.039808 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.041350 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.041350 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:05.041350 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:05.041350 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:05.041350 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:05.041350 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '267b8353-7862-4b07-b860-8a9264050c3b' could not be found. Oct 17 12:49:05.041350 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.042960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac0651b1-a7c9-41ee-a714-e5f13202f624 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Returning 404 to user: Hypervisor with ID '267b8353-7862-4b07-b860-8a9264050c3b' could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:05.043828 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac0651b1-a7c9-41ee-a714-e5f13202f624 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/267b8353-7862-4b07-b860-8a9264050c3b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.036525 Oct 17 12:49:05.044393 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 49/119] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 17 12:49:05 2022] GET /compute/v2.1/os-hypervisors/267b8353-7862-4b07-b860-8a9264050c3b/uptime => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:05.059718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Calling method '.version_select at 0x7fa821d645e0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:05.069498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:05.071597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:05.073239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:05.130587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:05.131140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:05.131583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:05.151100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:05.151656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:05.156242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:05.185809 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e46681a-d9ef-4b01-8bc7-8305f2e14d2b tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.131077 Oct 17 12:49:05.190026 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 50/120] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:49:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:05.210649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:05.211365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:05.230919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:05.231855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:05.232724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:05.234070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:05.236027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:05.236669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:05.500169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25fd0ce4-7b45-4d92-b57a-87e831bf179c tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-21664777", "id": 53009762, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:05.535278 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25fd0ce4-7b45-4d92-b57a-87e831bf179c tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.599379 Oct 17 12:49:05.536455 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 71/121] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:04 2022] POST /compute/v2.1/flavors => generated 417 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:05.545209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c91ee984-aff7-4a51-8c06-38a47515ff93 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Calling method '.version_select at 0x7fa822606040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:05.552156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c91ee984-aff7-4a51-8c06-38a47515ff93 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '90f1a838c6d54701a852bbacec084e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed456faf42d34eae93091c1033815d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c91ee984-aff7-4a51-8c06-38a47515ff93 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Request method failure captured: Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU88OX6YVjrBL_d1uuuImZdhF2o9LnF3JQwcMgVInmLAT4CPEahOtkR3kElQ-J6BGA7uBDLXDgHuuiwBJT-F_jC0HDYp9E-e2PCz-5ar_uDDaULqoQjVvdgviF9KgFiU_2rvbeN53K4OBpcjcquDAxEcRrCyAretTzjCy9KoCo_jEno Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:05.558088 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed456faf42d34eae93091c1033815d98", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed456faf42d34eae93091c1033815d98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed456faf42d34eae93091c1033815d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ed456faf42d34eae93091c1033815d98 Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888 Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 90f1a838c6d54701a852bbacec084e0e Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1573140888-project Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1'} Oct 17 12:49:05.559291 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:05.560118 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 12:49:05.561689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.565526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c91ee984-aff7-4a51-8c06-38a47515ff93 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:05.568201 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c91ee984-aff7-4a51-8c06-38a47515ff93 tempest-HypervisorAdminNegativeTestJSON-1573140888 tempest-HypervisorAdminNegativeTestJSON-1573140888-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.029918 Oct 17 12:49:05.570356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 72/122] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:05.586146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2565c71c-0d84-4e70-a7e9-77540fe7f9e9 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:05.606773 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2565c71c-0d84-4e70-a7e9-77540fe7f9e9 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034943 Oct 17 12:49:05.607657 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 73/123] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 17 12:49:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:49:05.612857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd9f513b-f3ed-43de-a956-e149624872f9 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Calling method '.version_select at 0x7fa821a3c940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:05.614959 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-fd9f513b-f3ed-43de-a956-e149624872f9 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] HTTP exception thrown: Hypervisor with ID '908346f2-6d86-4206-bfdb-1357b6c83659' could not be found. Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd9f513b-f3ed-43de-a956-e149624872f9 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Request method failure captured: Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hypervisors/908346f2-6d86-4206-bfdb-1357b6c83659 HTTP/1.1 Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8-hNnOnDjS5f5D5vvO3pEQZH8x01ttcSsGya31tnIs7Uw_O7nhmZn6Aws2vMeIB1VV_inXURqNXKHQWRkCsOS7MgX59OUOBAqyXQ0w952DT7-80U6cXvbH_ynrS2zjN8bYjgegShE2da_P8vD1ezCIo5A5_FP8kCA6w022KV3triM Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 3c513f05862f476e860413822e33275e Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-198490304 Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:49:05.625202 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3c513f05862f476e860413822e33275e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c513f05862f476e860413822e33275e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3c513f05862f476e860413822e33275e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3c513f05862f476e860413822e33275e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-198490304 Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 3c513f05862f476e860413822e33275e Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-198490304 Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: b6a78f3687a14dbf93afdd9b309e7da5 Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: exception: Hypervisor with ID '908346f2-6d86-4206-bfdb-1357b6c83659' could not be found. Oct 17 12:49:05.626540 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '908346f2-6d86-4206-bfdb-1357b6c83659'} Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '908346f2-6d86-4206-bfdb-1357b6c83659' Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 17 12:49:05.627166 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:49:05.628238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '908346f2-6d86-4206-bfdb-1357b6c83659' could not be found. Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '908346f2-6d86-4206-bfdb-1357b6c83659' could not be found. Oct 17 12:49:05.629259 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:05.632403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd9f513b-f3ed-43de-a956-e149624872f9 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] Returning 404 to user: Hypervisor with ID '908346f2-6d86-4206-bfdb-1357b6c83659' could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:05.636226 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd9f513b-f3ed-43de-a956-e149624872f9 tempest-HypervisorAdminNegativeTestJSON-198490304 tempest-HypervisorAdminNegativeTestJSON-198490304-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/908346f2-6d86-4206-bfdb-1357b6c83659" status: 404 len: 123 microversion: 2.1 time: 0.027150 Oct 17 12:49:05.636821 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 74/124] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 17 12:49:05 2022] GET /compute/v2.1/os-hypervisors/908346f2-6d86-4206-bfdb-1357b6c83659 => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:05.647560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3b8673b-5b5c-4837-bea6-21ae0bcd43c0 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-6588316", "id": 744708008, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:05.683018 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3b8673b-5b5c-4837-bea6-21ae0bcd43c0 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.045148 Oct 17 12:49:05.683625 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 75/125] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:05 2022] POST /compute/v2.1/flavors => generated 419 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:05.909268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:05.919176 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9a3e9601-5bde-4e11-a98d-792d2b10218c tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.726349 Oct 17 12:49:05.919760 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 51/126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:05 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:05.932761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf6acc19-e39c-44af-a2c3-756120d661a8 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:05.940604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:05.949571 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf6acc19-e39c-44af-a2c3-756120d661a8 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025574 Oct 17 12:49:05.964594 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 52/127] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 17 12:49:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:49:05.969476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b126fe4a-a861-44e6-90e4-a9b9afa9252e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Action: 'create', calling method: .version_select at 0x7fa821b9aaf0>, body: {"keypair": {"name": "tempest-keypair-633989678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIaU2Mq3Ww9wYAJFwTfzN0TAyZTl7U2NOfvJcuzCMIfW+ls7c6YEsm842/f93roID8UK/uw6aqJI2u6OM4/SeMa087PiLrR/RGiV2VdvqdM66Md7Eyr+bYICKj19vBJ+Q=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:06.040144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b126fe4a-a861-44e6-90e4-a9b9afa9252e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Getting quotas for project 18e42d050ee6400786fb16b79e54355b. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:06.053027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b126fe4a-a861-44e6-90e4-a9b9afa9252e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Getting quotas for user 68dd6904cebc42b48e4f421267cafd9d and project 18e42d050ee6400786fb16b79e54355b. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:06.144067 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b126fe4a-a861-44e6-90e4-a9b9afa9252e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178299 Oct 17 12:49:06.145277 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 53/128] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:49:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:06.536406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2fb576c0-3e90-4bdd-8b8e-2588b2d80793 req-2e9c466f-768f-406c-aa96-e6c2622400bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3395b13-8f84-42bf-a4fa-760d99c7f089", "name": "network-vif-plugged", "status": "completed", "tag": "0e878ffd-3794-490d-b85a-4c89ebdf0a31"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:06.555506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2fb576c0-3e90-4bdd-8b8e-2588b2d80793 req-2e9c466f-768f-406c-aa96-e6c2622400bc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:06.556191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2fb576c0-3e90-4bdd-8b8e-2588b2d80793 req-2e9c466f-768f-406c-aa96-e6c2622400bc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:06.556728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2fb576c0-3e90-4bdd-8b8e-2588b2d80793 req-2e9c466f-768f-406c-aa96-e6c2622400bc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:06.571258 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2fb576c0-3e90-4bdd-8b8e-2588b2d80793 req-2e9c466f-768f-406c-aa96-e6c2622400bc service nova] Creating event network-vif-plugged:0e878ffd-3794-490d-b85a-4c89ebdf0a31 for instance e3395b13-8f84-42bf-a4fa-760d99c7f089 on n-h2-853316-12 Oct 17 12:49:06.578567 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2fb576c0-3e90-4bdd-8b8e-2588b2d80793 req-2e9c466f-768f-406c-aa96-e6c2622400bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.891745 Oct 17 12:49:06.585483 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 76/129] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:06.945599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:06.946415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:06.958942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:06.959567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:06.960108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:06.969440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:06.970031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:06.970741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:07.804344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:07.825027 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-192b0529-45c4-405f-a777-df5d60bece70 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.885524 Oct 17 12:49:07.854153 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 54/130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:06 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:08.167228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Action: 'update', calling method: .version_select at 0x7fa821a11af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:08.174144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.174842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.175702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.209851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.234118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.235916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.253637 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] HTTP exception thrown: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Request method failure captured: Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7 HTTP/1.1 Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 56 Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9DWzlXAvDjpUpcAxgc8pRJHU7XEbSJNtZKLkxKch_0o86DVatnmlrwjouok0OqbSOp_hv-dDtMSlnYtjPfXppU0pYp73F-DcohzmtrbN1QjFZ5BTNxF8gOT2B0rMNZEAoxHcMI5WsZNfHJTy32zCmaAanJED7uAL4W3nG9SJt-liY Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: d3582216692a46fc845b8f0b3958b019 Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:49:08.258690 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3582216692a46fc845b8f0b3958b019", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: d3582216692a46fc845b8f0b3958b019 Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 8686763c58a04a909c5ab4d75ff9ac6d Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:08.260063 n-d-853316-12 devstack@n-api.service[127540]: exception: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '09af6a8e-d270-4884-b8b0-072292b2cff7', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.260910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:08.264395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:08.265818 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:08.265818 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.265818 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.269536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Returning 404 to user: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:08.273226 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f3265f3-0d40-43a7-a5ca-b000bb0fb878 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7" status: 404 len: 110 microversion: 2.53 time: 0.767748 Oct 17 12:49:08.302705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Action: 'update', calling method: .version_select at 0x7fa821be68b0>, body: {"status": "disabled"} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:08.308014 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 77/131] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 17 12:49:07 2022] PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7 => generated 110 bytes in 803 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:49:08.312332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.312835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.314359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.332461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.333494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.334637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.347537 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] HTTP exception thrown: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Request method failure captured: Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: request: PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7 HTTP/1.1 Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 22 Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9DWzlXAvDjpUpcAxgc8pRJHU7XEbSJNtZKLkxKch_0o86DVatnmlrwjouok0OqbSOp_hv-dDtMSlnYtjPfXppU0pYp73F-DcohzmtrbN1QjFZ5BTNxF8gOT2B0rMNZEAoxHcMI5WsZNfHJTy32zCmaAanJED7uAL4W3nG9SJt-liY Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: d3582216692a46fc845b8f0b3958b019 Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:08.350548 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3582216692a46fc845b8f0b3958b019", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: d3582216692a46fc845b8f0b3958b019 Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 8686763c58a04a909c5ab4d75ff9ac6d Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: {"status": "disabled"} Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: exception: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.352032 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '09af6a8e-d270-4884-b8b0-072292b2cff7', 'body': {'status': 'disabled'}} Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.353039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:08.354431 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:08.355640 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.355640 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.356914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Returning 404 to user: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:08.360864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7662a639-d334-480c-a2d5-78be0aea0691 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7" status: 404 len: 110 microversion: 2.53 time: 0.073671 Oct 17 12:49:08.361520 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 55/132] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 17 12:49:08 2022] PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7 => generated 110 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:49:08.375096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Action: 'update', calling method: .version_select at 0x7fa821a11b80>, body: {"status": "enabled"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:08.379904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.380781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.381522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.398733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.401122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.413024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.432842 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] HTTP exception thrown: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Request method failure captured: Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7 HTTP/1.1 Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 21 Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9DWzlXAvDjpUpcAxgc8pRJHU7XEbSJNtZKLkxKch_0o86DVatnmlrwjouok0OqbSOp_hv-dDtMSlnYtjPfXppU0pYp73F-DcohzmtrbN1QjFZ5BTNxF8gOT2B0rMNZEAoxHcMI5WsZNfHJTy32zCmaAanJED7uAL4W3nG9SJt-liY Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: d3582216692a46fc845b8f0b3958b019 Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:49:08.437492 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3582216692a46fc845b8f0b3958b019", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3582216692a46fc845b8f0b3958b019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: d3582216692a46fc845b8f0b3958b019 Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467 Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 8686763c58a04a909c5ab4d75ff9ac6d Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: {"status": "enabled"} Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: exception: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.438963 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '09af6a8e-d270-4884-b8b0-072292b2cff7', 'body': {'status': 'enabled'}} Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.439679 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:08.440912 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:08.442773 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. Oct 17 12:49:08.442773 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:08.447660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Returning 404 to user: Service 09af6a8e-d270-4884-b8b0-072292b2cff7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:08.448849 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-395504b4-5146-4339-9683-0b5ef0889a85 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7" status: 404 len: 110 microversion: 2.53 time: 0.078688 Oct 17 12:49:08.458101 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 78/133] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 17 12:49:08 2022] PUT /compute/v2.1/os-services/09af6a8e-d270-4884-b8b0-072292b2cff7 => generated 110 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:49:08.467668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e4ae9c6-8b1d-472d-a1ce-356b3a731401 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:08.471174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e4ae9c6-8b1d-472d-a1ce-356b3a731401 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.471661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e4ae9c6-8b1d-472d-a1ce-356b3a731401 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.478979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e4ae9c6-8b1d-472d-a1ce-356b3a731401 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.481776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e4ae9c6-8b1d-472d-a1ce-356b3a731401 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.482319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e4ae9c6-8b1d-472d-a1ce-356b3a731401 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.482770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e4ae9c6-8b1d-472d-a1ce-356b3a731401 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.599299 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e4ae9c6-8b1d-472d-a1ce-356b3a731401 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.113907 Oct 17 12:49:08.609939 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 56/134] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 17 12:49:08 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:08.617318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc3ddd26-d402-454d-a290-a5503133ab80 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:08.624579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc3ddd26-d402-454d-a290-a5503133ab80 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.625398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc3ddd26-d402-454d-a290-a5503133ab80 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.626203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc3ddd26-d402-454d-a290-a5503133ab80 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.639161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc3ddd26-d402-454d-a290-a5503133ab80 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.641879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc3ddd26-d402-454d-a290-a5503133ab80 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.642843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc3ddd26-d402-454d-a290-a5503133ab80 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.760818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc3ddd26-d402-454d-a290-a5503133ab80 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.149423 Oct 17 12:49:08.765241 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 79/135] 10.222.0.27 () {60 vars in 1211 bytes} [Mon Oct 17 12:49:08 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:49:08.797591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b741eb37-e990-4430-ad04-4bb7825ddd0d tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:08.812170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b741eb37-e990-4430-ad04-4bb7825ddd0d tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.813239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b741eb37-e990-4430-ad04-4bb7825ddd0d tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.814671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b741eb37-e990-4430-ad04-4bb7825ddd0d tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.817063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b741eb37-e990-4430-ad04-4bb7825ddd0d tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.819242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b741eb37-e990-4430-ad04-4bb7825ddd0d tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.819896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b741eb37-e990-4430-ad04-4bb7825ddd0d tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.873704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:08.888671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:08.909322 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b741eb37-e990-4430-ad04-4bb7825ddd0d tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.133313 Oct 17 12:49:08.916858 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 57/136] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 17 12:49:08 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:08.920923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.924443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.926843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.928770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.930901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.933985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.938774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84eb0376-fe77-4459-ab67-7f2245a89b43 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:08.952548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84eb0376-fe77-4459-ab67-7f2245a89b43 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.954035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84eb0376-fe77-4459-ab67-7f2245a89b43 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.964035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84eb0376-fe77-4459-ab67-7f2245a89b43 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:08.965084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84eb0376-fe77-4459-ab67-7f2245a89b43 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:08.965645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84eb0376-fe77-4459-ab67-7f2245a89b43 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:08.968064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84eb0376-fe77-4459-ab67-7f2245a89b43 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:09.062116 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84eb0376-fe77-4459-ab67-7f2245a89b43 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-853316-12&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.133577 Oct 17 12:49:09.074802 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 58/137] 10.222.0.27 () {60 vars in 1237 bytes} [Mon Oct 17 12:49:08 2022] GET /compute/v2.1/os-services?host=n-d-853316-12&binary=xxx => generated 16 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:09.081394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-05a27f61-35ea-44e9-8f3f-0fc41af9bd2e tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:09.088863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a27f61-35ea-44e9-8f3f-0fc41af9bd2e tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:09.092026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a27f61-35ea-44e9-8f3f-0fc41af9bd2e tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:09.092488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a27f61-35ea-44e9-8f3f-0fc41af9bd2e tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:09.093743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a27f61-35ea-44e9-8f3f-0fc41af9bd2e tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:09.095567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a27f61-35ea-44e9-8f3f-0fc41af9bd2e tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:09.096008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a27f61-35ea-44e9-8f3f-0fc41af9bd2e tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:09.149741 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-05a27f61-35ea-44e9-8f3f-0fc41af9bd2e tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.073653 Oct 17 12:49:09.150683 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 59/138] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 17 12:49:09 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:09.381474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:09.397929 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe41ab04-17ac-48fa-bfb3-c9920b3a1d2b tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1335 microversion: 2.1 time: 0.537958 Oct 17 12:49:09.414050 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 80/139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:08 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1335 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:09.439493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-63247f8e-9994-4efa-bbd5-5c665b48d361 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:09.443930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63247f8e-9994-4efa-bbd5-5c665b48d361 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:09.444416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63247f8e-9994-4efa-bbd5-5c665b48d361 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:09.444851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63247f8e-9994-4efa-bbd5-5c665b48d361 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:09.452922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63247f8e-9994-4efa-bbd5-5c665b48d361 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:09.454791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63247f8e-9994-4efa-bbd5-5c665b48d361 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:09.455248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63247f8e-9994-4efa-bbd5-5c665b48d361 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:09.523662 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-63247f8e-9994-4efa-bbd5-5c665b48d361 tempest-ServicesAdminNegativeV253TestJSON-783593467 tempest-ServicesAdminNegativeV253TestJSON-783593467-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.105987 Oct 17 12:49:09.525205 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 81/140] 10.222.0.27 () {60 vars in 1239 bytes} [Mon Oct 17 12:49:09 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:09.758514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-141ff7b6-5e80-444c-83a0-c3696e1b9a4a tempest-FlavorMetadataValidation-954540417 tempest-FlavorMetadataValidation-954540417-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1685652017", "id": 1290915977, "os-flavor-access:is_public": "True"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:09.825478 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-141ff7b6-5e80-444c-83a0-c3696e1b9a4a tempest-FlavorMetadataValidation-954540417 tempest-FlavorMetadataValidation-954540417-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.664335 Oct 17 12:49:09.827829 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 60/141] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:49:09 2022] POST /compute/v2.1/flavors => generated 471 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:49:09.845375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-601b4e95-5f16-44f3-993e-72629253b4d7 tempest-FlavorMetadataValidation-954540417 tempest-FlavorMetadataValidation-954540417-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:10.088707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-969c3dcb-91d3-40d7-93c8-95a331fe1c37 tempest-ServicesAdminNegativeV253TestJSON-701085960 tempest-ServicesAdminNegativeV253TestJSON-701085960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:10.098526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-969c3dcb-91d3-40d7-93c8-95a331fe1c37 tempest-ServicesAdminNegativeV253TestJSON-701085960 tempest-ServicesAdminNegativeV253TestJSON-701085960-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b1ee803d477745919edd2c4788f439d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1daa6bc288d4c4288caa785454ca1ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-969c3dcb-91d3-40d7-93c8-95a331fe1c37 tempest-ServicesAdminNegativeV253TestJSON-701085960 tempest-ServicesAdminNegativeV253TestJSON-701085960-project] Request method failure captured: Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9BzRL8MTVr4-5-yAGTJTJbrhTaGKll99vUyvI6_pfR0d6wM12p7hUVkIK9XUyokIfaCdpjdCNoCbZd3Miz5OfxRMP_qdUyUvczzhJZOOs6ZUg11WV_I7ANmW2GuiBdMlwfh0QivI0fp_o6avgAZ3V9Uo7Hi2bKDSlVrdvrqhPJaC0 Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b1daa6bc288d4c4288caa785454ca1ef Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-701085960 Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:10.102746 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b1daa6bc288d4c4288caa785454ca1ef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b1daa6bc288d4c4288caa785454ca1ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b1daa6bc288d4c4288caa785454ca1ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b1daa6bc288d4c4288caa785454ca1ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-701085960 Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b1daa6bc288d4c4288caa785454ca1ef Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-701085960 Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServicesAdminNegativeV253TestJSON-701085960-project Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: b1ee803d477745919edd2c4788f439d2 Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-701085960-project Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 12:49:10.104039 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:10.104699 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 12:49:10.105796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:10.116640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-969c3dcb-91d3-40d7-93c8-95a331fe1c37 tempest-ServicesAdminNegativeV253TestJSON-701085960 tempest-ServicesAdminNegativeV253TestJSON-701085960-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:10.117802 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-969c3dcb-91d3-40d7-93c8-95a331fe1c37 tempest-ServicesAdminNegativeV253TestJSON-701085960 tempest-ServicesAdminNegativeV253TestJSON-701085960-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.584703 Oct 17 12:49:10.119282 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 82/142] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 17 12:49:09 2022] GET /compute/v2.1/os-services => generated 112 bytes in 587 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:49:10.344183 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-601b4e95-5f16-44f3-993e-72629253b4d7 tempest-FlavorMetadataValidation-954540417 tempest-FlavorMetadataValidation-954540417-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1290915977/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.501361 Oct 17 12:49:10.351987 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 61/143] 10.222.0.27 () {62 vars in 1265 bytes} [Mon Oct 17 12:49:09 2022] POST /compute/v2.1/flavors/1290915977/os-extra_specs => generated 62 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:10.362912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4611ee11-191c-4024-b06b-6bf8484da5c3 tempest-FlavorMetadataValidation-954540417 tempest-FlavorMetadataValidation-954540417-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:10.418189 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4611ee11-191c-4024-b06b-6bf8484da5c3 tempest-FlavorMetadataValidation-954540417 tempest-FlavorMetadataValidation-954540417-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1290915977" status: 202 len: 0 microversion: 2.86 time: 0.064044 Oct 17 12:49:10.419192 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 83/144] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Oct 17 12:49:10 2022] DELETE /compute/v2.1/flavors/1290915977 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:49:10.429940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ecab613-ed0a-4b26-9d0d-68e4b7d3ccf5 tempest-FlavorMetadataValidation-954540417 tempest-FlavorMetadataValidation-954540417-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:10.431631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:10.433372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:10.452646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:10.453394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:10.454000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:10.454924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:10.458917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:10.459546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:10.540747 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ecab613-ed0a-4b26-9d0d-68e4b7d3ccf5 tempest-FlavorMetadataValidation-954540417 tempest-FlavorMetadataValidation-954540417-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6671 microversion: 2.86 time: 0.115139 Oct 17 12:49:10.545155 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 62/145] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 17 12:49:10 2022] GET /compute/v2.1/flavors/detail => generated 6671 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:11.196267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:11.208995 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0f22de6-7a1f-4a4d-8263-89ed5b48eb2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1485 microversion: 2.1 time: 0.782640 Oct 17 12:49:11.212834 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 84/146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:10 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1485 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:11.234059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:11.234712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:11.243624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:11.247231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:11.249002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:11.249965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:11.251141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:11.252446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:12.477142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1382880189", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "744708008", "adminPass": "***", "networks": [{"uuid": "ce06c3ed-b170-48a1-b300-59d26acfca9a"}], "security_groups": [{"name": "tempest-securitygroup--147241734"}], "key_name": "tempest-keypair-633989678", "user_data": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:12.795415 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4f2dbc7-2d63-4d0f-9359-059c3778b4ba tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1638 microversion: 2.1 time: 1.565088 Oct 17 12:49:12.797888 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 63/147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:11 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1638 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:12.890386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] validate_networks() for [('ce06c3ed-b170-48a1-b300-59d26acfca9a', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:13.358677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1071799765", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "fcc08196-2783-4add-8c4f-1228d3a30562"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:13.502474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] validate_networks() for [('fcc08196-2783-4add-8c4f-1228d3a30562', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:15.186377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:15.187793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:15.188548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:15.189188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:15.189901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:15.204550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:15.205292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:15.206177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:15.207927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:15.208583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:15.209425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:15.242544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Getting quotas for project 36f5a2ad7f31447fbbaca288ea3b0580. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:15.249906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Getting quotas for user 6a8004505d9c4554b2ea1ded5014c51f and project 36f5a2ad7f31447fbbaca288ea3b0580. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:15.283267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:15.286357 n-d-853316-12 devstack@n-api.service[127539]: WARNING nova.utils [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1071799765 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-107179976 Oct 17 12:49:15.287479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:15.327691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:15.328381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:15.328762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:15.329174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:15.329808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:15.359463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:15.359954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:15.361025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:15.366799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-caddb495-df89-4239-9058-d6028c75140b tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.557311 Oct 17 12:49:15.368166 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 64/148] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:49:15.380978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:15.381947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:15.386298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:15.386786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:15.387224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:15.391930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:15.392787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:15.393940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:15.395401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:15.396270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:15.396922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:15.432427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:49:15.484004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Getting quotas for project 18e42d050ee6400786fb16b79e54355b. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:15.542193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Getting quotas for user 68dd6904cebc42b48e4f421267cafd9d and project 18e42d050ee6400786fb16b79e54355b. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:15.603014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:15.606543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:15.644082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "compute-rpcapi-router" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:49:15.645115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcbf18c-83dd-4c98-862c-427581552007 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquired lock "compute-rpcapi-router" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:49:15.646811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:15.647307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:15.647749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:15.648583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:15.660891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:15.661419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:15.687311 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.rpcapi [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 12:49:15.688441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] Releasing lock "compute-rpcapi-router" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:49:15.731142 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cea87fba-49e6-419f-8757-154ef05c82ca tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.260573 Oct 17 12:49:15.739697 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 85/149] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 3270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:49:15.782703 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac7ae6d3-26ef-466f-8c64-2c1092ec185d None None] 10.222.0.27 "DELETE /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 204 len: 0 microversion: 2.1 time: 0.412496 Oct 17 12:49:15.784480 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 65/150] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:49:15 2022] DELETE /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:49:15.796074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-01345cf7-ddb5-4438-9552-92550b25e2fc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:15.801305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-01345cf7-ddb5-4438-9552-92550b25e2fc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:16.020485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01345cf7-ddb5-4438-9552-92550b25e2fc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:16.053958 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-01345cf7-ddb5-4438-9552-92550b25e2fc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1232 microversion: 2.1 time: 0.267839 Oct 17 12:49:16.054599 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 66/151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:15 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1232 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:16.104472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d19240b1-0000-477c-998a-d1b30d59cf0a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:16.105420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d19240b1-0000-477c-998a-d1b30d59cf0a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:16.245578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d19240b1-0000-477c-998a-d1b30d59cf0a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:16.253411 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d19240b1-0000-477c-998a-d1b30d59cf0a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1262 microversion: 2.1 time: 0.153835 Oct 17 12:49:16.257806 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 67/152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:16 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1262 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:16.273868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:16.274546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:16.290062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-104377372", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:16.309627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:16.310324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:16.310780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:16.311598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:16.314189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:16.314657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:16.445140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:16.647989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:16.656334 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3fa0d1e4-392d-40f3-b8f0-d319ce5d8b15 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1491 microversion: 2.1 time: 0.397254 Oct 17 12:49:16.659237 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 68/153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:16 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1491 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:17.086071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44232829-e6f9-4188-ba3b-df95db585f8f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:17.087079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44232829-e6f9-4188-ba3b-df95db585f8f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:17.193909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44232829-e6f9-4188-ba3b-df95db585f8f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:17.207470 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44232829-e6f9-4188-ba3b-df95db585f8f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1232 microversion: 2.1 time: 0.128517 Oct 17 12:49:17.210227 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 69/154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:17 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1232 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:17.284156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:17.284774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:17.297023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:17.297592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:17.305046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:17.306069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:17.306571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:17.307001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:17.433477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:17.467949 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d599ff37-2031-44f0-bb88-c2a594aa8a17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1258 microversion: 2.1 time: 0.188699 Oct 17 12:49:17.474734 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 70/155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:17 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1258 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:17.635085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:17.635583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:17.635964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:17.636368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:17.636819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:17.651227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:17.655180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:17.655593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:17.658445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:17.658916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:17.659348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:17.687238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:17.687859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:17.708988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:17.720608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:17.722147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:17.724516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:17.731291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:17.732926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:17.767068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Getting quotas for project d15166b17a404da4a671e1b992369d66. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:17.774114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Getting quotas for user 046bb953acb24208b3f458872e030eae and project d15166b17a404da4a671e1b992369d66. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:17.828937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:17.841481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:17.933666 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2cc84266-b6d9-4dfe-b5b2-39e3e81303e0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.192146 Oct 17 12:49:17.937490 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 86/156] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:49:17.950067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e347be6f-d6ce-4430-a34c-3557fb47162f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:17.951610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e347be6f-d6ce-4430-a34c-3557fb47162f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:18.032671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:18.041169 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b7c516c-7529-4173-85e4-69950f9fdca8 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1491 microversion: 2.1 time: 0.358298 Oct 17 12:49:18.043496 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 71/157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:17 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1491 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:18.234080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:18.234771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:18.252659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:18.253173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:18.259149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:18.259991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:18.261179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:18.261619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:18.527367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e347be6f-d6ce-4430-a34c-3557fb47162f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:18.559378 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e347be6f-d6ce-4430-a34c-3557fb47162f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1218 microversion: 2.1 time: 0.614181 Oct 17 12:49:18.563017 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 87/158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:17 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1218 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:18.567687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:18.574669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:18.576357 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-916db551-5fd2-41f4-b421-9858d79ab8d3 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1284 microversion: 2.1 time: 0.347356 Oct 17 12:49:18.578777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:18.583070 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 72/159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:18 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:18.612683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:18.616273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:18.618447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:18.621014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:18.621763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:18.622426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:19.013750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:19.052968 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e454e232-89a1-482a-84f2-946dd10bb3fb tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1332 microversion: 2.1 time: 0.488131 Oct 17 12:49:19.054267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 88/160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:18 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1332 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:19.072343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:19.073404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:19.088079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:19.088923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:19.089591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:19.090523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:19.091650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:19.092301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:19.430487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8af569a7-854a-4031-ad1b-62b5c24eb018 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:19.435376 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-8af569a7-854a-4031-ad1b-62b5c24eb018 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8af569a7-854a-4031-ad1b-62b5c24eb018 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398-project-admin] Request method failure captured: Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9O2Ak9v7hR-h-scUSXhGEgtGU0oEpnqkcjRXwQuoyjzcOIWMRQcVNXJ9HGpncnF7EAReALfbnv6fy1wBGUvuzUVvWBk09W8J4h0RsoK3ef64vJCE6peSJQv49oFkwc6mFUTiYxD23_NxZ9lx1otgrYEz642qLnXQKWTCVBBx1geNg Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: bff1ff37caaa4cfe8102306f2b9a0921 Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398 Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:19.454382 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bff1ff37caaa4cfe8102306f2b9a0921", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bff1ff37caaa4cfe8102306f2b9a0921"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bff1ff37caaa4cfe8102306f2b9a0921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bff1ff37caaa4cfe8102306f2b9a0921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398 Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: bff1ff37caaa4cfe8102306f2b9a0921 Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398 Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398-project-admin Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4e641b618e0449a48a7bae9d16b03f2d Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398-project-admin Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:19.455863 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid timestamp for date invalid_time Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'invalid_time'} Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:19.456539 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 17 12:49:19.457974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:19.461160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8af569a7-854a-4031-ad1b-62b5c24eb018 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:19.464077 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8af569a7-854a-4031-ad1b-62b5c24eb018 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398 tempest-InstanceUsageAuditLogNegativeTestJSON-2117040398-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.440349 Oct 17 12:49:19.467298 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 73/161] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 17 12:49:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 444 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:49:19.830074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-651bb946-6d96-4736-810b-a65911108b11 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:19.832364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-651bb946-6d96-4736-810b-a65911108b11 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5dac828dff15481fa1583caf6cae19f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edafc3190724089be2f1c021931b9f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-651bb946-6d96-4736-810b-a65911108b11 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] Request method failure captured: Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9NcAt3sGG1Qja_tGhSJ4tLd1dQqHjmZxvyZOVxHEMgm-mbNnVWgjdAkN89obJjPNOLDIrlsNzZQvzc4ynQ1QQHhW3tyxg6ThOW34mRIg55DRkiQ_2w2pSytDhoo3hbQwLdGJB-y8c2DuY1MyYtKvhdUrFwFCx2frcHkZ7t3Z_vxMs Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 7edafc3190724089be2f1c021931b9f2 Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:19.834055 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7edafc3190724089be2f1c021931b9f2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7edafc3190724089be2f1c021931b9f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7edafc3190724089be2f1c021931b9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7edafc3190724089be2f1c021931b9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 7edafc3190724089be2f1c021931b9f2 Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 5dac828dff15481fa1583caf6cae19f8 Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project Oct 17 12:49:19.835478 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: action_args: {} Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:19.836167 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 12:49:19.837232 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:19.844911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-651bb946-6d96-4736-810b-a65911108b11 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:19.846354 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-651bb946-6d96-4736-810b-a65911108b11 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.369953 Oct 17 12:49:19.853932 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 74/162] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 17 12:49:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 379 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:20.146657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:20.149272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:20.156712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:20.157479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:20.158149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:20.159024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:20.159675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:20.163257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:20.220788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:20.357657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:20.365947 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-96d3cad1-27ae-498a-8740-2fa10676281f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1292 microversion: 2.1 time: 0.510849 Oct 17 12:49:20.370785 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 75/163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:19 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1292 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:20.403308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:20.409538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:20.436282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:20.436984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:20.437521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:20.438399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:20.439078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:20.439555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:20.553111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:20.568567 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c770ce7-78e3-4d40-8f70-3bafcd5e76b2 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1491 microversion: 2.1 time: 1.499916 Oct 17 12:49:20.571158 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 89/164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:19 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1491 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:20.586137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f42ba7b-5c77-4234-9426-107759a74df7 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:20.594218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5f42ba7b-5c77-4234-9426-107759a74df7 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5dac828dff15481fa1583caf6cae19f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edafc3190724089be2f1c021931b9f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f42ba7b-5c77-4234-9426-107759a74df7 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] Request method failure captured: Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2012:49:19 HTTP/1.1 Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9NcAt3sGG1Qja_tGhSJ4tLd1dQqHjmZxvyZOVxHEMgm-mbNnVWgjdAkN89obJjPNOLDIrlsNzZQvzc4ynQ1QQHhW3tyxg6ThOW34mRIg55DRkiQ_2w2pSytDhoo3hbQwLdGJB-y8c2DuY1MyYtKvhdUrFwFCx2frcHkZ7t3Z_vxMs Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7edafc3190724089be2f1c021931b9f2 Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:20.597413 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7edafc3190724089be2f1c021931b9f2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7edafc3190724089be2f1c021931b9f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7edafc3190724089be2f1c021931b9f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7edafc3190724089be2f1c021931b9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7edafc3190724089be2f1c021931b9f2 Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 5dac828dff15481fa1583caf6cae19f8 Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project Oct 17 12:49:20.598996 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '2022-10-17 12:49:19'} Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:20.599550 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 12:49:20.600629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:20.606422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f42ba7b-5c77-4234-9426-107759a74df7 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:20.606543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:20.607787 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f42ba7b-5c77-4234-9426-107759a74df7 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511 tempest-InstanceUsageAuditLogNegativeTestJSON-1824449511-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17 12:49:19" status: 403 len: 128 microversion: 2.1 time: 0.034878 Oct 17 12:49:20.608636 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 90/165] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 12:49:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2012%3A49%3A19 => generated 128 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:20.616831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:20.617815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:20.621557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=7,nova_api:INSERT=9 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:20.622460 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c136713b-a0ed-4562-bab6-93e10e7ceea6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1297 microversion: 2.1 time: 0.250237 Oct 17 12:49:20.630925 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 76/166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:20 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1297 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:20.633549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:20.634292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:20.635334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:20.636449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:20.637258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:20.637911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:20.654730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-df9d61bf-3f9a-4efe-b08d-720101d669ce req-f371ceb6-d122-45c5-ae33-66bb58c4e529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3395b13-8f84-42bf-a4fa-760d99c7f089", "name": "network-vif-deleted", "tag": "0e878ffd-3794-490d-b85a-4c89ebdf0a31"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:20.660368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:20.705183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-df9d61bf-3f9a-4efe-b08d-720101d669ce req-f371ceb6-d122-45c5-ae33-66bb58c4e529 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:20.714773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-df9d61bf-3f9a-4efe-b08d-720101d669ce req-f371ceb6-d122-45c5-ae33-66bb58c4e529 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:20.715281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-df9d61bf-3f9a-4efe-b08d-720101d669ce req-f371ceb6-d122-45c5-ae33-66bb58c4e529 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:20.771020 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-df9d61bf-3f9a-4efe-b08d-720101d669ce req-f371ceb6-d122-45c5-ae33-66bb58c4e529 service nova] Creating event network-vif-deleted:0e878ffd-3794-490d-b85a-4c89ebdf0a31 for instance e3395b13-8f84-42bf-a4fa-760d99c7f089 on n-h2-853316-12 Oct 17 12:49:20.790643 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-df9d61bf-3f9a-4efe-b08d-720101d669ce req-f371ceb6-d122-45c5-ae33-66bb58c4e529 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155851 Oct 17 12:49:20.793507 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 77/167] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:20.948758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:20.965745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9a8dd712-781e-4817-b9f4-3fcc66461169 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1320 microversion: 2.1 time: 0.353035 Oct 17 12:49:20.969304 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 91/168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:20 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1320 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:21.404750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:21.406602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:21.427317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:21.427836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:21.428288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:21.429113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:21.429464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:21.429895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:21.605241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:21.606010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:21.641590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:21.642558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:21.644147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:21.645879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:21.648052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:21.649845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:21.713691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:21.727411 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb1705de-02ba-4c10-8783-04eedc8100db tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1292 microversion: 2.1 time: 0.330610 Oct 17 12:49:21.728009 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 78/169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:21 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1292 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:21.763575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:21.764108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:21.775896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:21.776763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:21.777964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:21.778931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lazy-loading 'fault' on Instance uuid e3395b13-8f84-42bf-a4fa-760d99c7f089 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:49:21.788839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:21.792121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:21.792896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:21.795247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:21.795937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:21.798234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:22.014628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630ed82be6054e91a63816cf766b91bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685b8feeef624944864f7e7a937256c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:22.025529 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-915a43be-746d-4d8a-af14-1e292821f60e tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 200 len: 1325 microversion: 2.1 time: 0.424954 Oct 17 12:49:22.029104 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 92/170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:21 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 1325 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:22.042029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:22.042934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:22.059104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:22.059915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:22.060587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:22.062648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:22.063414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:22.064314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:22.379823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:22.392533 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-301f7a7a-d680-47ef-ac14-f0c3825a347e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1295 microversion: 2.1 time: 0.640053 Oct 17 12:49:22.393142 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 79/171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:21 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1295 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:22.558680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:22.574273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-10005cbc-e7a0-4394-a0ad-2e128df00bc1 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.540269 Oct 17 12:49:22.575235 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 93/172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:22 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:22.754881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:22.757684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:22.774339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:22.777114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:22.778031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:22.779557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:22.780033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:22.780778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:22.921245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:22.934019 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5a604af8-a819-4261-ac6a-4976082e6e06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1292 microversion: 2.1 time: 0.184790 Oct 17 12:49:22.935916 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 80/173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:22 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:23.055141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:23.056325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:23.070183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:23.071320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:23.071759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:23.072482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:23.072942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:23.073370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:23.111232 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] HTTP exception thrown: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Request method failure captured: Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 HTTP/1.1 Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8ejenTtPT-qFtXCjV4dKpCoYn483CRBKyb_CUn3f-lMLA9rQKrdvRWorMO3nTOquCknQVqh2yEnukfSJfxUIqIkHy2UVEKF4QlZNiBrn4KmR7z-1TwiiuV4ylCRBJjpU9aeZSYt0WfYWh0K7HrIEUeqjMSIJl7YghAip4jywQFLfc Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 685b8feeef624944864f7e7a937256c3 Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:23.121488 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_685b8feeef624944864f7e7a937256c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/685b8feeef624944864f7e7a937256c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/685b8feeef624944864f7e7a937256c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/685b8feeef624944864f7e7a937256c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 685b8feeef624944864f7e7a937256c3 Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AggregatesAdminTestJSON-2042486034-project Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 630ed82be6054e91a63816cf766b91bf Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AggregatesAdminTestJSON-2042486034-project Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:23.122659 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e3395b13-8f84-42bf-a4fa-760d99c7f089'} Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:23.123410 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:23.124430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:23.125332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Returning 404 to user: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:23.125332 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a48e2ece-3e1d-4b1e-8fca-b927aed80e93 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 404 len: 111 microversion: 2.1 time: 0.072942 Oct 17 12:49:23.137105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1ba61799-11c1-4a80-a6de-7eef8265fc98 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:23.145840 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 94/174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:23 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:23.159745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ba61799-11c1-4a80-a6de-7eef8265fc98 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:23.160920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ba61799-11c1-4a80-a6de-7eef8265fc98 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:23.161534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ba61799-11c1-4a80-a6de-7eef8265fc98 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:23.419802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:23.421342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:23.446752 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1ba61799-11c1-4a80-a6de-7eef8265fc98 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 293 microversion: 2.1 time: 0.317699 Oct 17 12:49:23.459602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:23.463635 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 81/175] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:49:23 2022] POST /compute/v2.1/os-aggregates/1/action => generated 293 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:49:23.464291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:23.464854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:23.469528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:23.470074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:23.473124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:23.475668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7acb1ad4-dab3-48e5-8eaf-fadf9f4576db tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:23.521315 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7acb1ad4-dab3-48e5-8eaf-fadf9f4576db tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.055402 Oct 17 12:49:23.522176 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 82/176] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:23 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:23.550980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3dc0a7b-730f-43fd-8e76-df41e0eb980d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-504613387"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:23.570650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-b3dc0a7b-730f-43fd-8e76-df41e0eb980d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid e9156194-f9eb-4ee0-8684-d4fde5125d98 for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:23.631045 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b3dc0a7b-730f-43fd-8e76-df41e0eb980d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.085207 Oct 17 12:49:23.637331 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 83/177] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:49:23.643402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:23.645227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:23.653454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:23.654508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:23.655320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:23.656351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:23.656991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:23.657609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:23.975207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:23.989154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:23.990809 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a875ea2-3f2d-4882-a7ba-8e4c5ed5acf5 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1276 microversion: 2.1 time: 0.575367 Oct 17 12:49:24.002185 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 95/178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:23 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1276 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:24.006754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-352dfc41-54c6-4d3b-9b4e-a89d2821329e tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:24.013412 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55441f7b-8a56-4d61-81fd-0665d0c179ce tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.372723 Oct 17 12:49:24.024323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352dfc41-54c6-4d3b-9b4e-a89d2821329e tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:24.025245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352dfc41-54c6-4d3b-9b4e-a89d2821329e tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:24.025689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352dfc41-54c6-4d3b-9b4e-a89d2821329e tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:24.027171 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 84/179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:23 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:24.292971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-339632571", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e9442b7e-a211-428d-b994-b659608d7553"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:24.424749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] validate_networks() for [('e9442b7e-a211-428d-b994-b659608d7553', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:24.881061 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-352dfc41-54c6-4d3b-9b4e-a89d2821329e tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.887517 Oct 17 12:49:24.881655 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 96/180] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:49:23 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:24.889073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:24.890868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:24.903030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:24.904142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:24.904827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:24.905997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:24.906637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:24.907215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:25.143975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:25.145538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:25.146236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:25.147309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:25.147950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:25.158708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:25.159365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:25.160623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:25.161452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:25.162253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:25.162750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:25.189971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for project c964bbec50ba4a2480831a33d6a935c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:25.195342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for user 8dfeceb58cdd47b8b82d905614ba3d5b and project c964bbec50ba4a2480831a33d6a935c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:25.209198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:25.212339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:25.226202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:25.242400 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d8ffc6d-a070-45a3-96de-cb587c5ce503 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1292 microversion: 2.1 time: 0.351395 Oct 17 12:49:25.243058 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 97/181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:24 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1292 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:25.247555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e4e967d-bf47-4a7d-8937-2a54e4de5c1b tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:25.264245 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e4e967d-bf47-4a7d-8937-2a54e4de5c1b tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.019971 Oct 17 12:49:25.264825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 98/182] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:49:25 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:25.269311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:25.281550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:25.288098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:25.288784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:25.290189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:25.294484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:25.295138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:25.295721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:25.310880 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d951b7b-0813-4c1b-96ea-612afec6bad1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.282441 Oct 17 12:49:25.311582 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 85/183] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 12:49:25.345466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:25.348609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:25.360510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:25.361918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:25.362567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:25.364192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:25.365476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:25.366075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:25.664394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:25.674092 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e97178f4-6bbc-425d-823f-da3ef78b4a1e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.349800 Oct 17 12:49:25.678191 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 86/184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:25 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:25.689413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-067a988a-421d-43c7-b799-62f2425af404 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:25.717893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-067a988a-421d-43c7-b799-62f2425af404 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:25.718725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-067a988a-421d-43c7-b799-62f2425af404 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:25.719324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-067a988a-421d-43c7-b799-62f2425af404 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:25.868346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:25.877995 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbf393eb-17cd-4d03-970c-29b2779a251a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1318 microversion: 2.1 time: 0.612144 Oct 17 12:49:25.885591 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 99/185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:25 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:25.902742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-789cf89a-af41-454d-9ee7-c6297d245f5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:25.903851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-789cf89a-af41-454d-9ee7-c6297d245f5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:25.997807 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-067a988a-421d-43c7-b799-62f2425af404 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.318333 Oct 17 12:49:25.999178 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 87/186] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:49:25 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:26.010855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02f418df-f515-4980-aaa3-97eda1b0009a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:26.056497 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02f418df-f515-4980-aaa3-97eda1b0009a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.048991 Oct 17 12:49:26.057769 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 88/187] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:26 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 17 12:49:26.070719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6863c2bf-4ed3-4cfb-bf1b-8f228084dd1d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2120093185"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:26.083297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-6863c2bf-4ed3-4cfb-bf1b-8f228084dd1d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid 156aef37-155f-49d9-a049-befe27dbf219 for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:26.142155 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6863c2bf-4ed3-4cfb-bf1b-8f228084dd1d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074111 Oct 17 12:49:26.151432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 89/188] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:26.162306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80cd7b0c-b687-4a35-9027-d42d855cf87b tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:26.180129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-789cf89a-af41-454d-9ee7-c6297d245f5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:26.192322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-789cf89a-af41-454d-9ee7-c6297d245f5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:26.193902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cd7b0c-b687-4a35-9027-d42d855cf87b tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:26.194526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cd7b0c-b687-4a35-9027-d42d855cf87b tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:26.194864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cd7b0c-b687-4a35-9027-d42d855cf87b tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:26.196684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-789cf89a-af41-454d-9ee7-c6297d245f5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:26.198779 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-789cf89a-af41-454d-9ee7-c6297d245f5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1261 microversion: 2.25 time: 0.310662 Oct 17 12:49:26.200593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 100/189] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:25 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1261 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:26.280138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:26.280811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:26.306105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:26.306950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:26.307914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:26.308670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:26.309161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:26.309611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:26.540250 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80cd7b0c-b687-4a35-9027-d42d855cf87b tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.386638 Oct 17 12:49:26.549070 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 90/190] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:49:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:26.559162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8bed57d3-2b4d-4965-b079-d09d8e694796 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:26.575428 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8bed57d3-2b4d-4965-b079-d09d8e694796 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.024954 Oct 17 12:49:26.583913 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 91/191] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 12:49:26 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:26.590343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd42bdad-42cf-4f58-a114-1682158544f9 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:26.621019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:26.640027 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4bd9c8d5-da0d-40c2-a7c5-094e9414e7ee tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1292 microversion: 2.1 time: 0.374693 Oct 17 12:49:26.658919 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 101/192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:26 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1292 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:26.669051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd42bdad-42cf-4f58-a114-1682158544f9 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:26.670062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd42bdad-42cf-4f58-a114-1682158544f9 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:26.670939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd42bdad-42cf-4f58-a114-1682158544f9 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:26.713844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:26.714770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:26.722034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:26.723235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:26.723691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:26.730237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:26.730903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:26.731516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:26.922296 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd42bdad-42cf-4f58-a114-1682158544f9 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.336999 Oct 17 12:49:26.926330 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 92/193] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:49:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:26.948686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:26.949451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:26.996122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:26.996624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:26.997065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:27.008255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:27.009793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:27.011541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:27.201680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:27.213033 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9242e717-c9e3-4762-9b08-fd9672b8d3d2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.514464 Oct 17 12:49:27.227005 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 102/194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:26 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:27.248949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd9fd712-dd71-45b3-be07-45033bc2f13c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:27.296892 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd9fd712-dd71-45b3-be07-45033bc2f13c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.062764 Oct 17 12:49:27.297761 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 103/195] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:27 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:27.614475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-303113506", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:27.708731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:27.716821 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bea0b52b-8e29-47f8-a5d2-a1391f048591 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1318 microversion: 2.1 time: 0.789084 Oct 17 12:49:27.736882 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 93/196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:26 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:27.749866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:27.750530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:27.763397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:27.763893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:27.764331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:27.765044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:27.765499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:27.765923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:27.953104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=12 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:28.006136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:28.046276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:28.065787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:28.072342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:28.073800 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44810451-69a2-4a61-a830-00212171c8ec tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1319 microversion: 2.25 time: 0.335752 Oct 17 12:49:28.077175 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 94/197] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:27 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:28.092303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ea60f69-c0dc-4919-a1f2-3e6d439a976f tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-848883280"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:28.096306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-4ea60f69-c0dc-4919-a1f2-3e6d439a976f tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid 8f50817e-69b0-4160-9a78-0589395b35ec for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:28.137179 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ea60f69-c0dc-4919-a1f2-3e6d439a976f tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057899 Oct 17 12:49:28.138395 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 95/198] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:28.143601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:28.144626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:28.152518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.154505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.155072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.156080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.156704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.157237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.313612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:28.328300 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-914d5daf-1f50-41a5-8f04-bd161c5377c2 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1290 microversion: 2.1 time: 0.188631 Oct 17 12:49:28.331742 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 96/199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:28 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1290 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:28.353032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8ddd138e-7b9c-4838-b67d-bf17bb3500b5 req-4a8ba782-d830-4d78-8d7d-cb37862734ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a237d59a-8d0b-478f-9f8e-ea1c63061c75", "tag": "28fe8bdf-d13b-416e-81c1-0e667fee255d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:28.375322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8ddd138e-7b9c-4838-b67d-bf17bb3500b5 req-4a8ba782-d830-4d78-8d7d-cb37862734ce service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.376886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8ddd138e-7b9c-4838-b67d-bf17bb3500b5 req-4a8ba782-d830-4d78-8d7d-cb37862734ce service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.377466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8ddd138e-7b9c-4838-b67d-bf17bb3500b5 req-4a8ba782-d830-4d78-8d7d-cb37862734ce service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.404501 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8ddd138e-7b9c-4838-b67d-bf17bb3500b5 req-4a8ba782-d830-4d78-8d7d-cb37862734ce service nova] Creating event network-changed:28fe8bdf-d13b-416e-81c1-0e667fee255d for instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 on n-h2-853316-12 Oct 17 12:49:28.424337 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8ddd138e-7b9c-4838-b67d-bf17bb3500b5 req-4a8ba782-d830-4d78-8d7d-cb37862734ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077968 Oct 17 12:49:28.425193 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 97/200] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:28.433624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b87dfbf0-beb9-4e4f-868f-b37ccb8b8312 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:28.463707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87dfbf0-beb9-4e4f-868f-b37ccb8b8312 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.464529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87dfbf0-beb9-4e4f-868f-b37ccb8b8312 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.465270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87dfbf0-beb9-4e4f-868f-b37ccb8b8312 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.497380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=7,nova_api:INSERT=7 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:28.639921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:28.640559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:28.642047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:28.643672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:28.646222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:28.663099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.663916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.664538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.665440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.666343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.667302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.682013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:28.710808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Getting quotas for project aaaf8daae8414f86ae4a08bf5422df85. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:28.719637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Getting quotas for user d699c277952547d5ab19a8214961b65e and project aaaf8daae8414f86ae4a08bf5422df85. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:28.743198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:28.747920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:28.861335 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b87dfbf0-beb9-4e4f-868f-b37ccb8b8312 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.433142 Oct 17 12:49:28.862380 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 98/201] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:49:28 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:28.874462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:28.877564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:28.893031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.893785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.898490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.899529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.900153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.901769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.920170 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4c33efc1-b313-4e8e-8063-f37708f208cd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621067 Oct 17 12:49:28.923418 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 104/202] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:49:28.929369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:28.930503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:28.940246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.941112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.943378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:28.944440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:28.945072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:28.945635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:29.853400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:29.867368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d524b6f3-4391-4aa3-8c60-e14896e9cfd5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.999146 Oct 17 12:49:29.868925 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 99/203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:28 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:29.877740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-062d8e15-2844-4bdc-9114-14d45936034a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:29.923021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062d8e15-2844-4bdc-9114-14d45936034a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:29.924962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062d8e15-2844-4bdc-9114-14d45936034a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:29.926615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062d8e15-2844-4bdc-9114-14d45936034a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:29.952596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:29.961193 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8583153a-e298-4a9d-9a98-927665f79390 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1318 microversion: 2.1 time: 1.036501 Oct 17 12:49:29.964895 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 105/204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:28 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1318 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:29.971579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:29.972187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:29.993819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:29.994345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:29.994997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:29.995879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:29.996489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:29.997069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:30.115357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:30.124058 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0caa6f45-7fc3-4871-953f-e72de54b3208 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1226 microversion: 2.1 time: 0.157898 Oct 17 12:49:30.130828 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 106/205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:29 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1226 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:30.142800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:30.149173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:30.169854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:30.169854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:30.169854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:30.169854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:30.174639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:30.175124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:30.181675 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-062d8e15-2844-4bdc-9114-14d45936034a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.310883 Oct 17 12:49:30.183576 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 100/206] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:49:29 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:30.195717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:30.196655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:30.203776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:30.205446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:30.206451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:30.208671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:30.210106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:30.210949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:30.604342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:30.615232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:30.618240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:30.620579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-41dc4a40-e751-4956-b4e0-c22ccb5eb633 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1361 microversion: 2.25 time: 0.487628 Oct 17 12:49:30.622086 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 107/207] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:30 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:30.640426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c52a3e1e-3c02-49ec-8c58-3bcb5f7a9203 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:30.678240 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c52a3e1e-3c02-49ec-8c58-3bcb5f7a9203 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.054636 Oct 17 12:49:30.686487 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 108/208] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:30 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:30.692046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b170f7e4-30bc-4fe9-9363-0bde926e9af3 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1997612215"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:30.696449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-b170f7e4-30bc-4fe9-9363-0bde926e9af3 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid c7adfd8f-24e2-472d-9e84-01ddbeb73337 for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:30.743928 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b170f7e4-30bc-4fe9-9363-0bde926e9af3 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055878 Oct 17 12:49:30.744988 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 109/209] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:30.758003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0fa78ea-d623-43ad-b6d9-39a2398b647c tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-930874428"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:30.769155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-f0fa78ea-d623-43ad-b6d9-39a2398b647c tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Generated uuid b77a28ec-2f52-4f38-80e8-45fbc5f7ca19 for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:30.835813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0fa78ea-d623-43ad-b6d9-39a2398b647c tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.082589 Oct 17 12:49:30.853609 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 110/210] 10.222.0.27 () {62 vars in 1205 bytes} [Mon Oct 17 12:49:30 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:49:30.867927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8abbddca-a35d-48cc-acbf-2d4241cd0271 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:30.901427 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8abbddca-a35d-48cc-acbf-2d4241cd0271 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.045433 Oct 17 12:49:30.902897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:30.905994 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 111/211] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:30 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:30.911434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-346e91ca-7af1-41ed-a553-5333d8b6bd16 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-32573934"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:30.917110 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35b0583b-9b95-4769-83c5-9386a8f37ab5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.732224 Oct 17 12:49:30.925341 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 101/212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:30 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:30.938865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:30.945418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:30.961065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:30.964837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:30.977808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:30.978696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:30.979168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:30.979613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:31.001457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:31.232466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-346e91ca-7af1-41ed-a553-5333d8b6bd16 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 297 microversion: 2.41 time: 0.324089 Oct 17 12:49:31.243416 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 112/213] 10.222.0.27 () {62 vars in 1210 bytes} [Mon Oct 17 12:49:30 2022] PUT /compute/v2.1/os-aggregates/6 => generated 297 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:49:31.251752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-27bf36fe-214f-49b8-8068-19a4e8a68b5d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:31.261734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-27bf36fe-214f-49b8-8068-19a4e8a68b5d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-27bf36fe-214f-49b8-8068-19a4e8a68b5d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Request method failure captured: Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8gPFak2QAXI4rH2KWhHMPhWEPndajtytcoDsIOxsK5ADtnSgaDW3n10kV6b_7GMf7MZhKex_AuT2mFOT6Qy_lxkFC6wjpDQpXsZXOFAF8K8Tav7oum1ovNAGFjM2-Pnwn4FYlQahqswb83CTHjFQBVCaEA9cWCmYBmwwxUWRYZ5wg Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 13d459946d604bf8877cd4061eabe157 Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:49:31.265793 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13d459946d604bf8877cd4061eabe157", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13d459946d604bf8877cd4061eabe157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13d459946d604bf8877cd4061eabe157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13d459946d604bf8877cd4061eabe157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 13d459946d604bf8877cd4061eabe157 Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AggregatesAdminTestJSON-1160681676-project-admin Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7ef82d9a63e340f0913f37f34b39a72a Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AggregatesAdminTestJSON-1160681676-project-admin Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: exception: Aggregate 5 could not be found. Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5'} Oct 17 12:49:31.267076 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:31.267803 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 17 12:49:31.269986 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.271749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-27bf36fe-214f-49b8-8068-19a4e8a68b5d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:31.271749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-27bf36fe-214f-49b8-8068-19a4e8a68b5d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.022850 Oct 17 12:49:31.271749 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 113/214] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:49:31 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:49:31.280638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:31.281966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:31.290709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:31.291217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:31.291745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:31.292626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:31.293591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:31.294579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:31.867282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:31.877968 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c66e74c8-ce92-4631-bd99-ac8550269c08 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1318 microversion: 2.1 time: 0.605559 Oct 17 12:49:31.893354 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 114/215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:31 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:31.894055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:31.901904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:31.902574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:31.909727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:31.910822 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b0c587d-bb12-40f8-9e97-76281e4fd97c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.983222 Oct 17 12:49:31.911364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:31.911475 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 102/216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:30 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:31.912239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:31.912959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:31.913412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:31.913833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:31.919163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c476bbbe-4360-4101-bf8a-017a0440388a tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:31.935967 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c476bbbe-4360-4101-bf8a-017a0440388a tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 297 microversion: 2.41 time: 0.023424 Oct 17 12:49:31.942822 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 103/217] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 12:49:31 2022] GET /compute/v2.1/os-aggregates/6 => generated 297 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:49:31.948019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0598b6e-7ba6-4fe2-ba49-f7f3591519af tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:31.975428 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d0598b6e-7ba6-4fe2-ba49-f7f3591519af tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0598b6e-7ba6-4fe2-ba49-f7f3591519af tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Request method failure captured: Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8gPFak2QAXI4rH2KWhHMPhWEPndajtytcoDsIOxsK5ADtnSgaDW3n10kV6b_7GMf7MZhKex_AuT2mFOT6Qy_lxkFC6wjpDQpXsZXOFAF8K8Tav7oum1ovNAGFjM2-Pnwn4FYlQahqswb83CTHjFQBVCaEA9cWCmYBmwwxUWRYZ5wg Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 13d459946d604bf8877cd4061eabe157 Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:31.978605 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13d459946d604bf8877cd4061eabe157", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13d459946d604bf8877cd4061eabe157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13d459946d604bf8877cd4061eabe157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13d459946d604bf8877cd4061eabe157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 13d459946d604bf8877cd4061eabe157 Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminTestJSON-1160681676-project-admin Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7ef82d9a63e340f0913f37f34b39a72a Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminTestJSON-1160681676-project-admin Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: exception: Aggregate 5 could not be found. Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5'} Oct 17 12:49:31.979764 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:31.980442 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:31.981438 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:31.982700 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:31.982700 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:31.982700 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:31.982700 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 17 12:49:31.982700 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:31.985783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0598b6e-7ba6-4fe2-ba49-f7f3591519af tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:31.987221 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0598b6e-7ba6-4fe2-ba49-f7f3591519af tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.043336 Oct 17 12:49:31.988402 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 104/218] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:31 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:49:32.051568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:32.067548 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3fb17500-b430-4f06-91cb-c63b1bb6d38e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1280 microversion: 2.1 time: 0.172392 Oct 17 12:49:32.068380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 115/219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:31 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:32.073153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:32.073768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:32.078476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-334b14d9-5607-484f-b582-eef7edca801c req-fe3dadc5-7600-4482-9752-910518ebc4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac5965b-fa19-4a90-bfdb-3953192e5cbf", "tag": "1367d09a-14a0-4940-9553-e2f09a8fed0c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:32.088794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:32.090400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.091250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.092139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:32.093059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.093387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.093821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:32.094601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-334b14d9-5607-484f-b582-eef7edca801c req-fe3dadc5-7600-4482-9752-910518ebc4a5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.095325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-334b14d9-5607-484f-b582-eef7edca801c req-fe3dadc5-7600-4482-9752-910518ebc4a5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.095975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-334b14d9-5607-484f-b582-eef7edca801c req-fe3dadc5-7600-4482-9752-910518ebc4a5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:32.124713 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-334b14d9-5607-484f-b582-eef7edca801c req-fe3dadc5-7600-4482-9752-910518ebc4a5 service nova] Creating event network-changed:1367d09a-14a0-4940-9553-e2f09a8fed0c for instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf on n-h1-853316-12 Oct 17 12:49:32.130668 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-334b14d9-5607-484f-b582-eef7edca801c req-fe3dadc5-7600-4482-9752-910518ebc4a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140434 Oct 17 12:49:32.131941 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 105/220] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:32.137925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-32f856e2-bfdc-489f-9a2f-6b99886a07be tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:32.166900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32f856e2-bfdc-489f-9a2f-6b99886a07be tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.167601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32f856e2-bfdc-489f-9a2f-6b99886a07be tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.168220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32f856e2-bfdc-489f-9a2f-6b99886a07be tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:32.471138 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-32f856e2-bfdc-489f-9a2f-6b99886a07be tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.41 time: 0.337268 Oct 17 12:49:32.473660 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 106/221] 10.222.0.27 () {62 vars in 1232 bytes} [Mon Oct 17 12:49:32 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:49:32.482123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:32.485793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:32.503315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.504433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.504873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:32.511223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.511961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.512415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:32.835293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:32.861421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:32.867978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:32.869182 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e5f1ef2e-9465-4de8-8636-7643993feb90 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1361 microversion: 2.25 time: 0.799839 Oct 17 12:49:32.872707 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 116/222] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:32 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1361 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:32.872903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:32.880363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4be1df88-c48b-4496-830f-98ef6447a7b6 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1503070882", "name": "tempest-test_aggregate-882302275"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:32.887269 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb2054ff-2ae9-4bbf-9780-8c5513ebe33e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.412366 Oct 17 12:49:32.887871 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 107/223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:32 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:32.892614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69aba0a7-3605-4830-8f72-b29d59dec52d tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:32.915013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-4be1df88-c48b-4496-830f-98ef6447a7b6 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid d36f1cf3-57f3-4cbc-890c-a2604bcd81f6 for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:32.921622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69aba0a7-3605-4830-8f72-b29d59dec52d tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.922143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69aba0a7-3605-4830-8f72-b29d59dec52d tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.922578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69aba0a7-3605-4830-8f72-b29d59dec52d tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:32.954235 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4be1df88-c48b-4496-830f-98ef6447a7b6 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.080134 Oct 17 12:49:32.957674 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 117/224] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 17 12:49:32 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:32.964034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:32.965187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:32.974596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.975579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.976323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:32.977208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:32.977883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:32.978490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:33.121537 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69aba0a7-3605-4830-8f72-b29d59dec52d tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 297 microversion: 2.41 time: 0.232390 Oct 17 12:49:33.122693 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 108/225] 10.222.0.27 () {62 vars in 1232 bytes} [Mon Oct 17 12:49:32 2022] POST /compute/v2.1/os-aggregates/6/action => generated 297 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:49:33.127451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.137493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:33.144987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:33.145813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:33.146504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:33.147473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:33.148376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:33.149046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:33.264226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:33.279680 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c228e807-663b-4068-b695-ae5543bcd5db tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1318 microversion: 2.1 time: 0.320606 Oct 17 12:49:33.295318 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 118/226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:32 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:33.307885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-440a06c1-8506-4a42-baf0-227a55a6923e tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.342413 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-440a06c1-8506-4a42-baf0-227a55a6923e tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.044828 Oct 17 12:49:33.343137 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 119/227] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:33 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:33.352587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.353435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:33.360253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:33.360743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:33.361174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:33.362036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:33.365002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:33.365432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:33.491965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:33.501602 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fbb4bdd2-889d-44c3-bc65-96c6caa993e9 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1280 microversion: 2.1 time: 0.156719 Oct 17 12:49:33.503505 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 120/228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:33 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:33.526022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea0c2dc8-7903-4c98-8947-0136fc97c846 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.552343 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea0c2dc8-7903-4c98-8947-0136fc97c846 tempest-AggregatesAdminTestV241-1294657969 tempest-AggregatesAdminTestV241-1294657969-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.031669 Oct 17 12:49:33.554555 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 121/229] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 12:49:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:33.562829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f31d1b22-0e4b-4998-a6db-ee63378db84d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.577722 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f31d1b22-0e4b-4998-a6db-ee63378db84d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f31d1b22-0e4b-4998-a6db-ee63378db84d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Request method failure captured: Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8gPFak2QAXI4rH2KWhHMPhWEPndajtytcoDsIOxsK5ADtnSgaDW3n10kV6b_7GMf7MZhKex_AuT2mFOT6Qy_lxkFC6wjpDQpXsZXOFAF8K8Tav7oum1ovNAGFjM2-Pnwn4FYlQahqswb83CTHjFQBVCaEA9cWCmYBmwwxUWRYZ5wg Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 13d459946d604bf8877cd4061eabe157 Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:49:33.580121 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13d459946d604bf8877cd4061eabe157", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13d459946d604bf8877cd4061eabe157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13d459946d604bf8877cd4061eabe157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13d459946d604bf8877cd4061eabe157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 13d459946d604bf8877cd4061eabe157 Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AggregatesAdminTestJSON-1160681676-project-admin Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7ef82d9a63e340f0913f37f34b39a72a Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AggregatesAdminTestJSON-1160681676-project-admin Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: exception: Aggregate 7 could not be found. Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7'} Oct 17 12:49:33.582308 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:33.583081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 17 12:49:33.586130 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.587953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f31d1b22-0e4b-4998-a6db-ee63378db84d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:33.587953 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f31d1b22-0e4b-4998-a6db-ee63378db84d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.026187 Oct 17 12:49:33.587953 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 122/230] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:49:33 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:49:33.598878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29321716-30cf-4788-a29a-4008a4b596dc tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.613024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-29321716-30cf-4788-a29a-4008a4b596dc tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29321716-30cf-4788-a29a-4008a4b596dc tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Request method failure captured: Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8gPFak2QAXI4rH2KWhHMPhWEPndajtytcoDsIOxsK5ADtnSgaDW3n10kV6b_7GMf7MZhKex_AuT2mFOT6Qy_lxkFC6wjpDQpXsZXOFAF8K8Tav7oum1ovNAGFjM2-Pnwn4FYlQahqswb83CTHjFQBVCaEA9cWCmYBmwwxUWRYZ5wg Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 13d459946d604bf8877cd4061eabe157 Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:49:33.615846 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_13d459946d604bf8877cd4061eabe157", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13d459946d604bf8877cd4061eabe157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/13d459946d604bf8877cd4061eabe157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/13d459946d604bf8877cd4061eabe157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 13d459946d604bf8877cd4061eabe157 Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1160681676 Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AggregatesAdminTestJSON-1160681676-project-admin Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7ef82d9a63e340f0913f37f34b39a72a Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AggregatesAdminTestJSON-1160681676-project-admin Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: exception: Aggregate 7 could not be found. Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7'} Oct 17 12:49:33.617039 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:33.617910 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:33.619089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:33.620528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:33.620528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:33.620528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:33.620528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 17 12:49:33.620528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:33.620528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29321716-30cf-4788-a29a-4008a4b596dc tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:33.620528 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29321716-30cf-4788-a29a-4008a4b596dc tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.026478 Oct 17 12:49:33.626758 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 123/231] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:33 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:49:33.632847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb4d8057-1565-404b-9409-f12de1c51c2a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1297741361"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:33.637695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-eb4d8057-1565-404b-9409-f12de1c51c2a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid c9b7c091-7917-4560-b5e1-e59960fb38ac for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:33.669999 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eb4d8057-1565-404b-9409-f12de1c51c2a tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041302 Oct 17 12:49:33.679143 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 124/232] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:33.686003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90dcbb57-2eea-4fe1-9ff4-c439c5e66a5c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.699738 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90dcbb57-2eea-4fe1-9ff4-c439c5e66a5c tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.017505 Oct 17 12:49:33.709735 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 125/233] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:49:33 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:33.716964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df2d1546-e57d-48e2-80cf-b48519305541 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:33.765952 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df2d1546-e57d-48e2-80cf-b48519305541 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.054642 Oct 17 12:49:33.775380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 126/234] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 17 12:49:33 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:33.781325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3001429a-d41f-49e3-9658-3bb6c7d415c2 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.792664 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3001429a-d41f-49e3-9658-3bb6c7d415c2 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.015152 Oct 17 12:49:33.793455 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 127/235] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:49:33 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:33.814840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec7e490c-1210-4372-8078-4a3afe432363 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.859563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec7e490c-1210-4372-8078-4a3afe432363 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.057884 Oct 17 12:49:33.860142 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 128/236] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:33 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:33.871823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-36e78c2b-6d58-4e3a-a569-7e57f1c6e25d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-978421854", "availability_zone": "tempest-test_az-822803133"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:33.875407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-36e78c2b-6d58-4e3a-a569-7e57f1c6e25d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid f11f63c6-4b37-4719-b200-f2b6748aa429 for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:33.933272 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-36e78c2b-6d58-4e3a-a569-7e57f1c6e25d tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.065089 Oct 17 12:49:33.933696 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 129/237] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 17 12:49:33 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:49:33.938545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:33.939250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:33.946813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:33.947358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:33.947798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:33.948682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:33.949207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:33.949654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:33.993229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:34.008368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02bf0b8d-01f6-478c-aa69-e57c0fe11aaa tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.883135 Oct 17 12:49:34.009722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 109/238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:33 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:34.021782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:34.023724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:34.038316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:34.039709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:34.041170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:34.042792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:34.044892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:34.045674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:34.196523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:34.208410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:34.210539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:34.211930 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f6c88c82-c274-4fd5-8600-4b1c9e0c1ac7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1361 microversion: 2.25 time: 0.277280 Oct 17 12:49:34.212831 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 130/239] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:33 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:34.217542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-777aa24f-c29c-4f14-87b8-56b1499dda01 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-978421854_new", "availability_zone": "tempest-test_az-822803133_new"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:34.266645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777aa24f-c29c-4f14-87b8-56b1499dda01 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:34.267616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777aa24f-c29c-4f14-87b8-56b1499dda01 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:34.268256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777aa24f-c29c-4f14-87b8-56b1499dda01 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:34.325305 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-777aa24f-c29c-4f14-87b8-56b1499dda01 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.110952 Oct 17 12:49:34.336951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 131/240] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:49:34 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:34.510453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be255bb3-40ee-497a-a9e3-81f3bb96a760 tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] Calling method '.version_select at 0x7fa821869ca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:34.606060 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be255bb3-40ee-497a-a9e3-81f3bb96a760 tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.266880 Oct 17 12:49:34.615451 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 132/241] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:49:34 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:49:34.618597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:34.619430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:34.632724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:34.633405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:34.633943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:34.635073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:34.635836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:34.638480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:34.650533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:34.660706 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b6c648a-2c17-46a1-abbe-fa0b1bb012cc tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.649220 Oct 17 12:49:34.661394 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 110/242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:34 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:34.668596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-669eb31b-74a2-4e62-9dc6-488ac3a0a2bd req-d85e0bb6-61b7-42fe-bc3c-1796c3289dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d", "tag": "c2b9f881-8633-4890-96e4-8462666772c1"}, {"name": "network-changed", "server_uuid": "ea792d36-025e-4920-94b6-edd2f314fe14", "tag": "38ada92b-863e-4ecb-a957-96d170033bfb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:34.695473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-669eb31b-74a2-4e62-9dc6-488ac3a0a2bd req-d85e0bb6-61b7-42fe-bc3c-1796c3289dde service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:34.707661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-669eb31b-74a2-4e62-9dc6-488ac3a0a2bd req-d85e0bb6-61b7-42fe-bc3c-1796c3289dde service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:34.708501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-669eb31b-74a2-4e62-9dc6-488ac3a0a2bd req-d85e0bb6-61b7-42fe-bc3c-1796c3289dde service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:34.724983 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-669eb31b-74a2-4e62-9dc6-488ac3a0a2bd req-d85e0bb6-61b7-42fe-bc3c-1796c3289dde service nova] Creating event network-changed:c2b9f881-8633-4890-96e4-8462666772c1 for instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d on n-h1-853316-12 Oct 17 12:49:34.725711 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-669eb31b-74a2-4e62-9dc6-488ac3a0a2bd req-d85e0bb6-61b7-42fe-bc3c-1796c3289dde service nova] Creating event network-changed:38ada92b-863e-4ecb-a957-96d170033bfb for instance ea792d36-025e-4920-94b6-edd2f314fe14 on n-h2-853316-12 Oct 17 12:49:34.737537 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-669eb31b-74a2-4e62-9dc6-488ac3a0a2bd req-d85e0bb6-61b7-42fe-bc3c-1796c3289dde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070142 Oct 17 12:49:34.737537 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 111/243] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:34.741816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b70201d3-2446-43fc-b87b-e62795fa3810 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:34.749672 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b70201d3-2446-43fc-b87b-e62795fa3810 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.012496 Oct 17 12:49:34.750456 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 112/244] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 12:49:34 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:34.763578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:34.764714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:34.773877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:34.775632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:34.776240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:34.779606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:34.782217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:34.782837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:34.850154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:34.859000 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2d748e55-17f4-4c43-9599-7e40fc395d67 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1318 microversion: 2.1 time: 0.250793 Oct 17 12:49:34.870921 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 133/245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:34 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:34.870921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b87076bc-bec3-4688-bbf1-8f0eb92a530e tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] Action: 'create', calling method: .version_select at 0x7fa821ca83a0>, body: {"pool": "non_exist_pool"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:34.932173 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-b87076bc-bec3-4688-bbf1-8f0eb92a530e tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] HTTP exception thrown: Floating IP pool not found. Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b87076bc-bec3-4688-bbf1-8f0eb92a530e tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] Request method failure captured: Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 26 Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9eQ0FztEmOIWfMiwYrdrdYU7ViDcHxxFwVJETIXSAOlM-ci1LZ0XS0_dB0bWdCfWB23hSFUYaHgKncQNKDTf5cg-w4zmRGFAB8dUVhXvLfb57N6X4LML1U2fbevjHewWmpmX0Gej3cU8kzsfZyICnotD_-YS-AvNCwDN2rSkADbRc Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: e0bd36d74054410b84150249521d0482 Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1643619672 Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:34.935546 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e0bd36d74054410b84150249521d0482", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0bd36d74054410b84150249521d0482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e0bd36d74054410b84150249521d0482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0bd36d74054410b84150249521d0482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1643619672 Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: e0bd36d74054410b84150249521d0482 Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1643619672 Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FloatingIPsNegativeTestJSON-1643619672-project Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 69c876c31a1145e19c18011e16ca4aa6 Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1643619672-project Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: {"pool": "non_exist_pool"} Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: exception: Floating IP pool not found. Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 17 12:49:34.936727 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:34.938306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:34.939371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b87076bc-bec3-4688-bbf1-8f0eb92a530e tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] Returning 404 to user: Floating IP pool not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:34.940792 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b87076bc-bec3-4688-bbf1-8f0eb92a530e tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.075795 Oct 17 12:49:34.940961 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 134/246] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:49:34 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:49:34.952420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44868a29-b775-4377-b1d1-101d77b9e965 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:34.983430 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44868a29-b775-4377-b1d1-101d77b9e965 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.036275 Oct 17 12:49:34.984401 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 135/247] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:34 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:35.001117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c70c744-1fae-495c-aae6-2351f140652b tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] Calling method '.version_select at 0x7fa821cb4820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:35.117121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-7c70c744-1fae-495c-aae6-2351f140652b tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c4caf089-38f5-468e-ba07-e87f43f17e82 could not be found", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:49:35.118230 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-7c70c744-1fae-495c-aae6-2351f140652b tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] HTTP exception thrown: Floating IP not found for ID c4caf089-38f5-468e-ba07-e87f43f17e82 Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c70c744-1fae-495c-aae6-2351f140652b tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] Request method failure captured: Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-floating-ips/c4caf089-38f5-468e-ba07-e87f43f17e82 HTTP/1.1 Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9eQ0FztEmOIWfMiwYrdrdYU7ViDcHxxFwVJETIXSAOlM-ci1LZ0XS0_dB0bWdCfWB23hSFUYaHgKncQNKDTf5cg-w4zmRGFAB8dUVhXvLfb57N6X4LML1U2fbevjHewWmpmX0Gej3cU8kzsfZyICnotD_-YS-AvNCwDN2rSkADbRc Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: e0bd36d74054410b84150249521d0482 Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1643619672 Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:35.140232 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e0bd36d74054410b84150249521d0482", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0bd36d74054410b84150249521d0482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e0bd36d74054410b84150249521d0482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0bd36d74054410b84150249521d0482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1643619672 Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: e0bd36d74054410b84150249521d0482 Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1643619672 Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FloatingIPsNegativeTestJSON-1643619672-project Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 69c876c31a1145e19c18011e16ca4aa6 Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1643619672-project Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: exception: Floating IP not found for ID c4caf089-38f5-468e-ba07-e87f43f17e82 Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'c4caf089-38f5-468e-ba07-e87f43f17e82'} Oct 17 12:49:35.141469 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:49:35.142326 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c4caf089-38f5-468e-ba07-e87f43f17e82 could not be found Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a5dd249-d3f3-46eb-a310-2f6e27ac29f2'] Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c4caf089-38f5-468e-ba07-e87f43f17e82. Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:35.143422 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c4caf089-38f5-468e-ba07-e87f43f17e82 Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:35.144532 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:35.145888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c4caf089-38f5-468e-ba07-e87f43f17e82 Oct 17 12:49:35.145888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:35.147483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c70c744-1fae-495c-aae6-2351f140652b tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] Returning 404 to user: Floating IP not found for ID c4caf089-38f5-468e-ba07-e87f43f17e82 {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:35.149417 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c70c744-1fae-495c-aae6-2351f140652b tempest-FloatingIPsNegativeTestJSON-1643619672 tempest-FloatingIPsNegativeTestJSON-1643619672-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/c4caf089-38f5-468e-ba07-e87f43f17e82" status: 404 len: 111 microversion: 2.1 time: 0.163441 Oct 17 12:49:35.157698 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 136/248] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:49:34 2022] DELETE /compute/v2.1/os-floating-ips/c4caf089-38f5-468e-ba07-e87f43f17e82 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:35.163683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-42a7289e-e3ae-47b0-847c-a9e4e7da257f tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1814932772"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:35.168289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-42a7289e-e3ae-47b0-847c-a9e4e7da257f tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Generated uuid 4f317d33-6345-4a7c-b0d5-bab71b611686 for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:35.180550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=16 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:35.204429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=22 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:35.219878 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-42a7289e-e3ae-47b0-847c-a9e4e7da257f tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060581 Oct 17 12:49:35.220908 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 137/249] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:35.233706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:35.234475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:35.242788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:35.243655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:35.244304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:35.245234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:35.246013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:35.246690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:35.775594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:35.793644 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3160beb-fa3b-4a5e-94c9-e84f6df22e2e tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.571552 Oct 17 12:49:35.806232 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 138/250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:35 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:35.806232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-94af28e9-3460-4fb2-bc1f-4bd860984c08 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:35.819327 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-94af28e9-3460-4fb2-bc1f-4bd860984c08 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.023699 Oct 17 12:49:35.826854 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 139/251] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 12:49:35 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:35.837387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:35.837496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:35.859006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:35.859747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:35.860476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:35.861506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:35.862219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:35.862833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:35.993377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:36.012932 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de493f84-0578-44f9-b55a-dbdc04187b52 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 1.253350 Oct 17 12:49:36.016624 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 113/252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:34 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:36.022891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:36.023718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:36.030104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.030988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.031632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:36.032514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.033124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.033706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:36.523652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:36.533743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:36.535519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:36.537116 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e30b02f-8558-4cc2-b211-fab8c106d48e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1361 microversion: 2.25 time: 0.709584 Oct 17 12:49:36.537849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 140/253] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:35 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1361 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:36.567518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60d96b94-54c8-45ec-bc58-24c640161e47 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:36.595986 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60d96b94-54c8-45ec-bc58-24c640161e47 tempest-AggregatesAdminTestJSON-1160681676 tempest-AggregatesAdminTestJSON-1160681676-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.039932 Oct 17 12:49:36.601677 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 141/254] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:36 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:36.608014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:36.608926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:36.617955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.620121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.620805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:36.622036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.622671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.623246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:36.709184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:36.719129 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e85cdc70-8bef-4dbd-b64f-a475a388b860 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.700991 Oct 17 12:49:36.719738 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 114/255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:36 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:36.725967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d9d663fb-7c4c-440f-92e5-12bdc89807c1 req-2d381e5d-fd19-4b15-89d9-4898dfaa9529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a237d59a-8d0b-478f-9f8e-ea1c63061c75", "name": "network-vif-plugged", "status": "completed", "tag": "28fe8bdf-d13b-416e-81c1-0e667fee255d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:36.737722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d9d663fb-7c4c-440f-92e5-12bdc89807c1 req-2d381e5d-fd19-4b15-89d9-4898dfaa9529 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.740249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d9d663fb-7c4c-440f-92e5-12bdc89807c1 req-2d381e5d-fd19-4b15-89d9-4898dfaa9529 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.740890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d9d663fb-7c4c-440f-92e5-12bdc89807c1 req-2d381e5d-fd19-4b15-89d9-4898dfaa9529 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:36.759422 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d9d663fb-7c4c-440f-92e5-12bdc89807c1 req-2d381e5d-fd19-4b15-89d9-4898dfaa9529 service nova] Creating event network-vif-plugged:28fe8bdf-d13b-416e-81c1-0e667fee255d for instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 on n-h2-853316-12 Oct 17 12:49:36.765165 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d9d663fb-7c4c-440f-92e5-12bdc89807c1 req-2d381e5d-fd19-4b15-89d9-4898dfaa9529 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043917 Oct 17 12:49:36.766382 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 115/256] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:36.775867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:36.776469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:36.818738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.822207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.822844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:36.823784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.825291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.826232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:36.847609 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] HTTP exception thrown: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Request method failure captured: Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 HTTP/1.1 Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8ejenTtPT-qFtXCjV4dKpCoYn483CRBKyb_CUn3f-lMLA9rQKrdvRWorMO3nTOquCknQVqh2yEnukfSJfxUIqIkHy2UVEKF4QlZNiBrn4KmR7z-1TwiiuV4ylCRBJjpU9aeZSYt0WfYWh0K7HrIEUeqjMSIJl7YghAip4jywQFLfc Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 685b8feeef624944864f7e7a937256c3 Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:36.850897 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_685b8feeef624944864f7e7a937256c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/685b8feeef624944864f7e7a937256c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/685b8feeef624944864f7e7a937256c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/685b8feeef624944864f7e7a937256c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 685b8feeef624944864f7e7a937256c3 Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminTestJSON-2042486034-project Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 630ed82be6054e91a63816cf766b91bf Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminTestJSON-2042486034-project Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:36.852289 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e3395b13-8f84-42bf-a4fa-760d99c7f089'} Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:36.853105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:36.855516 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:36.858666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Returning 404 to user: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:36.859440 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-308b5ba1-6508-4a3f-81e8-0d8f8d810b2a tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 404 len: 111 microversion: 2.1 time: 0.092103 Oct 17 12:49:36.860588 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 116/257] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:49:36 2022] DELETE /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:36.898088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:36.898955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:36.911269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.912067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.912970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:36.913692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:36.914368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:36.914793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:37.230732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:37.239915 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-965d02a3-bcd2-45aa-9cc2-bf360d1c44a0 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1318 microversion: 2.1 time: 0.636660 Oct 17 12:49:37.242880 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 142/258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:36 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:37.258630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:37.259453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] [instance: e3395b13-8f84-42bf-a4fa-760d99c7f089] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:37.268147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:37.278256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:37.278816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:37.279278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:37.279992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:37.290989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:37.291692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:37.315891 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] HTTP exception thrown: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Request method failure captured: Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 HTTP/1.1 Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8ejenTtPT-qFtXCjV4dKpCoYn483CRBKyb_CUn3f-lMLA9rQKrdvRWorMO3nTOquCknQVqh2yEnukfSJfxUIqIkHy2UVEKF4QlZNiBrn4KmR7z-1TwiiuV4ylCRBJjpU9aeZSYt0WfYWh0K7HrIEUeqjMSIJl7YghAip4jywQFLfc Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 685b8feeef624944864f7e7a937256c3 Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:37.318355 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_685b8feeef624944864f7e7a937256c3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/685b8feeef624944864f7e7a937256c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/685b8feeef624944864f7e7a937256c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/685b8feeef624944864f7e7a937256c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 685b8feeef624944864f7e7a937256c3 Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2042486034 Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AggregatesAdminTestJSON-2042486034-project Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 630ed82be6054e91a63816cf766b91bf Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AggregatesAdminTestJSON-2042486034-project Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:37.319525 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e3395b13-8f84-42bf-a4fa-760d99c7f089'} Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:37.320156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. Oct 17 12:49:37.321159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:37.324007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] Returning 404 to user: Instance e3395b13-8f84-42bf-a4fa-760d99c7f089 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:37.324944 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91a94f52-3812-4d19-a68c-635847f7b572 tempest-AggregatesAdminTestJSON-2042486034 tempest-AggregatesAdminTestJSON-2042486034-project] 10.222.0.27 "GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089" status: 404 len: 111 microversion: 2.1 time: 0.076880 Oct 17 12:49:37.325564 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 143/259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:37 2022] GET /compute/v2.1/servers/e3395b13-8f84-42bf-a4fa-760d99c7f089 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:37.331014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:37.333969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:37.340511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:37.341235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:37.341879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:37.342801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:37.343433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:37.344034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:37.491512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:37.514607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-60d5439f-5267-4371-a374-f46f64bf6918 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.616107 Oct 17 12:49:37.534245 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 117/260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:36 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:37.568773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:37.571096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:37.582678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:37.584161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:37.588974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:37.590096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:37.593708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:37.594714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:38.008591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:38.018591 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51b3390d-9d8e-4ec3-a6fa-e1a04f9c9e17 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.691600 Oct 17 12:49:38.022485 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 144/261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:37 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:38.034466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:38.036749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:38.048567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:38.049349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:38.050451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:38.051389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:38.053125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:38.057149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:38.319679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:38.331348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:38.335059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:38.336836 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6916c3b-cfab-411e-9e82-34aa91df3135 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1361 microversion: 2.25 time: 0.773212 Oct 17 12:49:38.354634 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 118/262] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:37 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1361 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:49:38.360661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:38.361311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:38.375951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:38.377342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:38.384452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:38.385721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:38.387845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:38.390244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:38.622379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:38.634827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ba2e03d1-e05f-41e3-9c81-fb2841376409 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.609626 Oct 17 12:49:38.635586 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 145/263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:38 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:38.644104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:38.648802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:38.661518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:38.662910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:38.663427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:38.664372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:38.664895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:38.665428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:38.686001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:38.727919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:38.736632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=22 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:38.739292 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f5da7d79-9479-44dd-b68e-4e4ee5355060 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1468 microversion: 2.1 time: 0.387729 Oct 17 12:49:38.740252 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 119/264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:38 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:38.746618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8e34892d-bc6d-49b0-9765-2ed340665f1b req-1b607c3a-80a3-4056-9391-569d13ca708c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7878cbd0-2215-49db-9b62-55c2d21ae8a4", "tag": "9cf38d18-537d-4a59-8f56-a2a592cdbb4a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:38.767187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8e34892d-bc6d-49b0-9765-2ed340665f1b req-1b607c3a-80a3-4056-9391-569d13ca708c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:38.767864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8e34892d-bc6d-49b0-9765-2ed340665f1b req-1b607c3a-80a3-4056-9391-569d13ca708c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:38.768613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8e34892d-bc6d-49b0-9765-2ed340665f1b req-1b607c3a-80a3-4056-9391-569d13ca708c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:38.789904 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8e34892d-bc6d-49b0-9765-2ed340665f1b req-1b607c3a-80a3-4056-9391-569d13ca708c service nova] Creating event network-changed:9cf38d18-537d-4a59-8f56-a2a592cdbb4a for instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 on n-h1-853316-12 Oct 17 12:49:38.795338 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8e34892d-bc6d-49b0-9765-2ed340665f1b req-1b607c3a-80a3-4056-9391-569d13ca708c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053788 Oct 17 12:49:38.797693 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 120/265] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:39.120770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:39.123028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:39.134618 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-119e15e5-e2e4-4407-8254-a6b35dd194a9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.494231 Oct 17 12:49:39.134853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1722163033", "block_migration": true, "disk_over_commit": false}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:39.141952 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 146/266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:38 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:39.148586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:39.156687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c78abe6a-5d6d-48e4-beb0-89011375da0d req-611ab618-f320-4662-a2d7-c73148bdea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac5965b-fa19-4a90-bfdb-3953192e5cbf", "name": "network-vif-plugged", "status": "completed", "tag": "1367d09a-14a0-4940-9553-e2f09a8fed0c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:39.158390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.159045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.163496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:39.164614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.168323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.168987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:39.172396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c78abe6a-5d6d-48e4-beb0-89011375da0d req-611ab618-f320-4662-a2d7-c73148bdea7d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.176705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c78abe6a-5d6d-48e4-beb0-89011375da0d req-611ab618-f320-4662-a2d7-c73148bdea7d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.177422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c78abe6a-5d6d-48e4-beb0-89011375da0d req-611ab618-f320-4662-a2d7-c73148bdea7d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:39.192296 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c78abe6a-5d6d-48e4-beb0-89011375da0d req-611ab618-f320-4662-a2d7-c73148bdea7d service nova] Creating event network-vif-plugged:1367d09a-14a0-4940-9553-e2f09a8fed0c for instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf on n-h1-853316-12 Oct 17 12:49:39.206407 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c78abe6a-5d6d-48e4-beb0-89011375da0d req-611ab618-f320-4662-a2d7-c73148bdea7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062686 Oct 17 12:49:39.215714 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 147/267] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:39.223555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:39.228638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:39.244414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.247848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.248483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:39.249429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.250071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.250710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:39.294881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lazy-loading 'flavor' on Instance uuid a237d59a-8d0b-478f-9f8e-ea1c63061c75 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:49:39.364958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Going to try to live migrate instance to tempest-host-1722163033 {{(pid=127539) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 12:49:39.373108 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] HTTP exception thrown: Compute host tempest-host-1722163033 could not be found. Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Request method failure captured: Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75/action HTTP/1.1 Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 107 Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9J5TY_Sa11e56WZcNy-UFJV8dl2VahQujj2YK9kLJv5I07st4eWNefwUkMIahMs6Z_rIzE2IhBHnJ5Wh254g2yCGN9Xn6f5raVmTsiSjMrZH3Yz6TbY1KJ0ujKOaud38TtjzE-2zTnZr15n7lWh_d3S21NH_91xtLrIQ22VwbbCsw Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 43c5b56b60f24cccafd01fcbd57fdb5f Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-LiveMigrationNegativeTest-2077029240 Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:39.379892 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_43c5b56b60f24cccafd01fcbd57fdb5f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43c5b56b60f24cccafd01fcbd57fdb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/43c5b56b60f24cccafd01fcbd57fdb5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43c5b56b60f24cccafd01fcbd57fdb5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-LiveMigrationNegativeTest-2077029240 Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 43c5b56b60f24cccafd01fcbd57fdb5f Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2077029240 Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-LiveMigrationNegativeTest-2077029240-project-admin Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: bb5e619de9c64da3aaccc99f0dbd4f11 Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-LiveMigrationNegativeTest-2077029240-project-admin Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: {"os-migrateLive": {"host": "tempest-host-1722163033", "block_migration": true, "disk_over_commit": false}} Oct 17 12:49:39.381174 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: exception: Compute host tempest-host-1722163033 could not be found. Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a237d59a-8d0b-478f-9f8e-ea1c63061c75', 'body': {'os-migrateLive': {'host': 'tempest-host-1722163033', 'block_migration': True, 'disk_over_commit': False}}} Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 12:49:39.381923 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1722163033 could not be found. Oct 17 12:49:39.383053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1722163033 could not be found. Oct 17 12:49:39.384121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1722163033 could not be found. Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Returning 400 to user: Compute host tempest-host-1722163033 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c50e333b-e5be-47c8-89c9-cfa1db69d658 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75/action" status: 400 len: 100 microversion: 2.1 time: 0.583129 Oct 17 12:49:39.385212 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 121/268] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 17 12:49:38 2022] POST /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75/action => generated 100 bytes in 584 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:49:39.389585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:39.390651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:39.403002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.405898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.413786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:39.414685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.415175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.415614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:39.639234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:39.653802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:39.658994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:39.662082 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6868af04-07a0-4ed7-a25a-d85004b853d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1361 microversion: 2.25 time: 0.278559 Oct 17 12:49:39.674826 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 122/269] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:39 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:39.682824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:39.683439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:39.699449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.699924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.700441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:39.701060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:39.701524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:39.709070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.000592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:40.012121 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f65742a5-a4c6-4bf7-9f1c-b511c21faa23 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1468 microversion: 2.1 time: 0.348029 Oct 17 12:49:40.013564 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 123/270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:39 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1468 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:40.019066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:40.020233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:40.036161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:40.042682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.043403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.043961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.045152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.045787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.046658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.054672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eb086e07-e060-4c38-94ff-73e95952dc9c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.828986 Oct 17 12:49:40.055595 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 148/271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:39 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:40.299476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:40.310484 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-411d39e9-a368-4090-b1c9-afc591a11315 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.295406 Oct 17 12:49:40.311064 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 124/272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:40 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:40.327898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b43215a-55fe-4a72-a408-badf1136f3f8 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:40.330219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b43215a-55fe-4a72-a408-badf1136f3f8 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.334381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b43215a-55fe-4a72-a408-badf1136f3f8 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.334381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b43215a-55fe-4a72-a408-badf1136f3f8 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.334793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b43215a-55fe-4a72-a408-badf1136f3f8 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.335281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b43215a-55fe-4a72-a408-badf1136f3f8 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.338604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:40.339116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b43215a-55fe-4a72-a408-badf1136f3f8 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.364072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:40.375460 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b43215a-55fe-4a72-a408-badf1136f3f8 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.317138 Oct 17 12:49:40.377751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.381027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.381713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.383186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.384679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.385365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.385572 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 149/273] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 17 12:49:40 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:49:40.390751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1443330874", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:40.430323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:40.477999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:40.750861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:40.759563 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4475cf69-ff39-4b20-9111-4e28e28add00 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.440511 Oct 17 12:49:40.766423 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 125/274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:40 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:40.773903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90e15f6a-8a88-4494-aa68-ecfeb23b4274 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:40.781993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90e15f6a-8a88-4494-aa68-ecfeb23b4274 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.784093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90e15f6a-8a88-4494-aa68-ecfeb23b4274 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.786472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90e15f6a-8a88-4494-aa68-ecfeb23b4274 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.789707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90e15f6a-8a88-4494-aa68-ecfeb23b4274 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.792539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90e15f6a-8a88-4494-aa68-ecfeb23b4274 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.793106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90e15f6a-8a88-4494-aa68-ecfeb23b4274 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.878767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90e15f6a-8a88-4494-aa68-ecfeb23b4274 tempest-AZAdminV2TestJSON-1298284257 tempest-AZAdminV2TestJSON-1298284257-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.106395 Oct 17 12:49:40.884992 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 126/275] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 17 12:49:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:40.896298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:40.897424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:40.913132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.917507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.918073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:40.918885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:40.919398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:40.919966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.091246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:41.091950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:41.092675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:41.093390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:41.094237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:41.114992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.115909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.117828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.118688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.121380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.121898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.170728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Getting quotas for project d15166b17a404da4a671e1b992369d66. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:41.177852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Getting quotas for user 046bb953acb24208b3f458872e030eae and project d15166b17a404da4a671e1b992369d66. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:41.211164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:41.221746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:41.333162 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78ccdc38-f340-47b1-a8ee-b734fc3743ac tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946370 Oct 17 12:49:41.346089 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 150/276] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:49:41.357654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:41.362225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:41.374395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.376350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.377040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.380370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.382755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.383425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.610067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:41.641955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:41.652883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:41.659655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af3b622a-4e46-4a3f-85ed-4bb688719c14 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1361 microversion: 2.25 time: 0.773244 Oct 17 12:49:41.661376 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 127/277] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:40 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1361 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:41.677934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d7d8d11a-ccae-45c8-b90e-580df926cd68 req-3a8a51cd-e2c0-4ef0-a54f-92912240916e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea792d36-025e-4920-94b6-edd2f314fe14", "name": "network-vif-plugged", "status": "completed", "tag": "38ada92b-863e-4ecb-a957-96d170033bfb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:41.704555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:41.713870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7d8d11a-ccae-45c8-b90e-580df926cd68 req-3a8a51cd-e2c0-4ef0-a54f-92912240916e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.714305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7d8d11a-ccae-45c8-b90e-580df926cd68 req-3a8a51cd-e2c0-4ef0-a54f-92912240916e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.714699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7d8d11a-ccae-45c8-b90e-580df926cd68 req-3a8a51cd-e2c0-4ef0-a54f-92912240916e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.717331 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c4abe19-9211-41ab-85a9-c3faf47cd31e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.370028 Oct 17 12:49:41.717916 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 151/278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:41 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:41.742690 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d7d8d11a-ccae-45c8-b90e-580df926cd68 req-3a8a51cd-e2c0-4ef0-a54f-92912240916e service nova] Creating event network-vif-plugged:38ada92b-863e-4ecb-a957-96d170033bfb for instance ea792d36-025e-4920-94b6-edd2f314fe14 on n-h2-853316-12 Oct 17 12:49:41.751525 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d7d8d11a-ccae-45c8-b90e-580df926cd68 req-3a8a51cd-e2c0-4ef0-a54f-92912240916e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089122 Oct 17 12:49:41.752125 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 128/279] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:41.757449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe953ddd-3b0a-4a0e-a307-d711c43ed1ec tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:41.758153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fe953ddd-3b0a-4a0e-a307-d711c43ed1ec tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:41.760071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:41.765063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:41.798776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.804250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.804832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.805673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.807738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.808266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.933970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fe953ddd-3b0a-4a0e-a307-d711c43ed1ec tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:41.945168 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe953ddd-3b0a-4a0e-a307-d711c43ed1ec tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1219 microversion: 2.1 time: 0.191697 Oct 17 12:49:41.945750 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 129/280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:41 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1219 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:41.963468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:41.964367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:41.975034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.975784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.976688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:41.977731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:41.978344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:41.978921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:42.208021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:42.220928 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00f48e55-9c05-4d12-871f-df2b3a8a292f tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.483625 Oct 17 12:49:42.238201 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 152/281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:41 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:42.694614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:42.695605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:42.715527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:42.716500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:42.718345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:42.720717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:42.725944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:42.729192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:42.907862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:42.917482 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-252e8a8c-7d39-4d6a-87a5-66c708ae6743 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1387 microversion: 2.1 time: 0.970362 Oct 17 12:49:42.925911 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 130/282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:41 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1387 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:42.946372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:42.948753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:42.965708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:42.969450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:42.970750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:42.972004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:42.979583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:42.980908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.080444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:43.107084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:43.115094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:43.120308 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-154af73c-d931-4dfb-bb65-4ecb4ce31d91 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1361 microversion: 2.25 time: 0.431353 Oct 17 12:49:43.121744 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 153/283] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:42 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:43.135102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:43.136838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:43.152414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:43.156070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:43.156647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.157907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:43.160737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:43.162040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.274522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:43.283420 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8cec2254-36f9-417a-8e5a-196f88cc7404 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1271 microversion: 2.1 time: 0.159457 Oct 17 12:49:43.284650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 154/284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:43 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:43.290311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:43.291431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:43.297524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:43.298267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:43.298914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.299859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:43.300309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:43.301472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.568351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:43.603765 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6aad59e8-3e8c-4e48-8d5f-52e2b3a37b08 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.317674 Oct 17 12:49:43.605246 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 155/285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:43 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:43.682434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:43.697048 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dd230244-f9fa-41ad-bebd-fef8a1617c5e tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.769345 Oct 17 12:49:43.697638 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 131/286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:42 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:43.959865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:43.961298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cb0a3a9e-8925-4481-9004-37b0b9341e01 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:43.962235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:43.965272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0a3a9e-8925-4481-9004-37b0b9341e01 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:43.965992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0a3a9e-8925-4481-9004-37b0b9341e01 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:43.966670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0a3a9e-8925-4481-9004-37b0b9341e01 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.967618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0a3a9e-8925-4481-9004-37b0b9341e01 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:43.968262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0a3a9e-8925-4481-9004-37b0b9341e01 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:43.968884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0a3a9e-8925-4481-9004-37b0b9341e01 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.970939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:43.971640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:43.980175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.981327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:43.982139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:43.982781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:43.997546 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cb0a3a9e-8925-4481-9004-37b0b9341e01 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.391236 Oct 17 12:49:43.998611 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 156/287] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 12:49:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:44.013672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d787b4e-aa2a-43e8-a67b-4dcd4463bc29 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-384760217"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:44.024430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-1d787b4e-aa2a-43e8-a67b-4dcd4463bc29 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid c2f7ea71-eef0-48e8-b139-43ca0779e42c for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:44.062774 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d787b4e-aa2a-43e8-a67b-4dcd4463bc29 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053537 Oct 17 12:49:44.071139 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 157/288] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:49:44.096591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b31101a-db96-4d08-94eb-9ce27a9ff748 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:44.130565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b31101a-db96-4d08-94eb-9ce27a9ff748 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.131239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b31101a-db96-4d08-94eb-9ce27a9ff748 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.133496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b31101a-db96-4d08-94eb-9ce27a9ff748 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.283775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:44.308768 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80834ab6-31de-4a09-b854-1fed78d59945 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1587 microversion: 2.1 time: 0.351093 Oct 17 12:49:44.323089 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 132/289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:43 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1587 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:49:44.336729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:44.340175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:44.361962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.365127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.370599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.373130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.374828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.375837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.392283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b31101a-db96-4d08-94eb-9ce27a9ff748 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.314202 Oct 17 12:49:44.398606 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 158/290] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:44.406713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:44.407728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:44.417217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.418211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.419049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.420368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.421039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.421626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.514774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:44.529435 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cfbb3e1f-2081-4cc1-a003-714e08534147 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1277 microversion: 2.1 time: 0.129286 Oct 17 12:49:44.532509 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 159/291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:44 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:44.550943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:44.552726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:44.565180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.568285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.568736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.572109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.572629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.573551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.814014 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d9aeb5ca-00b9-4288-a9e6-a8d655be248b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.278910 Oct 17 12:49:44.815060 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 160/292] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 12:49:44 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf/os-interface => generated 285 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:44.815639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:44.820613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9a75288e-0668-46b2-9861-db1587e68208 req-7fb28c1c-a8bb-4078-a8d6-166c91be45a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d", "name": "network-vif-plugged", "status": "completed", "tag": "c2b9f881-8633-4890-96e4-8462666772c1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:44.830195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:44.831692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:44.838972 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71eb54eb-2620-47f5-8a32-e96e24bc5c72 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1557 microversion: 2.25 time: 0.524153 Oct 17 12:49:44.854189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 133/293] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:44 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1557 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:44.857334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9a75288e-0668-46b2-9861-db1587e68208 req-7fb28c1c-a8bb-4078-a8d6-166c91be45a2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.860628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9a75288e-0668-46b2-9861-db1587e68208 req-7fb28c1c-a8bb-4078-a8d6-166c91be45a2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.861754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9a75288e-0668-46b2-9861-db1587e68208 req-7fb28c1c-a8bb-4078-a8d6-166c91be45a2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.867725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ba37981-5aef-4128-8996-b4a5244e5bf0 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:44.885300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ba37981-5aef-4128-8996-b4a5244e5bf0 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.885809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ba37981-5aef-4128-8996-b4a5244e5bf0 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.886273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ba37981-5aef-4128-8996-b4a5244e5bf0 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.887449 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9a75288e-0668-46b2-9861-db1587e68208 req-7fb28c1c-a8bb-4078-a8d6-166c91be45a2 service nova] Creating event network-vif-plugged:c2b9f881-8633-4890-96e4-8462666772c1 for instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d on n-h1-853316-12 Oct 17 12:49:44.896053 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9a75288e-0668-46b2-9861-db1587e68208 req-7fb28c1c-a8bb-4078-a8d6-166c91be45a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077987 Oct 17 12:49:44.896420 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 161/294] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:44.902489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:44.903683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:44.911987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.912625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.913166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.913981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.914562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.915086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.920127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:DELETE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:44.930605 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0ba37981-5aef-4128-8996-b4a5244e5bf0 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-853316-12. Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ba37981-5aef-4128-8996-b4a5244e5bf0 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Request method failure captured: Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 40 Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9ntQzc1LEwvQdUrWqLPwoa7XRsFt0VRlc5pK2YLxq9suRYTGwgq-swOYR-7_fSFdP_rYvI3usCoU1WmsEt0qeyTeJ6tXlIHkJLo9EKpGvnMhLS8IU0vQkkMKuGPzA3UW1WoxqTMIReCS64JTVvkx8CsodsQc81wX6E890EtrKJL5Y Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:44.943164 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4628ef26d284e388a35bf0432cee9f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 375fb8f63a134a8db246e98edb151b61 Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: {"add_host": {"host": "n-h2-853316-12"}} Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:44.944671 n-d-853316-12 devstack@n-api.service[127539]: exception: Aggregate 11 already has host n-h2-853316-12. Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-853316-12'}}} Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result.read() Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 12:49:44.945583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-853316-12-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 12:49:44.946882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 12:49:44.948092 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 12:49:44.950069 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result.read() Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-853316-12-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 12, 49, 44, 918014), 'updated_at': None, 'host': 'n-h2-853316-12', 'aggregate_id': 11}] Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:44.951207 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-853316-12. Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.952712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-853316-12. Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:44.954233 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:44.955570 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-853316-12. Oct 17 12:49:44.955570 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:44.955570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ba37981-5aef-4128-8996-b4a5244e5bf0 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-853316-12. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:44.955570 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ba37981-5aef-4128-8996-b4a5244e5bf0 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.103676 Oct 17 12:49:44.955570 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 134/295] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 17 12:49:44.955929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:44.958618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:44.964712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.965320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.965754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:44.966591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:44.967044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:44.967470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:45.202222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:45.210858 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee732b69-d330-4e95-bc07-2040beb911c6 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.258742 Oct 17 12:49:45.215524 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 135/296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:44 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:45.622970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:45.623874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:45.634330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:45.635697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:45.636435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:45.637800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:45.640885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:45.642206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:45.820819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:45.839645 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc234a72-9b6f-4d15-b8da-460b578f330c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.941827 Oct 17 12:49:45.841338 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 162/297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:44 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:45.846840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68ac0cca-7e88-4270-85bc-36128706a838 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:45.860698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ac0cca-7e88-4270-85bc-36128706a838 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:45.861297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ac0cca-7e88-4270-85bc-36128706a838 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:45.861615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ac0cca-7e88-4270-85bc-36128706a838 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:46.040349 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68ac0cca-7e88-4270-85bc-36128706a838 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.197776 Oct 17 12:49:46.041343 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 163/298] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:45 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:46.051612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:46.053464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:46.085728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid ea792d36-025e-4920-94b6-edd2f314fe14 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:49:46.090706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:46.103764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:46.104218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:46.106189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:46.106674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:46.108109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:46.237494 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2a11d79-dcac-4065-b772-1a421e24201f tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 2051 microversion: 2.25 time: 1.020584 Oct 17 12:49:46.239430 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 136/299] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:45 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 2051 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:46.244850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39305db0-1295-4a5b-8a74-cbb30480f428 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:46.328595 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-39305db0-1295-4a5b-8a74-cbb30480f428 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.085639 Oct 17 12:49:46.334663 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 137/300] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:46 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:46.346628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:46.350674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:46.365965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:46.367258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:46.368194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:46.370035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:46.370999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:46.371769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:46.730485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:46.742060 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-671fc690-5867-4672-9c54-91a8469cdf08 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.405369 Oct 17 12:49:46.743041 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 138/301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:46 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:46.761767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:46.762578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:46.771320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:46.771898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:46.772478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:46.773633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:46.778770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:46.779752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:46.890496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:46.909070 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-30893f18-24e0-4451-bf1b-86b4426e1a44 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1319 microversion: 2.1 time: 0.866611 Oct 17 12:49:46.911003 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 164/302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:46 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1319 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:46.930866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-35eaa034-2974-429b-8297-20c49e5b4051 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-165772817"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:46.935223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-35eaa034-2974-429b-8297-20c49e5b4051 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid d4a63d9a-0b73-4519-809a-b3cc47290831 for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:46.964832 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-35eaa034-2974-429b-8297-20c49e5b4051 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051736 Oct 17 12:49:46.965878 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 165/303] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:47.133580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-441742625", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:47.195095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:47.282350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid ea792d36-025e-4920-94b6-edd2f314fe14 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:49:47.298944 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7a76f28c-c0c0-4fef-8629-0811b92c4801 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 2051 microversion: 2.25 time: 0.553892 Oct 17 12:49:47.299818 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 139/304] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:46 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 2051 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:47.316429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-948f8f4d-34d9-4da4-8034-417e7dd2d78a req-13fe8cbe-1f76-4f23-8bff-9782dcb6b96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc63310a-af08-4f3a-9fc1-955e0d0da893", "tag": "0ff6d8f4-1928-4708-945d-08fe25a25cd3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:47.330351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-948f8f4d-34d9-4da4-8034-417e7dd2d78a req-13fe8cbe-1f76-4f23-8bff-9782dcb6b96e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.331512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-948f8f4d-34d9-4da4-8034-417e7dd2d78a req-13fe8cbe-1f76-4f23-8bff-9782dcb6b96e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.332715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-948f8f4d-34d9-4da4-8034-417e7dd2d78a req-13fe8cbe-1f76-4f23-8bff-9782dcb6b96e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:47.353031 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-948f8f4d-34d9-4da4-8034-417e7dd2d78a req-13fe8cbe-1f76-4f23-8bff-9782dcb6b96e service nova] Creating event network-changed:0ff6d8f4-1928-4708-945d-08fe25a25cd3 for instance cc63310a-af08-4f3a-9fc1-955e0d0da893 on n-h2-853316-12 Oct 17 12:49:47.360281 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-948f8f4d-34d9-4da4-8034-417e7dd2d78a req-13fe8cbe-1f76-4f23-8bff-9782dcb6b96e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058449 Oct 17 12:49:47.361375 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 140/305] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:47.369497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:47.370272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:47.377717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.378227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.378770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:47.381092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.381831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.382679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:47.597682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:47.598563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:47.598700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:47.599449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:47.599869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:47.602551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:47.611441 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ea5b9f5-c17b-405a-896a-fdd39129cd06 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1332 microversion: 2.1 time: 0.248366 Oct 17 12:49:47.612342 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 141/306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:47 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1332 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:47.615483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.615998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.616400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:47.617181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.617640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.618610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:47.642115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Getting quotas for project 254cfab78c5442c58eb0cb2c51bdd8c4. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:47.647020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Getting quotas for user ffc77ed08cf741abac4491e84ba16f22 and project 254cfab78c5442c58eb0cb2c51bdd8c4. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:47.659162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:47.663312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:47.725472 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f48d3a41-d59c-47ba-a2a4-e37ad7950c44 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758012 Oct 17 12:49:47.726541 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 166/307] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:49:47.731039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b4e1c90-828a-4b34-87bf-fb3eea219f99 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:47.734668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b4e1c90-828a-4b34-87bf-fb3eea219f99 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.735254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b4e1c90-828a-4b34-87bf-fb3eea219f99 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.735754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b4e1c90-828a-4b34-87bf-fb3eea219f99 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:47.736549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b4e1c90-828a-4b34-87bf-fb3eea219f99 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.737064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b4e1c90-828a-4b34-87bf-fb3eea219f99 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.737560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b4e1c90-828a-4b34-87bf-fb3eea219f99 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:47.776335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b4e1c90-828a-4b34-87bf-fb3eea219f99 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.046383 Oct 17 12:49:47.784442 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 167/308] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 17 12:49:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:49:47.784442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-023c42bd-5dc3-43e4-9001-9fb90562b4e1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:47.784442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-023c42bd-5dc3-43e4-9001-9fb90562b4e1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:47.793619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:47.897239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-023c42bd-5dc3-43e4-9001-9fb90562b4e1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:47.909214 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-023c42bd-5dc3-43e4-9001-9fb90562b4e1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1219 microversion: 2.1 time: 0.128475 Oct 17 12:49:47.913110 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 168/309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:47 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:47.920773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:47.921385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:47.937981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.942775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.943232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:47.944114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:47.944423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:47.944847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.025629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15a56fe9-ac63-4d4d-864e-a1bc733be8b7 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:48.029395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15a56fe9-ac63-4d4d-864e-a1bc733be8b7 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'a6ba1df313e24b50bbc6e2f31223587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8838ca1431014558bf90ef804e24c035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15a56fe9-ac63-4d4d-864e-a1bc733be8b7 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Request method failure captured: Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 40 Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9lQcT3r7pernyEBXjFkNgwoqHg0vNUiFsFboZae1BiSUMnbWapqggriPDARAPvfMY3Tal99RC3IZWorYPa9f7pS3AhU4GSLYGKAMdynubWa21lyhCdA4Bn25UbtfEcOnl46NMsl4yBcPAZ9qp8VbsijTFRXRL60mIEjRU0yb7Udcg Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:48.032218 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8838ca1431014558bf90ef804e24c035", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8838ca1431014558bf90ef804e24c035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6ba1df313e24b50bbc6e2f31223587f Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: {"add_host": {"host": "n-h2-853316-12"}} Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:48.033467 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-853316-12'}}} Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:48.034246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 12:49:48.036605 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:48.039000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15a56fe9-ac63-4d4d-864e-a1bc733be8b7 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:48.039000 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15a56fe9-ac63-4d4d-864e-a1bc733be8b7 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.420063 Oct 17 12:49:48.039000 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 142/310] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:47 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:48.049060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:48.049671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:48.058019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.058533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.058971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.060563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.061046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.061469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.179536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:48.192177 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1dfaaeeb-6acb-4d3c-8752-bd561d3db645 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.275141 Oct 17 12:49:48.193769 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 169/311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:47 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:48.205414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853316-12", "block_migration": "auto"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:48.212878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:48.219514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.220211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.220883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.221749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.222955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.223622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.267985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:48.278986 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6aebd99-d3db-4e59-b4f5-6c1109ce69f2 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 200 len: 1587 microversion: 2.1 time: 0.241067 Oct 17 12:49:48.280092 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 143/312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:48 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 1587 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:48.287267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b859a4e2-646b-490d-b6a0-cc3639a4a002 req-659f5ae0-9f0e-40c3-821f-0d14d0add6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac5965b-fa19-4a90-bfdb-3953192e5cbf", "tag": "1367d09a-14a0-4940-9553-e2f09a8fed0c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:48.301578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b859a4e2-646b-490d-b6a0-cc3639a4a002 req-659f5ae0-9f0e-40c3-821f-0d14d0add6b2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.302868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b859a4e2-646b-490d-b6a0-cc3639a4a002 req-659f5ae0-9f0e-40c3-821f-0d14d0add6b2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.303408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b859a4e2-646b-490d-b6a0-cc3639a4a002 req-659f5ae0-9f0e-40c3-821f-0d14d0add6b2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.322060 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b859a4e2-646b-490d-b6a0-cc3639a4a002 req-659f5ae0-9f0e-40c3-821f-0d14d0add6b2 service nova] Creating event network-changed:1367d09a-14a0-4940-9553-e2f09a8fed0c for instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf on n-h1-853316-12 Oct 17 12:49:48.327596 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b859a4e2-646b-490d-b6a0-cc3639a4a002 req-659f5ae0-9f0e-40c3-821f-0d14d0add6b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045077 Oct 17 12:49:48.328959 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 144/313] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:48.331577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'flavor' on Instance uuid ea792d36-025e-4920-94b6-edd2f314fe14 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:49:48.335840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:48.336575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:48.343543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.344032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.344463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.345667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.346449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.347293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.414417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Going to try to live migrate instance to n-h1-853316-12 {{(pid=127540) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 12:49:48.536325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:48.666866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:48.680894 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b97da398-b348-497d-828c-e15dd8eccf1a tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1319 microversion: 2.1 time: 0.347357 Oct 17 12:49:48.682503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 145/314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:48 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:48.718987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4f93919-c219-498f-8f93-2cb9ee721d0b tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:48.786278 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4f93919-c219-498f-8f93-2cb9ee721d0b tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.085519 Oct 17 12:49:48.797743 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 146/315] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:48 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:48.820492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:48.827586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:48.840254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.845316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.845903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:48.846782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:48.847485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:48.848138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:49.264964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:49.275950 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5cc35fec-3f07-42cb-9892-2de807149f63 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1537 microversion: 2.1 time: 0.476795 Oct 17 12:49:49.276867 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 147/316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:48 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1537 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:49.281663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb277472-a5c3-4928-b7c5-4e5821f8f873 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1235074987"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:49.286470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-bb277472-a5c3-4928-b7c5-4e5821f8f873 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid edcdc422-4d17-4b6b-9c6a-02bf38404119 for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:49.319577 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb277472-a5c3-4928-b7c5-4e5821f8f873 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041571 Oct 17 12:49:49.320211 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 148/317] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:49.336545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:49.336545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:49.351490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:49.352873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:49.356990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:49.358469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:49.360955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:49.362112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:49.494985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:49.499031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:49.508897 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-58c631fb-ba58-4606-8350-b45e94ab8057 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1271 microversion: 2.1 time: 0.187663 Oct 17 12:49:49.509540 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 149/318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:49 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:49.529058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:49.530031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:49.540707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:49.541474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:49.542074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:49.542959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:49.543841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:49.544180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:49.852190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:49.865301 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90cb62ad-4322-42b6-9a4a-b2cdeb792cab tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.354632 Oct 17 12:49:49.882191 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 150/319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:49 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:49.888066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-07b2fd2e-55e5-44c0-a873-5f339e860825 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'create', calling method: .version_select at 0x7fa8215f6c10>, body: {"pool": "107dfb30-0fda-416a-9f56-050ede1e1c9c"} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:50.826831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:51.248058 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-774cf69e-c0b5-49f1-9cf7-d1651190c895 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14/action" status: 202 len: 0 microversion: 2.25 time: 3.048374 Oct 17 12:49:51.249189 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 170/320] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:49:48 2022] POST /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14/action => generated 0 bytes in 3050 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:49:51.255202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1845683206"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:51.271157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.271894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.272512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.286871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.287841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.289294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.305174 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1845683206 could not be found. Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Request method failure captured: Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 58 Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9ntQzc1LEwvQdUrWqLPwoa7XRsFt0VRlc5pK2YLxq9suRYTGwgq-swOYR-7_fSFdP_rYvI3usCoU1WmsEt0qeyTeJ6tXlIHkJLo9EKpGvnMhLS8IU0vQkkMKuGPzA3UW1WoxqTMIReCS64JTVvkx8CsodsQc81wX6E890EtrKJL5Y Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:49:51.309305 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4628ef26d284e388a35bf0432cee9f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 375fb8f63a134a8db246e98edb151b61 Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: {"add_host": {"host": "tempest-nonexist_host-1845683206"}} Oct 17 12:49:51.310778 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: exception: Compute host tempest-nonexist_host-1845683206 could not be found. Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1845683206'}}} Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1845683206' is not mapped to any cell Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:51.311568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 17 12:49:51.312948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1845683206 could not be found. Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1845683206 could not be found. Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:51.314328 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.315677 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:51.315677 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:51.315677 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:51.315677 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:51.315677 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:51.315677 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1845683206 could not be found. Oct 17 12:49:51.315677 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:51.318152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1845683206 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:51.319236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad74cf0f-7f91-47d4-a009-ac820606f9dc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.068913 Oct 17 12:49:51.320251 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 171/321] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:51 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:51.325169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:51.325833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:51.336284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.337018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.337598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.338502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.339098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.340561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.628387 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-07b2fd2e-55e5-44c0-a873-5f339e860825 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.757697 Oct 17 12:49:51.630604 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 151/322] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:49:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:51.638918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cafc00f4-2bba-4c2e-9e52-ff46065543e2 req-397c428e-5ad3-4126-9ae2-5c69a8fbeb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7878cbd0-2215-49db-9b62-55c2d21ae8a4", "name": "network-vif-plugged", "status": "completed", "tag": "9cf38d18-537d-4a59-8f56-a2a592cdbb4a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:51.650611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cafc00f4-2bba-4c2e-9e52-ff46065543e2 req-397c428e-5ad3-4126-9ae2-5c69a8fbeb33 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.651083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cafc00f4-2bba-4c2e-9e52-ff46065543e2 req-397c428e-5ad3-4126-9ae2-5c69a8fbeb33 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.653444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cafc00f4-2bba-4c2e-9e52-ff46065543e2 req-397c428e-5ad3-4126-9ae2-5c69a8fbeb33 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.673210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cafc00f4-2bba-4c2e-9e52-ff46065543e2 req-397c428e-5ad3-4126-9ae2-5c69a8fbeb33 service nova] Creating event network-vif-plugged:9cf38d18-537d-4a59-8f56-a2a592cdbb4a for instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 on n-h1-853316-12 Oct 17 12:49:51.683453 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cafc00f4-2bba-4c2e-9e52-ff46065543e2 req-397c428e-5ad3-4126-9ae2-5c69a8fbeb33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050922 Oct 17 12:49:51.684589 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 152/323] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:51.690305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ca70f0c9-0016-47e0-99fb-8d3dcccd397a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215f6ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:51.749381 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ca70f0c9-0016-47e0-99fb-8d3dcccd397a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/8ab3c518-5412-45df-9359-fa31fbc46c32" status: 200 len: 661 microversion: 2.1 time: 0.063403 Oct 17 12:49:51.754015 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 153/324] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:49:51 2022] GET /compute/v2.1/images/8ab3c518-5412-45df-9359-fa31fbc46c32 => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:51.762108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:51.763424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:51.771580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.772266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.775168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.777203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.777837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.778950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.832995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:51.843698 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c560efe-ebff-4c53-a109-af91748ac948 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1319 microversion: 2.1 time: 0.522325 Oct 17 12:49:51.844553 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 172/325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:51 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:51.864269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:51.865049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:51.873974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.875027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.875854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.876982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:51.877757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:51.878933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:51.938191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:52.041921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.053164 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-42b17b72-f807-48eb-86ca-7b0e55ef26a8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1319 microversion: 2.1 time: 0.297743 Oct 17 12:49:52.061078 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 154/326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:51 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:52.065932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.067671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:52.073476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:52.074208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:52.074861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:52.075742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:52.076358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:52.076931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:52.144385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.153224 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cd46f423-9b69-4ad7-b61e-ebb46d59010c tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1322 microversion: 2.1 time: 0.307516 Oct 17 12:49:52.153796 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 173/327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:51 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:52.159638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca5769d8-fddc-4062-b050-5fea3cde2781 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.189777 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca5769d8-fddc-4062-b050-5fea3cde2781 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.034690 Oct 17 12:49:52.197715 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 174/328] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:52 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:52.205118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'action', calling method: .version_select at 0x7fa822bc04c0>, body: {"addFloatingIp": {"address": "172.25.6.124"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.209125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:52.219108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:52.219834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:52.220426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:52.222081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:52.222781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:52.223430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:52.244010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.253450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.255006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.256170 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-83297bd7-30cc-48e1-abb6-a943f2934ed8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1567 microversion: 2.25 time: 0.194063 Oct 17 12:49:52.258515 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 155/329] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:52 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:52.270951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fad0e962-57a4-4936-91e5-dada94cc5c9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215e9820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.346660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:49:52.349306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquired lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:49:52.350903 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fad0e962-57a4-4936-91e5-dada94cc5c9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/8ab3c518-5412-45df-9359-fa31fbc46c32" status: 200 len: 661 microversion: 2.1 time: 0.091310 Oct 17 12:49:52.352555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 156/330] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:49:52 2022] GET /compute/v2.1/images/8ab3c518-5412-45df-9359-fa31fbc46c32 => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:52.358614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c03513f-60a6-472e-84d5-22c5a7903e7c tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c03513f-60a6-472e-84d5-22c5a7903e7c tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Request method failure captured: Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 283 Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9ntQzc1LEwvQdUrWqLPwoa7XRsFt0VRlc5pK2YLxq9suRYTGwgq-swOYR-7_fSFdP_rYvI3usCoU1WmsEt0qeyTeJ6tXlIHkJLo9EKpGvnMhLS8IU0vQkkMKuGPzA3UW1WoxqTMIReCS64JTVvkx8CsodsQc81wX6E890EtrKJL5Y Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:52.385190 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4628ef26d284e388a35bf0432cee9f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 375fb8f63a134a8db246e98edb151b61 Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.386495 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:49:52.387032 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.387589 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.388490 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.389296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:49:52.389296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:49:52.389296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 12:49:52.389296 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.389296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c03513f-60a6-472e-84d5-22c5a7903e7c tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.389594 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c03513f-60a6-472e-84d5-22c5a7903e7c tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.032632 Oct 17 12:49:52.389594 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 157/331] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:49:52.397959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8c4c3083-11af-4d58-ae93-5bba1b365930 req-6392c5f0-4c30-4d23-8f1c-7c84a4968b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884d3161-cfbe-40c2-82a9-6d0a013a811b", "tag": "dab6af1a-cb5b-4125-bc5f-8869228ed1c0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.415505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8c4c3083-11af-4d58-ae93-5bba1b365930 req-6392c5f0-4c30-4d23-8f1c-7c84a4968b33 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:52.416227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8c4c3083-11af-4d58-ae93-5bba1b365930 req-6392c5f0-4c30-4d23-8f1c-7c84a4968b33 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:52.416802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8c4c3083-11af-4d58-ae93-5bba1b365930 req-6392c5f0-4c30-4d23-8f1c-7c84a4968b33 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:52.430861 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8c4c3083-11af-4d58-ae93-5bba1b365930 req-6392c5f0-4c30-4d23-8f1c-7c84a4968b33 service nova] Creating event network-changed:dab6af1a-cb5b-4125-bc5f-8869228ed1c0 for instance 884d3161-cfbe-40c2-82a9-6d0a013a811b on n-h2-853316-12 Oct 17 12:49:52.436155 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8c4c3083-11af-4d58-ae93-5bba1b365930 req-6392c5f0-4c30-4d23-8f1c-7c84a4968b33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047159 Oct 17 12:49:52.436749 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 158/332] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:52.442065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b0ac47b-f22e-4be3-85bc-6a0119ed9ebc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b0ac47b-f22e-4be3-85bc-6a0119ed9ebc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Request method failure captured: Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 27 Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9ntQzc1LEwvQdUrWqLPwoa7XRsFt0VRlc5pK2YLxq9suRYTGwgq-swOYR-7_fSFdP_rYvI3usCoU1WmsEt0qeyTeJ6tXlIHkJLo9EKpGvnMhLS8IU0vQkkMKuGPzA3UW1WoxqTMIReCS64JTVvkx8CsodsQc81wX6E890EtrKJL5Y Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:52.446622 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4628ef26d284e388a35bf0432cee9f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 375fb8f63a134a8db246e98edb151b61 Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: {"aggregate": {"name": ""}} Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.447778 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi '' Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.448481 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 12:49:52.449703 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.450817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b0ac47b-f22e-4be3-85bc-6a0119ed9ebc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.450817 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b0ac47b-f22e-4be3-85bc-6a0119ed9ebc tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010357 Oct 17 12:49:52.450817 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 159/333] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:49:52.458801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1cfc95b2-2cc5-4842-ac71-f2388fb3aa68 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032056972"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.463122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1cfc95b2-2cc5-4842-ac71-f2388fb3aa68 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'a6ba1df313e24b50bbc6e2f31223587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8838ca1431014558bf90ef804e24c035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1cfc95b2-2cc5-4842-ac71-f2388fb3aa68 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Request method failure captured: Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 60 Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9lQcT3r7pernyEBXjFkNgwoqHg0vNUiFsFboZae1BiSUMnbWapqggriPDARAPvfMY3Tal99RC3IZWorYPa9f7pS3AhU4GSLYGKAMdynubWa21lyhCdA4Bn25UbtfEcOnl46NMsl4yBcPAZ9qp8VbsijTFRXRL60mIEjRU0yb7Udcg Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:52.465008 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8838ca1431014558bf90ef804e24c035", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8838ca1431014558bf90ef804e24c035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6ba1df313e24b50bbc6e2f31223587f Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: {"aggregate": {"name": "tempest-test_aggregate-2032056972"}} Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.466243 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2032056972'}}} Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:52.466980 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:52.467944 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 12:49:52.468967 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.468967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1cfc95b2-2cc5-4842-ac71-f2388fb3aa68 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.468967 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1cfc95b2-2cc5-4842-ac71-f2388fb3aa68 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012035 Oct 17 12:49:52.471031 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 160/334] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:49:52.480610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f3372d2f-fe56-4ccb-9ee2-7311c1a2c2b3 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1993364887"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.484014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-f3372d2f-fe56-4ccb-9ee2-7311c1a2c2b3 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid 0e629561-429e-4314-91d1-b68b6ec0b5d9 for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:52.508097 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f3372d2f-fe56-4ccb-9ee2-7311c1a2c2b3 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.032005 Oct 17 12:49:52.508706 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 161/335] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:52.520335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67f705d5-8432-4de3-8d2b-d56192f6d61d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1993364887"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.523685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-67f705d5-8432-4de3-8d2b-d56192f6d61d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid 87f57e38-3957-4a51-916c-b2af63e2e569 for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:52.532463 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-67f705d5-8432-4de3-8d2b-d56192f6d61d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1993364887 already exists. Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67f705d5-8432-4de3-8d2b-d56192f6d61d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Request method failure captured: Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 60 Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9ntQzc1LEwvQdUrWqLPwoa7XRsFt0VRlc5pK2YLxq9suRYTGwgq-swOYR-7_fSFdP_rYvI3usCoU1WmsEt0qeyTeJ6tXlIHkJLo9EKpGvnMhLS8IU0vQkkMKuGPzA3UW1WoxqTMIReCS64JTVvkx8CsodsQc81wX6E890EtrKJL5Y Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:52.534188 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4628ef26d284e388a35bf0432cee9f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 375fb8f63a134a8db246e98edb151b61 Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: {"aggregate": {"name": "tempest-test_aggregate-1993364887"}} Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.537502 n-d-853316-12 devstack@n-api.service[127539]: exception: Aggregate tempest-test_aggregate-1993364887 already exists. Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1993364887'}}} Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 17 12:49:52.538281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1993364887 already exists. Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:52.539282 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1993364887 already exists. Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1993364887 already exists. Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67f705d5-8432-4de3-8d2b-d56192f6d61d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1993364887 already exists. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.540309 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67f705d5-8432-4de3-8d2b-d56192f6d61d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.019996 Oct 17 12:49:52.541080 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 162/336] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 21 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:49:52.545407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf5e4ad1-1531-4bc4-9d28-87ec54cccb55 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.569003 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf5e4ad1-1531-4bc4-9d28-87ec54cccb55 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.027754 Oct 17 12:49:52.569917 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 163/337] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:52 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 17 12:49:52.578284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fd6f0cc-c6eb-49bc-909a-ff7946ee92c4 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1152620760"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.581613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-3fd6f0cc-c6eb-49bc-909a-ff7946ee92c4 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid 82788558-884b-4e6a-8b9c-eb33963251ee for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:52.601864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3fd6f0cc-c6eb-49bc-909a-ff7946ee92c4 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.027066 Oct 17 12:49:52.608739 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 164/338] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:49:52.614290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d059e9e-4008-4ac0-8563-1210510526ea tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.615749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d059e9e-4008-4ac0-8563-1210510526ea tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'a6ba1df313e24b50bbc6e2f31223587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8838ca1431014558bf90ef804e24c035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d059e9e-4008-4ac0-8563-1210510526ea tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Request method failure captured: Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9lQcT3r7pernyEBXjFkNgwoqHg0vNUiFsFboZae1BiSUMnbWapqggriPDARAPvfMY3Tal99RC3IZWorYPa9f7pS3AhU4GSLYGKAMdynubWa21lyhCdA4Bn25UbtfEcOnl46NMsl4yBcPAZ9qp8VbsijTFRXRL60mIEjRU0yb7Udcg Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:52.617379 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8838ca1431014558bf90ef804e24c035", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8838ca1431014558bf90ef804e24c035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6ba1df313e24b50bbc6e2f31223587f Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 12:49:52.618779 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '15'} Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:52.619527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.620646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d059e9e-4008-4ac0-8563-1210510526ea tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.621579 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d059e9e-4008-4ac0-8563-1210510526ea tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.008886 Oct 17 12:49:52.621579 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 165/339] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:52 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:49:52.627026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69d5643d-2a34-427d-ae47-04fae964e1bd tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.647870 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69d5643d-2a34-427d-ae47-04fae964e1bd tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.024414 Oct 17 12:49:52.648243 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 166/340] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:52 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:52.657057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c5a2989-d830-4866-802b-eea00b049dd8 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.667941 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0c5a2989-d830-4866-802b-eea00b049dd8 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c5a2989-d830-4866-802b-eea00b049dd8 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Request method failure captured: Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9ntQzc1LEwvQdUrWqLPwoa7XRsFt0VRlc5pK2YLxq9suRYTGwgq-swOYR-7_fSFdP_rYvI3usCoU1WmsEt0qeyTeJ6tXlIHkJLo9EKpGvnMhLS8IU0vQkkMKuGPzA3UW1WoxqTMIReCS64JTVvkx8CsodsQc81wX6E890EtrKJL5Y Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:52.669572 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4628ef26d284e388a35bf0432cee9f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 375fb8f63a134a8db246e98edb151b61 Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: exception: Aggregate -1 could not be found. Oct 17 12:49:52.671045 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '-1'} Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 12:49:52.671834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.673053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.674751 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.674751 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.674751 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:52.674751 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:52.674751 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 17 12:49:52.674751 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.674751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c5a2989-d830-4866-802b-eea00b049dd8 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.674751 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c5a2989-d830-4866-802b-eea00b049dd8 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.017626 Oct 17 12:49:52.676857 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 167/341] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:52 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 12:49:52.681094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1c5b4afd-846d-412b-872e-ccab827787e7 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1895627934"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.685392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-1c5b4afd-846d-412b-872e-ccab827787e7 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid 85259aae-9c5f-456a-a717-b6255535fdee for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:52.704914 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1c5b4afd-846d-412b-872e-ccab827787e7 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.027280 Oct 17 12:49:52.705690 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 168/342] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:52.717919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ded5cd8-f9a9-4a35-bd76-6cc73d546308 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.719494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ded5cd8-f9a9-4a35-bd76-6cc73d546308 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'a6ba1df313e24b50bbc6e2f31223587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8838ca1431014558bf90ef804e24c035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ded5cd8-f9a9-4a35-bd76-6cc73d546308 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Request method failure captured: Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9lQcT3r7pernyEBXjFkNgwoqHg0vNUiFsFboZae1BiSUMnbWapqggriPDARAPvfMY3Tal99RC3IZWorYPa9f7pS3AhU4GSLYGKAMdynubWa21lyhCdA4Bn25UbtfEcOnl46NMsl4yBcPAZ9qp8VbsijTFRXRL60mIEjRU0yb7Udcg Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:52.721006 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8838ca1431014558bf90ef804e24c035", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8838ca1431014558bf90ef804e24c035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6ba1df313e24b50bbc6e2f31223587f Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 12:49:52.722864 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '16'} Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:52.723829 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.724863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ded5cd8-f9a9-4a35-bd76-6cc73d546308 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.725756 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ded5cd8-f9a9-4a35-bd76-6cc73d546308 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.008612 Oct 17 12:49:52.725756 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 169/343] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:52 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:49:52.731280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a59df16-7966-444d-b43c-25bb957be77a tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.753092 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a59df16-7966-444d-b43c-25bb957be77a tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.025094 Oct 17 12:49:52.758018 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 170/344] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:52 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 17 12:49:52.763186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-226b1207-71d7-41e7-92d1-bb21cd25946b tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.770989 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-226b1207-71d7-41e7-92d1-bb21cd25946b tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-226b1207-71d7-41e7-92d1-bb21cd25946b tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Request method failure captured: Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9ntQzc1LEwvQdUrWqLPwoa7XRsFt0VRlc5pK2YLxq9suRYTGwgq-swOYR-7_fSFdP_rYvI3usCoU1WmsEt0qeyTeJ6tXlIHkJLo9EKpGvnMhLS8IU0vQkkMKuGPzA3UW1WoxqTMIReCS64JTVvkx8CsodsQc81wX6E890EtrKJL5Y Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:52.772508 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4628ef26d284e388a35bf0432cee9f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 375fb8f63a134a8db246e98edb151b61 Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: exception: Aggregate -1 could not be found. Oct 17 12:49:52.773737 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '-1'} Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.778586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 17 12:49:52.779688 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.781440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-226b1207-71d7-41e7-92d1-bb21cd25946b tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.781440 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-226b1207-71d7-41e7-92d1-bb21cd25946b tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.014341 Oct 17 12:49:52.781440 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 171/345] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:49:52 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 12:49:52.783522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87fe4be1-2503-4745-bea4-075956acd54a tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:52.786348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-87fe4be1-2503-4745-bea4-075956acd54a tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'a6ba1df313e24b50bbc6e2f31223587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8838ca1431014558bf90ef804e24c035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87fe4be1-2503-4745-bea4-075956acd54a tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Request method failure captured: Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9lQcT3r7pernyEBXjFkNgwoqHg0vNUiFsFboZae1BiSUMnbWapqggriPDARAPvfMY3Tal99RC3IZWorYPa9f7pS3AhU4GSLYGKAMdynubWa21lyhCdA4Bn25UbtfEcOnl46NMsl4yBcPAZ9qp8VbsijTFRXRL60mIEjRU0yb7Udcg Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:52.788038 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8838ca1431014558bf90ef804e24c035", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8838ca1431014558bf90ef804e24c035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6ba1df313e24b50bbc6e2f31223587f Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 12:49:52.790034 n-d-853316-12 devstack@n-api.service[127539]: action_args: {} Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:52.790851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:52.792121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87fe4be1-2503-4745-bea4-075956acd54a tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:52.793061 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-87fe4be1-2503-4745-bea4-075956acd54a tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009506 Oct 17 12:49:52.793061 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 172/346] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 12:49:52 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:52.801405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25d30213-f6ee-478a-a2e1-fc290b67ccb5 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1182103898"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.804802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-25d30213-f6ee-478a-a2e1-fc290b67ccb5 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid 3aa0bcca-c950-4ebd-935b-c746457d3949 for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:52.835930 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25d30213-f6ee-478a-a2e1-fc290b67ccb5 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039369 Oct 17 12:49:52.836564 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 173/347] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:52.848564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b8abccc-4cf3-4309-ac72-951e8ffefd92 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:52.861270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8abccc-4cf3-4309-ac72-951e8ffefd92 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:52.862036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8abccc-4cf3-4309-ac72-951e8ffefd92 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:52.863587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8abccc-4cf3-4309-ac72-951e8ffefd92 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:52.990099 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b8abccc-4cf3-4309-ac72-951e8ffefd92 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.145367 Oct 17 12:49:52.990820 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 174/348] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:53.001109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:53.001842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:53.008180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:53.008667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:53.009849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:53.010582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:53.011208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:53.011836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:53.219238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:53.230442 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10006be3-2e12-492c-bb83-7713fa3ec468 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1319 microversion: 2.1 time: 0.238588 Oct 17 12:49:53.231350 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 175/349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:52 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:53.237021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-596f2cb9-2cf9-4260-95e4-86039a996d54 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:53.242074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-596f2cb9-2cf9-4260-95e4-86039a996d54 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'a6ba1df313e24b50bbc6e2f31223587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8838ca1431014558bf90ef804e24c035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-596f2cb9-2cf9-4260-95e4-86039a996d54 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Request method failure captured: Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 43 Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9lQcT3r7pernyEBXjFkNgwoqHg0vNUiFsFboZae1BiSUMnbWapqggriPDARAPvfMY3Tal99RC3IZWorYPa9f7pS3AhU4GSLYGKAMdynubWa21lyhCdA4Bn25UbtfEcOnl46NMsl4yBcPAZ9qp8VbsijTFRXRL60mIEjRU0yb7Udcg Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:53.243963 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8838ca1431014558bf90ef804e24c035", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8838ca1431014558bf90ef804e24c035"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8838ca1431014558bf90ef804e24c035"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8838ca1431014558bf90ef804e24c035 Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-145542137 Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6ba1df313e24b50bbc6e2f31223587f Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-145542137-project Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: {"remove_host": {"host": "n-h2-853316-12"}} Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:53.245117 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-853316-12'}}} Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:53.245878 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 12:49:53.246888 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:53.249866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-596f2cb9-2cf9-4260-95e4-86039a996d54 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:53.251103 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-596f2cb9-2cf9-4260-95e4-86039a996d54 tempest-AggregatesAdminNegativeTestJSON-145542137 tempest-AggregatesAdminNegativeTestJSON-145542137-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.018552 Oct 17 12:49:53.251853 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 176/350] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:53.256954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:53.257638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:53.260956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=83,nova_api:DELETE=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:53.265767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:53.266363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:53.266869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:53.267641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:53.268165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:53.268707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:53.470176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:53.481335 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-32122dff-e288-4145-bff0-51bcae180409 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1319 microversion: 2.1 time: 0.228163 Oct 17 12:49:53.482117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 177/351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:53 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:53.487325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:53.488331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:53.495452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:53.496256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:53.497154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:53.498227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:53.498772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:53.499293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:53.778393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:53.802680 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62de5823-e030-4cc7-ab11-b9cb57aedfb5 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1472 microversion: 2.1 time: 0.319080 Oct 17 12:49:53.814434 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 178/352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:53 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1472 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:53.821565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e865df4e-1730-4bfd-aad2-cb516d2cf4ee tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:53.845891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e865df4e-1730-4bfd-aad2-cb516d2cf4ee tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:53.846500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e865df4e-1730-4bfd-aad2-cb516d2cf4ee tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:53.846889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e865df4e-1730-4bfd-aad2-cb516d2cf4ee tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.011671 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e865df4e-1730-4bfd-aad2-cb516d2cf4ee tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.195261 Oct 17 12:49:54.021464 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 179/353] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:54.027435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Building network info cache for instance {{(pid=127540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 12:49:54.029525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:54.030471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:54.036916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.037402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.037887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.038633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.039227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.039652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.194964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:54.208032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:54.212113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:54.214700 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8054256b-7151-4092-bd61-54884badaf79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1567 microversion: 2.25 time: 0.197472 Oct 17 12:49:54.215961 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 180/354] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:54 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:54.221384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b0eed9af-33d4-4aca-a02f-d11074671d60 req-9371ef90-c93f-49cc-9b83-2d62f38cab62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea792d36-025e-4920-94b6-edd2f314fe14", "name": "network-vif-unplugged", "status": "completed", "tag": "38ada92b-863e-4ecb-a957-96d170033bfb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:54.237896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0eed9af-33d4-4aca-a02f-d11074671d60 req-9371ef90-c93f-49cc-9b83-2d62f38cab62 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.238761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0eed9af-33d4-4aca-a02f-d11074671d60 req-9371ef90-c93f-49cc-9b83-2d62f38cab62 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.239385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0eed9af-33d4-4aca-a02f-d11074671d60 req-9371ef90-c93f-49cc-9b83-2d62f38cab62 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.251731 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b0eed9af-33d4-4aca-a02f-d11074671d60 req-9371ef90-c93f-49cc-9b83-2d62f38cab62 service nova] Creating event network-vif-unplugged:38ada92b-863e-4ecb-a957-96d170033bfb for instance ea792d36-025e-4920-94b6-edd2f314fe14 on n-h2-853316-12 Oct 17 12:49:54.258077 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b0eed9af-33d4-4aca-a02f-d11074671d60 req-9371ef90-c93f-49cc-9b83-2d62f38cab62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040621 Oct 17 12:49:54.258860 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 181/355] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:54.264794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:54.265375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:54.272740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.273569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.274201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.274928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.275385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.275814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.299921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Request method failure captured: Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4/diagnostics HTTP/1.1 Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9VRjAQOkEEsUijDduMDxpity9c7apfzULLAKq1oHMnT2Zsj0YmhgxqeGg6Q4LZi-BbKVqRvHVjeT38hzgdUhhkmivAFXVCqm3mqV4195oN00q6wisUtq6ddHzOtyMnsvfYbuo07NAIwPjzTIgK5O2FG-0JQn0Mm8kslSJ3FcbdeE0 Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: aaaf8daae8414f86ae4a08bf5422df85 Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-294432606 Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:49:54.302725 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aaaf8daae8414f86ae4a08bf5422df85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aaaf8daae8414f86ae4a08bf5422df85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aaaf8daae8414f86ae4a08bf5422df85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aaaf8daae8414f86ae4a08bf5422df85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-294432606 Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: aaaf8daae8414f86ae4a08bf5422df85 Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-294432606 Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerDiagnosticsNegativeTest-294432606-project Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: d699c277952547d5ab19a8214961b65e Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-294432606-project Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:54.303980 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '7878cbd0-2215-49db-9b62-55c2d21ae8a4'} Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:54.304762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:54.305913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:54.307939 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ed295be-d955-478c-aa33-af5ecd764a53 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.043915 Oct 17 12:49:54.307939 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 182/356] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:49:54 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4/diagnostics => generated 117 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:49:54.313936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d21c3b78-8461-4b5d-9f6b-dad15f56282a req-9adbf215-aa59-47ef-8a84-cfa62ed727d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc63310a-af08-4f3a-9fc1-955e0d0da893", "name": "network-vif-plugged", "status": "completed", "tag": "0ff6d8f4-1928-4708-945d-08fe25a25cd3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:54.326847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d21c3b78-8461-4b5d-9f6b-dad15f56282a req-9adbf215-aa59-47ef-8a84-cfa62ed727d1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.327587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d21c3b78-8461-4b5d-9f6b-dad15f56282a req-9adbf215-aa59-47ef-8a84-cfa62ed727d1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.328174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d21c3b78-8461-4b5d-9f6b-dad15f56282a req-9adbf215-aa59-47ef-8a84-cfa62ed727d1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.345799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d21c3b78-8461-4b5d-9f6b-dad15f56282a req-9adbf215-aa59-47ef-8a84-cfa62ed727d1 service nova] Creating event network-vif-plugged:0ff6d8f4-1928-4708-945d-08fe25a25cd3 for instance cc63310a-af08-4f3a-9fc1-955e0d0da893 on n-h2-853316-12 Oct 17 12:49:54.352272 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d21c3b78-8461-4b5d-9f6b-dad15f56282a req-9adbf215-aa59-47ef-8a84-cfa62ed727d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045542 Oct 17 12:49:54.353470 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 183/357] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:54.358942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ce0b51f-62b7-4214-ba88-73c39ceb0ca1 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215f6820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:54.411270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ce0b51f-62b7-4214-ba88-73c39ceb0ca1 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/54f14943-57c4-419c-a2be-cdf7cf400625" status: 200 len: 662 microversion: 2.1 time: 0.056425 Oct 17 12:49:54.412238 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 184/358] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:49:54 2022] GET /compute/v2.1/images/54f14943-57c4-419c-a2be-cdf7cf400625 => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:54.416880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3aa6f0cb-7ed7-436f-8ccb-cc2079ae15ec tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:54.441320 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3aa6f0cb-7ed7-436f-8ccb-cc2079ae15ec tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.027793 Oct 17 12:49:54.442833 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 185/359] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:54 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:54.448074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:54.449092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:54.456293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.458041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.458660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.459539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.460147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.462052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.606948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:54.616225 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c2716551-2392-48d2-97a4-68fd366d90ce tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1319 microversion: 2.1 time: 0.171484 Oct 17 12:49:54.617074 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 186/360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:54 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:54.624124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:54.624913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:54.632449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.633250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.633779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.634626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.635177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.635704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.678384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:49:54.763508 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-78fd10c7-af66-4b6f-a323-103f32e15983 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 204 len: 0 microversion: 2.1 time: 0.144958 Oct 17 12:49:54.764494 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 187/361] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:49:54 2022] DELETE /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:49:54.770902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4abe2503-9ae4-4dce-9bdd-2d236f212cc2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215fcaf0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:54.844878 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4abe2503-9ae4-4dce-9bdd-2d236f212cc2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/54f14943-57c4-419c-a2be-cdf7cf400625" status: 200 len: 662 microversion: 2.1 time: 0.078848 Oct 17 12:49:54.870548 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 188/362] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:49:54 2022] GET /compute/v2.1/images/54f14943-57c4-419c-a2be-cdf7cf400625 => generated 662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:54.880115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8aba56ca-3aa6-4ea9-a132-21466307beaa tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-601829972"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:54.883545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.aggregate [None req-8aba56ca-3aa6-4ea9-a132-21466307beaa tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Generated uuid 6290bbc3-0f1c-4ffb-8158-81dc75546532 for aggregate {{(pid=127539) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 12:49:54.932403 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8aba56ca-3aa6-4ea9-a132-21466307beaa tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060630 Oct 17 12:49:54.935908 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 189/363] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 12:49:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:54.948434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:54.948977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:54.967423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.967918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.968364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:54.969075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:54.969525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:54.969944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.104708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Updating instance_info_cache with network_info: [{"id": "c2b9f881-8633-4890-96e4-8462666772c1", "address": "fa:16:3e:bb:9e:2b", "network": {"id": "fcc08196-2783-4add-8c4f-1228d3a30562", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1005131008-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "36f5a2ad7f31447fbbaca288ea3b0580", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc2b9f881-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 12:49:55.118535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:55.123337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Releasing lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:49:55.124216 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4f064e8d-4abc-4326-8afa-715a86885700 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action" status: 202 len: 0 microversion: 2.1 time: 2.925184 Oct 17 12:49:55.125013 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 175/364] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:49:52 2022] POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action => generated 0 bytes in 2927 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 12:49:55.128365 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d115ee5-4e70-47eb-b782-0efd0542fab6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1319 microversion: 2.1 time: 0.181975 Oct 17 12:49:55.128365 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 190/365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:54 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:55.132108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-eacd5196-058b-4080-988e-09fdec6e15f5 req-64fc0336-b957-4575-9665-e59e90e1146e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d", "tag": "c2b9f881-8633-4890-96e4-8462666772c1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:55.136148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:55.137014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:55.141398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eacd5196-058b-4080-988e-09fdec6e15f5 req-64fc0336-b957-4575-9665-e59e90e1146e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.141879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eacd5196-058b-4080-988e-09fdec6e15f5 req-64fc0336-b957-4575-9665-e59e90e1146e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.142328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eacd5196-058b-4080-988e-09fdec6e15f5 req-64fc0336-b957-4575-9665-e59e90e1146e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.146322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.146815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.147411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.148147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.148600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.149027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.156103 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-eacd5196-058b-4080-988e-09fdec6e15f5 req-64fc0336-b957-4575-9665-e59e90e1146e service nova] Creating event network-changed:c2b9f881-8633-4890-96e4-8462666772c1 for instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d on n-h1-853316-12 Oct 17 12:49:55.162234 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-eacd5196-058b-4080-988e-09fdec6e15f5 req-64fc0336-b957-4575-9665-e59e90e1146e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034030 Oct 17 12:49:55.163226 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 191/366] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:55.168564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:55.179553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.180147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.180651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.188551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.189078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.189507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.201373 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.compute.aggregates [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 17 12:49:55.202246 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Request method failure captured: Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 42 Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9ntQzc1LEwvQdUrWqLPwoa7XRsFt0VRlc5pK2YLxq9suRYTGwgq-swOYR-7_fSFdP_rYvI3usCoU1WmsEt0qeyTeJ6tXlIHkJLo9EKpGvnMhLS8IU0vQkkMKuGPzA3UW1WoxqTMIReCS64JTVvkx8CsodsQc81wX6E890EtrKJL5Y Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:49:55.204372 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4628ef26d284e388a35bf0432cee9f7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4628ef26d284e388a35bf0432cee9f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4628ef26d284e388a35bf0432cee9f7 Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211 Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 375fb8f63a134a8db246e98edb151b61 Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: {"remove_host": {"host": "nonexist_host"}} Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:49:55.205618 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 17 12:49:55.206343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 17 12:49:55.207423 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.208443 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-87fe90cc-f657-4d64-a931-5682d661271d tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.041425 Oct 17 12:49:55.210866 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 192/367] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 12:49:55 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:49:55.212779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab087e6a-c1ac-4671-b4cb-bec9233d1387 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'create', calling method: .version_select at 0x7fa82323fca0>, body: {"pool": "107dfb30-0fda-416a-9f56-050ede1e1c9c"} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:55.399984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:55.408857 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16f62e41-557e-43a9-90d2-d0b1a8206dcf tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1478 microversion: 2.1 time: 0.278568 Oct 17 12:49:55.420916 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 176/368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:55 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1478 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:55.425814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0bda08e-315a-46c9-9989-d036965c5bf9 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:55.448648 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0bda08e-315a-46c9-9989-d036965c5bf9 tempest-AggregatesAdminNegativeTestJSON-1674881211 tempest-AggregatesAdminNegativeTestJSON-1674881211-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.026400 Oct 17 12:49:55.449928 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 177/369] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:49:55 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 12:49:55.455669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:55.455847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:55.463702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.464424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.465198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.465561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.466010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.466465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.617697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:55.629269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:55.631724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:55.632898 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3281dd1-010e-4227-9308-e0dfe1594683 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1567 microversion: 2.25 time: 0.181916 Oct 17 12:49:55.633447 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 178/370] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:55 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:55.650029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:55.651803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:55.658375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.659192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.659628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.661065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:55.661523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:55.661947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:55.895661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:55.904900 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c5600980-0514-41a1-8782-f24d0aa1ebbf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1319 microversion: 2.1 time: 0.262636 Oct 17 12:49:55.905824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 179/371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:55 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:56.150112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:56.150794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:56.156957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:56.157363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:56.157792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:56.159145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:56.159293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:56.161870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:56.338769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:56.347815 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dce3102a-38bc-4a83-abf8-7c6d56a3edef tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1319 microversion: 2.1 time: 0.201293 Oct 17 12:49:56.358569 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 180/372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:56 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:56.395300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-fb732b3a-8d6f-4b63-9ca9-d8d4aa22feb9 req-75174f3a-9716-4846-a336-c529302039ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea792d36-025e-4920-94b6-edd2f314fe14", "tag": "38ada92b-863e-4ecb-a957-96d170033bfb"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:56.414241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fb732b3a-8d6f-4b63-9ca9-d8d4aa22feb9 req-75174f3a-9716-4846-a336-c529302039ae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:56.414825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fb732b3a-8d6f-4b63-9ca9-d8d4aa22feb9 req-75174f3a-9716-4846-a336-c529302039ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:56.415273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fb732b3a-8d6f-4b63-9ca9-d8d4aa22feb9 req-75174f3a-9716-4846-a336-c529302039ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:56.427667 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-fb732b3a-8d6f-4b63-9ca9-d8d4aa22feb9 req-75174f3a-9716-4846-a336-c529302039ae service nova] Creating event network-changed:38ada92b-863e-4ecb-a957-96d170033bfb for instance ea792d36-025e-4920-94b6-edd2f314fe14 on n-h2-853316-12 Oct 17 12:49:56.433661 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-fb732b3a-8d6f-4b63-9ca9-d8d4aa22feb9 req-75174f3a-9716-4846-a336-c529302039ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043914 Oct 17 12:49:56.434281 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 181/373] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:49:56.440116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:56.440837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:56.448015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:56.448693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:56.449215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:56.450407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:56.450893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:56.451750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:56.792180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:56.803098 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad3c53e2-0f75-4898-8c2e-a8db0eeeacb7 tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1478 microversion: 2.1 time: 0.367379 Oct 17 12:49:56.803858 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 182/374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:56 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1478 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:56.826398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5006ee7e-ef88-48ae-9350-337f1a719b3d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215b90d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:56.876024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5006ee7e-ef88-48ae-9350-337f1a719b3d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0420036c-8237-4541-a69f-cf8136c54c8f" status: 200 len: 662 microversion: 2.1 time: 0.060504 Oct 17 12:49:56.876591 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 183/375] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:49:56 2022] GET /compute/v2.1/images/0420036c-8237-4541-a69f-cf8136c54c8f => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:56.886212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:56.887139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:56.893413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:56.893890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:56.894489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:56.895794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:56.896251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:56.896681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:56.958877 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab087e6a-c1ac-4671-b4cb-bec9233d1387 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.750996 Oct 17 12:49:56.970207 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 193/376] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:49:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:56.976531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7aeb4a78-e01e-4e1e-913d-2b99cece2c5a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8217f4af0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:57.044051 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7aeb4a78-e01e-4e1e-913d-2b99cece2c5a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0420036c-8237-4541-a69f-cf8136c54c8f" status: 200 len: 662 microversion: 2.1 time: 0.071783 Oct 17 12:49:57.044819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 194/377] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:49:56 2022] GET /compute/v2.1/images/0420036c-8237-4541-a69f-cf8136c54c8f => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:57.086547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:57.087284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:57.099439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:57.100148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:57.100761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:57.101546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:57.102087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:57.103692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:57.235503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:57.249707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:57.251556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:57.252941 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-342e7d56-c413-4bfb-92db-a4882cd97828 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1567 microversion: 2.25 time: 0.375285 Oct 17 12:49:57.254386 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 184/378] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:56 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1567 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:57.259521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.133"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:57.261997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:57.268214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:57.268876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:57.270070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:57.270961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:57.271567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:57.272172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:57.305758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:49:57.306156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquired lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:49:57.390275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:57.400229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:57.404612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-27ccb781-6328-477f-876a-54aacfe645bf tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1469 microversion: 2.1 time: 0.329449 Oct 17 12:49:57.405496 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 195/379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:57 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:57.414571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2137266334", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:57.484855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:57.789471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:57.790105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:57.790752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:57.791313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:57.791891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:57.816624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:57.817273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:57.817538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:57.826382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:57.826953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:57.827398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:57.868237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Getting quotas for project 6c080d0ac46242b190000e3b8726fe80. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:57.875117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Getting quotas for user 39934c0a585849b4bef5f4ae8cf4a49e and project 6c080d0ac46242b190000e3b8726fe80. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:57.896740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:57.899130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:57.902947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=14 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:49:57.957905 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5eb46dcb-0237-4632-85ed-71f739bacf5d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551017 Oct 17 12:49:57.959516 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 196/380] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:49:57.982402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:57.983422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:58.000831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.001972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.004075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.005041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.006121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.008961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.311305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:58.321540 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dab28e34-1a33-4a3a-9f3e-b0ca73868918 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1319 microversion: 2.1 time: 0.359538 Oct 17 12:49:58.322558 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 197/381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:57 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:58.328302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:58.328756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:58.346637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.347145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.349161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.349903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.350396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.351087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.412289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.133 (0b19c36a-c6b5-4b40-87da-f45f001b6932) with port c2b9f881-8633-4890-96e4-8462666772c1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 107dfb30-0fda-416a-9f56-050ede1e1c9c.", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:49:58.413463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Releasing lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:49:58.414476 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.133 (0b19c36a-c6b5-4b40-87da-f45f001b6932) with port c2b9f881-8633-4890-96e4-8462666772c1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 107dfb30-0fda-416a-9f56-050ede1e1c9c. Oct 17 12:49:58.414476 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-4ba87294-e6b2-4173-a106-06dd4a6ae333'] Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Request method failure captured: Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action HTTP/1.1 Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 46 Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9IkrTRgHneVihjG6LJXSa_-ZF66I3O9mIANfxJQL_Bh__smI9lqJuQgEjNydo2sfzPMaegntsJtdQ0e_TvOQAodwWWJMFb4Mmj5rFqoo63DjI8o_QVLeYQQnq_vhqNsFkXmqOHsp8gwB_ZhKmOD9m1H2cgBw_GUlHhm1fXRu3Xy5g Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:49:58.417052 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f5a2ad7f31447fbbaca288ea3b0580", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6a8004505d9c4554b2ea1ded5014c51f Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: {"addFloatingIp": {"address": "172.25.6.133"}} Oct 17 12:49:58.418493 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: exception: Cannot associate floating IP 172.25.6.133 (0b19c36a-c6b5-4b40-87da-f45f001b6932) with port c2b9f881-8633-4890-96e4-8462666772c1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 107dfb30-0fda-416a-9f56-050ede1e1c9c. Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-4ba87294-e6b2-4173-a106-06dd4a6ae333'] Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d', 'body': {'addFloatingIp': {'address': '172.25.6.133'}}} Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:58.419286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:49:58.420402 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.133 (0b19c36a-c6b5-4b40-87da-f45f001b6932) with port c2b9f881-8633-4890-96e4-8462666772c1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 107dfb30-0fda-416a-9f56-050ede1e1c9c. Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ba87294-e6b2-4173-a106-06dd4a6ae333'] Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.133 (0b19c36a-c6b5-4b40-87da-f45f001b6932) with port c2b9f881-8633-4890-96e4-8462666772c1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 107dfb30-0fda-416a-9f56-050ede1e1c9c. Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ba87294-e6b2-4173-a106-06dd4a6ae333'] Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:58.421561 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.133 (0b19c36a-c6b5-4b40-87da-f45f001b6932) with port c2b9f881-8633-4890-96e4-8462666772c1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 107dfb30-0fda-416a-9f56-050ede1e1c9c. Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ba87294-e6b2-4173-a106-06dd4a6ae333'] Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:58.422543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.133 (0b19c36a-c6b5-4b40-87da-f45f001b6932) with port c2b9f881-8633-4890-96e4-8462666772c1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 107dfb30-0fda-416a-9f56-050ede1e1c9c. Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ba87294-e6b2-4173-a106-06dd4a6ae333'] Oct 17 12:49:58.423707 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:49:58.426540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Returning 400 to user: Cannot associate floating IP 172.25.6.133 (0b19c36a-c6b5-4b40-87da-f45f001b6932) with port c2b9f881-8633-4890-96e4-8462666772c1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network 107dfb30-0fda-416a-9f56-050ede1e1c9c. Oct 17 12:49:58.426540 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-4ba87294-e6b2-4173-a106-06dd4a6ae333'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:49:58.427872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8b51cb9-6dcf-421f-9884-087b0e5e78ad tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action" status: 400 len: 382 microversion: 2.1 time: 1.172404 Oct 17 12:49:58.428924 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 185/382] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:49:57 2022] POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action => generated 382 bytes in 1174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:49:58.433909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-da3fb521-7137-42f8-a695-3d2f117bb8ee req-9387b342-4059-401c-80c3-d9ac18dc004a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7878cbd0-2215-49db-9b62-55c2d21ae8a4", "name": "network-vif-deleted", "tag": "9cf38d18-537d-4a59-8f56-a2a592cdbb4a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:58.456943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-da3fb521-7137-42f8-a695-3d2f117bb8ee req-9387b342-4059-401c-80c3-d9ac18dc004a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.457787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-da3fb521-7137-42f8-a695-3d2f117bb8ee req-9387b342-4059-401c-80c3-d9ac18dc004a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.458409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-da3fb521-7137-42f8-a695-3d2f117bb8ee req-9387b342-4059-401c-80c3-d9ac18dc004a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.470926 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-da3fb521-7137-42f8-a695-3d2f117bb8ee req-9387b342-4059-401c-80c3-d9ac18dc004a service nova] Creating event network-vif-deleted:9cf38d18-537d-4a59-8f56-a2a592cdbb4a for instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 on n-h1-853316-12 Oct 17 12:49:58.476468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lazy-loading 'flavor' on Instance uuid cc63310a-af08-4f3a-9fc1-955e0d0da893 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:49:58.478499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-da3fb521-7137-42f8-a695-3d2f117bb8ee req-9387b342-4059-401c-80c3-d9ac18dc004a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047971 Oct 17 12:49:58.479305 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 186/383] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:49:58.485738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:58.486759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:58.493825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.494360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.494800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.495505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.495960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.496384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.532130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.532941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.533374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.533828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lazy-loading 'fault' on Instance uuid 7878cbd0-2215-49db-9b62-55c2d21ae8a4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:49:58.588903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd699c277952547d5ab19a8214961b65e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaaf8daae8414f86ae4a08bf5422df85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:58.601912 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6bfccd27-497a-43fd-a2c1-a3c201c1be6d tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 200 len: 1312 microversion: 2.1 time: 0.121206 Oct 17 12:49:58.602526 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 187/384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:58 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 1312 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:58.616762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1069317524", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:49:58.707156 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c2f75c8-9775-45b5-bccf-c55fba4c8be4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893/action" status: 202 len: 0 microversion: 2.1 time: 0.353629 Oct 17 12:49:58.713034 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 198/385] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:49:58 2022] POST /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:49:58.718039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:49:58.735945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:58.735945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:58.752857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.754939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.755496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:58.757666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:58.758436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:58.759157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:59.008964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:59.025363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:59.027268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:59.028874 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a35a614e-4c0e-4911-bb75-123c44551093 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1567 microversion: 2.25 time: 0.313857 Oct 17 12:49:59.030192 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 199/386] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:49:58 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1567 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:49:59.034998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5f54815b-680a-47f2-95ac-aaf7601b8e3c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '.version_select at 0x7fa8215f6d30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:59.145545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:49:59.146293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:49:59.146968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:49:59.147483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:49:59.147996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:49:59.159500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:59.160846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:59.161901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:59.162744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:59.163323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:59.163860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:59.188540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Getting quotas for project 6c080d0ac46242b190000e3b8726fe80. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:49:59.194564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Getting quotas for user 39934c0a585849b4bef5f4ae8cf4a49e and project 6c080d0ac46242b190000e3b8726fe80. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:49:59.214156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:49:59.218141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:49:59.310361 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-550936fc-c08e-48bf-9c20-b91b6da86c1d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705926 Oct 17 12:49:59.321845 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 188/387] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:49:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:49:59.331373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:59.332880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:59.358032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:59.359020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:59.359896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:59.361225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:59.362181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:59.364255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:59.629069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:59.647306 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-747331b0-f7a2-490a-b470-f7f7b131b9cc tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1477 microversion: 2.1 time: 0.323027 Oct 17 12:49:59.648709 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 189/388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:59 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:59.659192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-809481ab-5a11-48e5-9a22-d06b7bf12ab7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:59.661852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-809481ab-5a11-48e5-9a22-d06b7bf12ab7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:59.739355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-809481ab-5a11-48e5-9a22-d06b7bf12ab7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:59.749127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-809481ab-5a11-48e5-9a22-d06b7bf12ab7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1218 microversion: 2.1 time: 0.098570 Oct 17 12:49:59.750394 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 190/389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:59 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:59.756032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:59.756633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:49:59.763412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:59.764190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:59.764962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:59.765981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:49:59.766665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:49:59.767237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:49:59.955136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:49:59.968498 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6987d29-e7bf-44fd-834b-d64e12690139 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1319 microversion: 2.1 time: 0.216742 Oct 17 12:49:59.969423 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 191/390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:59 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:49:59.994411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:49:59.996987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] [instance: 7878cbd0-2215-49db-9b62-55c2d21ae8a4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:00.013061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.013677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.014232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:00.015740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.016316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.016902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:00.035642 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] HTTP exception thrown: Instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 could not be found. Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Request method failure captured: Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 HTTP/1.1 Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9VRjAQOkEEsUijDduMDxpity9c7apfzULLAKq1oHMnT2Zsj0YmhgxqeGg6Q4LZi-BbKVqRvHVjeT38hzgdUhhkmivAFXVCqm3mqV4195oN00q6wisUtq6ddHzOtyMnsvfYbuo07NAIwPjzTIgK5O2FG-0JQn0Mm8kslSJ3FcbdeE0 Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: aaaf8daae8414f86ae4a08bf5422df85 Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-294432606 Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:00.039996 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aaaf8daae8414f86ae4a08bf5422df85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aaaf8daae8414f86ae4a08bf5422df85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aaaf8daae8414f86ae4a08bf5422df85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aaaf8daae8414f86ae4a08bf5422df85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-294432606 Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: aaaf8daae8414f86ae4a08bf5422df85 Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-294432606 Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerDiagnosticsNegativeTest-294432606-project Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: d699c277952547d5ab19a8214961b65e Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-294432606-project Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 could not be found. Oct 17 12:50:00.041275 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7878cbd0-2215-49db-9b62-55c2d21ae8a4'} Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 could not be found. Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:00.041950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 could not be found. Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 could not be found. Oct 17 12:50:00.043103 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:00.044877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] Returning 404 to user: Instance 7878cbd0-2215-49db-9b62-55c2d21ae8a4 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:00.044877 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c37d8cc-80a4-4f0a-8edb-797b537524dd tempest-ServerDiagnosticsNegativeTest-294432606 tempest-ServerDiagnosticsNegativeTest-294432606-project] 10.222.0.27 "GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4" status: 404 len: 111 microversion: 2.1 time: 0.071000 Oct 17 12:50:00.044877 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 192/391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:49:59 2022] GET /compute/v2.1/servers/7878cbd0-2215-49db-9b62-55c2d21ae8a4 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:00.053836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8bda0855-22ca-4d5d-82b5-be1f4f3d2106 req-15bf9afa-3cc5-4c7f-95a5-2aaa02835a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884d3161-cfbe-40c2-82a9-6d0a013a811b", "name": "network-vif-plugged", "status": "completed", "tag": "dab6af1a-cb5b-4125-bc5f-8869228ed1c0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:00.067113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8bda0855-22ca-4d5d-82b5-be1f4f3d2106 req-15bf9afa-3cc5-4c7f-95a5-2aaa02835a4f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.067501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8bda0855-22ca-4d5d-82b5-be1f4f3d2106 req-15bf9afa-3cc5-4c7f-95a5-2aaa02835a4f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.068025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8bda0855-22ca-4d5d-82b5-be1f4f3d2106 req-15bf9afa-3cc5-4c7f-95a5-2aaa02835a4f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:00.072760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:00.081663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8bda0855-22ca-4d5d-82b5-be1f4f3d2106 req-15bf9afa-3cc5-4c7f-95a5-2aaa02835a4f service nova] Creating event network-vif-plugged:dab6af1a-cb5b-4125-bc5f-8869228ed1c0 for instance 884d3161-cfbe-40c2-82a9-6d0a013a811b on n-h2-853316-12 Oct 17 12:50:00.087316 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8bda0855-22ca-4d5d-82b5-be1f4f3d2106 req-15bf9afa-3cc5-4c7f-95a5-2aaa02835a4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043243 Oct 17 12:50:00.088162 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 193/392] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:00.094780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:00.096411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:00.104252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.105308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.105970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:00.106859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.107470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.108129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:00.468349 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5f54815b-680a-47f2-95ac-aaf7601b8e3c tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/0b19c36a-c6b5-4b40-87da-f45f001b6932" status: 202 len: 0 microversion: 2.1 time: 1.436808 Oct 17 12:50:00.470039 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 200/393] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:49:59 2022] DELETE /compute/v2.1/os-floating-ips/0b19c36a-c6b5-4b40-87da-f45f001b6932 => generated 0 bytes in 1439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:00.478954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'action', calling method: .version_select at 0x7fa8235ef8b0>, body: {"removeFloatingIp": {"address": "172.25.6.124"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:00.572426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:00.581528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:00.588706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:00.590137 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6281c426-8459-4115-a541-0b9c5b3896d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1567 microversion: 2.25 time: 0.500756 Oct 17 12:50:00.593641 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 194/394] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:00 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1567 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:00.681552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:00.685545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:00.693883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.694916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.695723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:00.697064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.697896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.698514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:00.737736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:00.748821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.749320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.750581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:00.751303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:00.751766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:00.752201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:01.046186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:50:01.046596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquired lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:50:01.106077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:01.115958 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2589c187-eb74-4682-bd41-4099f4b69ebe tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1460 microversion: 2.1 time: 0.439854 Oct 17 12:50:01.134086 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 195/395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:00 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1460 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:01.140051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:01.140886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:01.148617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:01.149400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:01.149992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:01.150897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:01.151571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:01.152144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:01.306546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:01.333371 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-17699792-24b9-4619-85e6-a1411c81b721 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1270 microversion: 2.1 time: 0.197865 Oct 17 12:50:01.342342 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 196/396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:01 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:01.347242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:01.348435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:01.372601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:01.373101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:01.373542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:01.381059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:01.381575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:01.382028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:01.794078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:01.802451 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b2a4d39d-f9e9-48a5-97d6-bb6d471506f7 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1319 microversion: 2.1 time: 0.463725 Oct 17 12:50:01.811193 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 197/397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:01 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:01.815723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:01.816949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:01.826978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:01.827471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:01.827908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:01.828609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:01.829063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:01.829490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:02.632936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Building network info cache for instance {{(pid=127539) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 12:50:02.665077 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-54845edb-bfcd-43aa-a72f-91180151913e tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1613 microversion: 2.1 time: 0.851817 Oct 17 12:50:02.668264 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 198/398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:01 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1613 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:02.682198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:02.683301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:02.715032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:02.720318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:02.722060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:02.725334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:02.726723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:02.729547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:03.337391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:03.349352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:03.351647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:03.352993 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-22ca55ff-4320-434b-add5-70e9eb8f4194 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1567 microversion: 2.25 time: 0.682633 Oct 17 12:50:03.358899 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 199/399] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:02 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1567 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:03.369914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:03.373665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:03.392542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:03.393066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:03.393517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:03.394327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:03.394813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:03.395880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:03.519078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:03.531955 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-037b3335-a368-4bf1-9031-0262e93f2c73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1276 microversion: 2.1 time: 0.171864 Oct 17 12:50:03.532742 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 200/400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:03 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:03.551159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5fa08c23-b177-4527-bf20-4bef76957e5c req-836cbf98-0e8c-4b60-8d07-726b1bf8837a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d", "tag": "c2b9f881-8633-4890-96e4-8462666772c1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:03.567771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5fa08c23-b177-4527-bf20-4bef76957e5c req-836cbf98-0e8c-4b60-8d07-726b1bf8837a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:03.571491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5fa08c23-b177-4527-bf20-4bef76957e5c req-836cbf98-0e8c-4b60-8d07-726b1bf8837a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:03.574224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5fa08c23-b177-4527-bf20-4bef76957e5c req-836cbf98-0e8c-4b60-8d07-726b1bf8837a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:03.608561 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5fa08c23-b177-4527-bf20-4bef76957e5c req-836cbf98-0e8c-4b60-8d07-726b1bf8837a service nova] Creating event network-changed:c2b9f881-8633-4890-96e4-8462666772c1 for instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d on n-h1-853316-12 Oct 17 12:50:03.617816 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5fa08c23-b177-4527-bf20-4bef76957e5c req-836cbf98-0e8c-4b60-8d07-726b1bf8837a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083179 Oct 17 12:50:03.620950 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 201/401] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:03.637470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-078047f2-8b35-4594-b44b-1fadb81d41c4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:03.645146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-078047f2-8b35-4594-b44b-1fadb81d41c4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:03.645869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-078047f2-8b35-4594-b44b-1fadb81d41c4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:03.646502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-078047f2-8b35-4594-b44b-1fadb81d41c4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:03.647432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-078047f2-8b35-4594-b44b-1fadb81d41c4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:03.649020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-078047f2-8b35-4594-b44b-1fadb81d41c4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:03.651227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-078047f2-8b35-4594-b44b-1fadb81d41c4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:03.742466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-078047f2-8b35-4594-b44b-1fadb81d41c4 tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.110400 Oct 17 12:50:03.744350 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 202/402] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 12:50:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:03.765770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:03.775352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:03.794973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:03.798847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:03.800383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:03.802203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:03.804644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:03.807990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:04.009565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Updating instance_info_cache with network_info: [{"id": "c2b9f881-8633-4890-96e4-8462666772c1", "address": "fa:16:3e:bb:9e:2b", "network": {"id": "fcc08196-2783-4add-8c4f-1228d3a30562", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1005131008-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "36f5a2ad7f31447fbbaca288ea3b0580", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc2b9f881-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127539) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 12:50:04.043964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Releasing lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:50:04.044856 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6676e80a-0f25-48d7-8982-08db9d8d6ea5 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action" status: 202 len: 0 microversion: 2.1 time: 3.569874 Oct 17 12:50:04.045841 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 201/403] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:00 2022] POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action => generated 0 bytes in 3571 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 17 12:50:04.060858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853316-12", "block_migration": true, "disk_over_commit": false}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:04.063760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:04.082114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:04.084254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:04.084741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:04.085491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:04.085958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:04.090771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:04.151480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Lazy-loading 'flavor' on Instance uuid cc63310a-af08-4f3a-9fc1-955e0d0da893 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:04.184477 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance cc63310a-af08-4f3a-9fc1-955e0d0da893 while it is in vm_state suspended Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Request method failure captured: Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893/action HTTP/1.1 Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 98 Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9J5TY_Sa11e56WZcNy-UFJV8dl2VahQujj2YK9kLJv5I07st4eWNefwUkMIahMs6Z_rIzE2IhBHnJ5Wh254g2yCGN9Xn6f5raVmTsiSjMrZH3Yz6TbY1KJ0ujKOaud38TtjzE-2zTnZr15n7lWh_d3S21NH_91xtLrIQ22VwbbCsw Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 43c5b56b60f24cccafd01fcbd57fdb5f Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-LiveMigrationNegativeTest-2077029240 Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:50:04.190055 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_43c5b56b60f24cccafd01fcbd57fdb5f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43c5b56b60f24cccafd01fcbd57fdb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/43c5b56b60f24cccafd01fcbd57fdb5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/43c5b56b60f24cccafd01fcbd57fdb5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-LiveMigrationNegativeTest-2077029240 Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 43c5b56b60f24cccafd01fcbd57fdb5f Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2077029240 Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-LiveMigrationNegativeTest-2077029240-project-admin Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: bb5e619de9c64da3aaccc99f0dbd4f11 Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-LiveMigrationNegativeTest-2077029240-project-admin Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: {"os-migrateLive": {"host": "n-h1-853316-12", "block_migration": true, "disk_over_commit": false}} Oct 17 12:50:04.192114 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'os-migrateLive' instance cc63310a-af08-4f3a-9fc1-955e0d0da893 while it is in vm_state suspended Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'cc63310a-af08-4f3a-9fc1-955e0d0da893', 'body': {'os-migrateLive': {'host': 'n-h1-853316-12', 'block_migration': True, 'disk_over_commit': False}}} Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 12:50:04.192995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc63310a-af08-4f3a-9fc1-955e0d0da893 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:04.194064 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance cc63310a-af08-4f3a-9fc1-955e0d0da893 while it is in vm_state suspended Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance cc63310a-af08-4f3a-9fc1-955e0d0da893 while it is in vm_state suspended Oct 17 12:50:04.195291 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:04.197103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance cc63310a-af08-4f3a-9fc1-955e0d0da893 while it is in vm_state suspended {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:04.200888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-12450476-3042-48a1-ab27-d6e8b56892fe tempest-LiveMigrationNegativeTest-2077029240 tempest-LiveMigrationNegativeTest-2077029240-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893/action" status: 409 len: 155 microversion: 2.1 time: 0.152199 Oct 17 12:50:04.201676 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 202/404] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:04 2022] POST /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893/action => generated 155 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:50:04.211695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-13114d68-d191-4443-8a00-599cde1ebbef tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '.version_select at 0x7fa8215e9dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:04.795788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:04.809393 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13a09c07-15cd-4cd8-bbfa-2f818f53c9be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1469 microversion: 2.1 time: 1.057539 Oct 17 12:50:04.814332 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 203/405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:03 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1469 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:04.829477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:04.829995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:04.855577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:04.857550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:04.858943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:04.860210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:04.861745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:04.863242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:04.865173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:04.900920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:50:05.004445 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18cc18ec-90fd-469c-998f-2c1af1d6197f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 204 len: 0 microversion: 2.1 time: 0.188507 Oct 17 12:50:05.005220 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 204/406] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:04 2022] DELETE /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:50:05.015262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:05.016208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:05.028583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:05.029189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:05.030704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:05.031446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:05.031915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:05.032638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:05.366326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:05.376072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:05.377855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:05.380028 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a446cca9-36cd-47aa-9c8f-9a3af5910058 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1567 microversion: 2.25 time: 0.371700 Oct 17 12:50:05.381408 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 205/407] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:05 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1567 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:05.386460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:05.387212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:05.395080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:05.395730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:05.396401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:05.397333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:05.398090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:05.398772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:05.637016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:05.654405 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e950df0c-22b9-4907-8e53-4d015b09a409 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.271666 Oct 17 12:50:05.655348 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 206/408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:05 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:05.825963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85bd27c4-2b52-47c3-b75e-5c2c20600ccc tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-247432703", "id": 1876168502, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:05.851356 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85bd27c4-2b52-47c3-b75e-5c2c20600ccc tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.194766 Oct 17 12:50:05.852747 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 207/409] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:05 2022] POST /compute/v2.1/flavors => generated 429 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:05.983863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:05.984372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:05.991984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:05.992783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:05.993560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:05.994443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:05.995157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:05.995889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.026693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:50:06.129422 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e33a663e-ece7-49b6-a6c5-10f8024d389f tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 204 len: 0 microversion: 2.1 time: 0.274680 Oct 17 12:50:06.129964 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 208/410] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:05 2022] DELETE /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:50:06.190375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1545520648", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:06.248468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:50:06.255937 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-13114d68-d191-4443-8a00-599cde1ebbef tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/e8faa1b5-60db-47e4-99a7-cf19835edcf2" status: 202 len: 0 microversion: 2.1 time: 2.050560 Oct 17 12:50:06.257137 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 203/411] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:50:04 2022] DELETE /compute/v2.1/os-floating-ips/e8faa1b5-60db-47e4-99a7-cf19835edcf2 => generated 0 bytes in 2052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:06.263240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:06.264177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:06.272240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.274544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.275064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.275913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.276594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.277236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.477226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:50:06.477905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:50:06.478481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:50:06.478961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:50:06.479440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:50:06.489330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.490025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.490566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.491700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.492227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.492729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.510903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Getting quotas for project beb2bb05c21a441caa0d9f23de809625. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:50:06.514976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Getting quotas for user 7b5b462b403142459bfb1a10c6ddbc54 and project beb2bb05c21a441caa0d9f23de809625. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:50:06.526259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:50:06.528651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:50:06.582197 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a534d638-0436-43d1-aa8b-d25175f920af tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.449944 Oct 17 12:50:06.582811 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 209/412] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:50:06.590114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:06.596937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f35deda5-1a50-4a8b-8b58-eab3b2059768 req-e3eeef33-5f6d-40db-ac13-0b9c53ecd631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652645b9-e4bb-48f1-be51-e9483a163116", "tag": "29f3ca43-09a3-4d2b-9a04-d9d3003b14d2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:06.607989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f35deda5-1a50-4a8b-8b58-eab3b2059768 req-e3eeef33-5f6d-40db-ac13-0b9c53ecd631 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.608469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f35deda5-1a50-4a8b-8b58-eab3b2059768 req-e3eeef33-5f6d-40db-ac13-0b9c53ecd631 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.608893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f35deda5-1a50-4a8b-8b58-eab3b2059768 req-e3eeef33-5f6d-40db-ac13-0b9c53ecd631 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.614337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:06.618968 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-697ae8cb-919c-4399-ab5e-bf1bfc009375 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1466 microversion: 2.1 time: 0.347164 Oct 17 12:50:06.620799 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 204/413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:06 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1466 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:06.624742 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f35deda5-1a50-4a8b-8b58-eab3b2059768 req-e3eeef33-5f6d-40db-ac13-0b9c53ecd631 service nova] Creating event network-changed:29f3ca43-09a3-4d2b-9a04-d9d3003b14d2 for instance 652645b9-e4bb-48f1-be51-e9483a163116 on n-h1-853316-12 Oct 17 12:50:06.633832 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f35deda5-1a50-4a8b-8b58-eab3b2059768 req-e3eeef33-5f6d-40db-ac13-0b9c53ecd631 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049676 Oct 17 12:50:06.635290 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 210/414] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:06.640883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8a0b53b4-808c-479b-bfa3-a17223fe1424 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:06.641843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:06.642661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:06.651347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.651913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.652438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.653136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.653589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.654009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.673020 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8a0b53b4-808c-479b-bfa3-a17223fe1424 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1876168502" status: 202 len: 0 microversion: 2.1 time: 0.047816 Oct 17 12:50:06.676058 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 205/415] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:50:06 2022] DELETE /compute/v2.1/flavors/1876168502 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:06.687140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84a8ca20-3d85-49ff-bca1-515c9a46430d tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'action', calling method: .version_select at 0x7fa8235dbb80>, body: {"addFloatingIp": {"address": ""}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84a8ca20-3d85-49ff-bca1-515c9a46430d tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Request method failure captured: Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action HTTP/1.1 Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 34 Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9IkrTRgHneVihjG6LJXSa_-ZF66I3O9mIANfxJQL_Bh__smI9lqJuQgEjNydo2sfzPMaegntsJtdQ0e_TvOQAodwWWJMFb4Mmj5rFqoo63DjI8o_QVLeYQQnq_vhqNsFkXmqOHsp8gwB_ZhKmOD9m1H2cgBw_GUlHhm1fXRu3Xy5g Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:50:06.693359 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f5a2ad7f31447fbbaca288ea3b0580", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a8004505d9c4554b2ea1ded5014c51f Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: {"addFloatingIp": {"address": ""}} Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:50:06.694676 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d', 'body': {'addFloatingIp': {'address': ''}}} Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi '' Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:06.695400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:50:06.696566 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:50:06.697662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 12:50:06.697662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:06.702242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84a8ca20-3d85-49ff-bca1-515c9a46430d tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:06.703379 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84a8ca20-3d85-49ff-bca1-515c9a46430d tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action" status: 400 len: 142 microversion: 2.1 time: 0.026000 Oct 17 12:50:06.704125 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 206/416] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:06 2022] POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action => generated 142 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:50:06.711825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-20cd4843-6fa0-40d4-bdd4-0dcc303b86bc req-02c144d6-24a5-4f1e-9fee-3019f1402e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1584fb0-8664-4fa6-8ef7-58b1107b78c2", "tag": "14eafe5b-088e-4dfd-853c-16d4a0e15ed1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:06.729293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20cd4843-6fa0-40d4-bdd4-0dcc303b86bc req-02c144d6-24a5-4f1e-9fee-3019f1402e2e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.730265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20cd4843-6fa0-40d4-bdd4-0dcc303b86bc req-02c144d6-24a5-4f1e-9fee-3019f1402e2e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.730858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20cd4843-6fa0-40d4-bdd4-0dcc303b86bc req-02c144d6-24a5-4f1e-9fee-3019f1402e2e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.742306 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-20cd4843-6fa0-40d4-bdd4-0dcc303b86bc req-02c144d6-24a5-4f1e-9fee-3019f1402e2e service nova] Creating event network-changed:14eafe5b-088e-4dfd-853c-16d4a0e15ed1 for instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 on n-h1-853316-12 Oct 17 12:50:06.747077 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-20cd4843-6fa0-40d4-bdd4-0dcc303b86bc req-02c144d6-24a5-4f1e-9fee-3019f1402e2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041800 Oct 17 12:50:06.747982 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 207/417] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:06.753532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:06.755215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:06.762296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.762954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.763385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.764074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.764524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.764944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.842352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:06.851761 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd38ceff-ce82-4392-9f58-7e2048aaeb98 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1475 microversion: 2.1 time: 0.215102 Oct 17 12:50:06.852541 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 211/418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:06 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1475 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:06.856971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4478e461-c75a-4d8a-81eb-b5d6a726d1b5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:06.857458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4478e461-c75a-4d8a-81eb-b5d6a726d1b5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:06.915123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:06.921366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4478e461-c75a-4d8a-81eb-b5d6a726d1b5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:06.925580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:06.927688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:06.928864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0950f4f9-839e-4d67-8f6f-02ea0389f492 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1557 microversion: 2.25 time: 0.179765 Oct 17 12:50:06.929887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 208/419] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:06 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:06.931093 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4478e461-c75a-4d8a-81eb-b5d6a726d1b5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1217 microversion: 2.1 time: 0.077713 Oct 17 12:50:06.942195 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 212/420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:06 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:06.948290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd3e28a6-c831-4f3a-b7e8-5a834d9a5a16 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:06.952578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:06.953593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:06.960763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.961297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.961638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.962379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.962836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.963264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.973199 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd3e28a6-c831-4f3a-b7e8-5a834d9a5a16 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.039272 Oct 17 12:50:06.973788 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 213/421] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:06 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:06.978369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:06.980681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:06.986631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.987106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.987522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:06.988811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:06.989333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:06.989750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.015523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:50:07.015923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquired lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:50:07.108241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:07.116918 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c0e110b7-089c-4ad0-a1b5-ad8e7a3532fd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.185370 Oct 17 12:50:07.117555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 209/422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:06 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:07.125382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Releasing lock "refresh_cache-7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:50:07.125850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3082f349-4508-418b-893f-1b691248ce5b tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '.version_select at 0x7fa82148dca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.125965 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] HTTP exception thrown: floating IP not found Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Request method failure captured: Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action HTTP/1.1 Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 41 Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9IkrTRgHneVihjG6LJXSa_-ZF66I3O9mIANfxJQL_Bh__smI9lqJuQgEjNydo2sfzPMaegntsJtdQ0e_TvOQAodwWWJMFb4Mmj5rFqoo63DjI8o_QVLeYQQnq_vhqNsFkXmqOHsp8gwB_ZhKmOD9m1H2cgBw_GUlHhm1fXRu3Xy5g Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:07.127623 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f5a2ad7f31447fbbaca288ea3b0580", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6a8004505d9c4554b2ea1ded5014c51f Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:50:07.128943 n-d-853316-12 devstack@n-api.service[127540]: exception: floating IP not found Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:07.129646 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 17 12:50:07.131178 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.132904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Returning 404 to user: floating IP not found {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:07.132904 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-73826308-1c1d-4ab9-9391-9d2afc73d8dd tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action" status: 404 len: 67 microversion: 2.1 time: 0.154429 Oct 17 12:50:07.132904 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 214/423] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:06 2022] POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action => generated 67 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:50:07.136725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4870908e-23d2-47a3-9e01-ec0fd4fa3e12 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2075160130", "id": 1575215705, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:07.139769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3082f349-4508-418b-893f-1b691248ce5b tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.140637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3082f349-4508-418b-893f-1b691248ce5b tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.141179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3082f349-4508-418b-893f-1b691248ce5b tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.157403 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4870908e-23d2-47a3-9e01-ec0fd4fa3e12 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.026212 Oct 17 12:50:07.158013 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 215/424] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:07 2022] POST /compute/v2.1/flavors => generated 417 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:07.160525 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3082f349-4508-418b-893f-1b691248ce5b tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.040415 Oct 17 12:50:07.161875 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 210/425] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:07.163908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4230927-f179-4ca2-8ff0-8e0c96596c33 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Action: 'action', calling method: .version_select at 0x7fa822bc0430>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:07.173662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d8784f7-0fbf-437c-85b7-e90654f021e9 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.195338 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d8784f7-0fbf-437c-85b7-e90654f021e9 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6214 microversion: 2.1 time: 0.028414 Oct 17 12:50:07.195921 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 211/426] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/flavors/detail => generated 6214 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:07.200268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.200865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:07.206565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.207595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.208074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.208764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.209214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.209336 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f4230927-f179-4ca2-8ff0-8e0c96596c33 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 17 12:50:07.209678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4230927-f179-4ca2-8ff0-8e0c96596c33 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Request method failure captured: Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action HTTP/1.1 Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 44 Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9IkrTRgHneVihjG6LJXSa_-ZF66I3O9mIANfxJQL_Bh__smI9lqJuQgEjNydo2sfzPMaegntsJtdQ0e_TvOQAodwWWJMFb4Mmj5rFqoo63DjI8o_QVLeYQQnq_vhqNsFkXmqOHsp8gwB_ZhKmOD9m1H2cgBw_GUlHhm1fXRu3Xy5g Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:07.211795 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f5a2ad7f31447fbbaca288ea3b0580", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6a8004505d9c4554b2ea1ded5014c51f Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:50:07.213079 n-d-853316-12 devstack@n-api.service[127540]: exception: Floating IP not found for address 0.0.0.0. Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:07.213777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 17 12:50:07.214849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:07.217077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4230927-f179-4ca2-8ff0-8e0c96596c33 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:07.217077 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4230927-f179-4ca2-8ff0-8e0c96596c33 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action" status: 404 len: 88 microversion: 2.1 time: 0.054157 Oct 17 12:50:07.217077 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 216/427] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:07 2022] POST /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d/action => generated 88 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:50:07.221478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-267fd258-eca9-4694-b84e-ab0c483a627e tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.239701 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-267fd258-eca9-4694-b84e-ab0c483a627e tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1575215705" status: 202 len: 0 microversion: 2.1 time: 0.023906 Oct 17 12:50:07.240535 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 217/428] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:50:07 2022] DELETE /compute/v2.1/flavors/1575215705 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:07.245485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.246001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:07.252044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.252533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.252973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.254281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.254744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.255275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.288527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:50:07.344547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid ea792d36-025e-4920-94b6-edd2f314fe14 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:07.358079 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3881fcde-f5cc-4b0a-9494-6e7ac2491e67 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 2051 microversion: 2.25 time: 0.161150 Oct 17 12:50:07.358774 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 212/429] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 2051 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:07.369001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-61c43440-a713-44e4-bcd8-29b831a961fb tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.384785 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f2b27a0f-dae2-464a-82fe-8f4e3b0e9f13 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 204 len: 0 microversion: 2.1 time: 0.142686 Oct 17 12:50:07.389074 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 218/430] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:07 2022] DELETE /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:50:07.395723 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-61c43440-a713-44e4-bcd8-29b831a961fb tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.030070 Oct 17 12:50:07.396638 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 213/431] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:07.398725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.399761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:07.410368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.410368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.411046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.411545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.412003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.412493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.419542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a111212f-1057-476c-a79b-237cea3b7e7f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1698513923", "id": 1535957267, "os-flavor-access:is_public": "True"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:07.440818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a111212f-1057-476c-a79b-237cea3b7e7f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026836 Oct 17 12:50:07.441825 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 214/432] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:07 2022] POST /compute/v2.1/flavors => generated 429 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:07.453636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c5c235a5-1627-4a23-98b1-26fa0c1d91ab tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.462071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=8,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:07.490608 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c5c235a5-1627-4a23-98b1-26fa0c1d91ab tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1535957267" status: 202 len: 0 microversion: 2.1 time: 0.040404 Oct 17 12:50:07.494373 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 215/433] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:50:07 2022] DELETE /compute/v2.1/flavors/1535957267 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:50:07.500200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af45551a-2763-4f43-b2a3-c1d5e0436336 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.527032 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af45551a-2763-4f43-b2a3-c1d5e0436336 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.030603 Oct 17 12:50:07.527911 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 216/434] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:07.532542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1318700241", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e9442b7e-a211-428d-b994-b659608d7553"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:07.575637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:07.583701 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-821c25b8-0011-48bc-a812-bb74224882b1 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1543 microversion: 2.1 time: 0.192984 Oct 17 12:50:07.584352 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 219/435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1543 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:07.588633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f4e9e5c-a048-4858-831a-0cef2ec696d3 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-281731083", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:07.589861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] validate_networks() for [('e9442b7e-a211-428d-b994-b659608d7553', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:50:07.607569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f4e9e5c-a048-4858-831a-0cef2ec696d3 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.022178 Oct 17 12:50:07.608187 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 220/436] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:07 2022] POST /compute/v2.1/flavors => generated 506 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:07.620505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d05797aa-1a4b-4c43-922b-c048a5b7e3dd tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.638071 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d05797aa-1a4b-4c43-922b-c048a5b7e3dd tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/f5ee7d04-9df6-4173-9e1b-8f0b70ea16d0" status: 202 len: 0 microversion: 2.1 time: 0.021173 Oct 17 12:50:07.639311 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 221/437] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:07 2022] DELETE /compute/v2.1/flavors/f5ee7d04-9df6-4173-9e1b-8f0b70ea16d0 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:50:07.647028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.647638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:07.653399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.653885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.654381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.655082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.655533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.655955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.839857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:07.885953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:07.888199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:07.903034 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d0144b3-a3ea-4986-83ed-b427e2217f7e tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1466 microversion: 2.1 time: 0.259956 Oct 17 12:50:07.904231 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 222/438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1466 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:07.908960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-05c8c6e8-2fab-455b-ae34-de943ac06385 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.933731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-05c8c6e8-2fab-455b-ae34-de943ac06385 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.028196 Oct 17 12:50:07.934801 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 223/439] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:07.939101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:07.939704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:07.953977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.954502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.955053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:07.955751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:07.956208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:07.956669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.177161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:08.185789 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d97cf29f-99bf-42df-9774-ac4fb4f3856b tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1475 microversion: 2.1 time: 0.250129 Oct 17 12:50:08.190661 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 224/440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:07 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1475 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:08.199646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:08.200733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:08.208524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.209948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.211325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.212124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.212664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.213207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.308022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:08.320672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3790a054-436a-47ed-a8ab-6d6ab58743d1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1213 microversion: 2.1 time: 0.128463 Oct 17 12:50:08.335280 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 225/441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:08 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:08.346642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-491f7a80-5c24-4c73-b010-4ad257c7aaae tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-305806620", "id": "be74c7a9-486f-4709-965e-786709a80aa1", "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:08.385760 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-491f7a80-5c24-4c73-b010-4ad257c7aaae tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046504 Oct 17 12:50:08.386497 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 226/442] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:08 2022] POST /compute/v2.1/flavors => generated 506 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:08.399010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:08.399537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:08.417139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.418717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.421844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.422688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.424466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.427439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.453827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:50:08.454779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:50:08.455402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:50:08.455963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:50:08.456551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:50:08.480904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.481828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.482472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.483401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.484025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.484620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.529447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for project c964bbec50ba4a2480831a33d6a935c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:50:08.540188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for user 8dfeceb58cdd47b8b82d905614ba3d5b and project c964bbec50ba4a2480831a33d6a935c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:50:08.566658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:50:08.573477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:50:08.678219 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd8df4bd-3a9d-46e5-a132-7f881da28be4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.149243 Oct 17 12:50:08.679414 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 217/443] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 12:50:08.704014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f99dbf55-ae90-45be-83d6-56588dabaf0b tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:08.738890 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f99dbf55-ae90-45be-83d6-56588dabaf0b tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/be74c7a9-486f-4709-965e-786709a80aa1" status: 202 len: 0 microversion: 2.1 time: 0.058254 Oct 17 12:50:08.743319 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 218/444] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:08 2022] DELETE /compute/v2.1/flavors/be74c7a9-486f-4709-965e-786709a80aa1 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:08.749820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:08.751092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:08.761951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.762483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.762928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.765201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.765797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.766236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.833961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:08.859795 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be9f91ec-04d8-4937-8abe-b257259dc3aa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.470813 Oct 17 12:50:08.867081 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 227/445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:08 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:08.876160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1324dafa-8128-419b-935e-8277c80cfb6f req-ba3e3fe2-17e1-4604-9358-cde0dd615e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc63310a-af08-4f3a-9fc1-955e0d0da893", "name": "network-vif-deleted", "tag": "0ff6d8f4-1928-4708-945d-08fe25a25cd3"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:08.916874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1324dafa-8128-419b-935e-8277c80cfb6f req-ba3e3fe2-17e1-4604-9358-cde0dd615e7a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:08.918039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1324dafa-8128-419b-935e-8277c80cfb6f req-ba3e3fe2-17e1-4604-9358-cde0dd615e7a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:08.918676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1324dafa-8128-419b-935e-8277c80cfb6f req-ba3e3fe2-17e1-4604-9358-cde0dd615e7a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:08.934708 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1324dafa-8128-419b-935e-8277c80cfb6f req-ba3e3fe2-17e1-4604-9358-cde0dd615e7a service nova] Creating event network-vif-deleted:0ff6d8f4-1928-4708-945d-08fe25a25cd3 for instance cc63310a-af08-4f3a-9fc1-955e0d0da893 on n-h2-853316-12 Oct 17 12:50:08.939919 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1324dafa-8128-419b-935e-8277c80cfb6f req-ba3e3fe2-17e1-4604-9358-cde0dd615e7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071296 Oct 17 12:50:08.950334 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 228/446] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:08.956305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd7465d9-e757-4374-9c41-a516ced8bae6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:08.957987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd7465d9-e757-4374-9c41-a516ced8bae6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:08.961360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:09.036070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fd7465d9-e757-4374-9c41-a516ced8bae6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:09.072488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fd7465d9-e757-4374-9c41-a516ced8bae6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:09.073066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:09.074747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fd7465d9-e757-4374-9c41-a516ced8bae6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:09.075507 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd7465d9-e757-4374-9c41-a516ced8bae6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1262 microversion: 2.25 time: 0.123477 Oct 17 12:50:09.075870 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 229/447] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:08 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1262 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:09.086116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62663567-75c0-4ad8-8a7e-170a19aadcdb tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.100060 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1f11d99e-8ce6-435f-8389-d12006acd837 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1543 microversion: 2.1 time: 0.355417 Oct 17 12:50:09.100868 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 219/448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:08 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1543 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:09.111256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.114215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:09.127437 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62663567-75c0-4ad8-8a7e-170a19aadcdb tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.049476 Oct 17 12:50:09.130548 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 230/449] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:09.144853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.145374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.149385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4ef48c9f-2355-435a-85d8-adebbd8a9bb4 req-15baca63-77b3-44a7-bc3e-b88313ebff9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884d3161-cfbe-40c2-82a9-6d0a013a811b", "name": "network-vif-deleted", "tag": "dab6af1a-cb5b-4125-bc5f-8869228ed1c0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:09.157054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.162087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ef48c9f-2355-435a-85d8-adebbd8a9bb4 req-15baca63-77b3-44a7-bc3e-b88313ebff9d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.162435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.162620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ef48c9f-2355-435a-85d8-adebbd8a9bb4 req-15baca63-77b3-44a7-bc3e-b88313ebff9d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.163562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ef48c9f-2355-435a-85d8-adebbd8a9bb4 req-15baca63-77b3-44a7-bc3e-b88313ebff9d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.163683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.163765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.183648 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4ef48c9f-2355-435a-85d8-adebbd8a9bb4 req-15baca63-77b3-44a7-bc3e-b88313ebff9d service nova] Creating event network-vif-deleted:dab6af1a-cb5b-4125-bc5f-8869228ed1c0 for instance 884d3161-cfbe-40c2-82a9-6d0a013a811b on n-h2-853316-12 Oct 17 12:50:09.197177 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4ef48c9f-2355-435a-85d8-adebbd8a9bb4 req-15baca63-77b3-44a7-bc3e-b88313ebff9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064891 Oct 17 12:50:09.198141 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 231/450] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:09.205150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f197832b-c72e-46b9-a961-3a5691ec2287 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-668294856", "id": 678103319, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:09.226842 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f197832b-c72e-46b9-a961-3a5691ec2287 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.027459 Oct 17 12:50:09.227445 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 232/451] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:09 2022] POST /compute/v2.1/flavors => generated 410 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:09.228481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.229246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.229685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.230278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lazy-loading 'fault' on Instance uuid cc63310a-af08-4f3a-9fc1-955e0d0da893 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:09.242678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.243668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:09.251601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.252333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.253066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.254636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.255823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.256359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.302048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:09.307502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.307987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.308485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.308859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lazy-loading 'fault' on Instance uuid 884d3161-cfbe-40c2-82a9-6d0a013a811b {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:09.320351 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ee52c99-55d5-4e20-958c-02e24383fed6 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 200 len: 1309 microversion: 2.1 time: 0.213327 Oct 17 12:50:09.321563 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 220/452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:09.330846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-295c7399-c3be-4b54-ba8f-6d3867bd54df tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.349086 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-295c7399-c3be-4b54-ba8f-6d3867bd54df tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/678103319" status: 200 len: 410 microversion: 2.1 time: 0.026103 Oct 17 12:50:09.350924 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 221/453] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/flavors/678103319 => generated 410 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:09.364784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.367959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:09.383188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:09.391818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c841706-de80-468e-b912-b7eccf54cd0a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1309 microversion: 2.1 time: 0.163352 Oct 17 12:50:09.392350 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 233/454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:09.418500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.419005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.419445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.420160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.420603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.421029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.558391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:09.566803 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4be52b16-8159-4158-ba0b-c6fa245ae555 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1277 microversion: 2.1 time: 0.212619 Oct 17 12:50:09.567601 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 222/455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:09.581049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14f90a7b-0cde-493c-ba79-cf2a8501eb68 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.601777 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-14f90a7b-0cde-493c-ba79-cf2a8501eb68 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6207 microversion: 2.1 time: 0.208404 Oct 17 12:50:09.602379 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 234/456] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/flavors/detail => generated 6207 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:09.622019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-833e636c-7b79-47cc-918c-a9e89472730f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.639710 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-833e636c-7b79-47cc-918c-a9e89472730f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/678103319" status: 202 len: 0 microversion: 2.1 time: 0.021252 Oct 17 12:50:09.640403 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 223/457] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:50:09 2022] DELETE /compute/v2.1/flavors/678103319 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:09.648619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f440735d-cf01-47ce-aaca-a103c14aff97 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.669161 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f440735d-cf01-47ce-aaca-a103c14aff97 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.024141 Oct 17 12:50:09.669706 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 235/458] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:09.689718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f3139423-c3a3-44d3-a261-ad0d49c48a6c tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1681500382", "id": 1156627729, "os-flavor-access:is_public": "False"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:09.707048 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f3139423-c3a3-44d3-a261-ad0d49c48a6c tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.020868 Oct 17 12:50:09.707579 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 224/459] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:09 2022] POST /compute/v2.1/flavors => generated 430 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:09.719852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0218bbb-ceca-4b33-b495-d781962c2a91 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "1156627729"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:09.730556 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e0218bbb-ceca-4b33-b495-d781962c2a91 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] HTTP exception thrown: Flavor 1156627729 could not be found. Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0218bbb-ceca-4b33-b495-d781962c2a91 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] Request method failure captured: Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 107 Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU97aF6VWoC4-WVbP4ZDUVdCcnKiY8ku6SwFISCb6dVVGoOuZBujONBOv7XAgiMmSGn5B15FRTi_gWnvOGk-2NBwroB2ORZIAgfP9yY2Fg-UVDg1yNAdsssKSqLpWkV36tuS_L2c1qgeqNqiK6MSqNKIb4Mk_9Pygv7ri-cIElBCZnE Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 700df5ab12ae4fb6b9183eaeb0c27bdc Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsAdminTestJSON-1208441418 Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:09.732692 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_700df5ab12ae4fb6b9183eaeb0c27bdc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/700df5ab12ae4fb6b9183eaeb0c27bdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/700df5ab12ae4fb6b9183eaeb0c27bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/700df5ab12ae4fb6b9183eaeb0c27bdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsAdminTestJSON-1208441418 Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 700df5ab12ae4fb6b9183eaeb0c27bdc Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1208441418 Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsAdminTestJSON-1208441418-project Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 5b2a1d5d4dee4305a763cbba679860a5 Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsAdminTestJSON-1208441418-project Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "test", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "1156627729"}} Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:09.734252 n-d-853316-12 devstack@n-api.service[127540]: exception: Flavor 1156627729 could not be found. Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '1156627729'}}} Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1156627729 could not be found. Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:09.735197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1156627729 could not be found. Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:09.736595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:09.738842 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:09.738842 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:09.738842 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:09.738842 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1156627729 could not be found. Oct 17 12:50:09.738842 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:09.738842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0218bbb-ceca-4b33-b495-d781962c2a91 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] Returning 400 to user: Flavor 1156627729 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:09.738842 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e0218bbb-ceca-4b33-b495-d781962c2a91 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.018073 Oct 17 12:50:09.738842 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 236/460] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:09 2022] POST /compute/v2.1/servers => generated 81 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:50:09.743182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7e22614-15a7-4a3f-8d95-2425e4b7c4e8 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.768577 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7e22614-15a7-4a3f-8d95-2425e4b7c4e8 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1156627729" status: 202 len: 0 microversion: 2.1 time: 0.028800 Oct 17 12:50:09.769033 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 225/461] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:50:09 2022] DELETE /compute/v2.1/flavors/1156627729 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:09.780082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a8acfaaa-4d3a-4ef8-a2ca-3fef0f6cde39 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.819569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a8acfaaa-4d3a-4ef8-a2ca-3fef0f6cde39 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.045014 Oct 17 12:50:09.833501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 237/462] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:09.845064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b25daf28-8df6-4213-89cb-013051fdfe68 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1478640375", "id": 905028304, "os-flavor-access:is_public": "False"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:09.867903 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b25daf28-8df6-4213-89cb-013051fdfe68 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.026795 Oct 17 12:50:09.869037 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 226/463] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:09 2022] POST /compute/v2.1/flavors => generated 412 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:09.884232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e2abdb2b-f8db-478d-8b7e-36ccbb60dafe tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1888957441", "id": 2135832267, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:09.888711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.889432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:09.904584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.905138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.905575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.906562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:09.907222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:09.907861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:09.913735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:09.913947 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e2abdb2b-f8db-478d-8b7e-36ccbb60dafe tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.034585 Oct 17 12:50:09.916192 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 238/464] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:09 2022] POST /compute/v2.1/flavors => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:09.930545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e98864ec-f4ce-46ed-ab5b-378e1983059a tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.952377 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e98864ec-f4ce-46ed-ab5b-378e1983059a tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.027606 Oct 17 12:50:09.962277 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 239/465] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:09.968795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-570b7426-ce07-4799-b97d-2e5a908c5a6f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:09.984787 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-570b7426-ce07-4799-b97d-2e5a908c5a6f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.021042 Oct 17 12:50:09.994634 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 240/466] 10.222.0.27 () {58 vars in 1177 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:10.000950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fcd42e2a-6a81-43a3-9de2-06c56ae4a978 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.012871 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fcd42e2a-6a81-43a3-9de2-06c56ae4a978 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.016701 Oct 17 12:50:10.013466 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 241/467] 10.222.0.27 () {58 vars in 1171 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:10.027053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20533f02-9af4-4208-a81c-e7594ba5d8ee tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.039011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20533f02-9af4-4208-a81c-e7594ba5d8ee tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.015751 Oct 17 12:50:10.039737 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 242/468] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:10.054283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b2251fe-d3e1-4c12-b41d-f5454866a55f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.077627 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b2251fe-d3e1-4c12-b41d-f5454866a55f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6211 microversion: 2.1 time: 0.027798 Oct 17 12:50:10.078242 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 243/469] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6211 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:10.099450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-02bf582b-5c0f-4926-9d1a-42da3525ebe5 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.130830 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-02bf582b-5c0f-4926-9d1a-42da3525ebe5 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6211 microversion: 2.1 time: 0.036076 Oct 17 12:50:10.131572 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 244/470] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6211 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:10.142238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.143273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:10.150020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.150653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.151162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.151962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.152487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.152973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.160683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:10.169935 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-578f75e4-4837-4122-bd7b-30c9afbdc8d9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.287129 Oct 17 12:50:10.182955 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 227/471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:09 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.182955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.182955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:10.182955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.183778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.184303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.193500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.193500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.193500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.225407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:10.234238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:10.235903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:10.237074 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8bd9041c-a498-4aa4-9ff1-9029fa8f5c3e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1258 microversion: 2.25 time: 0.098881 Oct 17 12:50:10.238642 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 245/472] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1258 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:10.247333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08e34cc8-5167-44ad-8f8c-7ad0cdf1db2f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.275307 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08e34cc8-5167-44ad-8f8c-7ad0cdf1db2f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6211 microversion: 2.1 time: 0.031587 Oct 17 12:50:10.275917 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 246/473] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6211 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.295444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2aec8ac4-48f6-462e-9dd1-524e70d2fe2e tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.319637 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2aec8ac4-48f6-462e-9dd1-524e70d2fe2e tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6211 microversion: 2.1 time: 0.027711 Oct 17 12:50:10.334589 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 247/474] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6211 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:10.340593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3003890-3014-4995-9b95-2b0a4b69bf74 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.367065 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3003890-3014-4995-9b95-2b0a4b69bf74 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2135832267" status: 202 len: 0 microversion: 2.1 time: 0.030794 Oct 17 12:50:10.371427 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 248/475] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:50:10 2022] DELETE /compute/v2.1/flavors/2135832267 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:50:10.376651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.377317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: cc63310a-af08-4f3a-9fc1-955e0d0da893] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:10.389380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.389881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.390371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.391258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.392043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.392536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.411970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:10.415492 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] HTTP exception thrown: Instance cc63310a-af08-4f3a-9fc1-955e0d0da893 could not be found. Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Request method failure captured: Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 HTTP/1.1 Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9Ihzvqp23x7u9M-xADgm52wh6AnVpSrCDlDsgQTr7vPuRlkzry9VVa4hQJfxkCfbFMkNBwLg23n-Cg2vdcN5BrqYgGqVFFRvdogJ5NG2uu42ud_dZcRvxGWwhPp5oprcoc4jn2E1_BMXqSzrCNQVRLgLHxiqt_cjKu1dKBAoHxpGg Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: d15166b17a404da4a671e1b992369d66 Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-LiveMigrationNegativeTest-947706089 Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:10.418329 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d15166b17a404da4a671e1b992369d66", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d15166b17a404da4a671e1b992369d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d15166b17a404da4a671e1b992369d66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d15166b17a404da4a671e1b992369d66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-LiveMigrationNegativeTest-947706089 Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: d15166b17a404da4a671e1b992369d66 Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-947706089 Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-LiveMigrationNegativeTest-947706089-project Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 046bb953acb24208b3f458872e030eae Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-LiveMigrationNegativeTest-947706089-project Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance cc63310a-af08-4f3a-9fc1-955e0d0da893 could not be found. Oct 17 12:50:10.419588 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'cc63310a-af08-4f3a-9fc1-955e0d0da893'} Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc63310a-af08-4f3a-9fc1-955e0d0da893 could not be found. Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:10.420324 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc63310a-af08-4f3a-9fc1-955e0d0da893 could not be found. Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc63310a-af08-4f3a-9fc1-955e0d0da893 could not be found. Oct 17 12:50:10.421407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:10.423905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Returning 404 to user: Instance cc63310a-af08-4f3a-9fc1-955e0d0da893 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:10.423905 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d12efa69-9578-4a42-add3-9de4ab739383 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893" status: 404 len: 111 microversion: 2.1 time: 0.050181 Oct 17 12:50:10.426594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 249/476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/servers/cc63310a-af08-4f3a-9fc1-955e0d0da893 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:10.427258 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-54c0c530-1448-4528-a166-ba3dd88826a6 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1543 microversion: 2.1 time: 0.254035 Oct 17 12:50:10.427847 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 228/477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1543 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.433161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aff20fa-ab43-451a-8308-41b50a7b7e6f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.437635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.438499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:10.460132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.462457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.463097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.464329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.466713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.467312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.470095 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0aff20fa-ab43-451a-8308-41b50a7b7e6f tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.041761 Oct 17 12:50:10.471217 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 250/478] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.478429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.478972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:10.487743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.489125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.489625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.490620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.491501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.491940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.525718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:50:10.545375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.546096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.546567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.547069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lazy-loading 'fault' on Instance uuid 884d3161-cfbe-40c2-82a9-6d0a013a811b {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:10.633857 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cd5b3de5-c5da-4df5-b6b4-f381d87cde32 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 204 len: 0 microversion: 2.1 time: 0.161220 Oct 17 12:50:10.637346 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 251/479] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:10 2022] DELETE /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:50:10.641298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72f636c5-cdd7-45ca-aebe-5fdb859a8e10 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.642068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:10.653553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9933a4d-433a-4d4e-96d1-185f709977be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 200 len: 1309 microversion: 2.1 time: 0.222604 Oct 17 12:50:10.654057 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 229/480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.661666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.662301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:10.675193 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72f636c5-cdd7-45ca-aebe-5fdb859a8e10 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/905028304" status: 202 len: 0 microversion: 2.1 time: 0.039128 Oct 17 12:50:10.676611 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 252/481] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:50:10 2022] DELETE /compute/v2.1/flavors/905028304 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:10.680880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.681452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.681600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.682292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.682592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:10.683400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.683924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.684610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.689401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.689980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.690449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.691863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:10.692482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:10.692904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:10.767924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:10.777172 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51330d38-89b5-45e5-81cc-794ba03a08c5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1275 microversion: 2.1 time: 0.119334 Oct 17 12:50:10.779602 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 230/482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.784223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d1da9ac-9e95-452b-874e-e792e5977541 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.807534 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d1da9ac-9e95-452b-874e-e792e5977541 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.026421 Oct 17 12:50:10.808322 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 231/483] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.832893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a3cabcc7-c054-4771-b5ca-a0949b1df0a5 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-747454010", "id": 573099636, "os-flavor-access:is_public": "False"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:10.853114 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a3cabcc7-c054-4771-b5ca-a0949b1df0a5 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.026100 Oct 17 12:50:10.854391 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 232/484] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:10 2022] POST /compute/v2.1/flavors => generated 411 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:10.866207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:10.868295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-431e8518-0641-47e4-a94a-149e05600ecc tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.876739 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c5c4f600-d5a6-49df-ab5e-281d0fe595d4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1474 microversion: 2.1 time: 0.198876 Oct 17 12:50:10.877557 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 253/485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1474 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.893381 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-431e8518-0641-47e4-a94a-149e05600ecc tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.030718 Oct 17 12:50:10.898200 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 233/486] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.915646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c142cf3e-6d1e-4df7-a28a-cacd0fae951e tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.938905 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c142cf3e-6d1e-4df7-a28a-cacd0fae951e tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.027554 Oct 17 12:50:10.939799 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 254/487] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:10.959396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6d70cc1-a3af-4be1-bf1c-d884f50d7f4b tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:10.979575 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6d70cc1-a3af-4be1-bf1c-d884f50d7f4b tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/573099636" status: 202 len: 0 microversion: 2.1 time: 0.024180 Oct 17 12:50:10.982213 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 234/488] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:50:10 2022] DELETE /compute/v2.1/flavors/573099636 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:10.989456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ebe27744-fa75-4ca3-8805-86113c3b69b7 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.011240 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ebe27744-fa75-4ca3-8805-86113c3b69b7 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.026536 Oct 17 12:50:11.012052 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 255/489] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:10 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:11.032787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9f7286e-d207-46e3-9934-6b7233c4d8aa tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2084952228", "id": 548839410, "os-flavor-access:is_public": "True"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:11.054818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9f7286e-d207-46e3-9934-6b7233c4d8aa tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.025468 Oct 17 12:50:11.055786 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 235/490] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:11 2022] POST /compute/v2.1/flavors => generated 411 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:11.070866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c7d5b78-68c9-4c11-8d00-77f05729c1b9 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.096542 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c7d5b78-68c9-4c11-8d00-77f05729c1b9 tempest-FlavorsAdminTestJSON-1208441418 tempest-FlavorsAdminTestJSON-1208441418-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6208 microversion: 2.1 time: 0.031711 Oct 17 12:50:11.097426 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 256/491] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:11 2022] GET /compute/v2.1/flavors/detail => generated 6208 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:11.118307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-947dd5ae-e9fc-4028-830c-d008893ccac4 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.141879 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-947dd5ae-e9fc-4028-830c-d008893ccac4 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/548839410" status: 202 len: 0 microversion: 2.1 time: 0.028520 Oct 17 12:50:11.146209 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 236/492] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:50:11 2022] DELETE /compute/v2.1/flavors/548839410 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:11.151467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cdf4b124-9ad4-4760-8c2d-8914923f02a3 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.173104 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cdf4b124-9ad4-4760-8c2d-8914923f02a3 tempest-FlavorsAdminTestJSON-1865006743 tempest-FlavorsAdminTestJSON-1865006743-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.025233 Oct 17 12:50:11.174013 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 257/493] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:11 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:11.202304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.203047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:11.211635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.212917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.213676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.214488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.215053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.215575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.265996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.266808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:11.275291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.275935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.276513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.277484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.278085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.278678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.284208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:11.362991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:11.372354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:11.373793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:11.374920 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4f309bb9-e520-4faa-be1d-1373ccb12200 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1314 microversion: 2.25 time: 0.113971 Oct 17 12:50:11.375469 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 258/494] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:11 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1314 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:50:11.456481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.457140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:11.467413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.467727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.468169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.468880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.469340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.469766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.539426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:11.552682 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2eb347b-4db9-4b02-b76d-61640d68629b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.355561 Oct 17 12:50:11.553265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 237/495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:11 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:11.678153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.679834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:11.685526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=16,nova_api:INSERT=7 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:11.687744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.689413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.690548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.692092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.692767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.693685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.713720 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] HTTP exception thrown: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Request method failure captured: Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b HTTP/1.1 Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9pnuRaOYOo3b2AYOC8NK-eEWmk8zi-nUl7FbXM8jR2lcmREc8kzOCdGrsR42x9LycP7bVFeZyEaVMYwu8WzQU2iqZvazSzQYFHRapQNTnO5HkDEkoz9kj1zBhxqAzhRvJ6zhDJn-XijGA3uie3JRqiY7I-h-W30NiqYHl2H-waEWU Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:50:11.715963 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_254cfab78c5442c58eb0cb2c51bdd8c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ffc77ed08cf741abac4491e84ba16f22 Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:11.717444 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '884d3161-cfbe-40c2-82a9-6d0a013a811b'} Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:11.718314 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:11.719583 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:11.720530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Returning 404 to user: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:11.720530 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a0b55dd-581e-4147-9915-c2a49a64d4c6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 404 len: 111 microversion: 2.1 time: 0.044742 Oct 17 12:50:11.720530 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 238/496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:11 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:50:11.804199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.806095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:11.824614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:11.828087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.832857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.833613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.837988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.839000 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-608af714-8571-4a3e-99fa-d9874954d755 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1543 microversion: 2.1 time: 0.387442 Oct 17 12:50:11.839363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.839584 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 259/497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:11 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1543 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:11.853188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.901158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:11.901975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:11.914099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.918295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.918994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:11.919914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:11.920535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:11.921213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:12.159672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:12.169669 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ad85a59-d73a-4974-865b-a6e1ec6f2c04 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1317 microversion: 2.1 time: 0.371920 Oct 17 12:50:12.170815 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 239/498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:11 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:12.194914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-363288877", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:12.275103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:12.283299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:50:12.288992 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b011ac1-e9b7-4416-a04e-da05209eca79 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1474 microversion: 2.1 time: 0.391250 Oct 17 12:50:12.291653 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 260/499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:11 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1474 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:12.400953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:12.401941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:12.410517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:12.411671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:12.412276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:12.414607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:12.415431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:12.416259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:12.604036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:12.613125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:12.619007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:12.623583 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32ac6d79-4b9a-4940-bd35-183dbe603a58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1320 microversion: 2.25 time: 0.225522 Oct 17 12:50:12.625249 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 261/500] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:12 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:50:12.645563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e86611ba-ba4e-4f3d-a44e-e7354f14e045 req-1482b9a4-9a37-496d-9264-90dce5094b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652645b9-e4bb-48f1-be51-e9483a163116", "name": "network-vif-plugged", "status": "completed", "tag": "29f3ca43-09a3-4d2b-9a04-d9d3003b14d2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:12.665808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e86611ba-ba4e-4f3d-a44e-e7354f14e045 req-1482b9a4-9a37-496d-9264-90dce5094b32 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:12.666689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e86611ba-ba4e-4f3d-a44e-e7354f14e045 req-1482b9a4-9a37-496d-9264-90dce5094b32 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:12.667359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e86611ba-ba4e-4f3d-a44e-e7354f14e045 req-1482b9a4-9a37-496d-9264-90dce5094b32 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:12.680786 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e86611ba-ba4e-4f3d-a44e-e7354f14e045 req-1482b9a4-9a37-496d-9264-90dce5094b32 service nova] Creating event network-vif-plugged:29f3ca43-09a3-4d2b-9a04-d9d3003b14d2 for instance 652645b9-e4bb-48f1-be51-e9483a163116 on n-h1-853316-12 Oct 17 12:50:12.688041 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e86611ba-ba4e-4f3d-a44e-e7354f14e045 req-1482b9a4-9a37-496d-9264-90dce5094b32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052440 Oct 17 12:50:12.689472 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 262/501] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:12.696891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:12.697860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:12.705876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:12.707271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:12.708905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:12.709906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:12.710889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:12.711750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:12.966036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:12.984611 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-930ac99b-e4c9-4dc2-b712-329443fe998a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.293543 Oct 17 12:50:12.987145 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 263/502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:12 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:12.992630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2eb4f545-672c-49c8-9f04-f69561a781a1 req-de1fe27a-3289-4c7b-8e65-5d8776e684b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d", "name": "network-vif-deleted", "tag": "c2b9f881-8633-4890-96e4-8462666772c1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:13.000818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:50:13.001923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:50:13.003086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:50:13.003528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:50:13.004311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:50:13.023508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.024005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.025311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2eb4f545-672c-49c8-9f04-f69561a781a1 req-de1fe27a-3289-4c7b-8e65-5d8776e684b3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.025788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2eb4f545-672c-49c8-9f04-f69561a781a1 req-de1fe27a-3289-4c7b-8e65-5d8776e684b3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.026034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.026975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.027587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2eb4f545-672c-49c8-9f04-f69561a781a1 req-de1fe27a-3289-4c7b-8e65-5d8776e684b3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.030742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.031376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.053805 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2eb4f545-672c-49c8-9f04-f69561a781a1 req-de1fe27a-3289-4c7b-8e65-5d8776e684b3 service nova] Creating event network-vif-deleted:c2b9f881-8633-4890-96e4-8462666772c1 for instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d on n-h1-853316-12 Oct 17 12:50:13.060682 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2eb4f545-672c-49c8-9f04-f69561a781a1 req-de1fe27a-3289-4c7b-8e65-5d8776e684b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072152 Oct 17 12:50:13.065294 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 264/503] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:13.068920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Getting quotas for project 254cfab78c5442c58eb0cb2c51bdd8c4. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:50:13.077869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:13.079118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Getting quotas for user ffc77ed08cf741abac4491e84ba16f22 and project 254cfab78c5442c58eb0cb2c51bdd8c4. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:50:13.079793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:13.088914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:13.099539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.103562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.104221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.105604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.106262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.107117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.110858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:50:13.120393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:50:13.232109 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-54837e42-5bb1-4234-b932-3d165940ebb1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047077 Oct 17 12:50:13.233201 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 240/504] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:50:13.238895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-871c939b-f97a-4a78-9166-a544b3ffc5a3 req-7aafbff0-c4c6-403b-a2e7-f3b8240e072f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1973e5f8-4e02-44fb-89ff-467c3af31c21", "tag": "efced7b6-2b69-4375-a6e0-ff4de63851db"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:13.250711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-871c939b-f97a-4a78-9166-a544b3ffc5a3 req-7aafbff0-c4c6-403b-a2e7-f3b8240e072f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.251441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-871c939b-f97a-4a78-9166-a544b3ffc5a3 req-7aafbff0-c4c6-403b-a2e7-f3b8240e072f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.252148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-871c939b-f97a-4a78-9166-a544b3ffc5a3 req-7aafbff0-c4c6-403b-a2e7-f3b8240e072f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.264972 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-871c939b-f97a-4a78-9166-a544b3ffc5a3 req-7aafbff0-c4c6-403b-a2e7-f3b8240e072f service nova] Creating event network-changed:efced7b6-2b69-4375-a6e0-ff4de63851db for instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 on n-h2-853316-12 Oct 17 12:50:13.276273 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-871c939b-f97a-4a78-9166-a544b3ffc5a3 req-7aafbff0-c4c6-403b-a2e7-f3b8240e072f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041448 Oct 17 12:50:13.277374 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 241/505] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:13.284135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:13.285926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:13.295760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.296615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.297387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.298617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.300079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.301658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.322921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:13.334257 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2d2923b-064f-4e0c-a00b-8ae846461703 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1501 microversion: 2.1 time: 0.266290 Oct 17 12:50:13.337519 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 265/506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:13 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1501 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:13.344886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d74147bf-345a-4b77-a9cc-ec80068d9879 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:13.346220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d74147bf-345a-4b77-a9cc-ec80068d9879 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:13.563923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d74147bf-345a-4b77-a9cc-ec80068d9879 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:13.587549 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d74147bf-345a-4b77-a9cc-ec80068d9879 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1219 microversion: 2.1 time: 0.248752 Oct 17 12:50:13.605199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 266/507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:13 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1219 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:13.624238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:13.626122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:13.640325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.645733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.646447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.649271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.650674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.651659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.730960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:13.731534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:13.733604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:13.734407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lazy-loading 'fault' on Instance uuid a237d59a-8d0b-478f-9f8e-ea1c63061c75 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:14.208775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:14.218583 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad7840de-45dd-4e6a-9115-dfe92363546a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1317 microversion: 2.1 time: 0.939584 Oct 17 12:50:14.246647 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 242/508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:13 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:14.249925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046bb953acb24208b3f458872e030eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15166b17a404da4a671e1b992369d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:14.251747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:14.252626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:14.262672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.270332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.270979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:14.271489 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9cadfc2b-cfc4-47f7-8bc8-0f2639891db4 tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 200 len: 1308 microversion: 2.1 time: 0.664286 Oct 17 12:50:14.271739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.272205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.272626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:14.273316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 267/509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:13 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:14.298789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:14.301603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:14.317564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.323926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.325056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:14.325963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.326618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.327311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:14.798902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:14.808534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:14.811035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:14.812416 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-265b1344-6b79-4074-a308-9cfd6e56486b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1362 microversion: 2.25 time: 0.564808 Oct 17 12:50:14.813545 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 243/510] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:14 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1362 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:14.819091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:14.820176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:14.827969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.828705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.829346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:14.830315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.830972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.832216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:14.869264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.870113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.870807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:14.871459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lazy-loading 'fault' on Instance uuid 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:14.935918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:14.952742 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c140e4e-3b04-4fa4-87b7-3fd1a3985412 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1322 microversion: 2.1 time: 0.137656 Oct 17 12:50:14.953445 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 244/511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:14 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:14.964891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:14.967836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:14.985221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.985970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.989274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:14.990243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:14.991024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:14.991377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.010140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:15.021212 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-70bfaefb-6df7-4ab5-ac85-c5a2dfa29ae6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.744806 Oct 17 12:50:15.022448 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 268/512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:14 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:15.078033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:15.086888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c1b382b-0a1c-4ecc-8edd-a70c937df0d2 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1279 microversion: 2.1 time: 0.131732 Oct 17 12:50:15.087459 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 245/513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:14 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1279 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:15.241620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:15.242290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:15.249984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.250665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.251384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.252350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.253002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.254113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.303593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:15.304473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] [instance: a237d59a-8d0b-478f-9f8e-ea1c63061c75] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:15.312977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.313563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.314075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.314904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.315448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.316003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.339594 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] HTTP exception thrown: Instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 could not be found. Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Request method failure captured: Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 HTTP/1.1 Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9Ihzvqp23x7u9M-xADgm52wh6AnVpSrCDlDsgQTr7vPuRlkzry9VVa4hQJfxkCfbFMkNBwLg23n-Cg2vdcN5BrqYgGqVFFRvdogJ5NG2uu42ud_dZcRvxGWwhPp5oprcoc4jn2E1_BMXqSzrCNQVRLgLHxiqt_cjKu1dKBAoHxpGg Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: d15166b17a404da4a671e1b992369d66 Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-LiveMigrationNegativeTest-947706089 Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:50:15.344924 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d15166b17a404da4a671e1b992369d66", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d15166b17a404da4a671e1b992369d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d15166b17a404da4a671e1b992369d66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d15166b17a404da4a671e1b992369d66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-LiveMigrationNegativeTest-947706089 Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: d15166b17a404da4a671e1b992369d66 Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-947706089 Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-LiveMigrationNegativeTest-947706089-project Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 046bb953acb24208b3f458872e030eae Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-LiveMigrationNegativeTest-947706089-project Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 could not be found. Oct 17 12:50:15.346264 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a237d59a-8d0b-478f-9f8e-ea1c63061c75'} Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 could not be found. Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:15.347458 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 could not be found. Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 could not be found. Oct 17 12:50:15.348572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:15.349571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] Returning 404 to user: Instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:15.349571 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9854b30-ea98-4a36-a85e-4d96ba0a1e5f tempest-LiveMigrationNegativeTest-947706089 tempest-LiveMigrationNegativeTest-947706089-project] 10.222.0.27 "GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75" status: 404 len: 111 microversion: 2.1 time: 0.052924 Oct 17 12:50:15.362330 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 246/514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:15 2022] GET /compute/v2.1/servers/a237d59a-8d0b-478f-9f8e-ea1c63061c75 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:15.370983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fdf46800-570a-4f71-95ea-1b73d1994149 req-d9187c5d-dd30-4619-9152-69b9b2b37ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a237d59a-8d0b-478f-9f8e-ea1c63061c75", "name": "network-vif-deleted", "tag": "28fe8bdf-d13b-416e-81c1-0e667fee255d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:15.385640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fdf46800-570a-4f71-95ea-1b73d1994149 req-d9187c5d-dd30-4619-9152-69b9b2b37ef7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.386665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fdf46800-570a-4f71-95ea-1b73d1994149 req-d9187c5d-dd30-4619-9152-69b9b2b37ef7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.387292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fdf46800-570a-4f71-95ea-1b73d1994149 req-d9187c5d-dd30-4619-9152-69b9b2b37ef7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.407292 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fdf46800-570a-4f71-95ea-1b73d1994149 req-d9187c5d-dd30-4619-9152-69b9b2b37ef7 service nova] Creating event network-vif-deleted:28fe8bdf-d13b-416e-81c1-0e667fee255d for instance a237d59a-8d0b-478f-9f8e-ea1c63061c75 on n-h2-853316-12 Oct 17 12:50:15.415010 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fdf46800-570a-4f71-95ea-1b73d1994149 req-d9187c5d-dd30-4619-9152-69b9b2b37ef7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048633 Oct 17 12:50:15.422186 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 247/515] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:15.481149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:15.492360 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2025a48e-efa3-40f8-ba36-3a00450028ec tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1317 microversion: 2.1 time: 0.254867 Oct 17 12:50:15.493006 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 269/516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:15 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:15.676093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-10c52adb-fd92-4161-9814-a5df9d4e2d47 req-05761ffd-e979-41ef-b0a8-79dc5aaccab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19e54d2-638f-4ff0-b1ca-556fd7322174", "tag": "5508e157-467a-4880-9215-51dfaa80fe19"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:15.686333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10c52adb-fd92-4161-9814-a5df9d4e2d47 req-05761ffd-e979-41ef-b0a8-79dc5aaccab5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.687819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10c52adb-fd92-4161-9814-a5df9d4e2d47 req-05761ffd-e979-41ef-b0a8-79dc5aaccab5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.688463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10c52adb-fd92-4161-9814-a5df9d4e2d47 req-05761ffd-e979-41ef-b0a8-79dc5aaccab5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.702044 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-10c52adb-fd92-4161-9814-a5df9d4e2d47 req-05761ffd-e979-41ef-b0a8-79dc5aaccab5 service nova] Creating event network-changed:5508e157-467a-4880-9215-51dfaa80fe19 for instance c19e54d2-638f-4ff0-b1ca-556fd7322174 on n-h2-853316-12 Oct 17 12:50:15.709149 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-10c52adb-fd92-4161-9814-a5df9d4e2d47 req-05761ffd-e979-41ef-b0a8-79dc5aaccab5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037594 Oct 17 12:50:15.709837 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 248/517] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:15.844072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:15.848669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:15.870281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.875246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.875246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.875246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.877968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.889648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.983132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:15.983849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:15.993431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.993933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.994459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:15.995179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:15.995808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:15.996339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:16.085930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:16.086918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:16.087571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:16.088252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lazy-loading 'fault' on Instance uuid 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:16.188283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8004505d9c4554b2ea1ded5014c51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5a2ad7f31447fbbaca288ea3b0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:16.199348 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7da0468-a31b-409a-895e-36da5d1196d4 tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 200 len: 1322 microversion: 2.1 time: 0.225005 Oct 17 12:50:16.200681 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 249/518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:15 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:16.210458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:16.211332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:16.243364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:16.243734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:16.244164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:16.245004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:16.249830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:16.250802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:16.493972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:16.500300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=18 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:16.514048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:16.516195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:16.517621 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c6fa413-badc-4168-8ec0-45d14ca69b4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1362 microversion: 2.25 time: 0.678438 Oct 17 12:50:16.518742 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 270/519] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:15 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1362 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:16.551359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:16.551359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:16.560025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:16.562575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:16.563146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:16.564035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:16.570855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:16.571465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:16.753030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:16.762465 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-344afa6c-9bf2-43f2-a28b-84967e5ea32f tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1277 microversion: 2.1 time: 0.242325 Oct 17 12:50:16.772940 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 271/520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:16 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:16.775453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:16.787072 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf096a0b-f9cd-431c-b15c-187651dae122 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.585031 Oct 17 12:50:16.788422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:16.788651 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 250/521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:16 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:16.789149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:16.796241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:16.796736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:16.797180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:16.797886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:16.798371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:16.804695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:17.106531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:17.123147 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bf784573-e6bb-4327-a04d-a6840f405744 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1317 microversion: 2.1 time: 0.348952 Oct 17 12:50:17.124234 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 272/522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:16 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:17.227418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:17.228506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] [instance: 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:17.239031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:17.239857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:17.243504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:17.244459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:17.245073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:17.245665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:17.281726 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] HTTP exception thrown: Instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d could not be found. Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Request method failure captured: Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d HTTP/1.1 Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9IkrTRgHneVihjG6LJXSa_-ZF66I3O9mIANfxJQL_Bh__smI9lqJuQgEjNydo2sfzPMaegntsJtdQ0e_TvOQAodwWWJMFb4Mmj5rFqoo63DjI8o_QVLeYQQnq_vhqNsFkXmqOHsp8gwB_ZhKmOD9m1H2cgBw_GUlHhm1fXRu3Xy5g Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:50:17.285809 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f5a2ad7f31447fbbaca288ea3b0580", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f5a2ad7f31447fbbaca288ea3b0580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 36f5a2ad7f31447fbbaca288ea3b0580 Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514 Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a8004505d9c4554b2ea1ded5014c51f Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:50:17.287233 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d could not be found. Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d'} Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d could not be found. Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:17.287866 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d could not be found. Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d could not be found. Oct 17 12:50:17.288978 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:17.291833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] Returning 404 to user: Instance 7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:17.293639 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-436b333e-2b98-4b3f-98e5-1ceec120dd3e tempest-FloatingIPsAssociationNegativeTestJSON-715723514 tempest-FloatingIPsAssociationNegativeTestJSON-715723514-project] 10.222.0.27 "GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d" status: 404 len: 111 microversion: 2.1 time: 0.070293 Oct 17 12:50:17.301328 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 251/523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:17 2022] GET /compute/v2.1/servers/7b1a7bf2-f9ae-4e45-bd7c-b4cdc0e0359d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:17.548353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:17.548948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:17.562228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:17.562700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:17.563318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:17.564734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:17.566814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:17.567248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:17.918305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:17.929083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:17.931970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:17.939374 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bb253d47-107e-41e9-84fa-473d13b252d1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1362 microversion: 2.25 time: 0.394576 Oct 17 12:50:17.942920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 273/524] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:17 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:17.962609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:17.963807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:17.970689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:17.971967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:17.973588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:17.974889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:17.975739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:17.978303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:18.140624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7286cbd1-1725-4ff8-8dec-aaff27c58afe tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-824240550", "ram": 512, "vcpus": 1, "disk": 10, "id": 1437324750, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:18.169590 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7286cbd1-1725-4ff8-8dec-aaff27c58afe tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.420089 Oct 17 12:50:18.170549 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 252/525] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:17 2022] POST /compute/v2.1/flavors => generated 415 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:18.176491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:18.177459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:18.189522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:18.190044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:18.190682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:18.192646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:18.193104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:18.193805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:18.255915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:18.266852 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3713a5b-c748-4581-91f8-1ba5d68e5f50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.319983 Oct 17 12:50:18.271885 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 274/526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:17 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:18.288290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:18.289022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:18.298292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:18.298843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:18.299282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:18.299962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:18.300948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:18.302349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:18.377626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:18.398312 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-321c3ed1-59a1-4714-98dc-352caf4a3eea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.225643 Oct 17 12:50:18.399517 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 253/527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:18 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:18.576448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:18.596978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e854166-6128-4a84-8132-44941c9d0e03 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1317 microversion: 2.1 time: 0.311469 Oct 17 12:50:18.601325 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 275/528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:18 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:18.662478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1a46c82-764e-4621-b192-89c01f314b0c tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:18.672583 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-a1a46c82-764e-4621-b192-89c01f314b0c tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] HTTP exception thrown: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1a46c82-764e-4621-b192-89c01f314b0c tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Request method failure captured: Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/flavors/1437324750/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU-IxiZZDOdEhla8tFVWB-P9FcXtbmXE0x6ayXD6KL0Lzi9Vwsf7umMPZZl-qzBsF5T4sCXbaYGzySSIKEgXFnl9d0g042E7Kieabem7amkH3Sr-PX5FvsBB3WXtP_QaaqfAqmOmK4sj4wJVwPmJn6B2nDazTmDA9NzJ3nOiKxX9FDY Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ceea8552793f47b0868093c776ecba31 Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:50:18.675046 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ceea8552793f47b0868093c776ecba31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ceea8552793f47b0868093c776ecba31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ceea8552793f47b0868093c776ecba31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ceea8552793f47b0868093c776ecba31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ceea8552793f47b0868093c776ecba31 Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9fdcec91230c42dd9f13a7e41ec0776a Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:50:18.676667 n-d-853316-12 devstack@n-api.service[127539]: exception: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'flavor_id': '1437324750', 'id': 'hw:cpu_thread_policy'} Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.677312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.678575 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.678575 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.678575 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.678575 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:18.678575 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:18.678575 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. Oct 17 12:50:18.678575 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.679003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-35cfa8df-170b-4e1b-9e0e-78377f640588 req-0ca881f6-fa33-4404-9f37-72e49a8d4420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1584fb0-8664-4fa6-8ef7-58b1107b78c2", "name": "network-vif-plugged", "status": "completed", "tag": "14eafe5b-088e-4dfd-853c-16d4a0e15ed1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:18.680982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1a46c82-764e-4621-b192-89c01f314b0c tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Returning 404 to user: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:18.682593 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a1a46c82-764e-4621-b192-89c01f314b0c tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] 10.222.0.27 "GET /compute/v2.1/flavors/1437324750/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.280541 Oct 17 12:50:18.683514 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 254/529] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:50:18 2022] GET /compute/v2.1/flavors/1437324750/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:18.695497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8b1666f-e788-4743-bdfb-27a18759b437 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:18.700009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f8b1666f-e788-4743-bdfb-27a18759b437 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '9fdcec91230c42dd9f13a7e41ec0776a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceea8552793f47b0868093c776ecba31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8b1666f-e788-4743-bdfb-27a18759b437 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Request method failure captured: Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/flavors/1437324750/os-extra_specs HTTP/1.1 Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 66 Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU-IxiZZDOdEhla8tFVWB-P9FcXtbmXE0x6ayXD6KL0Lzi9Vwsf7umMPZZl-qzBsF5T4sCXbaYGzySSIKEgXFnl9d0g042E7Kieabem7amkH3Sr-PX5FvsBB3WXtP_QaaqfAqmOmK4sj4wJVwPmJn6B2nDazTmDA9NzJ3nOiKxX9FDY Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ceea8552793f47b0868093c776ecba31 Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:50:18.706124 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ceea8552793f47b0868093c776ecba31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ceea8552793f47b0868093c776ecba31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ceea8552793f47b0868093c776ecba31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ceea8552793f47b0868093c776ecba31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ceea8552793f47b0868093c776ecba31 Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9fdcec91230c42dd9f13a7e41ec0776a Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 17 12:50:18.708255 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'flavor_id': '1437324750', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:50:18.708938 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 12:50:18.710038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.712517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-35cfa8df-170b-4e1b-9e0e-78377f640588 req-0ca881f6-fa33-4404-9f37-72e49a8d4420 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:18.713051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-35cfa8df-170b-4e1b-9e0e-78377f640588 req-0ca881f6-fa33-4404-9f37-72e49a8d4420 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:18.713854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-35cfa8df-170b-4e1b-9e0e-78377f640588 req-0ca881f6-fa33-4404-9f37-72e49a8d4420 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:18.714292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8b1666f-e788-4743-bdfb-27a18759b437 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:18.715775 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8b1666f-e788-4743-bdfb-27a18759b437 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] 10.222.0.27 "POST /compute/v2.1/flavors/1437324750/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.026662 Oct 17 12:50:18.716884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 255/530] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 17 12:50:18 2022] POST /compute/v2.1/flavors/1437324750/os-extra_specs => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:50:18.730027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ca5d7485-1746-4e72-9f89-1ea8e2c9ed26 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:18.745792 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-35cfa8df-170b-4e1b-9e0e-78377f640588 req-0ca881f6-fa33-4404-9f37-72e49a8d4420 service nova] Creating event network-vif-plugged:14eafe5b-088e-4dfd-853c-16d4a0e15ed1 for instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 on n-h1-853316-12 Oct 17 12:50:18.758847 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-35cfa8df-170b-4e1b-9e0e-78377f640588 req-0ca881f6-fa33-4404-9f37-72e49a8d4420 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084425 Oct 17 12:50:18.760744 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 276/531] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:50:18.781072 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ca5d7485-1746-4e72-9f89-1ea8e2c9ed26 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1437324750/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058899 Oct 17 12:50:18.781818 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 256/532] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 17 12:50:18 2022] POST /compute/v2.1/flavors/1437324750/os-extra_specs => generated 66 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:50:18.794807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6e6dc492-5fda-4148-9d3c-c3124de3da94 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:18.802062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6e6dc492-5fda-4148-9d3c-c3124de3da94 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '9fdcec91230c42dd9f13a7e41ec0776a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceea8552793f47b0868093c776ecba31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6e6dc492-5fda-4148-9d3c-c3124de3da94 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Request method failure captured: Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU-IxiZZDOdEhla8tFVWB-P9FcXtbmXE0x6ayXD6KL0Lzi9Vwsf7umMPZZl-qzBsF5T4sCXbaYGzySSIKEgXFnl9d0g042E7Kieabem7amkH3Sr-PX5FvsBB3WXtP_QaaqfAqmOmK4sj4wJVwPmJn6B2nDazTmDA9NzJ3nOiKxX9FDY Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ceea8552793f47b0868093c776ecba31 Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:18.804732 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ceea8552793f47b0868093c776ecba31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ceea8552793f47b0868093c776ecba31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ceea8552793f47b0868093c776ecba31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ceea8552793f47b0868093c776ecba31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ceea8552793f47b0868093c776ecba31 Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9fdcec91230c42dd9f13a7e41ec0776a Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:18.805982 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'flavor_id': '1437324750', 'id': 'hw:numa_nodes'} Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:50:18.806686 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.808054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6e6dc492-5fda-4148-9d3c-c3124de3da94 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:18.832254 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6e6dc492-5fda-4148-9d3c-c3124de3da94 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016696 Oct 17 12:50:18.832898 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 277/533] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 12:50:18 2022] DELETE /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes => generated 124 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:18.842648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ae318b8-aca7-4ad4-bef0-6206a828fa2f tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:18.868977 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ae318b8-aca7-4ad4-bef0-6206a828fa2f tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1437324750/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030464 Oct 17 12:50:18.870144 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 257/534] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 17 12:50:18 2022] POST /compute/v2.1/flavors/1437324750/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:50:18.880870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-776eeda0-fc33-472a-a1c0-8bae7a9b32f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:18.884538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-776eeda0-fc33-472a-a1c0-8bae7a9b32f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '9fdcec91230c42dd9f13a7e41ec0776a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceea8552793f47b0868093c776ecba31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-776eeda0-fc33-472a-a1c0-8bae7a9b32f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Request method failure captured: Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 22 Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU-IxiZZDOdEhla8tFVWB-P9FcXtbmXE0x6ayXD6KL0Lzi9Vwsf7umMPZZl-qzBsF5T4sCXbaYGzySSIKEgXFnl9d0g042E7Kieabem7amkH3Sr-PX5FvsBB3WXtP_QaaqfAqmOmK4sj4wJVwPmJn6B2nDazTmDA9NzJ3nOiKxX9FDY Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ceea8552793f47b0868093c776ecba31 Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:18.886505 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ceea8552793f47b0868093c776ecba31", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ceea8552793f47b0868093c776ecba31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ceea8552793f47b0868093c776ecba31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ceea8552793f47b0868093c776ecba31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ceea8552793f47b0868093c776ecba31 Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9fdcec91230c42dd9f13a7e41ec0776a Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: {"hw:numa_nodes": "1"} Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:18.888023 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'flavor_id': '1437324750', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:50:18.888929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 12:50:18.891281 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.893686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-776eeda0-fc33-472a-a1c0-8bae7a9b32f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:18.895288 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-776eeda0-fc33-472a-a1c0-8bae7a9b32f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858 tempest-FlavorsExtraSpecsNegativeTestJSON-1428023858-project] 10.222.0.27 "PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019379 Oct 17 12:50:18.896430 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 278/535] 10.222.0.27 () {60 vars in 1265 bytes} [Mon Oct 17 12:50:18 2022] PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:18.907009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e136ef1e-5b5a-4355-913c-aef975ca2567 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:18.916368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e136ef1e-5b5a-4355-913c-aef975ca2567 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] HTTP exception thrown: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e136ef1e-5b5a-4355-913c-aef975ca2567 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Request method failure captured: Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/flavors/1437324750/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU-JVHdC77S9lM-n7zi3ngE_ajWcWGc8zow4tcTnZ3694XsvWRsRpqhK0g2mL5sIX-PIhULVHjIB2M0hzO81I2Gf5IEKgY_KVNDO54Y01Vg_GHNRG1Ype14Zf9X5re__PWijKcomiNJ7oWvC_znkYCW55B1xZS2zzVEaLh7uufmVYIQ Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 64d9b3093058439eb286eb6da1bd967a Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:50:18.918242 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64d9b3093058439eb286eb6da1bd967a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 64d9b3093058439eb286eb6da1bd967a Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 78c2a1db05644c3a8593c9654fabe6a6 Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:50:18.919732 n-d-853316-12 devstack@n-api.service[127539]: exception: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'flavor_id': '1437324750', 'id': 'hw:cpu_thread_policy'} Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.920505 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.922067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.922067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.922067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.922067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:18.922067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:18.922067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. Oct 17 12:50:18.922067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.923991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e136ef1e-5b5a-4355-913c-aef975ca2567 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Returning 404 to user: Flavor 1437324750 has no extra specs with key hw:cpu_thread_policy. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:18.929767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e136ef1e-5b5a-4355-913c-aef975ca2567 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1437324750/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.027877 Oct 17 12:50:18.931775 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 258/536] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 12:50:18 2022] DELETE /compute/v2.1/flavors/1437324750/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:18.942809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6e97eeb0-c831-4436-92d9-f022aca82cb8 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:18.947901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-6e97eeb0-c831-4436-92d9-f022aca82cb8 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6e97eeb0-c831-4436-92d9-f022aca82cb8 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Request method failure captured: Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 27 Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU-JVHdC77S9lM-n7zi3ngE_ajWcWGc8zow4tcTnZ3694XsvWRsRpqhK0g2mL5sIX-PIhULVHjIB2M0hzO81I2Gf5IEKgY_KVNDO54Y01Vg_GHNRG1Ype14Zf9X5re__PWijKcomiNJ7oWvC_znkYCW55B1xZS2zzVEaLh7uufmVYIQ Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 64d9b3093058439eb286eb6da1bd967a Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:50:18.949733 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64d9b3093058439eb286eb6da1bd967a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 64d9b3093058439eb286eb6da1bd967a Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 78c2a1db05644c3a8593c9654fabe6a6 Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: {"hw:cpu_policy": "shared"} Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:18.951270 n-d-853316-12 devstack@n-api.service[127540]: exception: Request body and URI mismatch Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'flavor_id': '1437324750', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.952159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.953523 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:18.953523 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:18.953523 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 17 12:50:18.953523 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.954929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6e97eeb0-c831-4436-92d9-f022aca82cb8 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:18.956225 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6e97eeb0-c831-4436-92d9-f022aca82cb8 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.018099 Oct 17 12:50:18.957667 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 279/537] 10.222.0.27 () {60 vars in 1265 bytes} [Mon Oct 17 12:50:18 2022] PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes => generated 73 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:50:18.967560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:18.968320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:18.970830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c129aca-3670-4137-a082-1d978892fdd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c129aca-3670-4137-a082-1d978892fdd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Request method failure captured: Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 49 Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU-JVHdC77S9lM-n7zi3ngE_ajWcWGc8zow4tcTnZ3694XsvWRsRpqhK0g2mL5sIX-PIhULVHjIB2M0hzO81I2Gf5IEKgY_KVNDO54Y01Vg_GHNRG1Ype14Zf9X5re__PWijKcomiNJ7oWvC_znkYCW55B1xZS2zzVEaLh7uufmVYIQ Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 64d9b3093058439eb286eb6da1bd967a Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:50:18.976670 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_64d9b3093058439eb286eb6da1bd967a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/64d9b3093058439eb286eb6da1bd967a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 64d9b3093058439eb286eb6da1bd967a Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 78c2a1db05644c3a8593c9654fabe6a6 Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 17 12:50:18.977989 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'flavor_id': '1437324750', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance: Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 17 12:50:18.978730 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.980028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:18.981127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:18.981127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:18.981127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:50:18.981127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:50:18.981127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 12:50:18.981127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:18.985289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c129aca-3670-4137-a082-1d978892fdd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:18.985834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:18.986262 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c129aca-3670-4137-a082-1d978892fdd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.021602 Oct 17 12:50:18.986409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:18.986783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:18.987620 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 280/538] 10.222.0.27 () {60 vars in 1265 bytes} [Mon Oct 17 12:50:18 2022] PUT /compute/v2.1/flavors/1437324750/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:50:18.993052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:18.993590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:18.993985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:19.000701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbc63e54-5ee2-47d6-a609-3a62bed364de tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:19.012783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:19.042419 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbc63e54-5ee2-47d6-a609-3a62bed364de tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1437324750" status: 202 len: 0 microversion: 2.1 time: 0.046022 Oct 17 12:50:19.043421 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 281/539] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:50:18 2022] DELETE /compute/v2.1/flavors/1437324750 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:19.052576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e6f7d172-00ae-4c00-a3d6-7a26aa39db6c tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:19.077687 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e6f7d172-00ae-4c00-a3d6-7a26aa39db6c tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924 tempest-FlavorsExtraSpecsNegativeTestJSON-1887165924-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.030385 Oct 17 12:50:19.078638 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 282/540] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:19 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:19.191066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:19.200849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:19.204661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:19.207820 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f45e6ae7-9fae-401f-8cb8-9b3c8f11c27f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1362 microversion: 2.25 time: 0.242749 Oct 17 12:50:19.224536 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 259/541] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:18 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:19.298371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:19.299814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:19.310804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:19.311779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:19.312582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:19.313987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:19.314590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:19.315490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:19.350778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:19.427437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:19.429187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:19.443037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:19.444920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:19.446370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:19.448292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:19.449389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:19.450696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:19.676851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:19.700737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46919987-0d5d-42eb-a2c7-514e4a5112be tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.405234 Oct 17 12:50:19.702870 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 283/542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:19 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:19.713369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:19.714847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:19.729583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:19.730726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:19.731759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:19.733238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:19.734294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:19.735278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:19.765634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:19.779795 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da10ea80-389d-44b0-8a61-7d8ed597afd6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1318 microversion: 2.1 time: 0.360512 Oct 17 12:50:19.780455 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 260/543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:19 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:20.193252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:20.210581 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-221f0064-8d0c-4aad-bb0a-9a512310b6de tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1317 microversion: 2.1 time: 0.505890 Oct 17 12:50:20.223640 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 284/544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:19 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:20.236133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:20.236710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:20.247775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:20.248263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:20.249295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:20.250083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:20.250561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:20.251327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:20.441899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:20.458744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:20.463690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:20.465482 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93146ec1-294d-4b9d-8399-a214cf4d3814 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1362 microversion: 2.25 time: 0.233264 Oct 17 12:50:20.479811 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 261/545] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:20 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:50:20.717998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d2f47b3f-dadc-4eb4-8342-cf88d2b9ef49 req-670c53e5-f765-4f0e-a2ef-68f84af2fb28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f0532d-b86c-4499-b9f8-ebf43447822e", "tag": "14aa7fe0-97dd-4d4c-90be-e22f6e24367a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:20.744448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d2f47b3f-dadc-4eb4-8342-cf88d2b9ef49 req-670c53e5-f765-4f0e-a2ef-68f84af2fb28 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:20.746321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d2f47b3f-dadc-4eb4-8342-cf88d2b9ef49 req-670c53e5-f765-4f0e-a2ef-68f84af2fb28 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:20.748078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d2f47b3f-dadc-4eb4-8342-cf88d2b9ef49 req-670c53e5-f765-4f0e-a2ef-68f84af2fb28 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:20.768692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d2f47b3f-dadc-4eb4-8342-cf88d2b9ef49 req-670c53e5-f765-4f0e-a2ef-68f84af2fb28 service nova] Creating event network-changed:14aa7fe0-97dd-4d4c-90be-e22f6e24367a for instance 89f0532d-b86c-4499-b9f8-ebf43447822e on n-h2-853316-12 Oct 17 12:50:20.776001 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d2f47b3f-dadc-4eb4-8342-cf88d2b9ef49 req-670c53e5-f765-4f0e-a2ef-68f84af2fb28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061172 Oct 17 12:50:20.777239 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 262/546] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:20.784634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:20.785989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:20.794745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:20.795776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:20.796627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:20.797667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:20.798505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:20.799170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:20.825444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fdbec9c-618f-46e9-a9ec-1a073898343f tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Action: 'update', calling method: .version_select at 0x7fa8213ac550>, body: {"quota_set": {"ram": "5120"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:21.052698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fdbec9c-618f-46e9-a9ec-1a073898343f tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.053812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fdbec9c-618f-46e9-a9ec-1a073898343f tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.054610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fdbec9c-618f-46e9-a9ec-1a073898343f tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.055504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:21.056265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fdbec9c-618f-46e9-a9ec-1a073898343f tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.056954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fdbec9c-618f-46e9-a9ec-1a073898343f tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.058042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fdbec9c-618f-46e9-a9ec-1a073898343f tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.065107 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba4817dd-3fad-4004-a5ca-58ca41bb2e56 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.285896 Oct 17 12:50:21.079062 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 263/547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:20 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:21.092369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:21.093236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:21.099865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.100584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.101183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.102320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.102943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.103527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.206070 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fdbec9c-618f-46e9-a9ec-1a073898343f tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/89238d89d904448388f1170bd6bfd19d" status: 200 len: 148 microversion: 2.57 time: 0.805065 Oct 17 12:50:21.206070 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 285/548] 10.222.0.27 () {62 vars in 1303 bytes} [Mon Oct 17 12:50:20 2022] PUT /compute/v2.1/os-quota-sets/89238d89d904448388f1170bd6bfd19d => generated 148 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:21.206070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-99156bd2-6258-4278-9e6e-22091fbcf4b9 req-ac02d8b1-297a-4c2c-8c8c-0c3a6c20395b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1973e5f8-4e02-44fb-89ff-467c3af31c21", "name": "network-vif-plugged", "status": "completed", "tag": "efced7b6-2b69-4375-a6e0-ff4de63851db"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:21.221501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-99156bd2-6258-4278-9e6e-22091fbcf4b9 req-ac02d8b1-297a-4c2c-8c8c-0c3a6c20395b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.222928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-99156bd2-6258-4278-9e6e-22091fbcf4b9 req-ac02d8b1-297a-4c2c-8c8c-0c3a6c20395b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.223644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-99156bd2-6258-4278-9e6e-22091fbcf4b9 req-ac02d8b1-297a-4c2c-8c8c-0c3a6c20395b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.237559 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-99156bd2-6258-4278-9e6e-22091fbcf4b9 req-ac02d8b1-297a-4c2c-8c8c-0c3a6c20395b service nova] Creating event network-vif-plugged:efced7b6-2b69-4375-a6e0-ff4de63851db for instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 on n-h2-853316-12 Oct 17 12:50:21.244899 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-99156bd2-6258-4278-9e6e-22091fbcf4b9 req-ac02d8b1-297a-4c2c-8c8c-0c3a6c20395b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043941 Oct 17 12:50:21.246876 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 286/549] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:21.256172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a77cb0b5-7cb9-4211-86da-00d8ce989c3e tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Calling method '.version_select at 0x7fa8213b1e50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:21.466118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77cb0b5-7cb9-4211-86da-00d8ce989c3e tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.466772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77cb0b5-7cb9-4211-86da-00d8ce989c3e tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.467209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77cb0b5-7cb9-4211-86da-00d8ce989c3e tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.468152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77cb0b5-7cb9-4211-86da-00d8ce989c3e tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.468619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77cb0b5-7cb9-4211-86da-00d8ce989c3e tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.469049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77cb0b5-7cb9-4211-86da-00d8ce989c3e tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.493436 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a77cb0b5-7cb9-4211-86da-00d8ce989c3e tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/89238d89d904448388f1170bd6bfd19d/detail" status: 200 len: 463 microversion: 2.57 time: 0.244891 Oct 17 12:50:21.494195 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 287/550] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 17 12:50:21 2022] GET /compute/v2.1/os-quota-sets/89238d89d904448388f1170bd6bfd19d/detail => generated 463 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:21.498756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:21.499485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:21.517889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.518431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.518878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.519767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.520264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.520738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.857309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:21.883883 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb626e0d-b6d9-4cce-b768-bdc6f24e7260 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1467 microversion: 2.1 time: 0.801785 Oct 17 12:50:21.886079 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 264/551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:21 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1467 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:21.897763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:21.898734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:21.907482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.908251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.908754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.910195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:21.910971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:21.911403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:21.932994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:21.942326 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b85fe1e1-2920-43a2-825f-1b484c58ea83 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1317 microversion: 2.1 time: 0.447119 Oct 17 12:50:21.947838 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 288/552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:21 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:21.958543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Action: 'update', calling method: .version_select at 0x7fa82140b280>, body: {"quota_set": {"ram": "2048"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:22.073273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.074104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.074476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.075389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.075955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.076503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.116871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.117567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.118109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.119106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.120365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.121061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.178463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:22.192573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:22.194709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:22.196020 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-571c1cb4-dcf1-4454-960b-2905e72ca701 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1362 microversion: 2.25 time: 0.305916 Oct 17 12:50:22.196923 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 265/553] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:21 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:22.216307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:22.216995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:22.241839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.242664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.244831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.245798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.247595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.248352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.254273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7450613d-a644-49b4-9202-c6e5d578b197 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/89238d89d904448388f1170bd6bfd19d?user_id=dbfa5e6e2ddf4a14b52404885b16ae1d" status: 200 len: 148 microversion: 2.57 time: 0.304057 Oct 17 12:50:22.256067 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 289/554] 10.222.0.27 () {62 vars in 1384 bytes} [Mon Oct 17 12:50:21 2022] PUT /compute/v2.1/os-quota-sets/89238d89d904448388f1170bd6bfd19d?user_id=dbfa5e6e2ddf4a14b52404885b16ae1d => generated 148 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:22.262593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:22.263200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:22.271457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.271883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.272321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.273027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.273475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.273895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.491119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:22.502018 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02bc651d-7f9f-4a68-b425-7a28cdff2702 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1468 microversion: 2.1 time: 0.303739 Oct 17 12:50:22.514205 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 266/555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:22 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1468 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:22.522748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9327e643-f0be-4465-9e8f-cb6b82d9ca67 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] Calling method '.version_select at 0x7fa8213f6e50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:22.867258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:22.877822 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-35194839-590a-49c3-b320-120a5c8c9cf0 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.620641 Oct 17 12:50:22.879117 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 290/556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:22 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:22.884088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1763955526"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:22.891672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:22.908132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.910975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.912170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.914004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.914725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.915717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.935309 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9327e643-f0be-4465-9e8f-cb6b82d9ca67 tempest-QuotasAdminTestV257-735323536 tempest-QuotasAdminTestV257-735323536-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/89238d89d904448388f1170bd6bfd19d?user_id=dbfa5e6e2ddf4a14b52404885b16ae1d" status: 200 len: 190 microversion: 2.57 time: 0.421307 Oct 17 12:50:22.935875 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 267/557] 10.222.0.27 () {60 vars in 1364 bytes} [Mon Oct 17 12:50:22 2022] GET /compute/v2.1/os-quota-sets/89238d89d904448388f1170bd6bfd19d?user_id=dbfa5e6e2ddf4a14b52404885b16ae1d => generated 190 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:22.969235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:22.969854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:22.982281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:22.984543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.986096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.986563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:22.987265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:22.990421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:22.990929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:23.070399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:23.321876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:23.330766 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fc3b98ca-50e5-459f-a4af-9e516aee83fb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1317 microversion: 2.1 time: 0.365291 Oct 17 12:50:23.331933 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 268/558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:22 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:23.337901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:23.338811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:23.349019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:23.349783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:23.350432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:23.351305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:23.351904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:23.352473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:23.393214 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-38d81fb0-d4e3-4a7a-8b7e-a5f555de37da tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "POST /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116/action" status: 202 len: 0 microversion: 2.1 time: 0.492532 Oct 17 12:50:23.395320 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 291/559] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:22 2022] POST /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 12:50:23.413011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f63f7ce-7c14-4970-ad9e-d4b56f32a0c5 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82140f280>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:23.482891 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f63f7ce-7c14-4970-ad9e-d4b56f32a0c5 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1453 microversion: 2.1 time: 0.079600 Oct 17 12:50:23.483943 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 292/560] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:23 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:23.540572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:23.550078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:23.551853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:23.553143 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10d669d6-509f-4425-b898-28686a266336 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1362 microversion: 2.25 time: 0.219621 Oct 17 12:50:23.566211 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 269/561] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:23 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:23.905348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:23.906419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:23.916321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:23.917233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:23.917838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:23.919882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:23.920532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:23.921126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:24.135611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:24.146533 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8316bde6-f771-4844-b725-4b0c9bb5898a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.248640 Oct 17 12:50:24.147804 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 293/562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:23 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:24.148320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-32c3379a-f8ae-4da9-b785-145890d77cee req-00dc7e52-d40f-4aa0-9f44-ceef10f987c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19e54d2-638f-4ff0-b1ca-556fd7322174", "name": "network-vif-plugged", "status": "completed", "tag": "5508e157-467a-4880-9215-51dfaa80fe19"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:24.169722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32c3379a-f8ae-4da9-b785-145890d77cee req-00dc7e52-d40f-4aa0-9f44-ceef10f987c5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:24.170429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32c3379a-f8ae-4da9-b785-145890d77cee req-00dc7e52-d40f-4aa0-9f44-ceef10f987c5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:24.171456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32c3379a-f8ae-4da9-b785-145890d77cee req-00dc7e52-d40f-4aa0-9f44-ceef10f987c5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:24.202896 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-32c3379a-f8ae-4da9-b785-145890d77cee req-00dc7e52-d40f-4aa0-9f44-ceef10f987c5 service nova] Creating event network-vif-plugged:5508e157-467a-4880-9215-51dfaa80fe19 for instance c19e54d2-638f-4ff0-b1ca-556fd7322174 on n-h2-853316-12 Oct 17 12:50:24.213930 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-32c3379a-f8ae-4da9-b785-145890d77cee req-00dc7e52-d40f-4aa0-9f44-ceef10f987c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070005 Oct 17 12:50:24.215056 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 270/563] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:50:24.353626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:24.355382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:24.366697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:24.368801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:24.370100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:24.373457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:24.374191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:24.375886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:24.501845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e675693-3ac0-4ea5-8801-9f0704b42501 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82148db80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:24.589783 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e675693-3ac0-4ea5-8801-9f0704b42501 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1453 microversion: 2.1 time: 0.093817 Oct 17 12:50:24.591012 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 271/564] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:24 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:24.604860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:24.607062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:24.624837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:24.627826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:24.629049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:24.629185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:24.630575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:24.631237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:24.631866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:24.646009 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eb8b5bbc-e5c1-4b5d-bce0-0a1ceae70922 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1467 microversion: 2.1 time: 0.296791 Oct 17 12:50:24.647045 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 294/565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:24 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1467 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:24.673137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1870316612", "metadata": {"image_type": "test"}}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:24.676438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:24.703669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:24.704178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:24.704623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:24.705338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:24.707795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:24.709715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:24.771448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:24.798784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Getting quotas for project beb2bb05c21a441caa0d9f23de809625. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:50:24.809234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Getting quotas for user 7b5b462b403142459bfb1a10c6ddbc54 and project beb2bb05c21a441caa0d9f23de809625. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:50:24.977675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:24.986425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:24.989221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:24.990898 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0a0f3061-4a0c-420f-9f6d-a2a88cd80538 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1362 microversion: 2.25 time: 0.396064 Oct 17 12:50:24.991884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 272/566] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:24 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:25.097040 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aebab082-f165-4180-b008-8012fdbc9ab7 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "POST /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21/action" status: 202 len: 0 microversion: 2.1 time: 0.429390 Oct 17 12:50:25.098760 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 295/567] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:24 2022] POST /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 17 12:50:25.120305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88052d3b-d87d-49df-a6e1-630cced87821 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa821422040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:25.190581 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88052d3b-d87d-49df-a6e1-630cced87821 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 200 len: 1422 microversion: 2.1 time: 0.083219 Oct 17 12:50:25.200475 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 296/568] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:25 2022] GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:25.200475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:25.200475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:25.211830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:25.211830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:25.211830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:25.211830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:25.212284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:25.212284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:25.367015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5d829ea-072c-418a-884e-a4e6375b8ade tempest-FlavorsV261TestJSON-1481236785 tempest-FlavorsV261TestJSON-1481236785-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-174708724", "id": 425638100, "os-flavor-access:is_public": "True"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:25.397486 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5d829ea-072c-418a-884e-a4e6375b8ade tempest-FlavorsV261TestJSON-1481236785 tempest-FlavorsV261TestJSON-1481236785-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.404440 Oct 17 12:50:25.398090 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 273/569] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:50:24 2022] POST /compute/v2.1/flavors => generated 464 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:25.411927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:25.428627 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e27bdb21-e58e-4cf3-a03a-781522034887 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.234413 Oct 17 12:50:25.429191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 297/570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:25 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:25.607918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69a2e05f-3634-4144-a2c0-b030efe04e0e tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138a820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:25.640182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bbd97d39-6ecd-48d8-8c81-1d5c9b5d8666 tempest-FlavorsV261TestJSON-1240766772 tempest-FlavorsV261TestJSON-1240766772-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:25.665969 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bbd97d39-6ecd-48d8-8c81-1d5c9b5d8666 tempest-FlavorsV261TestJSON-1240766772 tempest-FlavorsV261TestJSON-1240766772-project] 10.222.0.27 "GET /compute/v2.1/flavors/425638100" status: 200 len: 464 microversion: 2.61 time: 0.257961 Oct 17 12:50:25.675668 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 274/571] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Oct 17 12:50:25 2022] GET /compute/v2.1/flavors/425638100 => generated 464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:25.680424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52cab9ed-794f-4b11-a2da-184809961f95 tempest-FlavorsV261TestJSON-1481236785 tempest-FlavorsV261TestJSON-1481236785-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:25.696822 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69a2e05f-3634-4144-a2c0-b030efe04e0e tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1453 microversion: 2.1 time: 0.093901 Oct 17 12:50:25.700535 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 298/572] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:25 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:25.728147 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52cab9ed-794f-4b11-a2da-184809961f95 tempest-FlavorsV261TestJSON-1481236785 tempest-FlavorsV261TestJSON-1481236785-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/425638100" status: 200 len: 465 microversion: 2.61 time: 0.051234 Oct 17 12:50:25.729177 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 275/573] 10.222.0.27 () {62 vars in 1216 bytes} [Mon Oct 17 12:50:25 2022] PUT /compute/v2.1/flavors/425638100 => generated 465 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:25.743098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e6b8e81-29a5-48f8-b026-073819a9e26e tempest-FlavorsV261TestJSON-1240766772 tempest-FlavorsV261TestJSON-1240766772-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:25.769742 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e6b8e81-29a5-48f8-b026-073819a9e26e tempest-FlavorsV261TestJSON-1240766772 tempest-FlavorsV261TestJSON-1240766772-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 7142 microversion: 2.61 time: 0.030277 Oct 17 12:50:25.786190 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 299/574] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 17 12:50:25 2022] GET /compute/v2.1/flavors/detail => generated 7142 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:25.794410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5d71e83-e4bc-4044-9e00-270160600bd2 tempest-FlavorsV261TestJSON-1240766772 tempest-FlavorsV261TestJSON-1240766772-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:25.825056 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5d71e83-e4bc-4044-9e00-270160600bd2 tempest-FlavorsV261TestJSON-1240766772 tempest-FlavorsV261TestJSON-1240766772-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3669 microversion: 2.61 time: 0.035102 Oct 17 12:50:25.825649 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 276/575] 10.222.0.27 () {60 vars in 1166 bytes} [Mon Oct 17 12:50:25 2022] GET /compute/v2.1/flavors => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:25.849169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93a587f8-d752-40c9-b406-663fae0c02c4 tempest-FlavorsV261TestJSON-1481236785 tempest-FlavorsV261TestJSON-1481236785-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:25.904228 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-93a587f8-d752-40c9-b406-663fae0c02c4 tempest-FlavorsV261TestJSON-1481236785 tempest-FlavorsV261TestJSON-1481236785-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/425638100" status: 202 len: 0 microversion: 2.61 time: 0.064541 Oct 17 12:50:25.905309 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 300/576] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Oct 17 12:50:25 2022] DELETE /compute/v2.1/flavors/425638100 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:50:25.914209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bbf58942-390f-4c94-a363-096f00a28b49 tempest-FlavorsV261TestJSON-1481236785 tempest-FlavorsV261TestJSON-1481236785-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:25.937924 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bbf58942-390f-4c94-a363-096f00a28b49 tempest-FlavorsV261TestJSON-1481236785 tempest-FlavorsV261TestJSON-1481236785-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6687 microversion: 2.61 time: 0.028227 Oct 17 12:50:25.938537 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 277/577] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 17 12:50:25 2022] GET /compute/v2.1/flavors/detail => generated 6687 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:26.016534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:26.017495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:26.028124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.029716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.030434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.031497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.032688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.033390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.209714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-73f18ac7-8643-4c40-9997-7ea263279766 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa82142d310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:26.266994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:26.279404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:26.284066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:26.287471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-893827b7-26d7-42dc-ad1c-22d52f718836 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1558 microversion: 2.25 time: 0.274879 Oct 17 12:50:26.290025 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 301/578] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:26 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:50:26.296170 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-73f18ac7-8643-4c40-9997-7ea263279766 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 200 len: 1422 microversion: 2.1 time: 0.094303 Oct 17 12:50:26.297819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 278/579] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:26 2022] GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:26.319629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:26.320248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:26.337160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.337647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.338069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.339155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.341338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.341560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.452898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:26.454676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:26.476644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.477325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.478140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.478950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.479399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.479818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.555409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid c19e54d2-638f-4ff0-b1ca-556fd7322174 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:26.627879 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ecbacef-d97b-45a5-91b0-11a6fcb97896 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 2053 microversion: 2.25 time: 0.314970 Oct 17 12:50:26.628505 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 302/580] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:26 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 2053 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:26.658924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:26.659534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:26.664650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:26.667141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.667639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.668074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.668770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.669217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.669633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.674148 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f75710b-2466-4f10-a5f6-f2a29993fc3a tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.225134 Oct 17 12:50:26.675125 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 279/581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:26 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:26.717825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d6c48148-5aba-4d40-a82b-6bee4b0ee6f4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215fc040>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:26.771294 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d6c48148-5aba-4d40-a82b-6bee4b0ee6f4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1453 microversion: 2.1 time: 0.059036 Oct 17 12:50:26.772397 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 280/582] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:26 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:26.820874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:26.837239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid c19e54d2-638f-4ff0-b1ca-556fd7322174 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:26.869441 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d6f9d1f-bf0e-43e5-938e-176556d496dc tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 2053 microversion: 2.25 time: 0.215830 Oct 17 12:50:26.872614 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 303/583] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:26 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 2053 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:50:26.898574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1378ea0-5239-488b-b44c-ec341b2fa081 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:26.903928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1378ea0-5239-488b-b44c-ec341b2fa081 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.904600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1378ea0-5239-488b-b44c-ec341b2fa081 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.905196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1378ea0-5239-488b-b44c-ec341b2fa081 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.906086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1378ea0-5239-488b-b44c-ec341b2fa081 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.907070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1378ea0-5239-488b-b44c-ec341b2fa081 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.907977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1378ea0-5239-488b-b44c-ec341b2fa081 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.937051 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1378ea0-5239-488b-b44c-ec341b2fa081 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.043139 Oct 17 12:50:26.946101 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 281/584] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 17 12:50:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:50:26.951410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:26.952194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:26.961280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.962702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.963451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:26.964368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:26.965347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:26.965982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:27.067985 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-384be26d-d00d-46af-abb2-ba90086c95de tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174/action" status: 202 len: 0 microversion: 2.25 time: 0.120933 Oct 17 12:50:27.069516 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 304/585] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:50:26 2022] POST /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:50:27.083567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:27.085451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:27.095722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:27.096250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:27.096993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:27.098351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:27.098843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:27.099512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:27.294665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid c19e54d2-638f-4ff0-b1ca-556fd7322174 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:27.313820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cdd871bc-16e2-4e8f-967d-973c6d526684 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8213b1280>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:27.313974 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8bb043ec-8ae1-4d41-b0e0-ddbc871bdabd tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 2058 microversion: 2.25 time: 0.239487 Oct 17 12:50:27.314756 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 282/586] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:27 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 2058 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:27.375281 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cdd871bc-16e2-4e8f-967d-973c6d526684 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 200 len: 1422 microversion: 2.1 time: 0.064298 Oct 17 12:50:27.376096 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 305/587] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:27 2022] GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 1422 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:27.704688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:27.706016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:27.718866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:27.721132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:27.721732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:27.724127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:27.724908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:27.725946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:27.790727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bcb52362-7946-4f1c-b2fd-89bce9478a27 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82132b8b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:27.917179 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bcb52362-7946-4f1c-b2fd-89bce9478a27 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1453 microversion: 2.1 time: 0.133847 Oct 17 12:50:27.921854 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 306/588] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:27 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:28.014764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:28.024911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d34518c8-2dfe-4bcb-a2de-300877476848 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.324934 Oct 17 12:50:28.027441 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 283/589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:27 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:28.322525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1186665f-fcac-48f9-9fd3-2dbff9ab5407 req-95fc85b1-8797-4986-9500-ba271bbeea3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f0532d-b86c-4499-b9f8-ebf43447822e", "name": "network-vif-plugged", "status": "completed", "tag": "14aa7fe0-97dd-4d4c-90be-e22f6e24367a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:28.354773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:28.356369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1186665f-fcac-48f9-9fd3-2dbff9ab5407 req-95fc85b1-8797-4986-9500-ba271bbeea3e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:28.356840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1186665f-fcac-48f9-9fd3-2dbff9ab5407 req-95fc85b1-8797-4986-9500-ba271bbeea3e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:28.358056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:28.358960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1186665f-fcac-48f9-9fd3-2dbff9ab5407 req-95fc85b1-8797-4986-9500-ba271bbeea3e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:28.388419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:28.388920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:28.389132 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1186665f-fcac-48f9-9fd3-2dbff9ab5407 req-95fc85b1-8797-4986-9500-ba271bbeea3e service nova] Creating event network-vif-plugged:14aa7fe0-97dd-4d4c-90be-e22f6e24367a for instance 89f0532d-b86c-4499-b9f8-ebf43447822e on n-h2-853316-12 Oct 17 12:50:28.389356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:28.390066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:28.393312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:28.393966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:28.415651 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1186665f-fcac-48f9-9fd3-2dbff9ab5407 req-95fc85b1-8797-4986-9500-ba271bbeea3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099579 Oct 17 12:50:28.416256 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 307/590] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:28.434106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29825570-1268-4153-8528-159a4ede937a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa82132b550>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:28.525479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29825570-1268-4153-8528-159a4ede937a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 200 len: 1422 microversion: 2.1 time: 0.107479 Oct 17 12:50:28.526811 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 308/591] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:28 2022] GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:28.748978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid c19e54d2-638f-4ff0-b1ca-556fd7322174 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:28.803952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c8cbe33-db2a-4afa-963b-3e62e8dcfc29 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 2038 microversion: 2.25 time: 0.458617 Oct 17 12:50:28.806397 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 284/592] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:28 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 2038 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:28.841489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853316-12", "block_migration": "auto"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:28.846345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:28.882199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:28.883934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:28.884412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:28.885764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:28.886380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:28.886981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:28.920945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'flavor' on Instance uuid c19e54d2-638f-4ff0-b1ca-556fd7322174 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:28.937241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-883bfa59-43f4-41fa-8b73-6b76fb3998a4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8214ccd30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:28.953650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Going to try to live migrate instance to n-h1-853316-12 {{(pid=127540) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 12:50:29.009327 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-883bfa59-43f4-41fa-8b73-6b76fb3998a4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1453 microversion: 2.1 time: 0.078177 Oct 17 12:50:29.011131 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 285/593] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:28 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:29.052178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:29.060293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:29.076131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:29.083862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:29.086527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:29.087495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:29.088090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:29.089548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:29.330927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:29.345931 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ca6df67b-0237-4aa9-abbe-c1d96067ef2e tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1319 microversion: 2.1 time: 0.297629 Oct 17 12:50:29.348709 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 286/594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:29 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:30.158756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1718316731", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:30.291148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:50:30.756692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:50:30.757212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:50:30.757698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:50:30.758233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:50:30.758654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:50:30.795490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:30.798406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:30.798857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:30.799632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:30.802192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:30.802683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:30.875750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Getting quotas for project 398c14a84792484ba396062bf18c6933. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:50:30.885003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Getting quotas for user 6e904404abe5420bb929ff9ab97f0a02 and project 398c14a84792484ba396062bf18c6933. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:50:30.904933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:50:30.910745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:50:31.041527 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-61fc0ef6-dd22-4bbe-ac7b-4f3d9f64aa6a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.564005 Oct 17 12:50:31.044061 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 287/595] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 12:50:31.058834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44daeaad-f229-479d-a107-eeea8541effb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8214cc550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:31.664481 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44daeaad-f229-479d-a107-eeea8541effb tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 200 len: 1422 microversion: 2.1 time: 0.619144 Oct 17 12:50:31.666060 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 288/596] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:31 2022] GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 1422 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:31.679576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c3a9ced-35e8-4be2-a49b-18d63b10d341 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8213f61f0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:32.090075 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ef024f3b-56c2-48c9-8d2c-e96dbe941c37 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174/action" status: 202 len: 0 microversion: 2.25 time: 3.256950 Oct 17 12:50:32.091533 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 309/597] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:50:28 2022] POST /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174/action => generated 0 bytes in 3259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:50:32.104093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:32.107621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:32.136848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:32.142540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:32.144699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:32.145668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:32.148915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:32.150344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:32.152850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=9 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:32.237939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=42 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:32.633704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:32.643908 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-612a36eb-7c6d-416c-ab07-0dc937e59a50 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1469 microversion: 2.1 time: 0.550638 Oct 17 12:50:32.646862 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 310/598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:32 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1469 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:32.671889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1ed45eb2-fc32-4d51-ab62-1d49dad01160 req-71122b23-9b7f-47a0-993b-b6abf971aab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1973e5f8-4e02-44fb-89ff-467c3af31c21", "name": "network-vif-plugged", "status": "completed", "tag": "efced7b6-2b69-4375-a6e0-ff4de63851db"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:32.702969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1ed45eb2-fc32-4d51-ab62-1d49dad01160 req-71122b23-9b7f-47a0-993b-b6abf971aab5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:32.714796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1ed45eb2-fc32-4d51-ab62-1d49dad01160 req-71122b23-9b7f-47a0-993b-b6abf971aab5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:32.715703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1ed45eb2-fc32-4d51-ab62-1d49dad01160 req-71122b23-9b7f-47a0-993b-b6abf971aab5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:32.734871 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1ed45eb2-fc32-4d51-ab62-1d49dad01160 req-71122b23-9b7f-47a0-993b-b6abf971aab5 service nova] Creating event network-vif-plugged:efced7b6-2b69-4375-a6e0-ff4de63851db for instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 on n-h2-853316-12 Oct 17 12:50:32.745689 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1ed45eb2-fc32-4d51-ab62-1d49dad01160 req-71122b23-9b7f-47a0-993b-b6abf971aab5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079883 Oct 17 12:50:32.749606 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 311/599] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:32.768736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1072912219", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:40.836283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:40.839417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=99 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:40.899604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=22 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:40.984113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:42.739794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:42.791954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:46.612330 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c3a9ced-35e8-4be2-a49b-18d63b10d341 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1453 microversion: 2.1 time: 14.944780 Oct 17 12:50:46.613221 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 289/600] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:31 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1453 bytes in 14946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:46.614686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c3a9ced-35e8-4be2-a49b-18d63b10d341 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:46.617825 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c3a9ced-35e8-4be2-a49b-18d63b10d341 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001091 Oct 17 12:50:46.618208 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 290/601] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 17 12:50:46 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 12:50:46.624029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:50:46.631300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:46.632289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:46.646600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:46.647463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:46.648749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:46.649685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:46.651106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:46.651826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:46.905492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:46.914182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:50:46.914672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:50:46.915288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:50:46.915856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:50:46.916403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:50:46.919136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:46.920895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:46.922078 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d45213ba-2cef-4ce7-b924-fc7afbef410a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1543 microversion: 2.25 time: 0.302735 Oct 17 12:50:46.924671 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 291/602] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:46 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1543 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:46.938394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:46.938394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:46.938394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:46.938394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:46.938896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:46.938896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:46.956359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:46.960457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:46.964508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Getting quotas for project 398c14a84792484ba396062bf18c6933. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:50:46.966693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:46.967181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:46.967613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:46.968307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:46.968930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:46.969315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Getting quotas for user 6e904404abe5420bb929ff9ab97f0a02 and project 398c14a84792484ba396062bf18c6933. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:50:46.969447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:46.985427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:50:46.989987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:50:47.114031 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6003674c-8b6f-480c-8099-35922c47a271 tempest-DeleteServersAdminTestJSON-832028890 tempest-DeleteServersAdminTestJSON-832028890-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e/action" status: 202 len: 0 microversion: 2.1 time: 0.164834 Oct 17 12:50:47.118311 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 292/603] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:46 2022] POST /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:50:47.120383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe984413-9b51-422a-b809-8b04dc3f086b tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa821423dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:47.188990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe984413-9b51-422a-b809-8b04dc3f086b tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 200 len: 1431 microversion: 2.1 time: 0.072999 Oct 17 12:50:47.189762 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 293/604] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:47 2022] GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 1431 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:47.196133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a54a971b-bff0-4cc2-a920-1e4a7f51e7b0 req-a9743688-7443-4bba-b642-bffbae2c18dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652645b9-e4bb-48f1-be51-e9483a163116", "name": "network-vif-plugged", "status": "completed", "tag": "29f3ca43-09a3-4d2b-9a04-d9d3003b14d2"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:47.222362 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b3cd2ff-16f8-49d2-bfbf-97f8bd0b2b7c tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.470793 Oct 17 12:50:47.222779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a54a971b-bff0-4cc2-a920-1e4a7f51e7b0 req-a9743688-7443-4bba-b642-bffbae2c18dd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:47.223557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a54a971b-bff0-4cc2-a920-1e4a7f51e7b0 req-a9743688-7443-4bba-b642-bffbae2c18dd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:47.223998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a54a971b-bff0-4cc2-a920-1e4a7f51e7b0 req-a9743688-7443-4bba-b642-bffbae2c18dd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:47.224426 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 312/605] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:50:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 14474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:50:47.230767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5c9a3c87-a3f6-4bf5-90d7-6a54120fb328 req-8b4fb8ce-1468-4552-9350-35347c5f0389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19e54d2-638f-4ff0-b1ca-556fd7322174", "name": "network-vif-unplugged", "status": "completed", "tag": "5508e157-467a-4880-9215-51dfaa80fe19"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:47.235804 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a54a971b-bff0-4cc2-a920-1e4a7f51e7b0 req-a9743688-7443-4bba-b642-bffbae2c18dd service nova] Creating event network-vif-plugged:29f3ca43-09a3-4d2b-9a04-d9d3003b14d2 for instance 652645b9-e4bb-48f1-be51-e9483a163116 on n-h1-853316-12 Oct 17 12:50:47.248210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c9a3c87-a3f6-4bf5-90d7-6a54120fb328 req-8b4fb8ce-1468-4552-9350-35347c5f0389 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:47.249010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c9a3c87-a3f6-4bf5-90d7-6a54120fb328 req-8b4fb8ce-1468-4552-9350-35347c5f0389 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:47.249660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c9a3c87-a3f6-4bf5-90d7-6a54120fb328 req-8b4fb8ce-1468-4552-9350-35347c5f0389 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:47.255874 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a54a971b-bff0-4cc2-a920-1e4a7f51e7b0 req-a9743688-7443-4bba-b642-bffbae2c18dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064675 Oct 17 12:50:47.260586 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 294/606] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:47.268225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b0800546-1757-46c2-9bd2-f0fb30c46a51 req-709868ef-b069-4c4b-a4a5-20818011dd74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f35cc1-58d6-4894-af02-7db8eefeb420", "tag": "9a19bdb4-6892-4689-af82-3c465058331f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:47.280381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0800546-1757-46c2-9bd2-f0fb30c46a51 req-709868ef-b069-4c4b-a4a5-20818011dd74 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:47.281223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0800546-1757-46c2-9bd2-f0fb30c46a51 req-709868ef-b069-4c4b-a4a5-20818011dd74 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:47.281650 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5c9a3c87-a3f6-4bf5-90d7-6a54120fb328 req-8b4fb8ce-1468-4552-9350-35347c5f0389 service nova] Creating event network-vif-unplugged:5508e157-467a-4880-9215-51dfaa80fe19 for instance c19e54d2-638f-4ff0-b1ca-556fd7322174 on n-h1-853316-12 Oct 17 12:50:47.282127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0800546-1757-46c2-9bd2-f0fb30c46a51 req-709868ef-b069-4c4b-a4a5-20818011dd74 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:47.288861 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5c9a3c87-a3f6-4bf5-90d7-6a54120fb328 req-8b4fb8ce-1468-4552-9350-35347c5f0389 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063010 Oct 17 12:50:47.289721 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 313/607] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:47.337774 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b0800546-1757-46c2-9bd2-f0fb30c46a51 req-709868ef-b069-4c4b-a4a5-20818011dd74 service nova] Creating event network-changed:9a19bdb4-6892-4689-af82-3c465058331f for instance d7f35cc1-58d6-4894-af02-7db8eefeb420 on n-h1-853316-12 Oct 17 12:50:47.365518 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b0800546-1757-46c2-9bd2-f0fb30c46a51 req-709868ef-b069-4c4b-a4a5-20818011dd74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102283 Oct 17 12:50:47.379119 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 295/608] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:47.385741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab09b108-57d2-4565-acbd-e99b2cd28a77 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '.version_select at 0x7fa82148dca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:47.389085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab09b108-57d2-4565-acbd-e99b2cd28a77 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:47.389567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab09b108-57d2-4565-acbd-e99b2cd28a77 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:47.389998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab09b108-57d2-4565-acbd-e99b2cd28a77 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:47.411687 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab09b108-57d2-4565-acbd-e99b2cd28a77 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.030751 Oct 17 12:50:47.412400 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 296/609] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 17 12:50:47 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:47.427663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:47.428693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:47.443069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:47.443559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:47.443991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:47.444911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:47.445321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:47.445737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:47.518717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:47.519299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:47.520465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:47.520927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lazy-loading 'fault' on Instance uuid 89f0532d-b86c-4499-b9f8-ebf43447822e {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:47.771663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc81b436-0c48-44a4-b5db-9cd79d2de5da tempest-FloatingIPDetailsNegativeTestJSON-732331931 tempest-FloatingIPDetailsNegativeTestJSON-732331931-project] Calling method '.version_select at 0x7fa8212ad820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:47.973736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:47.994328 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-294e98fa-c374-4a78-95e4-7b4b5f99ec87 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1452 microversion: 2.1 time: 0.580673 Oct 17 12:50:47.995633 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 297/610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:47 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1452 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:48.014706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-97da8815-232f-4469-8e0f-4855fd822fbf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8215e9af0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:48.089634 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-97da8815-232f-4469-8e0f-4855fd822fbf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 200 len: 1431 microversion: 2.1 time: 0.092674 Oct 17 12:50:48.094220 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 298/611] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:47 2022] GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 1431 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:48.112657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72544a18-226d-4d60-b4c6-dcd1d7eb4333 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:48.114001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72544a18-226d-4d60-b4c6-dcd1d7eb4333 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:48.230811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72544a18-226d-4d60-b4c6-dcd1d7eb4333 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:48.242225 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72544a18-226d-4d60-b4c6-dcd1d7eb4333 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1214 microversion: 2.1 time: 0.147146 Oct 17 12:50:48.258655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 299/612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:48 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:48.264069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:48.264904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:48.273928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.274717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.275126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-bc81b436-0c48-44a4-b5db-9cd79d2de5da tempest-FloatingIPDetailsNegativeTestJSON-732331931 tempest-FloatingIPDetailsNegativeTestJSON-732331931-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0b9a2504-4908-43b8-821f-78cdfdea92a4 could not be found", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:50:48.275597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.276028 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-bc81b436-0c48-44a4-b5db-9cd79d2de5da tempest-FloatingIPDetailsNegativeTestJSON-732331931 tempest-FloatingIPDetailsNegativeTestJSON-732331931-project] HTTP exception thrown: Floating IP not found for ID 0b9a2504-4908-43b8-821f-78cdfdea92a4 Oct 17 12:50:48.276926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.277936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc81b436-0c48-44a4-b5db-9cd79d2de5da tempest-FloatingIPDetailsNegativeTestJSON-732331931 tempest-FloatingIPDetailsNegativeTestJSON-732331931-project] Request method failure captured: Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-floating-ips/0b9a2504-4908-43b8-821f-78cdfdea92a4 HTTP/1.1 Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU-fUbwbd8r94tDUpWwg48P6tCfNpmpEDJMgfbq_XGS1GHTN1bIq5q1R9taE6JOsWUv37SbKDYG1GWpz0eRbVdJpFG8BFp8h4zekgHgbHwSTmw1xT10XZVGxDyItOcAaOwkbiL8vLXqlDRBfPXMlh9a8XVv2f3wXP9m5o_B4GMzaZoI Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c330f8eb142241748e0a26f39391ffb2 Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-732331931 Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:48.278566 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c330f8eb142241748e0a26f39391ffb2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c330f8eb142241748e0a26f39391ffb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c330f8eb142241748e0a26f39391ffb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c330f8eb142241748e0a26f39391ffb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-732331931 Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c330f8eb142241748e0a26f39391ffb2 Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-732331931 Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-732331931-project Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 4fe12863efac4473a99c14d7754dc93d Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-732331931-project Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: exception: Floating IP not found for ID 0b9a2504-4908-43b8-821f-78cdfdea92a4 Oct 17 12:50:48.279905 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '0b9a2504-4908-43b8-821f-78cdfdea92a4'} Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:50:48.280764 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0b9a2504-4908-43b8-821f-78cdfdea92a4 could not be found Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2a5f7ae-d94c-43eb-9dd1-49e37c370409'] Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0b9a2504-4908-43b8-821f-78cdfdea92a4. Oct 17 12:50:48.282234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0b9a2504-4908-43b8-821f-78cdfdea92a4 Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:48.283348 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:48.284579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:48.284579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0b9a2504-4908-43b8-821f-78cdfdea92a4 Oct 17 12:50:48.284579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:48.284874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.286219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc81b436-0c48-44a4-b5db-9cd79d2de5da tempest-FloatingIPDetailsNegativeTestJSON-732331931 tempest-FloatingIPDetailsNegativeTestJSON-732331931-project] Returning 404 to user: Floating IP not found for ID 0b9a2504-4908-43b8-821f-78cdfdea92a4 {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:48.286219 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc81b436-0c48-44a4-b5db-9cd79d2de5da tempest-FloatingIPDetailsNegativeTestJSON-732331931 tempest-FloatingIPDetailsNegativeTestJSON-732331931-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/0b9a2504-4908-43b8-821f-78cdfdea92a4" status: 404 len: 111 microversion: 2.1 time: 0.989287 Oct 17 12:50:48.286219 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 314/613] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 12:50:47 2022] GET /compute/v2.1/os-floating-ips/0b9a2504-4908-43b8-821f-78cdfdea92a4 => generated 111 bytes in 991 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:48.291436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8c3f2c45-083e-4501-8789-617b1819fd48 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821291e50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:48.363407 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8c3f2c45-083e-4501-8789-617b1819fd48 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1453 microversion: 2.1 time: 0.080316 Oct 17 12:50:48.364630 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 315/614] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:48 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:48.370097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:48.370929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:48.377996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.379361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.380122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.381197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.382405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.383647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.422771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:50:48.596213 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ecb8795-e8e6-4393-93cd-2380f914cdc8 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 204 len: 0 microversion: 2.1 time: 0.229975 Oct 17 12:50:48.601357 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 316/615] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:48 2022] DELETE /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:50:48.608963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:48.609738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:48.616240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.616973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.617597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.619166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.619814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.620516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.772958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid c19e54d2-638f-4ff0-b1ca-556fd7322174 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:48.812419 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-600a34e1-dc24-428a-87fd-435edb398996 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 2038 microversion: 2.25 time: 0.552053 Oct 17 12:50:48.814995 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 300/616] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:48 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 2038 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:48.824458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:48.825074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:48.832242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.833241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.833755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.834566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.835179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.835775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.884282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:48.884874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:48.885384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:48.886060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lazy-loading 'fault' on Instance uuid 89f0532d-b86c-4499-b9f8-ebf43447822e {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:48.936183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:48.951567 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-caa6f30b-6502-4b7a-a44f-68864df1f5cf tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1467 microversion: 2.1 time: 0.348757 Oct 17 12:50:48.952237 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 317/617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:48 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1467 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:48.960889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9298f3fc-8dfd-4b9e-990d-c9791dc06dc8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Action: 'create', calling method: .version_select at 0x7fa821291ee0>, body: {"keypair": {"name": "tempest-keypair-1838025958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkjU5d2JbBCFpl1us8C3YQiAkfE2SloPV8PGbTAkBn9FvlKcMNUphxXGyxyq+8zX8nhZ6q/sqAl1C8Ar6r93k432U1J026TzNjLhh8pMDcW9ygXoYHmybpK488dTcyjPg=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:48.984087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-9298f3fc-8dfd-4b9e-990d-c9791dc06dc8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for project c964bbec50ba4a2480831a33d6a935c7. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:50:48.990375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-9298f3fc-8dfd-4b9e-990d-c9791dc06dc8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for user 8dfeceb58cdd47b8b82d905614ba3d5b and project c964bbec50ba4a2480831a33d6a935c7. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:50:49.020821 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9298f3fc-8dfd-4b9e-990d-c9791dc06dc8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.067282 Oct 17 12:50:49.021622 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 318/618] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 12:50:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 12:50:49.027815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e6521bd-ea3c-48b7-8644-bc16f071f313 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8213499d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:49.036152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:49.047061 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-96aa6894-6792-4720-b821-a403afe52675 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1458 microversion: 2.1 time: 0.227187 Oct 17 12:50:49.049134 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 301/619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:48 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1458 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:49.097908 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e6521bd-ea3c-48b7-8644-bc16f071f313 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/c0b8bbed-67fa-4bc6-93c9-ab1f864c501f" status: 200 len: 784 microversion: 2.1 time: 0.074535 Oct 17 12:50:49.098806 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 319/620] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:49 2022] GET /compute/v2.1/images/c0b8bbed-67fa-4bc6-93c9-ab1f864c501f => generated 784 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:49.112422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0a8587c-3e69-4342-ac3d-92339088d0b3 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:49.122667 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0a8587c-3e69-4342-ac3d-92339088d0b3 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013813 Oct 17 12:50:49.123857 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 302/621] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:50:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:49.138116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c19be3e4-3733-4807-9dc1-4d46b78e21f6 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa821291820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:49.276001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:49.277344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:49.286688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:49.287561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:49.289005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:49.290417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:49.291168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:49.292042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:49.381113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:49.391128 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-280fc3ce-7594-4bbf-a9fd-c4d9f4a375d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1266 microversion: 2.1 time: 0.120768 Oct 17 12:50:49.407523 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 303/622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:49 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:49.416572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f686092b-36b2-43be-ae17-c2e1acfce8a0 req-2aeceb96-ae73-4919-b545-ce9c76fbe185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f35cc1-58d6-4894-af02-7db8eefeb420", "name": "network-vif-plugged", "status": "completed", "tag": "9a19bdb4-6892-4689-af82-3c465058331f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:49.428181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f686092b-36b2-43be-ae17-c2e1acfce8a0 req-2aeceb96-ae73-4919-b545-ce9c76fbe185 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:49.429537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f686092b-36b2-43be-ae17-c2e1acfce8a0 req-2aeceb96-ae73-4919-b545-ce9c76fbe185 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:49.430285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f686092b-36b2-43be-ae17-c2e1acfce8a0 req-2aeceb96-ae73-4919-b545-ce9c76fbe185 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:49.446682 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f686092b-36b2-43be-ae17-c2e1acfce8a0 req-2aeceb96-ae73-4919-b545-ce9c76fbe185 service nova] Creating event network-vif-plugged:9a19bdb4-6892-4689-af82-3c465058331f for instance d7f35cc1-58d6-4894-af02-7db8eefeb420 on n-h1-853316-12 Oct 17 12:50:49.452987 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f686092b-36b2-43be-ae17-c2e1acfce8a0 req-2aeceb96-ae73-4919-b545-ce9c76fbe185 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043638 Oct 17 12:50:49.453984 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 304/623] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:49.461888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c3a11a4b-76db-4519-86ac-a2e62a813073 req-5f950720-b4bc-4fc0-b225-9f2d2c8f3e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19e54d2-638f-4ff0-b1ca-556fd7322174", "tag": "5508e157-467a-4880-9215-51dfaa80fe19"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:49.476278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c3a11a4b-76db-4519-86ac-a2e62a813073 req-5f950720-b4bc-4fc0-b225-9f2d2c8f3e0d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:49.476872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c3a11a4b-76db-4519-86ac-a2e62a813073 req-5f950720-b4bc-4fc0-b225-9f2d2c8f3e0d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:49.477404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c3a11a4b-76db-4519-86ac-a2e62a813073 req-5f950720-b4bc-4fc0-b225-9f2d2c8f3e0d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:49.489583 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c3a11a4b-76db-4519-86ac-a2e62a813073 req-5f950720-b4bc-4fc0-b225-9f2d2c8f3e0d service nova] Creating event network-changed:5508e157-467a-4880-9215-51dfaa80fe19 for instance c19e54d2-638f-4ff0-b1ca-556fd7322174 on n-h1-853316-12 Oct 17 12:50:49.495706 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c3a11a4b-76db-4519-86ac-a2e62a813073 req-5f950720-b4bc-4fc0-b225-9f2d2c8f3e0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039072 Oct 17 12:50:49.496631 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 305/624] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:49.501941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d89b3c05-869c-4a2f-a7c7-0627b828230a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82142d670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:49.558307 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d89b3c05-869c-4a2f-a7c7-0627b828230a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1462 microversion: 2.1 time: 0.060132 Oct 17 12:50:49.559095 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 306/625] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:49 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1462 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:49.573826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-955913a5-4c0b-4912-8425-6ce7bc66654a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215e9a60>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:49.622737 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-955913a5-4c0b-4912-8425-6ce7bc66654a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 200 len: 1462 microversion: 2.1 time: 0.053398 Oct 17 12:50:49.623492 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 307/626] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:49 2022] GET /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 1462 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:49.638902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:49.639583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:49.649238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:49.649989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:49.650614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:49.651638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:49.652135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:49.653476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:50.029425 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c19be3e4-3733-4807-9dc1-4d46b78e21f6 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "DELETE /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 204 len: 0 microversion: 2.1 time: 0.896455 Oct 17 12:50:50.033421 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 320/627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:49 2022] DELETE /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:50:50.038290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ca82e09-7a33-4a1c-a962-f3a79ac71e68 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa82132b790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:50.068513 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8ca82e09-7a33-4a1c-a962-f3a79ac71e68 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] HTTP exception thrown: Image not found. Oct 17 12:50:50.080220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ca82e09-7a33-4a1c-a962-f3a79ac71e68 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Request method failure captured: Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 HTTP/1.1 Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU98Ux8QF2pq0Qc7ZmhBDMScG-bscKzvJJOaIiqRwn_AxcGANaTvAA0MRbIZTA2zFUG3geTapbCjedCbkCtQgiPGS1uCJKQWyOZU8lzVAhBtw7ra6x797RqNiuwH4gFq7d7Hj67AO00JboDBw3-vTuSySrZcsrpf2sw6-1Ze1h8C_zQ Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: beb2bb05c21a441caa0d9f23de809625 Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:50.083550 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_beb2bb05c21a441caa0d9f23de809625", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: beb2bb05c21a441caa0d9f23de809625 Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesOneServerTestJSON-479382231-project Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b5b462b403142459bfb1a10c6ddbc54 Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesOneServerTestJSON-479382231-project Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b1d2aa94-347d-4fab-b3dd-553929261924'} Oct 17 12:50:50.084802 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:50:50.085582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b1d2aa94-347d-4fab-b3dd-553929261924 Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:50:50.086785 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b1d2aa94-347d-4fab-b3dd-553929261924 could not be found. Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:50:50.089381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ca82e09-7a33-4a1c-a962-f3a79ac71e68 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:50.091982 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ca82e09-7a33-4a1c-a962-f3a79ac71e68 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 404 len: 62 microversion: 2.1 time: 0.051729 Oct 17 12:50:50.094274 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 321/628] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:50 2022] GET /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 12:50:50.095936 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15d383d1-c2b7-41f7-b4d4-18987192870b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1481 microversion: 2.1 time: 0.459892 Oct 17 12:50:50.096308 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 308/629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:49 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1481 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:50.111419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:50.113337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:50.114782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2021998510"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:50.123167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:50.129830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:50.134439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:50.135018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:50.135961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:50.136123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:50.136900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:50.137636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:50.138085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:50.138574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:50.138833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:50.139294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:50.139716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:50.207738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:50.208519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:50.209509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:50.210156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lazy-loading 'fault' on Instance uuid 89f0532d-b86c-4499-b9f8-ebf43447822e {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:50.594228 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f90783ab-5c7f-4fda-80b8-ab187733f107 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "POST /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21/action" status: 202 len: 0 microversion: 2.1 time: 0.495592 Oct 17 12:50:50.594695 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 309/630] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:50 2022] POST /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 12:50:50.607503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:50.609157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:50.619666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:50.620621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:50.621688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:50.622809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:50.624596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:50.625445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:50.771557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:50.780583 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6bbabac4-e155-4063-95d4-1b553a4b92fe tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1272 microversion: 2.1 time: 0.184478 Oct 17 12:50:50.796810 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 310/631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:50 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:50.802686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f63fdf0-30b0-40cf-9ab1-fab5b4ee2704 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8215e9670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:50.859387 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3f63fdf0-30b0-40cf-9ab1-fab5b4ee2704 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.061063 Oct 17 12:50:50.860782 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 311/632] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:50 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:50.959632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:50.971086 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e43b27e6-1a91-4fe5-ada0-933864db1cf1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1458 microversion: 2.1 time: 0.879327 Oct 17 12:50:50.971735 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 322/633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:50 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1458 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:51.124984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:51.126206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:51.140435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:51.142189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:51.147548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:51.148600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:51.149743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:51.152035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:51.481774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1d00396d-1a14-442a-b53f-d24f26e34e05 req-64de3fb1-35d6-4f5c-915c-fbc22b06dc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f0532d-b86c-4499-b9f8-ebf43447822e", "name": "network-vif-deleted", "tag": "14aa7fe0-97dd-4d4c-90be-e22f6e24367a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:51.526969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1d00396d-1a14-442a-b53f-d24f26e34e05 req-64de3fb1-35d6-4f5c-915c-fbc22b06dc8a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:51.527485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1d00396d-1a14-442a-b53f-d24f26e34e05 req-64de3fb1-35d6-4f5c-915c-fbc22b06dc8a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:51.527920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1d00396d-1a14-442a-b53f-d24f26e34e05 req-64de3fb1-35d6-4f5c-915c-fbc22b06dc8a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:51.546142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:51.559550 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-437913a0-72db-4a30-934e-14bfb3cad9ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1468 microversion: 2.1 time: 0.441363 Oct 17 12:50:51.572290 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 312/634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:51 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1468 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:51.576629 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1d00396d-1a14-442a-b53f-d24f26e34e05 req-64de3fb1-35d6-4f5c-915c-fbc22b06dc8a service nova] Creating event network-vif-deleted:14aa7fe0-97dd-4d4c-90be-e22f6e24367a for instance 89f0532d-b86c-4499-b9f8-ebf43447822e on n-h2-853316-12 Oct 17 12:50:51.582021 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1d00396d-1a14-442a-b53f-d24f26e34e05 req-64de3fb1-35d6-4f5c-915c-fbc22b06dc8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104285 Oct 17 12:50:51.582844 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 323/635] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:50:51.588749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-219440082"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:51.591371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:51.600116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:51.600810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:51.601505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:51.602442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:51.603091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:51.603728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:51.804112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:51.804803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:51.821853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:51.832171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:51.833042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:51.842235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:51.842899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:51.843519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:51.875357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:51.982694 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ea5f7f2-92b6-4ad6-8e81-efe645c0d3f2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "POST /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2/action" status: 202 len: 0 microversion: 2.1 time: 0.398548 Oct 17 12:50:51.989909 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 313/636] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:50:51 2022] POST /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 17 12:50:51.997815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-28e63215-e314-4a7b-8b5a-1182b90469a5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8215e9670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:52.091167 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-28e63215-e314-4a7b-8b5a-1182b90469a5 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.099782 Oct 17 12:50:52.107678 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 314/637] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:51 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:52.124558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:52.125367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:52.146870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.147394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.148014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:52.149258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.149793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.150409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:52.259038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.259534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.259977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:52.260441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lazy-loading 'fault' on Instance uuid 89f0532d-b86c-4499-b9f8-ebf43447822e {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:50:52.514747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:52.533569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a93e333-2a11-4d59-adff-e7cb15c523a9 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1272 microversion: 2.1 time: 0.726763 Oct 17 12:50:52.536346 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 324/638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:51 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1272 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:52.545424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d764d680-8ceb-4c5b-9e24-a517a473ee80 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821349b80>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:52.559959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc77ed08cf741abac4491e84ba16f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254cfab78c5442c58eb0cb2c51bdd8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:52.578885 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3fde854c-261d-4e1e-9931-9215a106e6b6 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 200 len: 1309 microversion: 2.1 time: 0.469686 Oct 17 12:50:52.579927 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 315/639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:52 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:52.589758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6117cdc8-94dd-4bd1-a9a4-cc8cbe0b17ba req-4d95faa5-4238-49ed-b287-ea66016e13b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1973e5f8-4e02-44fb-89ff-467c3af31c21", "name": "network-vif-unplugged", "status": "completed", "tag": "efced7b6-2b69-4375-a6e0-ff4de63851db"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:52.632362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6117cdc8-94dd-4bd1-a9a4-cc8cbe0b17ba req-4d95faa5-4238-49ed-b287-ea66016e13b8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.633051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6117cdc8-94dd-4bd1-a9a4-cc8cbe0b17ba req-4d95faa5-4238-49ed-b287-ea66016e13b8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.633620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6117cdc8-94dd-4bd1-a9a4-cc8cbe0b17ba req-4d95faa5-4238-49ed-b287-ea66016e13b8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:52.636475 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d764d680-8ceb-4c5b-9e24-a517a473ee80 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.098817 Oct 17 12:50:52.637284 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 325/640] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:52 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:52.675399 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6117cdc8-94dd-4bd1-a9a4-cc8cbe0b17ba req-4d95faa5-4238-49ed-b287-ea66016e13b8 service nova] Creating event network-vif-unplugged:efced7b6-2b69-4375-a6e0-ff4de63851db for instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 on n-h2-853316-12 Oct 17 12:50:52.681720 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6117cdc8-94dd-4bd1-a9a4-cc8cbe0b17ba req-4d95faa5-4238-49ed-b287-ea66016e13b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100588 Oct 17 12:50:52.687413 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 316/641] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:52.899370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Calling method '.version_select at 0x7fa8212ab0d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:52.901912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.902423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.903260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:52.922430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.923225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.923818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:52.942830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.943564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.944216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:52.947403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-667116955", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e9442b7e-a211-428d-b994-b659608d7553"}], "security_groups": [{"name": "tempest-securitygroup--1705582006"}], "key_name": "tempest-keypair-1838025958", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:52.951162 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4d81516-426a-48c3-9ef4-43ec5ee15e11 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.276412 Oct 17 12:50:52.959164 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 326/642] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:50:52.963890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Calling method '.version_select at 0x7fa8213b3280>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:52.965621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.966105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.966573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:52.983695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:52.984214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:52.984659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.009662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.010360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.010981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.020221 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6288ae3-66bc-4f8b-9969-437a7af67b88 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-853316-12/servers" status: 200 len: 276 microversion: 2.1 time: 0.059660 Oct 17 12:50:53.028425 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 327/643] 10.222.0.27 () {58 vars in 1215 bytes} [Mon Oct 17 12:50:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-853316-12/servers => generated 276 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:53.035513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Calling method '.version_select at 0x7fa8213f9c10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:53.037592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.038268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.038871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.053846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.054623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.055219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.068410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.069440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.072409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.095310 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-57d3bfa7-12c3-465d-8d81-7d829ade2cf9 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.064960 Oct 17 12:50:53.096515 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 328/644] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:50:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:53.102982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] validate_networks() for [('e9442b7e-a211-428d-b994-b659608d7553', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:50:53.109337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1085bb5-2de6-4f56-b700-69a06574d866 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Calling method '.version_select at 0x7fa82132b0d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:53.111542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1085bb5-2de6-4f56-b700-69a06574d866 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.112215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1085bb5-2de6-4f56-b700-69a06574d866 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.114036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1085bb5-2de6-4f56-b700-69a06574d866 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.130595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1085bb5-2de6-4f56-b700-69a06574d866 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.131549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1085bb5-2de6-4f56-b700-69a06574d866 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.132183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1085bb5-2de6-4f56-b700-69a06574d866 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.140846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c1085bb5-2de6-4f56-b700-69a06574d866 tempest-HypervisorAdminUnderV252Test-1656909324 tempest-HypervisorAdminUnderV252Test-1656909324-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-853316-12/search" status: 200 len: 105 microversion: 2.1 time: 0.035900 Oct 17 12:50:53.149492 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 329/645] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 17 12:50:53 2022] GET /compute/v2.1/os-hypervisors/n-h2-853316-12/search => generated 105 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:53.155297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e9f569f0-f238-40f9-b18f-cd3446937a9b tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa82132b8b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:53.219269 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e9f569f0-f238-40f9-b18f-cd3446937a9b tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.067092 Oct 17 12:50:53.228723 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 330/646] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:53 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:53.558492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:53.559130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:53.577440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.581424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.582351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.583364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.583836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.584252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.819646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:50:53.820635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:50:53.821201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:50:53.821852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:50:53.822901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:50:53.834931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.835543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.836147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.837065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.837510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.838042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.857248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for project c964bbec50ba4a2480831a33d6a935c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:50:53.862371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for user 8dfeceb58cdd47b8b82d905614ba3d5b and project c964bbec50ba4a2480831a33d6a935c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:50:53.875590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:50:53.878530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:50:53.932836 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-86634a62-79e1-4b85-8ba0-eea10c07b794 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.988980 Oct 17 12:50:53.938326 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 317/647] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:50:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 12:50:53.946512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:53.950489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:53.965653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.967485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.968589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.969680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:53.970402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:53.971126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:53.979541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:53.990943 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] HTTP exception thrown: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Request method failure captured: Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e HTTP/1.1 Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9pnuRaOYOo3b2AYOC8NK-eEWmk8zi-nUl7FbXM8jR2lcmREc8kzOCdGrsR42x9LycP7bVFeZyEaVMYwu8WzQU2iqZvazSzQYFHRapQNTnO5HkDEkoz9kj1zBhxqAzhRvJ6zhDJn-XijGA3uie3JRqiY7I-h-W30NiqYHl2H-waEWU Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:50:53.993532 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_254cfab78c5442c58eb0cb2c51bdd8c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ffc77ed08cf741abac4491e84ba16f22 Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:53.994921 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '89f0532d-b86c-4499-b9f8-ebf43447822e'} Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:53.995657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:53.996834 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:50:53.997970 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-92d56431-fe91-4724-ac8a-669d7a492e20 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1314 microversion: 2.1 time: 0.442198 Oct 17 12:50:53.999166 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 331/648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:53 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:53.999617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Returning 404 to user: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:54.000565 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-350d06c7-1d28-470a-bf1d-412560c739c1 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 404 len: 111 microversion: 2.1 time: 0.061007 Oct 17 12:50:54.007575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9befbaa-a451-4420-83bd-f14c0988830d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82132b160>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:54.012817 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 318/649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:53 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:54.019670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-557242a6-2664-4c07-8450-d48560d47b80 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:54.020691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-557242a6-2664-4c07-8450-d48560d47b80 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:54.105638 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9befbaa-a451-4420-83bd-f14c0988830d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.104929 Oct 17 12:50:54.106304 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 332/650] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:53 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:54.116494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:54.117002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:54.130219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.130706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.131149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.140499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.140988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.144483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.165781 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] HTTP exception thrown: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Request method failure captured: Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e HTTP/1.1 Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9pnuRaOYOo3b2AYOC8NK-eEWmk8zi-nUl7FbXM8jR2lcmREc8kzOCdGrsR42x9LycP7bVFeZyEaVMYwu8WzQU2iqZvazSzQYFHRapQNTnO5HkDEkoz9kj1zBhxqAzhRvJ6zhDJn-XijGA3uie3JRqiY7I-h-W30NiqYHl2H-waEWU Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:54.168747 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_254cfab78c5442c58eb0cb2c51bdd8c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ffc77ed08cf741abac4491e84ba16f22 Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.170239 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '89f0532d-b86c-4499-b9f8-ebf43447822e'} Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:54.171105 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.172455 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.174711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Returning 404 to user: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:54.176937 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dae7763e-c852-421c-bc44-f6c8e48e0234 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 404 len: 111 microversion: 2.1 time: 0.069701 Oct 17 12:50:54.181304 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 333/651] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:54 2022] DELETE /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:54.184152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-557242a6-2664-4c07-8450-d48560d47b80 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:54.189877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:54.192693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 89f0532d-b86c-4499-b9f8-ebf43447822e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:54.198188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-557242a6-2664-4c07-8450-d48560d47b80 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:54.204874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.205381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.205824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-557242a6-2664-4c07-8450-d48560d47b80 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:54.208085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.209624 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-557242a6-2664-4c07-8450-d48560d47b80 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1285 microversion: 2.25 time: 0.193436 Oct 17 12:50:54.211001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.211655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.212032 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 319/652] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:54 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:54.212434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.237200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-581b4e96-f178-4b0e-afc9-532ce68f8d92 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8213f6820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:54.238852 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] HTTP exception thrown: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Request method failure captured: Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e HTTP/1.1 Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9pnuRaOYOo3b2AYOC8NK-eEWmk8zi-nUl7FbXM8jR2lcmREc8kzOCdGrsR42x9LycP7bVFeZyEaVMYwu8WzQU2iqZvazSzQYFHRapQNTnO5HkDEkoz9kj1zBhxqAzhRvJ6zhDJn-XijGA3uie3JRqiY7I-h-W30NiqYHl2H-waEWU Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:54.240366 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_254cfab78c5442c58eb0cb2c51bdd8c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ffc77ed08cf741abac4491e84ba16f22 Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.241829 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '89f0532d-b86c-4499-b9f8-ebf43447822e'} Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:54.242702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. Oct 17 12:50:54.244194 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.245457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Returning 404 to user: Instance 89f0532d-b86c-4499-b9f8-ebf43447822e could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:54.249964 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbee20d0-9b17-4b9c-b033-0bbd4c5abdda tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e" status: 404 len: 111 microversion: 2.1 time: 0.056424 Oct 17 12:50:54.250903 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 334/653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:54 2022] GET /compute/v2.1/servers/89f0532d-b86c-4499-b9f8-ebf43447822e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:54.258978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:54.260539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:54.270322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.274137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.274870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.275891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.277715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.280954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.314737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] HTTP exception thrown: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Request method failure captured: Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b HTTP/1.1 Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9pnuRaOYOo3b2AYOC8NK-eEWmk8zi-nUl7FbXM8jR2lcmREc8kzOCdGrsR42x9LycP7bVFeZyEaVMYwu8WzQU2iqZvazSzQYFHRapQNTnO5HkDEkoz9kj1zBhxqAzhRvJ6zhDJn-XijGA3uie3JRqiY7I-h-W30NiqYHl2H-waEWU Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:54.316894 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_254cfab78c5442c58eb0cb2c51bdd8c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ffc77ed08cf741abac4491e84ba16f22 Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.318346 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '884d3161-cfbe-40c2-82a9-6d0a013a811b'} Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:54.319160 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.320495 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.321916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Returning 404 to user: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:54.325335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a1686bdc-3ac5-415d-b800-e5fb95577853 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "DELETE /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 404 len: 111 microversion: 2.1 time: 0.063120 Oct 17 12:50:54.329137 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 335/654] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:50:54 2022] DELETE /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:50:54.336244 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-581b4e96-f178-4b0e-afc9-532ce68f8d92 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.104626 Oct 17 12:50:54.337343 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 320/655] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:54 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:54.343472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:54.346959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] [instance: 884d3161-cfbe-40c2-82a9-6d0a013a811b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:54.355267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.356147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.356589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.357292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.358001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.359178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.410740 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] HTTP exception thrown: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Request method failure captured: Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b HTTP/1.1 Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9pnuRaOYOo3b2AYOC8NK-eEWmk8zi-nUl7FbXM8jR2lcmREc8kzOCdGrsR42x9LycP7bVFeZyEaVMYwu8WzQU2iqZvazSzQYFHRapQNTnO5HkDEkoz9kj1zBhxqAzhRvJ6zhDJn-XijGA3uie3JRqiY7I-h-W30NiqYHl2H-waEWU Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:50:54.415038 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_254cfab78c5442c58eb0cb2c51bdd8c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/254cfab78c5442c58eb0cb2c51bdd8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 254cfab78c5442c58eb0cb2c51bdd8c4 Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2120914555 Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ffc77ed08cf741abac4491e84ba16f22 Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersAdminTestJSON-2120914555-project Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.416325 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '884d3161-cfbe-40c2-82a9-6d0a013a811b'} Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:50:54.417008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. Oct 17 12:50:54.418122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:50:54.419159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] Returning 404 to user: Instance 884d3161-cfbe-40c2-82a9-6d0a013a811b could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:50:54.419159 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3bd5b74-b256-4988-a8f9-3a51b183b502 tempest-DeleteServersAdminTestJSON-2120914555 tempest-DeleteServersAdminTestJSON-2120914555-project] 10.222.0.27 "GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b" status: 404 len: 111 microversion: 2.1 time: 0.089049 Oct 17 12:50:54.421824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 336/656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:54 2022] GET /compute/v2.1/servers/884d3161-cfbe-40c2-82a9-6d0a013a811b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:50:54.703461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-ead90b72-2d97-4d85-976c-4a3ea0c2afe3 req-1f34ea8d-90e4-4a2d-90d2-54e2db68a4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652645b9-e4bb-48f1-be51-e9483a163116", "name": "network-vif-unplugged", "status": "completed", "tag": "29f3ca43-09a3-4d2b-9a04-d9d3003b14d2"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:54.726605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ead90b72-2d97-4d85-976c-4a3ea0c2afe3 req-1f34ea8d-90e4-4a2d-90d2-54e2db68a4e9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:54.727082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ead90b72-2d97-4d85-976c-4a3ea0c2afe3 req-1f34ea8d-90e4-4a2d-90d2-54e2db68a4e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:54.727620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ead90b72-2d97-4d85-976c-4a3ea0c2afe3 req-1f34ea8d-90e4-4a2d-90d2-54e2db68a4e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:54.779403 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-ead90b72-2d97-4d85-976c-4a3ea0c2afe3 req-1f34ea8d-90e4-4a2d-90d2-54e2db68a4e9 service nova] Creating event network-vif-unplugged:29f3ca43-09a3-4d2b-9a04-d9d3003b14d2 for instance 652645b9-e4bb-48f1-be51-e9483a163116 on n-h1-853316-12 Oct 17 12:50:54.792687 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-ead90b72-2d97-4d85-976c-4a3ea0c2afe3 req-1f34ea8d-90e4-4a2d-90d2-54e2db68a4e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092912 Oct 17 12:50:54.793362 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 321/657] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:55.025304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:55.028212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:55.057743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:55.066712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:55.067490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:55.068341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:55.069045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:55.069535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:55.121689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-29ff03b2-3e88-4f1d-b120-9ab29f44ae8b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821c071f0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:55.272585 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-29ff03b2-3e88-4f1d-b120-9ab29f44ae8b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.154873 Oct 17 12:50:55.273256 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 322/658] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:55 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:55.299443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:55.301495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:55.334734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:55.335642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:55.340134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:55.340924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:55.341399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:55.341833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:55.509786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:55.519207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:55.521964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:55.523614 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-547e3903-e6d1-4b51-ad7d-48c71f2ade86 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1337 microversion: 2.25 time: 0.249423 Oct 17 12:50:55.538244 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 323/659] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:55 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1337 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:55.551465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7d689d8-d985-4275-abf9-dc0d2f03c289 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8213f69d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:55.624691 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7d689d8-d985-4275-abf9-dc0d2f03c289 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.084915 Oct 17 12:50:55.626109 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 324/660] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:55 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:55.758449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:55.770762 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ed186a6c-4972-4994-8b63-818cbb6eef15 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1314 microversion: 2.1 time: 0.748934 Oct 17 12:50:55.773300 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 337/661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:55 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:56.248332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-bd8d156e-5a04-488d-9e2b-b1adf50f95b8 req-82c6b1d8-4ee0-4f91-a339-510bd7292141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beab481d-f8f2-4ad4-b54e-dc0da55403c6", "tag": "0a12bacf-e64c-4255-a09d-edb9ed6a43cf"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:56.274842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd8d156e-5a04-488d-9e2b-b1adf50f95b8 req-82c6b1d8-4ee0-4f91-a339-510bd7292141 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:56.280315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd8d156e-5a04-488d-9e2b-b1adf50f95b8 req-82c6b1d8-4ee0-4f91-a339-510bd7292141 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:56.281032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd8d156e-5a04-488d-9e2b-b1adf50f95b8 req-82c6b1d8-4ee0-4f91-a339-510bd7292141 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:56.288934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-39437a86-048d-46dd-921b-231e696888bb tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82137a4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:56.311686 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-bd8d156e-5a04-488d-9e2b-b1adf50f95b8 req-82c6b1d8-4ee0-4f91-a339-510bd7292141 service nova] Creating event network-changed:0a12bacf-e64c-4255-a09d-edb9ed6a43cf for instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 on n-h2-853316-12 Oct 17 12:50:56.320341 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-bd8d156e-5a04-488d-9e2b-b1adf50f95b8 req-82c6b1d8-4ee0-4f91-a339-510bd7292141 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075753 Oct 17 12:50:56.326928 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 325/662] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:56.415696 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-39437a86-048d-46dd-921b-231e696888bb tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.131027 Oct 17 12:50:56.422217 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 338/663] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:56 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:56.552373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:56.554310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:56.570354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:56.571050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:56.571741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:56.573657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:56.574350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:56.579038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:56.643549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9f9d73e1-1af6-46e9-a67c-bda887aa1220 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8212ab430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:56.730731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9f9d73e1-1af6-46e9-a67c-bda887aa1220 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.091158 Oct 17 12:50:56.731317 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 339/664] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:56 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:56.800391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:56.801511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:56.820437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:56.821743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:56.825813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:56.829542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:56.833156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:56.835054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:56.836020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:56.851185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:56.852701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:56.855257 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8a1f48e-e83e-41e5-9075-38c69ed97940 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1343 microversion: 2.25 time: 0.307039 Oct 17 12:50:56.858482 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 326/665] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:56 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1343 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:56.863893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fd661ff1-cf81-4ec4-a146-b16a36c37c14 req-a5e05197-cefc-4034-aa64-bc2fb7215d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1973e5f8-4e02-44fb-89ff-467c3af31c21", "name": "network-vif-plugged", "status": "completed", "tag": "efced7b6-2b69-4375-a6e0-ff4de63851db"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:56.899623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd661ff1-cf81-4ec4-a146-b16a36c37c14 req-a5e05197-cefc-4034-aa64-bc2fb7215d0e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:56.900419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd661ff1-cf81-4ec4-a146-b16a36c37c14 req-a5e05197-cefc-4034-aa64-bc2fb7215d0e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:56.901055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd661ff1-cf81-4ec4-a146-b16a36c37c14 req-a5e05197-cefc-4034-aa64-bc2fb7215d0e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:56.939529 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fd661ff1-cf81-4ec4-a146-b16a36c37c14 req-a5e05197-cefc-4034-aa64-bc2fb7215d0e service nova] Creating event network-vif-plugged:efced7b6-2b69-4375-a6e0-ff4de63851db for instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 on n-h2-853316-12 Oct 17 12:50:56.959133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:56.961739 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fd661ff1-cf81-4ec4-a146-b16a36c37c14 req-a5e05197-cefc-4034-aa64-bc2fb7215d0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101010 Oct 17 12:50:56.965562 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 327/666] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:57.434177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-262868c2-c19b-4821-962f-07457439f903 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8213f6af0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:57.557175 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-262868c2-c19b-4821-962f-07457439f903 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.127819 Oct 17 12:50:57.557840 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 328/667] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:57 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:57.749293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87c2fa26-7b46-4475-b6fd-276a0e6bdba1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa82142d430>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:57.792303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:57.810909 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0cf7bdda-f03a-45d8-bbd9-917662a15bdb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1314 microversion: 2.1 time: 1.006946 Oct 17 12:50:57.827747 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 340/668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:56 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1314 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:57.851202 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-87c2fa26-7b46-4475-b6fd-276a0e6bdba1 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.107958 Oct 17 12:50:57.852512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 329/669] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:57 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:57.887229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:57.888815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:57.901922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:57.904854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:57.905673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:57.907727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:57.912157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:57.912907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:58.436760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:58.447650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:58.460007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:58.461860 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b0131be-4615-4644-92a7-adb8fb7a4eb7 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1411 microversion: 2.25 time: 0.580412 Oct 17 12:50:58.483725 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 341/670] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:57 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1411 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:50:58.585871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ea4003f-5d98-47a2-a043-b99d7d593a85 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8213c0d30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:58.671398 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ea4003f-5d98-47a2-a043-b99d7d593a85 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.101884 Oct 17 12:50:58.672944 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 330/671] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:58 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:58.839624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:58.840389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:58.847554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:58.848511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:58.849112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:58.849947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:58.850568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:58.851285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:58.856567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:58.870137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55cab044-6c09-4d95-8b42-a2f56c98ad56 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa82142d430>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:58.952379 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55cab044-6c09-4d95-8b42-a2f56c98ad56 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.088534 Oct 17 12:50:58.964821 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 331/672] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:58 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:58.999490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:50:59.483218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:50:59.494095 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e6e941b3-f6ec-4fb7-8064-eb10beaf7599 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1314 microversion: 2.1 time: 0.659177 Oct 17 12:50:59.494816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:59.495969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:50:59.508411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:59.509248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:59.510566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:59.511949 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 342/673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:50:58 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:50:59.513021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:59.514718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:59.516613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:59.688381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-643ea199-5e7d-4f63-9a4c-047e82912f83 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212a8040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:50:59.798354 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-643ea199-5e7d-4f63-9a4c-047e82912f83 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.111065 Oct 17 12:50:59.804729 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 343/674] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:59 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:50:59.829342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c9761cdf-ceb7-46b0-8b8b-24d21ded41cd req-9117ddaf-07f7-4e9d-9f09-c3f810ce327c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1584fb0-8664-4fa6-8ef7-58b1107b78c2", "name": "network-vif-plugged", "status": "completed", "tag": "14eafe5b-088e-4dfd-853c-16d4a0e15ed1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:50:59.883999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c9761cdf-ceb7-46b0-8b8b-24d21ded41cd req-9117ddaf-07f7-4e9d-9f09-c3f810ce327c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:50:59.886376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c9761cdf-ceb7-46b0-8b8b-24d21ded41cd req-9117ddaf-07f7-4e9d-9f09-c3f810ce327c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:50:59.889080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c9761cdf-ceb7-46b0-8b8b-24d21ded41cd req-9117ddaf-07f7-4e9d-9f09-c3f810ce327c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:50:59.933802 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c9761cdf-ceb7-46b0-8b8b-24d21ded41cd req-9117ddaf-07f7-4e9d-9f09-c3f810ce327c service nova] Creating event network-vif-plugged:14eafe5b-088e-4dfd-853c-16d4a0e15ed1 for instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 on n-h1-853316-12 Oct 17 12:50:59.952372 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c9761cdf-ceb7-46b0-8b8b-24d21ded41cd req-9117ddaf-07f7-4e9d-9f09-c3f810ce327c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141278 Oct 17 12:50:59.958501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 344/675] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:50:59.972246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1f98a59e-97b1-4e36-a53d-99dc4f95da01 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8212abf70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:00.041050 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1f98a59e-97b1-4e36-a53d-99dc4f95da01 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.073196 Oct 17 12:51:00.041640 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 345/676] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:50:59 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:00.338053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:00.357691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:00.361308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:00.369091 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b360c087-5449-4244-8134-30615e71834f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1411 microversion: 2.25 time: 0.878859 Oct 17 12:51:00.375032 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 332/677] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:50:59 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1411 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:51:00.518448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:00.520653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:00.536080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:00.536578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:00.539002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:00.539756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:00.540365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:00.541680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:00.663156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fcee3fca-1eb7-43ea-b248-0d40d9869b22 req-d7577bed-0037-4311-826e-9de6494e0448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a076fb2-b905-428e-8d88-e396a91a80c1", "tag": "271b29d9-801d-45ee-9eb8-0cc803f60d9a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:00.678770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fcee3fca-1eb7-43ea-b248-0d40d9869b22 req-d7577bed-0037-4311-826e-9de6494e0448 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:00.684438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fcee3fca-1eb7-43ea-b248-0d40d9869b22 req-d7577bed-0037-4311-826e-9de6494e0448 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:00.685043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fcee3fca-1eb7-43ea-b248-0d40d9869b22 req-d7577bed-0037-4311-826e-9de6494e0448 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:00.708642 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fcee3fca-1eb7-43ea-b248-0d40d9869b22 req-d7577bed-0037-4311-826e-9de6494e0448 service nova] Creating event network-changed:271b29d9-801d-45ee-9eb8-0cc803f60d9a for instance 5a076fb2-b905-428e-8d88-e396a91a80c1 on n-h2-853316-12 Oct 17 12:51:00.722408 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fcee3fca-1eb7-43ea-b248-0d40d9869b22 req-d7577bed-0037-4311-826e-9de6494e0448 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063764 Oct 17 12:51:00.723560 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 333/678] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:51:00.810311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:00.827190 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45e87b00-1bb7-4039-b2dd-80a15f5cdfae tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1314 microversion: 2.1 time: 0.314127 Oct 17 12:51:00.842217 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 346/679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:00 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:00.843317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-21db4550-b029-4a64-84e3-efb2d5e3b97d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821423dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:00.898942 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-21db4550-b029-4a64-84e3-efb2d5e3b97d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.082999 Oct 17 12:51:00.899841 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 334/680] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:00 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:01.079087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17fb6c47-1456-4f06-8d15-0a2104f6d72b tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8213495e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:01.202278 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-17fb6c47-1456-4f06-8d15-0a2104f6d72b tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1427 microversion: 2.1 time: 0.128959 Oct 17 12:51:01.203305 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 347/681] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:01 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:01.404266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:01.404799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:01.420939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:01.421458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:01.421893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:01.428460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:01.429012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:01.432891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:01.601809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9adb18ef-f653-49a8-b1aa-9951dccaa715 tempest-InstanceUsageAuditLogTestJSON-953824762 tempest-InstanceUsageAuditLogTestJSON-953824762-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:01.637952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9adb18ef-f653-49a8-b1aa-9951dccaa715 tempest-InstanceUsageAuditLogTestJSON-953824762 tempest-InstanceUsageAuditLogTestJSON-953824762-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17 12:51:01" status: 200 len: 318 microversion: 2.1 time: 0.545535 Oct 17 12:51:01.639719 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 335/682] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 12:51:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2012%3A51%3A01 => generated 318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:01.655087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3300cc02-9a0d-4ff1-bb81-68880aeae904 tempest-InstanceUsageAuditLogTestJSON-953824762 tempest-InstanceUsageAuditLogTestJSON-953824762-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:01.684929 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3300cc02-9a0d-4ff1-bb81-68880aeae904 tempest-InstanceUsageAuditLogTestJSON-953824762 tempest-InstanceUsageAuditLogTestJSON-953824762-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.033849 Oct 17 12:51:01.688532 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 336/683] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 17 12:51:01 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:01.853203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:01.854376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:01.868823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:01.870775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:01.871329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:01.882940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:01.888787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:01.890426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:02.012025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:02.021159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:02.037710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:02.040866 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d5783ada-0c86-4619-974d-cd5bd238c936 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1411 microversion: 2.25 time: 0.640612 Oct 17 12:51:02.066837 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 348/684] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:51:01 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1411 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:51:02.074622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be80a712-b4ca-4a05-8fcf-aee9d27146d3 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821280430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:02.248572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:02.263262 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f994e082-1501-4a43-aed6-d27e130f2d1d tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1314 microversion: 2.1 time: 0.414659 Oct 17 12:51:02.266609 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 337/685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:01 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:02.498308 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be80a712-b4ca-4a05-8fcf-aee9d27146d3 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.429637 Oct 17 12:51:02.502830 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 349/686] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:02 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:02.515647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c29cf3b0-dd8d-40ea-98e9-ca65fd273cb9 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8212805e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:02.869140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7d49eec-2e07-4c60-a7a6-45af55db53a9 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Action: 'create', calling method: .version_select at 0x7fa8217e0670>, body: {"keypair": {"name": "tempest-keypair-1029112737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL0XCd2T/yHuVsm7OK55Z47jlEnuSDHhUV+eTvc0PvDAHf+OpIkSH+cMyvBwr3dFoxRYIbaaGwhehu4iJ1cLJoiXPPP+2uK2RNfusDtJ1uevWZWuibJ+bzOU+p3R54J6w=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:02.905792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d7d49eec-2e07-4c60-a7a6-45af55db53a9 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:02.914852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d7d49eec-2e07-4c60-a7a6-45af55db53a9 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for user 61bd380e33bc4ea1a36b5ac9c3bc6605 and project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:02.952925 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7d49eec-2e07-4c60-a7a6-45af55db53a9 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.684198 Oct 17 12:51:02.954226 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 338/687] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:02.973605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-006e6b59-1c6a-4b09-adc3-d9fe45b4a272 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Calling method '.version_select at 0x7fa82137e0d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:02.993231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:03.007515 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-006e6b59-1c6a-4b09-adc3-d9fe45b4a272 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1029112737" status: 200 len: 497 microversion: 2.1 time: 0.043210 Oct 17 12:51:03.010013 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 339/688] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 12:51:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1029112737 => generated 497 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:03.025883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-358a2c68-33da-4488-b0e9-012680592431 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Calling method '.version_select at 0x7fa82137edc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:03.071010 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-358a2c68-33da-4488-b0e9-012680592431 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029112737" status: 202 len: 0 microversion: 2.1 time: 0.052824 Oct 17 12:51:03.072211 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 340/689] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 12:51:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029112737 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:03.085018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:03.086119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:03.102931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:03.103690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:03.106491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:03.107468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:03.108244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:03.109164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:03.793404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:03.802837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:03.809343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:03.817046 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cae43654-c78b-4375-8289-c1a64132c137 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1411 microversion: 2.25 time: 0.743424 Oct 17 12:51:03.828722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 341/690] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:51:03 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1411 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:51:03.835886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9c39705f-e5f4-43ca-8c09-b9740302ef43 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Action: 'create', calling method: .version_select at 0x7fa8213af670>, body: {"keypair": {"name": "tempest-keypair-835559375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHFAZvNqtK9ghoTTpHGx9IHng86NKLC1zLAZN8a/Eijaxfrb8vQ13ZxGfbslbD7pIMJ1Uiodh6EbJJKkVAalAFVul4ZoJ1dkLt9UU/r/O9BXB33iiJ4lT6HEj+t2HCBpg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:03.850495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:03.879016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-9c39705f-e5f4-43ca-8c09-b9740302ef43 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:03.886771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-9c39705f-e5f4-43ca-8c09-b9740302ef43 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for user 61bd380e33bc4ea1a36b5ac9c3bc6605 and project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:03.947301 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9c39705f-e5f4-43ca-8c09-b9740302ef43 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116013 Oct 17 12:51:03.950522 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 342/691] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:03.966144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:03.971129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:03.998844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:04.009377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:04.010295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:04.014037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:04.014908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:04.015571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:04.908702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:04.918013 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eeeb28be-5760-4ba3-b1e7-bc37f30a8490 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1314 microversion: 2.1 time: 0.965616 Oct 17 12:51:04.919918 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 343/692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:03 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1314 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:04.924680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9421aa84-d9ae-424d-979c-676a2ace200e tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8213afb80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:11.417821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:12.017511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=18 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:13.905446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=26 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:13.980698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:14.917159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:16.276646 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c29cf3b0-dd8d-40ea-98e9-ca65fd273cb9 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1436 microversion: 2.1 time: 13.771785 Oct 17 12:51:16.277641 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 350/693] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:02 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1436 bytes in 13774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:16.292438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01dad748-43a6-4db1-8038-9af0ed4e9a36 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Calling method '.version_select at 0x7fa821229940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:16.301532 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9421aa84-d9ae-424d-979c-676a2ace200e tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 11.378958 Oct 17 12:51:16.303099 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 344/694] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:04 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 11382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:16.310740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:16.313216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:16.328304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:16.329029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:16.329660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:16.330915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:16.332291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:16.332949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:16.338057 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01dad748-43a6-4db1-8038-9af0ed4e9a36 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835559375" status: 202 len: 0 microversion: 2.1 time: 0.057977 Oct 17 12:51:16.340283 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 351/695] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 12:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835559375 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:16.350272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:16.352759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:16.362887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:16.365827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:16.366882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:16.367882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:16.368561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:16.369212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:16.656387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:16.676163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:16.678834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:16.681225 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f279e64a-62be-4cb8-befa-60da4a11ee4a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1411 microversion: 2.25 time: 0.376873 Oct 17 12:51:16.700650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:16.705170 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 345/696] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:51:16 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1411 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:51:16.712570 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-35b84a76-9790-4467-9f43-5e5a70efa2bb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1314 microversion: 2.1 time: 0.370918 Oct 17 12:51:16.718901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-069e0aa0-e2ab-4244-907e-498446362273 req-0c3b7ef9-35dd-4f0a-a74f-fd2d08fec92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beab481d-f8f2-4ad4-b54e-dc0da55403c6", "name": "network-vif-plugged", "status": "completed", "tag": "0a12bacf-e64c-4255-a09d-edb9ed6a43cf"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:16.719877 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 352/697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:16 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:16.749041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-069e0aa0-e2ab-4244-907e-498446362273 req-0c3b7ef9-35dd-4f0a-a74f-fd2d08fec92b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:16.749902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-069e0aa0-e2ab-4244-907e-498446362273 req-0c3b7ef9-35dd-4f0a-a74f-fd2d08fec92b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:16.750818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-069e0aa0-e2ab-4244-907e-498446362273 req-0c3b7ef9-35dd-4f0a-a74f-fd2d08fec92b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:16.783777 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-069e0aa0-e2ab-4244-907e-498446362273 req-0c3b7ef9-35dd-4f0a-a74f-fd2d08fec92b service nova] Creating event network-vif-plugged:0a12bacf-e64c-4255-a09d-edb9ed6a43cf for instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 on n-h2-853316-12 Oct 17 12:51:16.798384 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-069e0aa0-e2ab-4244-907e-498446362273 req-0c3b7ef9-35dd-4f0a-a74f-fd2d08fec92b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091624 Oct 17 12:51:16.800944 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 346/698] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:16.843930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f4fa4baa-352b-4901-8439-12101db321b6 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8213f6dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:16.952592 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f4fa4baa-352b-4901-8439-12101db321b6 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 200 len: 1436 microversion: 2.1 time: 0.148667 Oct 17 12:51:16.961818 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 347/699] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:16 2022] GET /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 1436 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:16.975663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bfbb6640-2858-42eb-b86f-69fc7111237d tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Action: 'create', calling method: .version_select at 0x7fa82148dca0>, body: {"keypair": {"name": "tempest-keypair-1311910538", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:17.023157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-bfbb6640-2858-42eb-b86f-69fc7111237d tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:17.028630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-bfbb6640-2858-42eb-b86f-69fc7111237d tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for user 61bd380e33bc4ea1a36b5ac9c3bc6605 and project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:17.083706 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bfbb6640-2858-42eb-b86f-69fc7111237d tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.120607 Oct 17 12:51:17.085373 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 348/700] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:16 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:17.100609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:17.102892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:17.116756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:17.119746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:17.124562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:17.125569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:17.126241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:17.126838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:17.178783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:51:17.384778 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1494cd5-b682-4c43-bee4-21e2cc508de7 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 204 len: 0 microversion: 2.1 time: 0.296696 Oct 17 12:51:17.385720 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 349/701] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:51:17 2022] DELETE /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:17.405351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:17.406082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:17.427359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:17.427810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:17.428255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:17.428974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:17.429428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:17.429864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:17.453263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4054ce41-a905-4fe9-93e0-1e292498bb59 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Action: 'update', calling method: .version_select at 0x7fa82122e160>, body: {"quota_set": {"ram": "5120"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:17.602687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-a905-4fe9-93e0-1e292498bb59 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:17.609601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-a905-4fe9-93e0-1e292498bb59 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:17.610877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-a905-4fe9-93e0-1e292498bb59 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:17.616848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-a905-4fe9-93e0-1e292498bb59 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:17.621834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-a905-4fe9-93e0-1e292498bb59 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:17.625280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-a905-4fe9-93e0-1e292498bb59 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:17.735248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:17.746767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7440aaa-8101-4e36-808c-d22204464061 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1467 microversion: 2.1 time: 0.357276 Oct 17 12:51:17.747861 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 350/702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:17 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1467 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:17.777796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31804d99-f49c-42bc-aa44-6cab1f1e6785 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Calling method '.version_select at 0x7fa82137eca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:17.813679 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31804d99-f49c-42bc-aa44-6cab1f1e6785 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311910538" status: 202 len: 0 microversion: 2.1 time: 0.049841 Oct 17 12:51:17.827732 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 351/703] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 12:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311910538 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:17.835385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8cc11a91-6699-406c-b6b6-8ab8e34e6a53 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8213c03a0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:17.839409 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4054ce41-a905-4fe9-93e0-1e292498bb59 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/0e034965e7644c4b8848c1d29169d052" status: 200 len: 240 microversion: 2.36 time: 1.113239 Oct 17 12:51:17.850325 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 353/704] 10.222.0.27 () {62 vars in 1303 bytes} [Mon Oct 17 12:51:16 2022] PUT /compute/v2.1/os-quota-sets/0e034965e7644c4b8848c1d29169d052 => generated 240 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:51:17.886331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:17.888376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:17.897415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:17.897981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:17.899586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:17.901624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:17.902572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:17.903016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:17.944455 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8cc11a91-6699-406c-b6b6-8ab8e34e6a53 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.115215 Oct 17 12:51:17.945715 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 352/705] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:17 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:17.953582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-969060104", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "53009762", "adminPass": "***", "networks": [{"uuid": "ce06c3ed-b170-48a1-b300-59d26acfca9a"}], "security_groups": [{"name": "tempest-securitygroup--147241734"}], "key_name": "tempest-keypair-633989678", "user_data": "}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:18.208404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] validate_networks() for [('ce06c3ed-b170-48a1-b300-59d26acfca9a', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:51:18.375338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:18.395492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:18.400931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:18.404390 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ffb86afc-927c-4998-b78e-f899895767e3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1411 microversion: 2.25 time: 0.544822 Oct 17 12:51:18.406335 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 354/706] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:51:17 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1411 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:51:18.414391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:18.415353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:18.424015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:18.424876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:18.425511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:18.427646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:18.428327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:18.428939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:18.829560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:18.843893 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c86dd6d6-92b8-4f66-99ac-6dfc810f0f26 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1464 microversion: 2.1 time: 0.436105 Oct 17 12:51:18.844744 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 355/707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:18 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1464 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:18.854732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-edfe9f07-1cf5-405f-bc17-71a3c68db786 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8212310d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:18.893007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:51:18.893487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:51:18.894020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:51:18.894836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:51:18.896423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:51:18.908339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:18.909084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:18.910520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:18.911336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:18.911744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:18.912161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:18.955927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Getting quotas for project 18e42d050ee6400786fb16b79e54355b. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:18.960466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Getting quotas for user 68dd6904cebc42b48e4f421267cafd9d and project 18e42d050ee6400786fb16b79e54355b. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:18.986089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:51:18.989311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:51:19.141559 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0886b8ad-b95a-473b-af18-c15d9491b399 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.194706 Oct 17 12:51:19.142414 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 353/708] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:51:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:51:19.153336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f830522e-a085-4563-a484-61ac53b0389d tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Action: 'create', calling method: .version_select at 0x7fa82142d5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1389022596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJDuHuQyeNVPJmk+7kD76OFBULVJ49t+LynLY78j5Mk2Naex9liua/iP5qtE1RH1j60QaSgMubbAHTh37vEDqJGzQ9ui0BT9o+0C6lxnIGhpN1b8ArlPlLLVNvJebxHtQ=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:19.223433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f830522e-a085-4563-a484-61ac53b0389d tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:19.243824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f830522e-a085-4563-a484-61ac53b0389d tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for user 61bd380e33bc4ea1a36b5ac9c3bc6605 and project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:19.338911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f830522e-a085-4563-a484-61ac53b0389d tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.191553 Oct 17 12:51:19.340560 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 354/709] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:19.357166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b4cdbd46-b03d-4f2f-8ebf-d530c2694d1a tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Calling method '.version_select at 0x7fa821423040>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:19.798827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cdbd46-b03d-4f2f-8ebf-d530c2694d1a tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:19.800604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cdbd46-b03d-4f2f-8ebf-d530c2694d1a tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:19.803087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cdbd46-b03d-4f2f-8ebf-d530c2694d1a tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:19.805446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cdbd46-b03d-4f2f-8ebf-d530c2694d1a tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:19.806290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cdbd46-b03d-4f2f-8ebf-d530c2694d1a tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:19.808514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cdbd46-b03d-4f2f-8ebf-d530c2694d1a tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:19.874794 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b4cdbd46-b03d-4f2f-8ebf-d530c2694d1a tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0e034965e7644c4b8848c1d29169d052/detail" status: 200 len: 672 microversion: 2.36 time: 0.530257 Oct 17 12:51:19.875372 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 355/710] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 17 12:51:19 2022] GET /compute/v2.1/os-quota-sets/0e034965e7644c4b8848c1d29169d052/detail => generated 672 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:51:19.921708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:19.923919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:19.968678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:19.969186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:19.969665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:19.970936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:19.971401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:19.971832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:20.483245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:20.492748 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-358682b8-711d-4735-bbf2-62c48a3eb1d4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1464 microversion: 2.1 time: 0.597505 Oct 17 12:51:20.497686 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 356/711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:19 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1464 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:20.510269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a6552453-cc4a-4ee9-80ad-5d4fa3ce966f req-d5ae559f-9a86-4e50-9c32-a0ede39b8c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a076fb2-b905-428e-8d88-e396a91a80c1", "name": "network-vif-plugged", "status": "completed", "tag": "271b29d9-801d-45ee-9eb8-0cc803f60d9a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:20.549419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a6552453-cc4a-4ee9-80ad-5d4fa3ce966f req-d5ae559f-9a86-4e50-9c32-a0ede39b8c06 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:20.558208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a6552453-cc4a-4ee9-80ad-5d4fa3ce966f req-d5ae559f-9a86-4e50-9c32-a0ede39b8c06 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:20.559314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a6552453-cc4a-4ee9-80ad-5d4fa3ce966f req-d5ae559f-9a86-4e50-9c32-a0ede39b8c06 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:20.580120 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-edfe9f07-1cf5-405f-bc17-71a3c68db786 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "DELETE /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660" status: 204 len: 0 microversion: 2.1 time: 1.733630 Oct 17 12:51:20.581869 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 356/712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:18 2022] DELETE /compute/v2.1/images/8b3fb34a-bf91-40e1-92f9-65669e0d7660 => generated 0 bytes in 1735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:20.600818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a6552453-cc4a-4ee9-80ad-5d4fa3ce966f req-d5ae559f-9a86-4e50-9c32-a0ede39b8c06 service nova] Creating event network-vif-plugged:271b29d9-801d-45ee-9eb8-0cc803f60d9a for instance 5a076fb2-b905-428e-8d88-e396a91a80c1 on n-h2-853316-12 Oct 17 12:51:20.604372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dae832f1-6601-4c52-93ba-74bec8b4732f tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82140b1f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:20.611862 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a6552453-cc4a-4ee9-80ad-5d4fa3ce966f req-d5ae559f-9a86-4e50-9c32-a0ede39b8c06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112632 Oct 17 12:51:20.617686 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 357/713] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:20.623451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:20.637020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:20.657488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:20.657853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:20.658323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:20.665676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:20.668577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:20.669241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:20.786485 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dae832f1-6601-4c52-93ba-74bec8b4732f tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.195416 Oct 17 12:51:20.795603 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 357/714] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:20 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:20.809990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a27e2864-9368-486d-a3b0-1061ac72f60f tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Action: 'create', calling method: .version_select at 0x7fa8212a9ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1283225531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOcWkmhnqzBkVLCZAcjjI2zUqLJGhTl6RaU2VGMVSugwuDcD+R5J5TasfhbdrTtnxy9A8rO/YVEEFfBoXPmPCJ3du+NF55x7fuDpiz4EEhOtp1FZn4j4IgMIyhbkFiVxA=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:20.857397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a27e2864-9368-486d-a3b0-1061ac72f60f tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:20.867393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a27e2864-9368-486d-a3b0-1061ac72f60f tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for user 61bd380e33bc4ea1a36b5ac9c3bc6605 and project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:20.939272 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a27e2864-9368-486d-a3b0-1061ac72f60f tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.141353 Oct 17 12:51:20.943655 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 358/715] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:20.950569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:20.951506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:20.961111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:20.962632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:20.963305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:20.964543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:20.965892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:20.966521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:20.982811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:20.992940 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ca55960-5bac-4832-b32f-e84e1aa0a534 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1255 microversion: 2.1 time: 0.373702 Oct 17 12:51:21.002784 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 358/716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:20 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1255 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:21.028650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Action: 'update', calling method: .version_select at 0x7fa821423040>, body: {"quota_set": {"ram": "2048"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:21.152068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:21.153357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:21.153952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:21.154885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:21.155502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:21.156107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:21.211191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:21.211902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:21.212502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:21.215316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:21.216004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:21.216596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:21.344111 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-320f5743-826f-41c5-8eb5-e9dfb04c7a5c tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/0e034965e7644c4b8848c1d29169d052?user_id=e6af4aa5de2e490f91f0978dea0386a0" status: 200 len: 240 microversion: 2.36 time: 0.326397 Oct 17 12:51:21.352530 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 359/717] 10.222.0.27 () {62 vars in 1384 bytes} [Mon Oct 17 12:51:21 2022] PUT /compute/v2.1/os-quota-sets/0e034965e7644c4b8848c1d29169d052?user_id=e6af4aa5de2e490f91f0978dea0386a0 => generated 240 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:51:21.358878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a13482a8-5e19-4061-888d-1d090345c9cd tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '.version_select at 0x7fa8213af4c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:21.399625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:21.421457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:21.423705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:21.425783 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2340c108-ee3f-45e2-b4a5-e5585096db58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1411 microversion: 2.25 time: 0.480440 Oct 17 12:51:21.428789 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 359/718] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:51:20 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1411 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:51:21.435286 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-a13482a8-5e19-4061-888d-1d090345c9cd tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] HTTP exception thrown: Image not found. Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a13482a8-5e19-4061-888d-1d090345c9cd tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Request method failure captured: Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 HTTP/1.1 Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU98Ux8QF2pq0Qc7ZmhBDMScG-bscKzvJJOaIiqRwn_AxcGANaTvAA0MRbIZTA2zFUG3geTapbCjedCbkCtQgiPGS1uCJKQWyOZU8lzVAhBtw7ra6x797RqNiuwH4gFq7d7Hj67AO00JboDBw3-vTuSySrZcsrpf2sw6-1Ze1h8C_zQ Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: beb2bb05c21a441caa0d9f23de809625 Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:51:21.439693 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_beb2bb05c21a441caa0d9f23de809625", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: beb2bb05c21a441caa0d9f23de809625 Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerTestJSON-479382231-project Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b5b462b403142459bfb1a10c6ddbc54 Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerTestJSON-479382231-project Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'b1d2aa94-347d-4fab-b3dd-553929261924'} Oct 17 12:51:21.441872 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b1d2aa94-347d-4fab-b3dd-553929261924 to delete Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:21.442779 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b1d2aa94-347d-4fab-b3dd-553929261924 could not be found. Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:21.443933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 12:51:21.445093 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:21.448944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a13482a8-5e19-4061-888d-1d090345c9cd tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:21.450044 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a13482a8-5e19-4061-888d-1d090345c9cd tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "DELETE /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924" status: 404 len: 62 microversion: 2.1 time: 0.095284 Oct 17 12:51:21.451153 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 360/719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:21 2022] DELETE /compute/v2.1/images/b1d2aa94-347d-4fab-b3dd-553929261924 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:51:21.462043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-053e62dc-a2c7-4d43-8cf1-32ad87a42c19 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Action: 'create', calling method: .version_select at 0x7fa8217f4700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-117451696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZpQ+zNWaaTSIpi74+eIuJiuRVKXsQmj/WwYWim0oWa9bqCHjw31JTQX9xe5bTpagGvOQbuFn3mbFYTJK9z/YAQ5palgQm+JkBi/65Q0nlJJkPXO6w+7QgCgDNjMgLS+Q=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:21.467273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-99130639", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d7f35cc1-58d6-4894-af02-7db8eefeb420"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:21.549270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-053e62dc-a2c7-4d43-8cf1-32ad87a42c19 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:21.608210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:21.641751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-053e62dc-a2c7-4d43-8cf1-32ad87a42c19 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Getting quotas for user 61bd380e33bc4ea1a36b5ac9c3bc6605 and project c19cdca48b46412083f41a5cd69354c0. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:21.728083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:51:21.790975 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-053e62dc-a2c7-4d43-8cf1-32ad87a42c19 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.338411 Oct 17 12:51:21.791613 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 361/720] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:21.802363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5f85e32-798f-480c-a98f-a74940fb55e8 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] Calling method '.version_select at 0x7fa8212ea160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:22.161628 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5f85e32-798f-480c-a98f-a74940fb55e8 tempest-QuotasAdminTestV236-524150041 tempest-QuotasAdminTestV236-524150041-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0e034965e7644c4b8848c1d29169d052?user_id=e6af4aa5de2e490f91f0978dea0386a0" status: 200 len: 282 microversion: 2.36 time: 0.363133 Oct 17 12:51:22.171400 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 362/721] 10.222.0.27 () {60 vars in 1364 bytes} [Mon Oct 17 12:51:21 2022] GET /compute/v2.1/os-quota-sets/0e034965e7644c4b8848c1d29169d052?user_id=e6af4aa5de2e490f91f0978dea0386a0 => generated 282 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:51:22.177202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:22.194996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:22.216880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.217925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.222288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.225768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.227079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.227978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.299560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:51:22.370207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:51:22.370670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:51:22.371594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:51:22.372321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:51:22.372938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:51:22.401789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.411002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.414401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.415458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.416128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.420826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.482835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Getting quotas for project 398c14a84792484ba396062bf18c6933. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:22.491153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Getting quotas for user 6e904404abe5420bb929ff9ab97f0a02 and project 398c14a84792484ba396062bf18c6933. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:22.523832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:51:22.529476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:51:22.570691 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-91a21975-bb89-4df9-a659-f063ca17ec4e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 204 len: 0 microversion: 2.1 time: 0.397813 Oct 17 12:51:22.571572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 363/722] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:51:22 2022] DELETE /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:22.586123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2aa7b03d-21e1-4396-887e-3eebd17d979a tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Calling method '.version_select at 0x7fa8212ea040>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:22.600753 n-d-853316-12 devstack@n-api.service[127539]: WARNING oslo_db.sqlalchemy.utils [None req-2aa7b03d-21e1-4396-887e-3eebd17d979a tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 12:51:22.636711 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2aa7b03d-21e1-4396-887e-3eebd17d979a tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.063556 Oct 17 12:51:22.642835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 364/723] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:51:22 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:22.652096 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3a714c3-569a-48fa-8752-401e0bfb3a98 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194916 Oct 17 12:51:22.652784 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 360/724] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:51:22.665096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:22.665763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d5ef377a-552e-4a77-84a8-c18b34fc2d35 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138cd30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:22.668843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:22.680022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.680995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.681897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.683063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.683682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.684522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.810995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:22.820801 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9befa374-5e79-477d-a657-df7d48c808a6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1317 microversion: 2.1 time: 0.166753 Oct 17 12:51:22.823257 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d5ef377a-552e-4a77-84a8-c18b34fc2d35 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1452 microversion: 2.1 time: 0.177250 Oct 17 12:51:22.830869 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 365/725] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:22 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:22.840535 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 361/726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:22 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:22.840535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:22.840535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:22.852112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:22.859572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:22.859713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.860169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.860615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.863781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.864491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.864938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.891902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.894154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.896338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:22.901670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:22.903264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:22.905980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:23.164948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:23.180671 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ba60412-81da-4142-9a7e-89f86d98fe47 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1473 microversion: 2.1 time: 0.346042 Oct 17 12:51:23.182030 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 362/727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:22 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1473 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:23.191599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62f2f094-7004-4314-a9bf-ae87e16bc753 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Calling method '.version_select at 0x7fa8212ad550>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:23.228007 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62f2f094-7004-4314-a9bf-ae87e16bc753 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-117451696" status: 202 len: 0 microversion: 2.1 time: 0.044559 Oct 17 12:51:23.230394 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 363/728] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 12:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-117451696 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:23.236136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29fa969f-6ef0-4f72-b0ec-f139d8ad8c4f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:23.236698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-29fa969f-6ef0-4f72-b0ec-f139d8ad8c4f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:23.318465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-29fa969f-6ef0-4f72-b0ec-f139d8ad8c4f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:23.331826 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29fa969f-6ef0-4f72-b0ec-f139d8ad8c4f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1212 microversion: 2.1 time: 0.099869 Oct 17 12:51:23.333072 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 364/729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:23 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:23.342818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-265aaa12-8c8b-4438-804e-0ba946703edd req-f5607fb0-40fd-4669-a393-eef28164183f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1973e5f8-4e02-44fb-89ff-467c3af31c21", "name": "network-vif-unplugged", "status": "completed", "tag": "efced7b6-2b69-4375-a6e0-ff4de63851db"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:23.385549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-265aaa12-8c8b-4438-804e-0ba946703edd req-f5607fb0-40fd-4669-a393-eef28164183f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:23.388099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-265aaa12-8c8b-4438-804e-0ba946703edd req-f5607fb0-40fd-4669-a393-eef28164183f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:23.388690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-265aaa12-8c8b-4438-804e-0ba946703edd req-f5607fb0-40fd-4669-a393-eef28164183f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:23.432376 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-265aaa12-8c8b-4438-804e-0ba946703edd req-f5607fb0-40fd-4669-a393-eef28164183f service nova] Creating event network-vif-unplugged:efced7b6-2b69-4375-a6e0-ff4de63851db for instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 on n-h2-853316-12 Oct 17 12:51:23.469566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-265aaa12-8c8b-4438-804e-0ba946703edd req-f5607fb0-40fd-4669-a393-eef28164183f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133355 Oct 17 12:51:23.470976 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 365/730] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:23.475609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:23.479743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-675d5acf-9a78-482c-8355-1e5a31b3402a req-3f93aebc-0866-4977-9d8c-28af81e4dbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac5965b-fa19-4a90-bfdb-3953192e5cbf", "name": "network-vif-deleted", "tag": "1367d09a-14a0-4940-9553-e2f09a8fed0c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:23.493701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-675d5acf-9a78-482c-8355-1e5a31b3402a req-3f93aebc-0866-4977-9d8c-28af81e4dbc4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:23.494391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-675d5acf-9a78-482c-8355-1e5a31b3402a req-3f93aebc-0866-4977-9d8c-28af81e4dbc4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:23.494929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-675d5acf-9a78-482c-8355-1e5a31b3402a req-3f93aebc-0866-4977-9d8c-28af81e4dbc4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:23.503158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:23.505431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:23.506655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c2f7f63-4cbf-44c2-be44-e3741fab4886 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1608 microversion: 2.25 time: 0.680184 Oct 17 12:51:23.532637 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-675d5acf-9a78-482c-8355-1e5a31b3402a req-3f93aebc-0866-4977-9d8c-28af81e4dbc4 service nova] Creating event network-vif-deleted:1367d09a-14a0-4940-9553-e2f09a8fed0c for instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf on n-h1-853316-12 Oct 17 12:51:23.541005 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-675d5acf-9a78-482c-8355-1e5a31b3402a req-3f93aebc-0866-4977-9d8c-28af81e4dbc4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067499 Oct 17 12:51:23.541239 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 366/731] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:51:22 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1608 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:51:23.541957 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 366/732] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:23.549232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bc0aa5f-569e-47ef-913a-c3b825a02457 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Calling method '.version_select at 0x7fa82140b790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:23.552124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:23.552626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:23.583907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:23.585260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:23.586409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:23.587516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:23.588298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:23.590259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:23.599277 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7bc0aa5f-569e-47ef-913a-c3b825a02457 tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1283225531" status: 202 len: 0 microversion: 2.1 time: 0.055981 Oct 17 12:51:23.603770 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 367/733] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 17 12:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1283225531 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:23.608557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-229e17af-1453-4a6b-a90c-532b2a08580b tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] Calling method '.version_select at 0x7fa8212ad3a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:23.654726 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-229e17af-1453-4a6b-a90c-532b2a08580b tempest-KeyPairsV2TestJSON-2109743958 tempest-KeyPairsV2TestJSON-2109743958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1389022596" status: 202 len: 0 microversion: 2.1 time: 0.049817 Oct 17 12:51:23.660610 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 368/734] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 17 12:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1389022596 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:23.842204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4df07476-d818-4f03-ad46-1373311b924a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8213b1670>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:23.965647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4df07476-d818-4f03-ad46-1373311b924a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1461 microversion: 2.1 time: 0.129012 Oct 17 12:51:23.967670 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 369/735] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:23 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1461 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:23.980711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:23.982199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:24.016843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:24.024639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:24.025453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:24.026109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:24.026652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:24.035513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:24.188758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c8815b69-5eae-40b9-8814-22ebe4a6805c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.641107 Oct 17 12:51:24.189355 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 367/736] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 12:51:23 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-interface => generated 285 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:51:24.205905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2217fcad-c251-46d3-99ff-73d145d08487 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212eb0d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:24.249749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:24.267136 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f5c59ea-4af2-410b-9fee-44e13a33cfe5 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1317 microversion: 2.1 time: 0.298106 Oct 17 12:51:24.286657 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 370/737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:23 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:24.296246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:24.297061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:24.309210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2217fcad-c251-46d3-99ff-73d145d08487 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 200 len: 1461 microversion: 2.1 time: 0.109361 Oct 17 12:51:24.310810 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 368/738] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:24 2022] GET /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 1461 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:24.320409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:24.320911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:24.321406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:24.322128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:24.322625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:24.323054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:24.326336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:24.339830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:24.360498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:24.366913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:24.367393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:24.374470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:24.375083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:24.375671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:24.571399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:24.582001 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c3276b5-dc0f-4eb8-ba03-cf5d3bba5b4f tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1473 microversion: 2.1 time: 0.293444 Oct 17 12:51:24.588307 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 371/739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:24 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1473 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:24.602498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:24.603111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:24.624334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:24.625046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:24.626774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:24.629744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:24.630285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:24.630822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:24.810450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:24.828909 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eab12610-3bb5-4be7-a965-6149abf9c335 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1264 microversion: 2.1 time: 0.236660 Oct 17 12:51:24.833761 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 372/740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:24 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:25.291560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:25.292323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:25.304593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:25.305519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:25.306189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:25.307318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:25.307963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:25.308536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:25.323946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:25.332901 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-611e42b2-9096-49c5-85f4-418387399eef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1480 microversion: 2.1 time: 1.012317 Oct 17 12:51:25.333089 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 369/741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:24 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1480 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:25.615706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:25.617131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:25.634727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:25.639065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:25.640583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:25.641590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:25.645271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:25.647516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:25.742713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:25.764128 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bbe8b7d5-d3c2-481c-b819-838476380c8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1317 microversion: 2.1 time: 0.476154 Oct 17 12:51:25.766610 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 373/742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:25 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:25.857256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:25.858311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:25.866116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:25.866914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:25.867520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:25.868625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:25.869264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:25.870050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:26.070744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:26.079539 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25d955c7-b24c-4ad4-9cfc-eade02f90cb8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1270 microversion: 2.1 time: 0.226861 Oct 17 12:51:26.095060 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 374/743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:25 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:26.356938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:26.357584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:26.373899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:26.374535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:26.374862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:26.375575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:26.376037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:26.376456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:26.773523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:26.787124 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2254a778-ce3b-483d-852f-f5dcd02cc98e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1473 microversion: 2.1 time: 1.176021 Oct 17 12:51:26.788423 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 370/744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:25 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1473 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:26.802638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:26.805898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:26.843681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:26.844213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:26.844658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:26.845377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:26.845823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:26.846267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:26.863644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:26.875081 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25324ffb-0f66-4f04-a17e-b3b3b0498b60 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1467 microversion: 2.1 time: 0.521704 Oct 17 12:51:26.877006 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 375/745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:26 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1467 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:26.905609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1717887730"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:26.909185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:26.916893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:26.917642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:26.918669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:26.919561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:26.920173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:26.920752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:27.197435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:27.207211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c0ca73d-15fc-4218-8abb-36db7ed49a20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1317 microversion: 2.1 time: 0.417374 Oct 17 12:51:27.208446 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 371/746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:26 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:27.215755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:27.218017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:27.230618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:27.248816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:27.249796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:27.251760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:27.252923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:27.254458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:27.287192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:27.287566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d57069b-3c41-4456-8ad5-30ac8df466fe tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "POST /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116/action" status: 202 len: 0 microversion: 2.1 time: 0.389269 Oct 17 12:51:27.293652 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 376/747] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:51:26 2022] POST /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 17 12:51:27.299596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-888ed120-e536-480e-9e49-8b5b48f615cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212ab430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:27.381068 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-888ed120-e536-480e-9e49-8b5b48f615cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.085641 Oct 17 12:51:27.382449 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 377/748] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:27 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:27.596609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:27.607729 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7672f5d-614c-4d10-9123-dc16b7437b54 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1270 microversion: 2.1 time: 0.397972 Oct 17 12:51:27.616999 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 372/749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:27 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1270 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:27.818684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:27.819615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:27.854303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:27.854646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:27.855080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:27.860136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:27.860683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:27.861082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:28.085195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:28.096499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:28.140490 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a423ef98-d129-4193-9ead-d65b7334065a tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1431 microversion: 2.1 time: 0.329357 Oct 17 12:51:28.141717 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 378/750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:27 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1431 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:28.234973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:28.235667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:28.255395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:28.267634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:28.268105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:28.290204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:28.294515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:28.295193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:28.644244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b41a202-0847-4de1-8c79-b6999aa60811 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Action: 'create', calling method: .version_select at 0x7fa8213ce550>, body: {"keypair": {"name": "tempest-keypair-1639441926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAl8vd64YnbgNq0kjvfC+8pb5HcGc3rB0FfWGqV5E6DsqshG8OB5Uac2A7azlhjS+8g/0FrCFNe+eoeKaHlr9JSf8744KdGO00RRnLO8YsXlohlrjKk863spJsOe68RwA=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:28.681643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1b41a202-0847-4de1-8c79-b6999aa60811 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:28.701866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:28.704738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1b41a202-0847-4de1-8c79-b6999aa60811 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:28.750660 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b41a202-0847-4de1-8c79-b6999aa60811 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.472805 Oct 17 12:51:28.752090 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 379/751] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 17 12:51:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 475 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 12:51:28.758440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-684fa2ad-f8ea-4fc1-a597-dae63fb4ec83 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821247e50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:28.845036 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-684fa2ad-f8ea-4fc1-a597-dae63fb4ec83 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.091473 Oct 17 12:51:28.845682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 380/752] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:28 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:28.859241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:28.859863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:28.879718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:28.880502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:28.881084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:28.881977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:28.882619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:28.883199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:29.269321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:29.289367 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c0315df9-4606-4c98-806c-91453e1934ea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 0.434387 Oct 17 12:51:29.290503 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 381/753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:28 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:29.296051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad6f119c-9513-47a9-b16d-0e2c06cd2d10 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa821247f70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:29.313788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:29.325010 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17ee6d18-4e23-427b-a01a-9fe7b13fc3e0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 1.095233 Oct 17 12:51:29.325998 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 373/754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:28 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:29.328608 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad6f119c-9513-47a9-b16d-0e2c06cd2d10 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1639441926" status: 200 len: 512 microversion: 2.2 time: 0.036807 Oct 17 12:51:29.329354 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 382/755] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 17 12:51:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1639441926 => generated 512 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:29.340892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:29.342334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-0f03d470-c938-4790-b9f9-5e3338f27c6d req-fdf072b5-137f-40a5-9102-729e9204c325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1973e5f8-4e02-44fb-89ff-467c3af31c21", "name": "network-vif-deleted", "tag": "efced7b6-2b69-4375-a6e0-ff4de63851db"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:29.351398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:29.358381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0f03d470-c938-4790-b9f9-5e3338f27c6d req-fdf072b5-137f-40a5-9102-729e9204c325 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:29.359410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0f03d470-c938-4790-b9f9-5e3338f27c6d req-fdf072b5-137f-40a5-9102-729e9204c325 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:29.360035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0f03d470-c938-4790-b9f9-5e3338f27c6d req-fdf072b5-137f-40a5-9102-729e9204c325 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:29.367119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:29.367620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:29.368066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:29.368782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:29.369230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:29.369663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:29.375113 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-0f03d470-c938-4790-b9f9-5e3338f27c6d req-fdf072b5-137f-40a5-9102-729e9204c325 service nova] Creating event network-vif-deleted:efced7b6-2b69-4375-a6e0-ff4de63851db for instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 on n-h2-853316-12 Oct 17 12:51:29.381176 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-0f03d470-c938-4790-b9f9-5e3338f27c6d req-fdf072b5-137f-40a5-9102-729e9204c325 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053376 Oct 17 12:51:29.382662 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 374/756] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:29.400042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fd592d6-4c00-470d-a56f-5dbed88b99b2 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa821423dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:29.424806 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7fd592d6-4c00-470d-a56f-5dbed88b99b2 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639441926" status: 204 len: 0 microversion: 2.2 time: 0.032191 Oct 17 12:51:29.427086 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 375/757] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 17 12:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639441926 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:29.445929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1f50669-8e4b-4ee9-8ae3-3b420a5fac46 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Action: 'create', calling method: .version_select at 0x7fa8212ea700>, body: {"keypair": {"name": "tempest-keypair-1131092337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVQZpK+hSH2T6Gtt2GLpDtVI2UpEP+uGznOFaya7Jr3EGHQud9XznPc05UNhoTu3Prp/OoPZpGHu0nVlSvv10BsyN6AjZKRQ5lV45nnN3NK1QiFRtrtHdXv59hQAuuQ3Q=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:29.450512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:29.451300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:29.452513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:29.453140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lazy-loading 'fault' on Instance uuid 1973e5f8-4e02-44fb-89ff-467c3af31c21 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:51:29.467547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-a1f50669-8e4b-4ee9-8ae3-3b420a5fac46 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:29.476078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-a1f50669-8e4b-4ee9-8ae3-3b420a5fac46 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:29.518458 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a1f50669-8e4b-4ee9-8ae3-3b420a5fac46 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.079852 Oct 17 12:51:29.520415 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 376/758] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 17 12:51:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 12:51:29.543740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b462b403142459bfb1a10c6ddbc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb2bb05c21a441caa0d9f23de809625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:29.545873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-751f19c2-cbb7-46be-a812-e7be1b65eebb tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa8212ed160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:29.553316 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bfb2e9fb-94bd-40de-94d0-8721d57cf43e tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 200 len: 1307 microversion: 2.1 time: 0.216148 Oct 17 12:51:29.565567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 383/759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:29 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:29.588560 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-751f19c2-cbb7-46be-a812-e7be1b65eebb tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131092337" status: 204 len: 0 microversion: 2.2 time: 0.054437 Oct 17 12:51:29.595716 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 377/760] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 17 12:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131092337 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:29.601647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e7708bc-bd8f-4f81-9c13-3e490b3df88d tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Action: 'create', calling method: .version_select at 0x7fa8212479d0>, body: {"keypair": {"name": "tempest-keypair-576697327", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:29.635829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5e7708bc-bd8f-4f81-9c13-3e490b3df88d tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:29.652584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5e7708bc-bd8f-4f81-9c13-3e490b3df88d tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:29.699725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5e7708bc-bd8f-4f81-9c13-3e490b3df88d tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.101027 Oct 17 12:51:29.702494 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 384/761] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 17 12:51:29 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 12:51:29.716914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d60a9341-7cda-4b9c-affe-5228f9510886 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa82138caf0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:29.756199 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d60a9341-7cda-4b9c-affe-5228f9510886 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-576697327" status: 204 len: 0 microversion: 2.2 time: 0.044877 Oct 17 12:51:29.757610 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 378/762] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 17 12:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-576697327 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:29.769681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee36d132-76d2-4678-bc30-028303fecb8b tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Action: 'create', calling method: .version_select at 0x7fa8213b1160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-71313813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEp7ZuNC2S3G7bhE9euFiPGg/bQU9n9bmVBT41j5yVztCBqw59JdyARTK7Hqg1AByyhupphmEBqBv1aoY4yUOP3mkD//ohBXpJ3Bpww0GEsP7YkJd5AI/mVx4jskRVxHuQ=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:29.810868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-ee36d132-76d2-4678-bc30-028303fecb8b tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:29.819342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-ee36d132-76d2-4678-bc30-028303fecb8b tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:29.864792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f87ce0dc-b012-4e93-a685-7f7abbb2e0de tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212f8310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:29.890669 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee36d132-76d2-4678-bc30-028303fecb8b tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.125668 Oct 17 12:51:29.893195 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 385/763] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 17 12:51:29 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 17 12:51:29.913259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6fb1677-a6aa-4851-906f-1eeb6cba9b39 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Action: 'create', calling method: .version_select at 0x7fa821291ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-397143117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIyjliXCaA4d20zlXb6yvo2Fnr3CvSxONjIhTYNpf9fQ3az4CBMJSCJOXOoozqwrJ+HRcs7gQ4h/7j0BWu+MunATtT2V1iqRAhr+MnrwwVqG5AIHAATLsesF22KRH4AZw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:29.975529 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f87ce0dc-b012-4e93-a685-7f7abbb2e0de tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.115159 Oct 17 12:51:29.976850 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 379/764] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:29 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:29.978035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c6fb1677-a6aa-4851-906f-1eeb6cba9b39 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:29.983630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c6fb1677-a6aa-4851-906f-1eeb6cba9b39 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:30.022598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6fb1677-a6aa-4851-906f-1eeb6cba9b39 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.116087 Oct 17 12:51:30.023849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 386/765] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 17 12:51:29 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 12:51:30.038590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ceb701d-00cd-4a18-b73f-6f215297686e tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Action: 'create', calling method: .version_select at 0x7fa8212eb5e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1513427823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZq6qwQOd3d2vBVg+sTw9iLcsaDGI6kxqXh8oPgDjf2h3TgqFDMt62fmINxMkC7GnYbc6rgY6fNi1AEF1SLa56IleKr7j7QrDtNkwW002/bw/GvEtpT4CXScrM+ClHDQ=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:30.088982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-4ceb701d-00cd-4a18-b73f-6f215297686e tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:30.105055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-4ceb701d-00cd-4a18-b73f-6f215297686e tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:30.192937 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ceb701d-00cd-4a18-b73f-6f215297686e tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.156976 Oct 17 12:51:30.202896 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 380/766] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 17 12:51:30 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 12:51:30.211563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a6ab471-86e8-4e72-9408-7917c2183a96 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa821225ee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:30.219797 n-d-853316-12 devstack@n-api.service[127540]: WARNING oslo_db.sqlalchemy.utils [None req-0a6ab471-86e8-4e72-9408-7917c2183a96 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 12:51:30.234640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a6ab471-86e8-4e72-9408-7917c2183a96 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.030213 Oct 17 12:51:30.248226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4fa19c8b-7497-4dc5-8011-f0df063fac18 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa8212eaaf0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:30.253042 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 387/767] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 17 12:51:30 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:30.272023 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4fa19c8b-7497-4dc5-8011-f0df063fac18 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1513427823" status: 204 len: 0 microversion: 2.2 time: 0.027729 Oct 17 12:51:30.283958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8dcea168-0b4a-40df-85c9-b127ca8a1a16 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa82122d9d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:30.288935 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 381/768] 10.222.0.27 () {60 vars in 1321 bytes} [Mon Oct 17 12:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1513427823 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:51:30.315388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:30.317092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:30.325373 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8dcea168-0b4a-40df-85c9-b127ca8a1a16 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-397143117" status: 204 len: 0 microversion: 2.2 time: 0.045155 Oct 17 12:51:30.330199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 388/769] 10.222.0.27 () {60 vars in 1318 bytes} [Mon Oct 17 12:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-397143117 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:30.335549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:30.337380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:30.339112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:30.340415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:30.342289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72df7821-560c-47d5-8eaa-c9f4850f1795 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa821225d30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:30.342879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:30.343481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:30.387081 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72df7821-560c-47d5-8eaa-c9f4850f1795 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-71313813" status: 204 len: 0 microversion: 2.2 time: 0.055070 Oct 17 12:51:30.398620 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 389/770] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Oct 17 12:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-71313813 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:30.420084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:30.420837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:30.447844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:30.448937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:30.451001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:30.454549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:30.455921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:30.458130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:30.931024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:30.946911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee6d2ae6-fcd9-44a5-94df-12c275411a3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 0.635821 Oct 17 12:51:30.950617 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 382/771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:30 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:30.972710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1120af5d-614c-4419-a6b3-0293f998b9ec tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Action: 'create', calling method: .version_select at 0x7fa8212ea3a0>, body: {"keypair": {"name": "tempest-keypair-578450593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmygoIDy2tbY7onaOiMaOpUfMszaQbyFnvfbVDw2JtCG0uIUD5d6KrEyCyvUOdu7nV2LMYRLCZjjhLRxRgEc36Pcz86HpPqUP9yjOC+VzisLgs7suRQThEC6Eb5GlEHzQ=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:31.009510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-1120af5d-614c-4419-a6b3-0293f998b9ec tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:31.018255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-1120af5d-614c-4419-a6b3-0293f998b9ec tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:31.072066 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1120af5d-614c-4419-a6b3-0293f998b9ec tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.120021 Oct 17 12:51:31.073091 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 383/772] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 17 12:51:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 12:51:31.084571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2003f2e7-cc7f-48db-9fd0-5a4dd57752fa req-17f72662-2962-4263-9a4a-bbd011da6a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1584fb0-8664-4fa6-8ef7-58b1107b78c2", "name": "network-vif-unplugged", "status": "completed", "tag": "14eafe5b-088e-4dfd-853c-16d4a0e15ed1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:31.106587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2003f2e7-cc7f-48db-9fd0-5a4dd57752fa req-17f72662-2962-4263-9a4a-bbd011da6a35 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:31.108750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2003f2e7-cc7f-48db-9fd0-5a4dd57752fa req-17f72662-2962-4263-9a4a-bbd011da6a35 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:31.109648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2003f2e7-cc7f-48db-9fd0-5a4dd57752fa req-17f72662-2962-4263-9a4a-bbd011da6a35 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:31.135550 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2003f2e7-cc7f-48db-9fd0-5a4dd57752fa req-17f72662-2962-4263-9a4a-bbd011da6a35 service nova] Creating event network-vif-unplugged:14eafe5b-088e-4dfd-853c-16d4a0e15ed1 for instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 on n-h1-853316-12 Oct 17 12:51:31.143214 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2003f2e7-cc7f-48db-9fd0-5a4dd57752fa req-17f72662-2962-4263-9a4a-bbd011da6a35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068614 Oct 17 12:51:31.153414 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 384/773] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:31.161111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:31.162603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] [instance: 1973e5f8-4e02-44fb-89ff-467c3af31c21] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:31.191372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:31.199541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:31.201977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:31.203178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:31.205710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:31.206265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:31.241999 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] HTTP exception thrown: Instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 could not be found. Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Request method failure captured: Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 HTTP/1.1 Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU98Ux8QF2pq0Qc7ZmhBDMScG-bscKzvJJOaIiqRwn_AxcGANaTvAA0MRbIZTA2zFUG3geTapbCjedCbkCtQgiPGS1uCJKQWyOZU8lzVAhBtw7ra6x797RqNiuwH4gFq7d7Hj67AO00JboDBw3-vTuSySrZcsrpf2sw6-1Ze1h8C_zQ Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: beb2bb05c21a441caa0d9f23de809625 Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:51:31.244833 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_beb2bb05c21a441caa0d9f23de809625", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb2bb05c21a441caa0d9f23de809625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: beb2bb05c21a441caa0d9f23de809625 Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-479382231 Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerTestJSON-479382231-project Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b5b462b403142459bfb1a10c6ddbc54 Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerTestJSON-479382231-project Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 could not be found. Oct 17 12:51:31.246118 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1973e5f8-4e02-44fb-89ff-467c3af31c21'} Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 could not be found. Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:31.246870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 could not be found. Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 could not be found. Oct 17 12:51:31.248022 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:31.251454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] Returning 404 to user: Instance 1973e5f8-4e02-44fb-89ff-467c3af31c21 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:31.252718 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8dd9a39-53b8-4cb5-b2a5-71ad232059a2 tempest-ImagesOneServerTestJSON-479382231 tempest-ImagesOneServerTestJSON-479382231-project] 10.222.0.27 "GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21" status: 404 len: 111 microversion: 2.1 time: 0.097890 Oct 17 12:51:31.258999 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 385/774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:31 2022] GET /compute/v2.1/servers/1973e5f8-4e02-44fb-89ff-467c3af31c21 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:51:31.278852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1bd4b63c-1282-4e7c-9c41-08c9aed9cc76 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212ea790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:31.313215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=9 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:31.380286 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1bd4b63c-1282-4e7c-9c41-08c9aed9cc76 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.119093 Oct 17 12:51:31.386520 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 386/775] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:31 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:31.400792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c780ae5a-65c0-4c65-bd55-010fa70d707b tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa8212edf70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:31.430190 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c780ae5a-65c0-4c65-bd55-010fa70d707b tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-578450593" status: 200 len: 512 microversion: 2.2 time: 0.040873 Oct 17 12:51:31.440278 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 387/776] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Oct 17 12:51:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-578450593 => generated 512 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:31.453095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c4b9313-a549-4996-84ba-60eea3fc98ad tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa821c071f0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:31.458537 n-d-853316-12 devstack@n-api.service[127539]: WARNING oslo_db.sqlalchemy.utils [None req-6c4b9313-a549-4996-84ba-60eea3fc98ad tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 12:51:31.472469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:31.478394 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6c4b9313-a549-4996-84ba-60eea3fc98ad tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.034136 Oct 17 12:51:31.479735 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 388/777] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 17 12:51:31 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:31.490788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:31.492040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd9d895a-8140-4705-888a-92cc9b6cda3d tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa82138c790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:31.506066 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4131c940-0800-4942-bb35-e380b6f65d17 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 1.103796 Oct 17 12:51:31.509042 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 390/778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:30 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:31.525281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-cbf588e1-58f6-4155-b1f4-b22b5f3a7154 req-8b5948de-edcc-4582-8a0c-f914f43ee69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2cda5e5-f691-4333-9658-96e88d5a2600", "tag": "57009ad5-805d-4dec-a5f3-f5ac7ebef5df"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:31.539199 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd9d895a-8140-4705-888a-92cc9b6cda3d tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-578450593" status: 204 len: 0 microversion: 2.2 time: 0.050611 Oct 17 12:51:31.544982 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 389/779] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 17 12:51:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-578450593 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:31.551502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Action: 'create', calling method: .version_select at 0x7fa8212f83a0>, body: {"keypair": {"name": "tempest-keypair-1643581364", "type": "x509"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:31.584298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:31.587304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cbf588e1-58f6-4155-b1f4-b22b5f3a7154 req-8b5948de-edcc-4582-8a0c-f914f43ee69a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:31.589712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cbf588e1-58f6-4155-b1f4-b22b5f3a7154 req-8b5948de-edcc-4582-8a0c-f914f43ee69a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:31.590576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cbf588e1-58f6-4155-b1f4-b22b5f3a7154 req-8b5948de-edcc-4582-8a0c-f914f43ee69a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:31.591496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:31.619151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.processutils [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpdc05i9dm/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpdc05i9dm/temp.key -subj /CN=6307455e91c84c1bbd2dfb9537bdb5fc -extensions v3_req_client {{(pid=127539) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 17 12:51:31.620588 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-cbf588e1-58f6-4155-b1f4-b22b5f3a7154 req-8b5948de-edcc-4582-8a0c-f914f43ee69a service nova] Creating event network-changed:57009ad5-805d-4dec-a5f3-f5ac7ebef5df for instance d2cda5e5-f691-4333-9658-96e88d5a2600 on n-h1-853316-12 Oct 17 12:51:31.627658 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-cbf588e1-58f6-4155-b1f4-b22b5f3a7154 req-8b5948de-edcc-4582-8a0c-f914f43ee69a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108443 Oct 17 12:51:31.629017 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 391/780] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:31.695653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-ffd1aaf6-59d8-4127-906d-f36a4fc7c8d5 req-d503811e-da5f-406a-b47a-587c45a84025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a076fb2-b905-428e-8d88-e396a91a80c1", "tag": "271b29d9-801d-45ee-9eb8-0cc803f60d9a"}, {"name": "network-changed", "server_uuid": "1b339d94-c1ae-4a21-9cc1-980fc71295c4", "tag": "6d73bd0e-3dc4-4afe-88a7-ac7e9316c237"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:31.708008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ffd1aaf6-59d8-4127-906d-f36a4fc7c8d5 req-d503811e-da5f-406a-b47a-587c45a84025 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:31.708744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ffd1aaf6-59d8-4127-906d-f36a4fc7c8d5 req-d503811e-da5f-406a-b47a-587c45a84025 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:31.709357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ffd1aaf6-59d8-4127-906d-f36a4fc7c8d5 req-d503811e-da5f-406a-b47a-587c45a84025 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:31.724317 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-ffd1aaf6-59d8-4127-906d-f36a4fc7c8d5 req-d503811e-da5f-406a-b47a-587c45a84025 service nova] Creating event network-changed:271b29d9-801d-45ee-9eb8-0cc803f60d9a for instance 5a076fb2-b905-428e-8d88-e396a91a80c1 on n-h2-853316-12 Oct 17 12:51:31.725241 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-ffd1aaf6-59d8-4127-906d-f36a4fc7c8d5 req-d503811e-da5f-406a-b47a-587c45a84025 service nova] Creating event network-changed:6d73bd0e-3dc4-4afe-88a7-ac7e9316c237 for instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 on n-h1-853316-12 Oct 17 12:51:31.736370 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-ffd1aaf6-59d8-4127-906d-f36a4fc7c8d5 req-d503811e-da5f-406a-b47a-587c45a84025 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048395 Oct 17 12:51:31.737398 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 392/781] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:31.950649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.processutils [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpdc05i9dm/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpdc05i9dm/temp.key -subj /CN=6307455e91c84c1bbd2dfb9537bdb5fc -extensions v3_req_client" returned: 0 in 0.331s {{(pid=127539) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 17 12:51:31.953543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.processutils [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpdc05i9dm/temp.key -password pass: {{(pid=127539) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 17 12:51:31.974291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:31.975085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:31.988635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:31.989384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:31.989831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:31.994564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:31.995737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:31.997597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:32.028513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.processutils [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpdc05i9dm/temp.key -password pass:" returned: 0 in 0.075s {{(pid=127539) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 17 12:51:32.113528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:32.122749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Getting quotas for user 6307455e91c84c1bbd2dfb9537bdb5fc and project 4b17a20879e6453eb43a8bcab11e92f6. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:32.168418 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-649bb49f-d230-48ff-b29a-5541100e5628 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.621945 Oct 17 12:51:32.175262 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 390/782] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Oct 17 12:51:31 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 624 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:32.183753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a4eb650-75b5-4a0a-939c-107440d41060 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa8212eb280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:32.205954 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a4eb650-75b5-4a0a-939c-107440d41060 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1643581364" status: 200 len: 1534 microversion: 2.2 time: 0.028527 Oct 17 12:51:32.213369 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 391/783] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 17 12:51:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1643581364 => generated 1534 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:32.228989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4c55477e-dd47-46d0-a5cc-873e37ac900e tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa8212ea5e0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:32.233316 n-d-853316-12 devstack@n-api.service[127539]: WARNING oslo_db.sqlalchemy.utils [None req-4c55477e-dd47-46d0-a5cc-873e37ac900e tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 12:51:32.241517 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4c55477e-dd47-46d0-a5cc-873e37ac900e tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.026273 Oct 17 12:51:32.249255 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 392/784] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 17 12:51:32 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:32.259459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c17505b1-a2a7-4db2-8552-96c08f770529 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] Calling method '.version_select at 0x7fa8212eda60>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:32.300402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c17505b1-a2a7-4db2-8552-96c08f770529 tempest-KeyPairsV22TestJSON-120406413 tempest-KeyPairsV22TestJSON-120406413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643581364" status: 204 len: 0 microversion: 2.2 time: 0.047885 Oct 17 12:51:32.308555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 393/785] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 17 12:51:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643581364 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:51:32.396215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1be73dfa-d2bd-48f6-903c-fc3f504a82d5 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138cb80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:32.451313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:32.481365 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1be73dfa-d2bd-48f6-903c-fc3f504a82d5 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.088395 Oct 17 12:51:32.483843 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 394/786] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:32 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:32.537876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:32.539238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:32.548057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:32.553097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:32.554829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:32.556117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:32.558653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:32.560498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:32.689466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:32.703531 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f110e808-fa67-4210-b426-4cab6f865ac1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 0.734317 Oct 17 12:51:32.705043 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 393/787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:31 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:33.082515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:33.105748 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48405d4b-e291-4020-83a3-1173443a7286 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.572939 Oct 17 12:51:33.106711 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 395/788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:32 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:33.262148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1202608829", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:33.336368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:51:33.501675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d021533-43e6-4b49-b1c4-de9ab2dcc23c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212edee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:33.578827 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d021533-43e6-4b49-b1c4-de9ab2dcc23c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.083056 Oct 17 12:51:33.583301 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 396/789] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:33 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:33.731407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:51:33.731963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:51:33.732751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:33.732874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:51:33.732970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:33.733050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:51:33.733261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:51:33.741756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:33.741756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:33.741756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:33.743330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:33.743330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:33.743330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:33.751654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:33.755356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:33.756216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:33.759651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:33.760734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:33.762700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:33.814685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:33.831005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:33.845067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:51:33.848868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:51:33.939833 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df6bcd00-db32-4bc2-a7a0-82eee90d6c41 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077518 Oct 17 12:51:33.943443 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 394/790] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:51:33.952968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-859204c2-dd57-4879-9c34-230548a4ae65 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:33.954897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-859204c2-dd57-4879-9c34-230548a4ae65 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:34.074201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-859204c2-dd57-4879-9c34-230548a4ae65 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:34.085807 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-859204c2-dd57-4879-9c34-230548a4ae65 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1217 microversion: 2.1 time: 0.137246 Oct 17 12:51:34.095659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 395/791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:33 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:34.133245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:34.133955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:34.141390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:34.146200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:34.162079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:34.163163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:34.163713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:34.164239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:34.306446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:34.319377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1f98e80a-d72c-47e2-a328-da74ff275d83 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 0.590965 Oct 17 12:51:34.319793 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 397/792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:33 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:34.414264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:34.432474 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c14a70cf-65a1-4d76-83af-8f345d09b471 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.303823 Oct 17 12:51:34.450427 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 396/793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:34 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:34.598772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-36268764-fdb5-48f6-941c-86a2f8f1b1f6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821244700>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:34.677941 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-36268764-fdb5-48f6-941c-86a2f8f1b1f6 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.083304 Oct 17 12:51:34.678643 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 397/794] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:34 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:34.732818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-355d119f-aa06-4724-96ca-5ab34eb7f480 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Action: 'create', calling method: .version_select at 0x7fa8213afaf0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4B6ocoV/1ntmeVZ2xnFdToRtwGT+Rt2mdC7GwPz0RqJepzr+7F7dLFlE7Gp+Gjc6H1M8O0Tu5/m2s06JIB2EE0MSUjsOhcjRS+AcgaKBiEQGxThZ7sJ8lVOzEH47SIgA=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-355d119f-aa06-4724-96ca-5ab34eb7f480 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Request method failure captured: Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 257 Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_Wj1yIFGq3S6ircGorHJ7qHgBisJuRNnAS1_A9zpu8kG1Y35XlHaeBD5zgaddmFxXQbuqOcjD8rxxk4pV3iTCkITqu5g6klVIzwNeFiowrfx_91P7SjTzLhUO9YaO-PbLajSv52vDWJiOrMqX251MsnRqr2LvLFLCYpjqKvCya2dA Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:51:34.738085 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a0fbce8461049c69204d44c45f5e892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:51:34.739584 n-d-853316-12 devstack@n-api.service[127539]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4B6ocoV/1ntmeVZ2xnFdToRtwGT+Rt2mdC7GwPz0RqJepzr+7F7dLFlE7Gp+Gjc6H1M8O0Tu5/m2s06JIB2EE0MSUjsOhcjRS+AcgaKBiEQGxThZ7sJ8lVOzEH47SIgA=="}} Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4B6ocoV/1ntmeVZ2xnFdToRtwGT+Rt2mdC7GwPz0RqJepzr+7F7dLFlE7Gp+Gjc6H1M8O0Tu5/m2s06JIB2EE0MSUjsOhcjRS+AcgaKBiEQGxThZ7sJ8lVOzEH47SIgA=='}}} Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.740302 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:34.741331 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:51:34.744815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:51:34.747400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 12:51:34.747400 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.747400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-355d119f-aa06-4724-96ca-5ab34eb7f480 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:34.747400 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-355d119f-aa06-4724-96ca-5ab34eb7f480 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.408445 Oct 17 12:51:34.747400 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 398/795] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 410 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:51:34.750685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7b88234-7ef1-4fdf-bfcd-c8121043e94f tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Action: 'create', calling method: .version_select at 0x7fa8212449d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1055824158", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:34.768870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d7b88234-7ef1-4fdf-bfcd-c8121043e94f tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:34.774235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d7b88234-7ef1-4fdf-bfcd-c8121043e94f tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for user 761aa84460d74448a93e0ea02821f968 and project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:34.784786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:34.796490 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-d7b88234-7ef1-4fdf-bfcd-c8121043e94f tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7b88234-7ef1-4fdf-bfcd-c8121043e94f tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Request method failure captured: Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 2167 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_Wj1yIFGq3S6ircGorHJ7qHgBisJuRNnAS1_A9zpu8kG1Y35XlHaeBD5zgaddmFxXQbuqOcjD8rxxk4pV3iTCkITqu5g6klVIzwNeFiowrfx_91P7SjTzLhUO9YaO-PbLajSv52vDWJiOrMqX251MsnRqr2LvLFLCYpjqKvCya2dA Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a0fbce8461049c69204d44c45f5e892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1055824158", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:51:34.811502 n-d-853316-12 devstack@n-api.service[127540]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1055824158', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:34.813680 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.816743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7b88234-7ef1-4fdf-bfcd-c8121043e94f tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:34.817875 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7b88234-7ef1-4fdf-bfcd-c8121043e94f tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.070798 Oct 17 12:51:34.818541 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 398/796] 10.222.0.27 () {60 vars in 1160 bytes} [Mon Oct 17 12:51:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:51:34.840048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abaaa515-2654-460e-a435-ce97fbfc7acc tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Action: 'create', calling method: .version_select at 0x7fa8212eac10>, body: {"keypair": {"name": "tempest-keypair-1427920412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGsoJTbIn5TMPn3mB97uaAoaJ5ThUkRzbDm5wxtnR3yElzY5VMb6Cnw/i2uaBSieXjJO3gu9fZFbMfklCTBytgmFbVmTuT4jXNzMi9Y9qyyOs6I7WQUVQEX+ylyraLKg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:34.863945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-abaaa515-2654-460e-a435-ce97fbfc7acc tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:34.869173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-abaaa515-2654-460e-a435-ce97fbfc7acc tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for user 761aa84460d74448a93e0ea02821f968 and project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:34.908538 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-abaaa515-2654-460e-a435-ce97fbfc7acc tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075502 Oct 17 12:51:34.909584 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 399/797] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:34.923636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c49277f2-9442-4f8f-8a33-910cb472f4c5 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Action: 'create', calling method: .version_select at 0x7fa821244820>, body: {"keypair": {"name": "tempest-keypair-1427920412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhkHn+VhDLV6bD4s70OHHRUC3DA+yLFk1kFEOib+CHzTy8vafC/T5OfsZhvLl8L2b3zsLanxLhrOJz8y0RbnYMkH1eEly+SfvqaKbTIi0TwdwaE3Sy39gST4QrxTHiTbA=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:34.944843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c49277f2-9442-4f8f-8a33-910cb472f4c5 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:34.949839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c49277f2-9442-4f8f-8a33-910cb472f4c5 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for user 761aa84460d74448a93e0ea02821f968 and project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:34.976952 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c49277f2-9442-4f8f-8a33-910cb472f4c5 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] HTTP exception thrown: Key pair 'tempest-keypair-1427920412' already exists. Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c49277f2-9442-4f8f-8a33-910cb472f4c5 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Request method failure captured: Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 273 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_Wj1yIFGq3S6ircGorHJ7qHgBisJuRNnAS1_A9zpu8kG1Y35XlHaeBD5zgaddmFxXQbuqOcjD8rxxk4pV3iTCkITqu5g6klVIzwNeFiowrfx_91P7SjTzLhUO9YaO-PbLajSv52vDWJiOrMqX251MsnRqr2LvLFLCYpjqKvCya2dA Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a0fbce8461049c69204d44c45f5e892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: {"keypair": {"name": "tempest-keypair-1427920412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhkHn+VhDLV6bD4s70OHHRUC3DA+yLFk1kFEOib+CHzTy8vafC/T5OfsZhvLl8L2b3zsLanxLhrOJz8y0RbnYMkH1eEly+SfvqaKbTIi0TwdwaE3Sy39gST4QrxTHiTbA=="}} Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: exception: Key pair 'tempest-keypair-1427920412' already exists. Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1427920412', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhkHn+VhDLV6bD4s70OHHRUC3DA+yLFk1kFEOib+CHzTy8vafC/T5OfsZhvLl8L2b3zsLanxLhrOJz8y0RbnYMkH1eEly+SfvqaKbTIi0TwdwaE3Sy39gST4QrxTHiTbA=='}}} Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result.read() Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '761aa84460d74448a93e0ea02821f968-tempest-keypair-1427920412' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 17 12:51:34.981813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result.read() Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 12:51:34.985300 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '761aa84460d74448a93e0ea02821f968-tempest-keypair-1427920412' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 12, 51, 34, 967884), 'updated_at': None, 'name': 'tempest-keypair-1427920412', 'user_id': '761aa84460d74448a93e0ea02821f968', 'fingerprint': 'fe:f3:89:40:a3:16:5b:82:de:94:fe:6e:03:e8:80:32', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhkHn+VhDLV6bD4s70OHHRUC3DA+yLFk1kFEOib+CHzTy8vafC/T5OfsZhvLl8L2b3zsLanxLhrOJz8y0RbnYMkH1eEly+SfvqaKbTIi0TwdwaE3Sy39gST4QrxTHiTbA==', 'type': 'ssh'}] Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi keypair.create() Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._create() Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1427920412' already exists. Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 17 12:51:34.999195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1427920412' already exists. Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1427920412' already exists. Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c49277f2-9442-4f8f-8a33-910cb472f4c5 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Returning 409 to user: Key pair 'tempest-keypair-1427920412' already exists. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c49277f2-9442-4f8f-8a33-910cb472f4c5 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.069400 Oct 17 12:51:35.009156 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 399/798] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:34 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:51:35.012857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-97aa5e9d-32bf-49c7-b1bd-f4e9f6b42c8b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Calling method '.version_select at 0x7fa8212ead30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:35.021641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-97aa5e9d-32bf-49c7-b1bd-f4e9f6b42c8b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427920412" status: 202 len: 0 microversion: 2.1 time: 0.027219 Oct 17 12:51:35.022652 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 400/799] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 12:51:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427920412 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:35.036522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b06aadd8-e694-42d5-adc0-15d2c833f81a tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Action: 'create', calling method: .version_select at 0x7fa8212445e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv6cIP96xcw/FifUc2yqHromvdkxMo/EpQqM09jze/h5iihZJPG02grbmfAWUT/q5L0Ta4U1XM6eWXcuoanqPMKwAI6ojiWK58EyAsXG9fOzr2oSFxZZFPb1JsdZXQM+Q=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b06aadd8-e694-42d5-adc0-15d2c833f81a tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Request method failure captured: Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 247 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_Wj1yIFGq3S6ircGorHJ7qHgBisJuRNnAS1_A9zpu8kG1Y35XlHaeBD5zgaddmFxXQbuqOcjD8rxxk4pV3iTCkITqu5g6klVIzwNeFiowrfx_91P7SjTzLhUO9YaO-PbLajSv52vDWJiOrMqX251MsnRqr2LvLFLCYpjqKvCya2dA Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a0fbce8461049c69204d44c45f5e892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv6cIP96xcw/FifUc2yqHromvdkxMo/EpQqM09jze/h5iihZJPG02grbmfAWUT/q5L0Ta4U1XM6eWXcuoanqPMKwAI6ojiWK58EyAsXG9fOzr2oSFxZZFPb1JsdZXQM+Q=="}} Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv6cIP96xcw/FifUc2yqHromvdkxMo/EpQqM09jze/h5iihZJPG02grbmfAWUT/q5L0Ta4U1XM6eWXcuoanqPMKwAI6ojiWK58EyAsXG9fOzr2oSFxZZFPb1JsdZXQM+Q=='}}} Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi '' Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:51:35.040936 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b06aadd8-e694-42d5-adc0-15d2c833f81a tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b06aadd8-e694-42d5-adc0-15d2c833f81a tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010974 Oct 17 12:51:35.051234 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 400/800] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:51:35.062687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7e5cb97-ee38-44b9-9057-0f0d3a07391b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Action: 'create', calling method: .version_select at 0x7fa8215fc430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-673701843", "public_key": " "}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:35.080714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e7e5cb97-ee38-44b9-9057-0f0d3a07391b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:35.085002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e7e5cb97-ee38-44b9-9057-0f0d3a07391b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for user 761aa84460d74448a93e0ea02821f968 and project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:35.101018 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e7e5cb97-ee38-44b9-9057-0f0d3a07391b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.112219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:35.113425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7e5cb97-ee38-44b9-9057-0f0d3a07391b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Request method failure captured: Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 94 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_Wj1yIFGq3S6ircGorHJ7qHgBisJuRNnAS1_A9zpu8kG1Y35XlHaeBD5zgaddmFxXQbuqOcjD8rxxk4pV3iTCkITqu5g6klVIzwNeFiowrfx_91P7SjTzLhUO9YaO-PbLajSv52vDWJiOrMqX251MsnRqr2LvLFLCYpjqKvCya2dA Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a0fbce8461049c69204d44c45f5e892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-673701843", "public_key": " "}} Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-673701843', 'public_key': ' '}}} Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.115038 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.119861 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.121800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7e5cb97-ee38-44b9-9057-0f0d3a07391b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:35.121945 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7e5cb97-ee38-44b9-9057-0f0d3a07391b tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.066095 Oct 17 12:51:35.124775 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 401/801] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Oct 17 12:51:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 12:51:35.140448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:35.140954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:35.141398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:35.142118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:35.142617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:35.143416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f78615e7-03d3-4c7d-bcf9-2a179ef507bf tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Action: 'create', calling method: .version_select at 0x7fa8212eb160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOV6yReknQCNwUvuBvXJo/3IVSeOR6X+EWu3zmIr+deRIiYei+UDWm5aGoj3GpP6v8PnCY5mYCvB1lZ1abXQmkDiShYe+QepAUKs/dv6nzOajphEL41RBCLgHVIIir6Ng=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:35.146660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f78615e7-03d3-4c7d-bcf9-2a179ef507bf tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Request method failure captured: Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 507 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_Wj1yIFGq3S6ircGorHJ7qHgBisJuRNnAS1_A9zpu8kG1Y35XlHaeBD5zgaddmFxXQbuqOcjD8rxxk4pV3iTCkITqu5g6klVIzwNeFiowrfx_91P7SjTzLhUO9YaO-PbLajSv52vDWJiOrMqX251MsnRqr2LvLFLCYpjqKvCya2dA Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a0fbce8461049c69204d44c45f5e892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOV6yReknQCNwUvuBvXJo/3IVSeOR6X+EWu3zmIr+deRIiYei+UDWm5aGoj3GpP6v8PnCY5mYCvB1lZ1abXQmkDiShYe+QepAUKs/dv6nzOajphEL41RBCLgHVIIir6Ng=="}} Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOV6yReknQCNwUvuBvXJo/3IVSeOR6X+EWu3zmIr+deRIiYei+UDWm5aGoj3GpP6v8PnCY5mYCvB1lZ1abXQmkDiShYe+QepAUKs/dv6nzOajphEL41RBCLgHVIIir6Ng=='}}} Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 17 12:51:35.147873 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 12:51:35.150933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.152847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f78615e7-03d3-4c7d-bcf9-2a179ef507bf tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:35.152847 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f78615e7-03d3-4c7d-bcf9-2a179ef507bf tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018877 Oct 17 12:51:35.161730 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 402/802] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:35 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:51:35.167712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0df84cc-8058-4d2f-9747-32c38bd62727 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Action: 'create', calling method: .version_select at 0x7fa82138c4c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1855276969", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:35.202875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d0df84cc-8058-4d2f-9747-32c38bd62727 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:51:35.208999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d0df84cc-8058-4d2f-9747-32c38bd62727 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Getting quotas for user 761aa84460d74448a93e0ea02821f968 and project 2a0fbce8461049c69204d44c45f5e892. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:51:35.231014 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d0df84cc-8058-4d2f-9747-32c38bd62727 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0df84cc-8058-4d2f-9747-32c38bd62727 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Request method failure captured: Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 118 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_Wj1yIFGq3S6ircGorHJ7qHgBisJuRNnAS1_A9zpu8kG1Y35XlHaeBD5zgaddmFxXQbuqOcjD8rxxk4pV3iTCkITqu5g6klVIzwNeFiowrfx_91P7SjTzLhUO9YaO-PbLajSv52vDWJiOrMqX251MsnRqr2LvLFLCYpjqKvCya2dA Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a0fbce8461049c69204d44c45f5e892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1855276969", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1855276969', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 12:51:35.233244 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 12:51:35.237393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.242355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0df84cc-8058-4d2f-9747-32c38bd62727 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:35.244142 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0df84cc-8058-4d2f-9747-32c38bd62727 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.081342 Oct 17 12:51:35.244380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:35.245244 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 403/803] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:51:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 12:51:35.256263 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc658657-6b39-4c14-a525-666e5c1c78f7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1269 microversion: 2.1 time: 0.149884 Oct 17 12:51:35.256854 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 401/804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:35 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:35.274131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef306a47-505c-44a3-95ca-311034272fe6 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Calling method '.version_select at 0x7fa82138c0d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:35.286958 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-ef306a47-505c-44a3-95ca-311034272fe6 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1009411761 not found for user 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef306a47-505c-44a3-95ca-311034272fe6 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Request method failure captured: Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1009411761 HTTP/1.1 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_Wj1yIFGq3S6ircGorHJ7qHgBisJuRNnAS1_A9zpu8kG1Y35XlHaeBD5zgaddmFxXQbuqOcjD8rxxk4pV3iTCkITqu5g6klVIzwNeFiowrfx_91P7SjTzLhUO9YaO-PbLajSv52vDWJiOrMqX251MsnRqr2LvLFLCYpjqKvCya2dA Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a0fbce8461049c69204d44c45f5e892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a0fbce8461049c69204d44c45f5e892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2a0fbce8461049c69204d44c45f5e892 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652623250 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652623250-project Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: exception: Keypair tempest-keypair-non-existent-1009411761 not found for user 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'tempest-keypair-non-existent-1009411761'} Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1009411761 not found for user 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.289094 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1009411761 not found for user 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1009411761 not found for user 761aa84460d74448a93e0ea02821f968 Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef306a47-505c-44a3-95ca-311034272fe6 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1009411761 not found for user 761aa84460d74448a93e0ea02821f968 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ef306a47-505c-44a3-95ca-311034272fe6 tempest-KeyPairsNegativeTestJSON-652623250 tempest-KeyPairsNegativeTestJSON-652623250-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1009411761" status: 404 len: 145 microversion: 2.1 time: 0.027560 Oct 17 12:51:35.292900 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 404/805] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 12:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1009411761 => generated 145 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:51:35.344483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:35.345921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:35.356335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:35.357486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:35.358391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:35.359535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:35.360165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:35.360788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:35.465654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:35.468595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:35.488417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:35.488923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:35.489642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:35.494945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:35.495543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:35.496059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:35.554143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:35.570227 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-194c4f90-70da-4e8a-9535-9325d7c68faf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 0.224939 Oct 17 12:51:35.571147 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 402/806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:35 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:35.694937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14b7f6a1-f618-4f31-9936-7d0270e6fd1f tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8211daee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:35.757209 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-14b7f6a1-f618-4f31-9936-7d0270e6fd1f tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.066846 Oct 17 12:51:35.758825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 403/807] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:35 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:35.869598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4f687f50-b9a4-4902-9bf4-eeaaa93d2a2d req-00eeb82c-5e15-4762-b0b2-ea8a239fd13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652645b9-e4bb-48f1-be51-e9483a163116", "name": "network-vif-plugged", "status": "completed", "tag": "29f3ca43-09a3-4d2b-9a04-d9d3003b14d2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:35.896070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4f687f50-b9a4-4902-9bf4-eeaaa93d2a2d req-00eeb82c-5e15-4762-b0b2-ea8a239fd13e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:35.896562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4f687f50-b9a4-4902-9bf4-eeaaa93d2a2d req-00eeb82c-5e15-4762-b0b2-ea8a239fd13e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:35.897001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4f687f50-b9a4-4902-9bf4-eeaaa93d2a2d req-00eeb82c-5e15-4762-b0b2-ea8a239fd13e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:35.935337 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4f687f50-b9a4-4902-9bf4-eeaaa93d2a2d req-00eeb82c-5e15-4762-b0b2-ea8a239fd13e service nova] Creating event network-vif-plugged:29f3ca43-09a3-4d2b-9a04-d9d3003b14d2 for instance 652645b9-e4bb-48f1-be51-e9483a163116 on n-h1-853316-12 Oct 17 12:51:35.944533 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4f687f50-b9a4-4902-9bf4-eeaaa93d2a2d req-00eeb82c-5e15-4762-b0b2-ea8a239fd13e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079080 Oct 17 12:51:35.948555 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 404/808] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:36.185507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:36.219986 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0b366b42-7fa0-4f44-8cb3-7db906556733 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.761966 Oct 17 12:51:36.222688 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 405/809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:35 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:36.281872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:36.282913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:36.303286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:36.303804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:36.304236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:36.304992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:36.305475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:36.305925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:36.435039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:36.450706 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f54a47d-0577-4ed5-9983-c20953d43227 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1275 microversion: 2.1 time: 0.173387 Oct 17 12:51:36.451912 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 405/810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:36 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:36.608948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:36.610029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:36.624978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:36.626345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:36.627341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:36.629394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:36.632377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:36.633571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:36.785848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d02660d4-6ff5-4f30-b115-dd005959c95d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82146f9d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:36.891943 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d02660d4-6ff5-4f30-b115-dd005959c95d tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.121178 Oct 17 12:51:36.905089 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 406/811] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:36 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:37.245063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:37.246046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:37.257105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:37.257970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:37.258694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:37.259633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:37.260302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:37.260953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:37.465139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:37.477514 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-104967c2-5820-44c0-9ac9-030beb5a6778 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.236046 Oct 17 12:51:37.479094 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 407/812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:37 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:37.484561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:37.485432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:37.492532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:37.493370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:37.494131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:37.495319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:37.496491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:37.497733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:37.557204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:37.574998 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-300dcfaf-de82-451d-a4f2-8f302b66893a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 0.980223 Oct 17 12:51:37.576325 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 406/813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:36 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:37.596689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:37.606430 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1e0e01b-c7a5-40fc-b136-467b1bc07866 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1275 microversion: 2.1 time: 0.126100 Oct 17 12:51:37.607593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 408/814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:37 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:37.913476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb2b5678-58cf-4c7e-b314-7941d951c511 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212eb550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:37.981288 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb2b5678-58cf-4c7e-b314-7941d951c511 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.072610 Oct 17 12:51:37.981947 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 407/815] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:37 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:38.508534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:38.511867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:38.527458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:38.528209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:38.528819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:38.529687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:38.531179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:38.531778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:38.600789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:38.601583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:38.616019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:38.618586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:38.619525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:38.622652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:38.623202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:38.626813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:39.072138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:39.075441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:39.101326 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b4e0760-085e-45e4-a076-123b35b2c943 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 0.506276 Oct 17 12:51:39.102100 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 408/816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:38 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:39.104886 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-526443d7-26ad-4b01-8645-92530dff5f0c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.603645 Oct 17 12:51:39.110950 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 409/817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:38 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:39.119949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:39.125125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:39.132873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-455961d0-ca53-42fd-a95f-f9e3c311b0ee tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212abee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:39.141754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:39.144987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:39.146412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:39.147392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:39.147997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:39.148587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:39.196134 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-455961d0-ca53-42fd-a95f-f9e3c311b0ee tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.083142 Oct 17 12:51:39.202221 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 410/818] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:39 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:39.634048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:39.647998 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f95e4d89-65e4-48ca-8036-1ef149554e53 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1317 microversion: 2.1 time: 0.543729 Oct 17 12:51:39.675483 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 409/819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:39 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:40.126424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:40.127606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:40.134034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:40.134723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:40.135950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:40.136660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:40.137287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:40.138233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:40.138877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:40.139486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:40.146260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:40.146768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:40.147218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:40.147939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:40.148392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:40.148823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:40.902878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:40.920456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-22aef8af-de5d-47f4-8225-f81dd1e3c0cf tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 0.798511 Oct 17 12:51:40.923881 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 411/820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:40 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:40.931358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c06254e6-d86f-4901-9fac-7cda68029315 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212040d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:40.986950 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c06254e6-d86f-4901-9fac-7cda68029315 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.061666 Oct 17 12:51:40.988052 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 412/821] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:40 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:41.000585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-15d27935-40cf-4855-9c69-c8fb9f5bd277 req-a4fc0444-5122-4171-bfb9-170011ef2e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2cda5e5-f691-4333-9658-96e88d5a2600", "name": "network-vif-plugged", "status": "completed", "tag": "57009ad5-805d-4dec-a5f3-f5ac7ebef5df"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:41.015757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-15d27935-40cf-4855-9c69-c8fb9f5bd277 req-a4fc0444-5122-4171-bfb9-170011ef2e15 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:41.016346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-15d27935-40cf-4855-9c69-c8fb9f5bd277 req-a4fc0444-5122-4171-bfb9-170011ef2e15 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:41.016851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-15d27935-40cf-4855-9c69-c8fb9f5bd277 req-a4fc0444-5122-4171-bfb9-170011ef2e15 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:41.059520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-15d27935-40cf-4855-9c69-c8fb9f5bd277 req-a4fc0444-5122-4171-bfb9-170011ef2e15 service nova] Creating event network-vif-plugged:57009ad5-805d-4dec-a5f3-f5ac7ebef5df for instance d2cda5e5-f691-4333-9658-96e88d5a2600 on n-h1-853316-12 Oct 17 12:51:41.069434 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-15d27935-40cf-4855-9c69-c8fb9f5bd277 req-a4fc0444-5122-4171-bfb9-170011ef2e15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072350 Oct 17 12:51:41.070398 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 413/822] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:41.076202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:41.077519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:41.101049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:41.118731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:41.119190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:41.119950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:41.120416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:41.120846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:41.267444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:41.283892 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c897fc4f-55bb-4b6b-9a01-48b10e8fc41a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 1.154362 Oct 17 12:51:41.306571 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 410/823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:40 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:41.498565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:41.507882 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d5150ea-447b-4ec3-883a-4ed02d133cc6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1317 microversion: 2.1 time: 0.435798 Oct 17 12:51:41.514948 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 414/824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:41 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:41.952784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:41.953412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:41.959942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:41.960679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:41.961279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:41.962224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:41.962851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:41.963444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:42.005191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf12713c-573d-4a1d-93d5-bbe00e3fa29e tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212805e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:42.073170 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bf12713c-573d-4a1d-93d5-bbe00e3fa29e tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.073398 Oct 17 12:51:42.074974 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 415/825] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:41 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:42.264563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2a80c2ac-4a45-49f1-be92-cd96f8e23011 req-7f5b15c1-7b1f-4d90-8d3e-db9f7b94f50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2607f9b-b14e-4bad-a241-9cd51a932b94", "tag": "d90e1352-9e51-4e32-8730-1c0d674883b0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:42.291374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2a80c2ac-4a45-49f1-be92-cd96f8e23011 req-7f5b15c1-7b1f-4d90-8d3e-db9f7b94f50b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:42.292323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2a80c2ac-4a45-49f1-be92-cd96f8e23011 req-7f5b15c1-7b1f-4d90-8d3e-db9f7b94f50b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:42.293091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2a80c2ac-4a45-49f1-be92-cd96f8e23011 req-7f5b15c1-7b1f-4d90-8d3e-db9f7b94f50b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:42.323439 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2a80c2ac-4a45-49f1-be92-cd96f8e23011 req-7f5b15c1-7b1f-4d90-8d3e-db9f7b94f50b service nova] Creating event network-changed:d90e1352-9e51-4e32-8730-1c0d674883b0 for instance e2607f9b-b14e-4bad-a241-9cd51a932b94 on n-h2-853316-12 Oct 17 12:51:42.346700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2a80c2ac-4a45-49f1-be92-cd96f8e23011 req-7f5b15c1-7b1f-4d90-8d3e-db9f7b94f50b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085836 Oct 17 12:51:42.350896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 416/826] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:51:42.359938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:42.363835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:42.388784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:42.391974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:42.392723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:42.393658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:42.394875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:42.398081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:42.673749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:42.686025 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0cb7cf51-e810-4d19-8c44-dac7c2504868 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.333354 Oct 17 12:51:42.688309 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 417/827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:42 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:42.709381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:42.710264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:42.717422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:42.718125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:42.718817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:42.719698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:42.721331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:42.722545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:42.750215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:42.992988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:43.006916 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1973142-d233-4e07-b443-9364c6302e51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1317 microversion: 2.1 time: 0.302713 Oct 17 12:51:43.008666 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 418/828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:42 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:43.091400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e0b3736-496d-4ec7-9125-36f0a212e742 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821422d30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:43.181987 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e0b3736-496d-4ec7-9125-36f0a212e742 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.092269 Oct 17 12:51:43.183241 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 419/829] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:43 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:43.233792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:43.249045 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1f1e990-9552-4890-ba4a-60b4cb42aaca tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1312 microversion: 2.1 time: 1.299984 Oct 17 12:51:43.260879 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 411/830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:41 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1312 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:43.716380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:43.717679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:43.737045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:43.738002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:43.739089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:43.740737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:43.741362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:43.742097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:43.788294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:44.037884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:44.038676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:44.052941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:44.067848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:44.073869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:44.075255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:44.075794 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-859b00da-d31e-4958-b992-4f5b3ba9f18a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.354886 Oct 17 12:51:44.080016 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 420/831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:43 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:44.089129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:44.095177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:44.097233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:44.201058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78170c8f-b257-4a3d-9d6a-5061adf662a7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212a8040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:44.279659 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78170c8f-b257-4a3d-9d6a-5061adf662a7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.084118 Oct 17 12:51:44.290778 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 421/832] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:44 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:44.298523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:44.299243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:44.314643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:44.315443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:44.316951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:44.319167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:44.320721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:44.322085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:44.748276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:44.757076 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-93a8e8e7-3e49-4bbf-9f06-7f876b007f1e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1461 microversion: 2.1 time: 0.464928 Oct 17 12:51:44.761050 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 422/833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:44 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1461 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:44.962229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=52 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:45.222626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=68 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:45.247561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:45.258395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Searching by: {'deleted': False, 'project_id': '6d5d79252aff42c1850cf21f278b247d'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:51:45.275357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:45.277973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:45.278775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:45.280060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:45.280888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:45.283566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:45.389298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:45.403389 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74de582d-bea3-4253-9c84-a08d2a0d04a4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1317 microversion: 2.1 time: 1.367386 Oct 17 12:51:45.404375 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 412/834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:44 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1317 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:45.418234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:45.423043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:45.450846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:45.451902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:45.455463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:45.458467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:45.459334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:45.460094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:45.696563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-03e06450-454a-4b8b-ad66-aa756f9facfc tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.914481 Oct 17 12:51:45.698683 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 423/835] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:51:44 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:51:45.704366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-edbc2a89-52a8-4e42-bb72-73d044320466 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821231dc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:45.791884 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-edbc2a89-52a8-4e42-bb72-73d044320466 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.091612 Oct 17 12:51:45.796430 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 424/836] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:45 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:45.871016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:45.886779 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-273d694a-b050-40ab-bae0-725cc65c1629 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.478775 Oct 17 12:51:45.887437 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 413/837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:45 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:45.896870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90de1a4f-33f1-42e0-b8f6-4b85fb73911a tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Calling method '.version_select at 0x7fa82132b160>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:45.903215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:45.910487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Searching by: {'deleted': False} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:51:45.928768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-90de1a4f-33f1-42e0-b8f6-4b85fb73911a tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 does not exist", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:51:45.929495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-90de1a4f-33f1-42e0-b8f6-4b85fb73911a tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Neutron security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 not found {{(pid=127540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:51:45.929948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:45.930495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-90de1a4f-33f1-42e0-b8f6-4b85fb73911a tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] HTTP exception thrown: Security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 does not exist Oct 17 12:51:45.930495 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-bcce36a7-fe4d-435e-885c-bd77ee77c78b'] Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90de1a4f-33f1-42e0-b8f6-4b85fb73911a tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Request method failure captured: Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-security-groups/1fd056d1-684f-4d17-bc68-c6b8eb8bf074 HTTP/1.1 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_hau4P27zLHmuGF3PnJGz5sZHwtLWFW6fq-F9tVi5lyWHQmhV4Ny8a1JST3tWJzQL03_5tLtxdkdKGGNLUmqGppjnyCUIcgabjgoAltvoNAU4rBNs0udoNIOrDwdbNhUWjIcJU7PDEAiJYt1NavAQ4_RBV23lZwbTAKbPeNYr-H-o Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 53f94ce8dacd4011adc4b3f58ea497fb Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53f94ce8dacd4011adc4b3f58ea497fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 53f94ce8dacd4011adc4b3f58ea497fb Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsNegativeTestJSON-1898260427-project Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 50646443269c484596ba6a8ec6068255 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427-project Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: exception: Security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 does not exist Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-bcce36a7-fe4d-435e-885c-bd77ee77c78b'] Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1fd056d1-684f-4d17-bc68-c6b8eb8bf074'} Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:51:45.933458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 does not exist Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcce36a7-fe4d-435e-885c-bd77ee77c78b'] Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 does not exist Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcce36a7-fe4d-435e-885c-bd77ee77c78b'] Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 does not exist Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcce36a7-fe4d-435e-885c-bd77ee77c78b'] Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 does not exist Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcce36a7-fe4d-435e-885c-bd77ee77c78b'] Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90de1a4f-33f1-42e0-b8f6-4b85fb73911a tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Returning 404 to user: Security group 1fd056d1-684f-4d17-bc68-c6b8eb8bf074 does not exist Oct 17 12:51:45.938897 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-bcce36a7-fe4d-435e-885c-bd77ee77c78b'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:45.944854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:45.944956 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90de1a4f-33f1-42e0-b8f6-4b85fb73911a tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1fd056d1-684f-4d17-bc68-c6b8eb8bf074" status: 404 len: 194 microversion: 2.1 time: 0.138306 Oct 17 12:51:45.945053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:45.945053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:45.945053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:45.945053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:45.945437 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 425/838] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:51:45 2022] DELETE /compute/v2.1/os-security-groups/1fd056d1-684f-4d17-bc68-c6b8eb8bf074 => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:51:45.955611 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d9600794-1e52-46ca-b9d2-6137d1584f06 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011954 Oct 17 12:51:45.957501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 426/839] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 17 12:51:45 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 12:51:45.977532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2dcfd69-a501-4dab-912e-2d77e3b47df4 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Calling method '.version_select at 0x7fa8212a84c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:46.125834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:51:46.275894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:46.277056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:46.277651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:46.337604 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2dcfd69-a501-4dab-912e-2d77e3b47df4 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.372277 Oct 17 12:51:46.347676 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 427/840] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:51:45 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:46.354534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee482e41-e946-4057-8044-c691aa3798ce tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Calling method '.version_select at 0x7fa821231160>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:46.538775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-ee482e41-e946-4057-8044-c691aa3798ce tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:51:46.539662 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ee482e41-e946-4057-8044-c691aa3798ce tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 17 12:51:46.539662 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-b04c2fff-1bad-4427-a834-61866c47a37d'] Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee482e41-e946-4057-8044-c691aa3798ce tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Request method failure captured: Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-security-groups/20e6ff6f-54cb-4b99-946e-f1293d0f5807 HTTP/1.1 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_hau4P27zLHmuGF3PnJGz5sZHwtLWFW6fq-F9tVi5lyWHQmhV4Ny8a1JST3tWJzQL03_5tLtxdkdKGGNLUmqGppjnyCUIcgabjgoAltvoNAU4rBNs0udoNIOrDwdbNhUWjIcJU7PDEAiJYt1NavAQ4_RBV23lZwbTAKbPeNYr-H-o Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 53f94ce8dacd4011adc4b3f58ea497fb Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53f94ce8dacd4011adc4b3f58ea497fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 53f94ce8dacd4011adc4b3f58ea497fb Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsNegativeTestJSON-1898260427-project Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 50646443269c484596ba6a8ec6068255 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427-project Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: exception: Insufficient rights for removing default security group. Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-b04c2fff-1bad-4427-a834-61866c47a37d'] Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '20e6ff6f-54cb-4b99-946e-f1293d0f5807'} Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:51:46.541935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b04c2fff-1bad-4427-a834-61866c47a37d'] Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b04c2fff-1bad-4427-a834-61866c47a37d'] Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b04c2fff-1bad-4427-a834-61866c47a37d'] Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b04c2fff-1bad-4427-a834-61866c47a37d'] Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee482e41-e946-4057-8044-c691aa3798ce tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-b04c2fff-1bad-4427-a834-61866c47a37d'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee482e41-e946-4057-8044-c691aa3798ce tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/20e6ff6f-54cb-4b99-946e-f1293d0f5807" status: 400 len: 182 microversion: 2.1 time: 0.194022 Oct 17 12:51:46.546192 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 428/841] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:51:46 2022] DELETE /compute/v2.1/os-security-groups/20e6ff6f-54cb-4b99-946e-f1293d0f5807 => generated 182 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:51:46.561868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:46.567005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:46.583145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:46.588688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:46.589649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:46.590622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:46.591277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:46.592650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:46.948472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:46.961811 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6b48ac9-dd62-4f80-9cb1-72e1474f32c2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1317 microversion: 2.1 time: 0.415106 Oct 17 12:51:46.974574 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 429/842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:46 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:46.984913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-104a87f0-781c-4055-bac8-612fa4534392 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Calling method '.version_select at 0x7fa82138aa60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:47.028739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-104a87f0-781c-4055-bac8-612fa4534392 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 73da0e02-8094-43ce-8985-b9fa146d9a23 does not exist", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:51:47.029561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-104a87f0-781c-4055-bac8-612fa4534392 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Neutron security group 73da0e02-8094-43ce-8985-b9fa146d9a23 not found {{(pid=127540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:51:47.030294 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-104a87f0-781c-4055-bac8-612fa4534392 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] HTTP exception thrown: Security group 73da0e02-8094-43ce-8985-b9fa146d9a23 does not exist Oct 17 12:51:47.030294 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-26112db1-a8cc-4562-8e2e-cea3363c2aab'] Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-104a87f0-781c-4055-bac8-612fa4534392 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Request method failure captured: Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-security-groups/73da0e02-8094-43ce-8985-b9fa146d9a23 HTTP/1.1 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_hau4P27zLHmuGF3PnJGz5sZHwtLWFW6fq-F9tVi5lyWHQmhV4Ny8a1JST3tWJzQL03_5tLtxdkdKGGNLUmqGppjnyCUIcgabjgoAltvoNAU4rBNs0udoNIOrDwdbNhUWjIcJU7PDEAiJYt1NavAQ4_RBV23lZwbTAKbPeNYr-H-o Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 53f94ce8dacd4011adc4b3f58ea497fb Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53f94ce8dacd4011adc4b3f58ea497fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 53f94ce8dacd4011adc4b3f58ea497fb Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsNegativeTestJSON-1898260427-project Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 50646443269c484596ba6a8ec6068255 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427-project Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: exception: Security group 73da0e02-8094-43ce-8985-b9fa146d9a23 does not exist Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-26112db1-a8cc-4562-8e2e-cea3363c2aab'] Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '73da0e02-8094-43ce-8985-b9fa146d9a23'} Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:51:47.032792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 73da0e02-8094-43ce-8985-b9fa146d9a23 does not exist Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26112db1-a8cc-4562-8e2e-cea3363c2aab'] Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 73da0e02-8094-43ce-8985-b9fa146d9a23 does not exist Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26112db1-a8cc-4562-8e2e-cea3363c2aab'] Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 73da0e02-8094-43ce-8985-b9fa146d9a23 does not exist Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26112db1-a8cc-4562-8e2e-cea3363c2aab'] Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 73da0e02-8094-43ce-8985-b9fa146d9a23 does not exist Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26112db1-a8cc-4562-8e2e-cea3363c2aab'] Oct 17 12:51:47.037929 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.041450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-104a87f0-781c-4055-bac8-612fa4534392 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Returning 404 to user: Security group 73da0e02-8094-43ce-8985-b9fa146d9a23 does not exist Oct 17 12:51:47.041450 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-26112db1-a8cc-4562-8e2e-cea3363c2aab'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:47.042572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-104a87f0-781c-4055-bac8-612fa4534392 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/73da0e02-8094-43ce-8985-b9fa146d9a23" status: 404 len: 194 microversion: 2.1 time: 0.066661 Oct 17 12:51:47.044646 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 430/843] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 12:51:46 2022] GET /compute/v2.1/os-security-groups/73da0e02-8094-43ce-8985-b9fa146d9a23 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:51:47.054717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21d0d724-ca92-4309-9739-d1f23119f109 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82140b820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:47.113501 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21d0d724-ca92-4309-9739-d1f23119f109 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.066871 Oct 17 12:51:47.123135 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 431/844] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:47 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:47.129236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:47.130209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:47.137037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:47.137879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:47.138667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:47.140395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:47.141286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:47.142062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:47.452346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:47.467265 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3077402a-226f-4c62-958e-97e73d30361d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.342820 Oct 17 12:51:47.472606 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 432/845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:47 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:47.491668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81b11850-f380-48ed-ba92-c5b49d0de5b7 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Action: 'update', calling method: .version_select at 0x7fa82140b550>, body: {"security_group": {"name": "tempest-sg-2003361620", "description": "tempest-description-530545670"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:47.575746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-81b11850-f380-48ed-ba92-c5b49d0de5b7 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 does not exist", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:51:47.576194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-81b11850-f380-48ed-ba92-c5b49d0de5b7 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Neutron security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 not found {{(pid=127540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:51:47.576735 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-81b11850-f380-48ed-ba92-c5b49d0de5b7 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] HTTP exception thrown: Security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 does not exist Oct 17 12:51:47.576735 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-93229b80-93af-4985-989f-35b58170497a'] Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81b11850-f380-48ed-ba92-c5b49d0de5b7 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Request method failure captured: Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-security-groups/1c3135b9-91e0-4928-8f58-208aa7e988a5 HTTP/1.1 Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 101 Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_hau4P27zLHmuGF3PnJGz5sZHwtLWFW6fq-F9tVi5lyWHQmhV4Ny8a1JST3tWJzQL03_5tLtxdkdKGGNLUmqGppjnyCUIcgabjgoAltvoNAU4rBNs0udoNIOrDwdbNhUWjIcJU7PDEAiJYt1NavAQ4_RBV23lZwbTAKbPeNYr-H-o Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 53f94ce8dacd4011adc4b3f58ea497fb Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53f94ce8dacd4011adc4b3f58ea497fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53f94ce8dacd4011adc4b3f58ea497fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 53f94ce8dacd4011adc4b3f58ea497fb Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427 Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsNegativeTestJSON-1898260427-project Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 50646443269c484596ba6a8ec6068255 Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1898260427-project Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: {"security_group": {"name": "tempest-sg-2003361620", "description": "tempest-description-530545670"}} Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: exception: Security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 does not exist Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-93229b80-93af-4985-989f-35b58170497a'] Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1c3135b9-91e0-4928-8f58-208aa7e988a5', 'body': {'security_group': {'name': 'tempest-sg-2003361620', 'description': 'tempest-description-530545670'}}} Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:51:47.578976 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 does not exist Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93229b80-93af-4985-989f-35b58170497a'] Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 does not exist Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93229b80-93af-4985-989f-35b58170497a'] Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 does not exist Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93229b80-93af-4985-989f-35b58170497a'] Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 does not exist Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93229b80-93af-4985-989f-35b58170497a'] Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81b11850-f380-48ed-ba92-c5b49d0de5b7 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] Returning 404 to user: Security group 1c3135b9-91e0-4928-8f58-208aa7e988a5 does not exist Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-93229b80-93af-4985-989f-35b58170497a'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81b11850-f380-48ed-ba92-c5b49d0de5b7 tempest-SecurityGroupsNegativeTestJSON-1898260427 tempest-SecurityGroupsNegativeTestJSON-1898260427-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/1c3135b9-91e0-4928-8f58-208aa7e988a5" status: 404 len: 194 microversion: 2.1 time: 0.106733 Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 433/846] 10.222.0.27 () {60 vars in 1290 bytes} [Mon Oct 17 12:51:47 2022] PUT /compute/v2.1/os-security-groups/1c3135b9-91e0-4928-8f58-208aa7e988a5 => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:51:47.591471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e4cf7bc8-b457-4973-9e87-3a77b7c24111 req-d649d9e5-8247-41e5-9fe8-971283c1f3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b339d94-c1ae-4a21-9cc1-980fc71295c4", "name": "network-vif-plugged", "status": "completed", "tag": "6d73bd0e-3dc4-4afe-88a7-ac7e9316c237"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:47.619406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4cf7bc8-b457-4973-9e87-3a77b7c24111 req-d649d9e5-8247-41e5-9fe8-971283c1f3e4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:47.620295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4cf7bc8-b457-4973-9e87-3a77b7c24111 req-d649d9e5-8247-41e5-9fe8-971283c1f3e4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:47.620955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4cf7bc8-b457-4973-9e87-3a77b7c24111 req-d649d9e5-8247-41e5-9fe8-971283c1f3e4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:47.632833 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e4cf7bc8-b457-4973-9e87-3a77b7c24111 req-d649d9e5-8247-41e5-9fe8-971283c1f3e4 service nova] Creating event network-vif-plugged:6d73bd0e-3dc4-4afe-88a7-ac7e9316c237 for instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 on n-h1-853316-12 Oct 17 12:51:47.639532 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e4cf7bc8-b457-4973-9e87-3a77b7c24111 req-d649d9e5-8247-41e5-9fe8-971283c1f3e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056893 Oct 17 12:51:47.640802 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 434/847] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:47.990931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:47.995540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:48.022048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:48.022817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:48.023977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:48.024933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:48.026081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:48.027636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:48.145543 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc5ad2e6-f812-4a97-b6a6-4f808470fb2d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16194 microversion: 2.1 time: 2.256485 Oct 17 12:51:48.146499 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 414/848] 10.222.0.27 () {58 vars in 1171 bytes} [Mon Oct 17 12:51:45 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16194 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:51:48.155829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d382fdba-6443-416a-be76-e26095f6df84 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212f84c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:48.225655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d382fdba-6443-416a-be76-e26095f6df84 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.077069 Oct 17 12:51:48.226376 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 415/849] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:48 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:48.236864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:48.260498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Searching by: {'deleted': False, 'project_id': '6d5d79252aff42c1850cf21f278b247d'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:51:48.279893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:48.287264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:48.289987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:48.291032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:48.294634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:48.299105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:48.554459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:48.563278 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e2552481-80ba-4544-88b4-c342fd064e81 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=398c14a84792484ba396062bf18c6933" status: 200 len: 15 microversion: 2.1 time: 0.335761 Oct 17 12:51:48.567259 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 416/850] 10.222.0.27 () {58 vars in 1231 bytes} [Mon Oct 17 12:51:48 2022] GET /compute/v2.1/servers/detail?tenant_id=398c14a84792484ba396062bf18c6933 => generated 15 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:51:48.587707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:48.588649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:48.622114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:48.623047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:48.626795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:48.627973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:48.628991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:48.629536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:49.198903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:49.207653 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf790183-fdd7-4768-85fd-d6e28ccf9c63 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1384 microversion: 2.1 time: 0.638825 Oct 17 12:51:49.223216 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 417/851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:48 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1384 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:49.232502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:49.250913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Searching by: {'tenant_id': '398c14a84792484ba396062bf18c6933', 'deleted': False} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:51:49.271781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:49.274314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:49.274940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:49.287051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:49.287554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:49.287992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:49.341473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:49.348195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:51:49.528918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:49.529525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:49.529976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:49.608852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:49.646452 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c137142e-1308-4a29-82a2-9f4493ca622a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1317 microversion: 2.1 time: 1.658623 Oct 17 12:51:49.662202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 435/852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:47 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1317 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:49.679948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-601d1fa9-4430-48c4-9fd3-26568e6e0ce9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138a4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:49.801903 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-601d1fa9-4430-48c4-9fd3-26568e6e0ce9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.150871 Oct 17 12:51:49.802835 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 436/853] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:49 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:50.240724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:50.241716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:50.252367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:50.256191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:50.258578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:50.259515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:50.261557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:50.262265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:50.780304 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2ec1448-5617-4994-80bb-7004b37522a0 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=398c14a84792484ba396062bf18c6933" status: 200 len: 4831 microversion: 2.1 time: 1.560804 Oct 17 12:51:50.781944 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 418/854] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 17 12:51:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=398c14a84792484ba396062bf18c6933 => generated 4831 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:50.787595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:50.788467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:50.823453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:50.835729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:50.836263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:50.837090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:50.837626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:50.838119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:50.881472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:50.904419 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fa2a39e1-19b0-4606-90b9-1afa59f59ddd tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1583 microversion: 2.1 time: 0.671275 Oct 17 12:51:50.905719 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 437/855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:50 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1583 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:50.918010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:50.947188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Searching by: {'tenant_id': '6d5d79252aff42c1850cf21f278b247d', 'deleted': False} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:51:50.969918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:50.971334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:50.976371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:50.979830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:50.980193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:50.980624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:51.058018 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-596ed8bd-6e86-4fe0-bb69-4a95cbaa6e0b tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6d5d79252aff42c1850cf21f278b247d" status: 200 len: 15 microversion: 2.1 time: 0.150858 Oct 17 12:51:51.060076 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 438/856] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 17 12:51:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6d5d79252aff42c1850cf21f278b247d => generated 15 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:51:51.073739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9960aaf3-bb51-4f73-b563-b8d66129b50e tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8213cedc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:51.150483 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9960aaf3-bb51-4f73-b563-b8d66129b50e tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.080727 Oct 17 12:51:51.153455 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 439/857] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:51 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:51.173251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9318d860-f682-40df-b334-b3ea1facc7d1 req-c95d066f-99b1-40f0-8751-fbd7142306fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2607f9b-b14e-4bad-a241-9cd51a932b94", "name": "network-vif-plugged", "status": "completed", "tag": "d90e1352-9e51-4e32-8730-1c0d674883b0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:51.209580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9318d860-f682-40df-b334-b3ea1facc7d1 req-c95d066f-99b1-40f0-8751-fbd7142306fb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:51.210059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9318d860-f682-40df-b334-b3ea1facc7d1 req-c95d066f-99b1-40f0-8751-fbd7142306fb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:51.219832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9318d860-f682-40df-b334-b3ea1facc7d1 req-c95d066f-99b1-40f0-8751-fbd7142306fb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:51.274783 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9318d860-f682-40df-b334-b3ea1facc7d1 req-c95d066f-99b1-40f0-8751-fbd7142306fb service nova] Creating event network-vif-plugged:d90e1352-9e51-4e32-8730-1c0d674883b0 for instance e2607f9b-b14e-4bad-a241-9cd51a932b94 on n-h2-853316-12 Oct 17 12:51:51.284098 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9318d860-f682-40df-b334-b3ea1facc7d1 req-c95d066f-99b1-40f0-8751-fbd7142306fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128606 Oct 17 12:51:51.288528 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 440/858] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:51.304035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:51.304668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:51.329845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:51.330454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:51.330904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:51.332167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:51.332628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:51.333111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:51.480175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:51.491548 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab1b7d18-3f86-4f03-b050-7308c5febe3f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1317 microversion: 2.1 time: 0.708097 Oct 17 12:51:51.500269 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 419/859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:50 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:51.526197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc5d55d0-5851-4f6a-8802-929924ff2eb2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:51.558065 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc5d55d0-5851-4f6a-8802-929924ff2eb2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.052323 Oct 17 12:51:51.577903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 420/860] 10.222.0.27 () {58 vars in 1189 bytes} [Mon Oct 17 12:51:51 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:51:51.606337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:51.608944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:51.629566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:51.630252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:51.635965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:51.637987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:51.643526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:51.646350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:51.820324 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b18caef2-9ce6-4c85-9915-d22e423d3854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action" status: 202 len: 0 microversion: 2.1 time: 0.217481 Oct 17 12:51:51.828364 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3427dacb-3f08-4653-905f-522c036a9444 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.535008 Oct 17 12:51:51.828364 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 441/861] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 12:51:51 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4/os-interface => generated 284 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:51.830968 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 421/862] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:51:51 2022] POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:51:51.838663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:51.856188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:51.857020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '398c14a84792484ba396062bf18c6933'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:51:51.883930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:51.884571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:51.884833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:51.891954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:51.897963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:51.898392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:52.157162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:51:52.169348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b11ff3c-98b8-4b9e-a40f-baf389913d4a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821144280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:52.324154 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-218fe37f-24a0-4cc4-964e-d059d1f3cba1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.489661 Oct 17 12:51:52.335565 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 442/863] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 17 12:51:51 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:52.343210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b11ff3c-98b8-4b9e-a40f-baf389913d4a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.178125 Oct 17 12:51:52.344646 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 422/864] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:52 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:52.345494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:52.375024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:52.405794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:52.406349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:52.406791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:52.407511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:52.428459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:52.429087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:52.528205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:52.529044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:52.537896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:52.546631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:52.547475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:52.549328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:52.550842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:52.551695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:52.780585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3ae16df-b70a-4508-9b83-b52333a20faa tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action" status: 202 len: 0 microversion: 2.1 time: 0.443175 Oct 17 12:51:52.785007 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 443/865] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:51:52 2022] POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:52.814428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:52.815217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:52.850847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:52.851768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:52.852435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:52.854743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:52.858569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:52.859366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:53.525243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:53.534367 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b0c067a-1c9c-4aa4-9191-e0f91490faeb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1317 microversion: 2.1 time: 1.010982 Oct 17 12:51:53.535728 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 423/866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:52 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1317 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:53.552560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ab558e2-75e2-4758-857f-98ebb30f9f47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212f8670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:53.564153 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-177c1f15-7e7b-4020-8908-c0b91ae4ae5d tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1617 microversion: 2.1 time: 0.777700 Oct 17 12:51:53.570748 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 444/867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:52 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1617 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:53.598144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:53.599130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:53.613737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:53.632541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:53.635202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:53.637633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:53.638586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:53.640556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:53.654764 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ab558e2-75e2-4758-857f-98ebb30f9f47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.108414 Oct 17 12:51:53.655723 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 424/868] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:53 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:54.064375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-05d2aed0-e77d-43fe-917b-18a12a1122d5 tempest-NetworksTest-381126119 tempest-NetworksTest-381126119-project-admin] Calling method '.version_select at 0x7fa8212eae50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:54.344663 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-05d2aed0-e77d-43fe-917b-18a12a1122d5 tempest-NetworksTest-381126119 tempest-NetworksTest-381126119-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6087 microversion: 2.1 time: 0.526724 Oct 17 12:51:54.345338 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 425/869] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:51:53 2022] GET /compute/v2.1/os-networks => generated 6087 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:54.354380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79769134-03f8-4172-8e95-b84ac133c2cd tempest-NetworksTest-381126119 tempest-NetworksTest-381126119-project-admin] Calling method '.version_select at 0x7fa8212ea3a0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:54.455289 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90f8f386-617e-4d1f-9b7d-2273152c6b49 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1617 microversion: 2.1 time: 0.861215 Oct 17 12:51:54.459335 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 445/870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:53 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1617 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:51:54.484892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:54.495043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Searching by: {'host': 'n-h1-853316-12', 'deleted': False} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:51:54.514894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:54.515561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:54.516182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:54.517568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:54.518636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:54.520204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:54.809958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:51:54.953306 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08563325-950b-4e67-a94d-b4585e48b338 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h1-853316-12&all_tenants=1" status: 200 len: 2332 microversion: 2.1 time: 0.472566 Oct 17 12:51:54.969682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 446/871] 10.222.0.27 () {58 vars in 1192 bytes} [Mon Oct 17 12:51:54 2022] GET /compute/v2.1/servers?host=n-h1-853316-12&all_tenants=1 => generated 2332 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:54.976525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:54.977401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:54.994758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:54.997958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:55.001712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:55.005751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:55.006484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:55.007095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:55.023360 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79769134-03f8-4172-8e95-b84ac133c2cd tempest-NetworksTest-381126119 tempest-NetworksTest-381126119-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/107dfb30-0fda-416a-9f56-050ede1e1c9c" status: 200 len: 652 microversion: 2.1 time: 0.672811 Oct 17 12:51:55.024466 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 426/872] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 12:51:54 2022] GET /compute/v2.1/os-networks/107dfb30-0fda-416a-9f56-050ede1e1c9c => generated 652 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:55.034426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a68066f-d66e-46b3-81d5-33b24321499b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138c790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:55.120543 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a68066f-d66e-46b3-81d5-33b24321499b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.094892 Oct 17 12:51:55.134349 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 427/873] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:55 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:55.146420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:55.167523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:51:55.177954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:55.178698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:55.182702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:55.189938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:55.193181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:55.193843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:55.393769 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da8db8cd-cf8e-40ea-a289-48f8badd92c2 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.256689 Oct 17 12:51:55.395808 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 428/874] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Oct 17 12:51:55 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:51:55.414909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc20e3fd-e180-4360-8e4e-db36e41c92ff tempest-NetworksTest-381126119 tempest-NetworksTest-381126119-project-admin] Calling method '.version_select at 0x7fa821144af0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:55.742555 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc20e3fd-e180-4360-8e4e-db36e41c92ff tempest-NetworksTest-381126119 tempest-NetworksTest-381126119-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6087 microversion: 2.1 time: 0.345336 Oct 17 12:51:55.743283 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 429/875] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:51:55 2022] GET /compute/v2.1/os-networks => generated 6087 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:55.753101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:55.756149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:55.775663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:55.776318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:55.777507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:55.778381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:55.780848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:55.784954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:55.944361 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5603cb91-b705-43d9-8e04-4479e8cb5307 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action" status: 202 len: 0 microversion: 2.1 time: 0.199686 Oct 17 12:51:55.945780 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 430/876] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:51:55 2022] POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:51:55.950870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:55.951826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:55.962037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:55.968424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:55.969907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:55.970976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:55.982920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:55.983758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:56.458376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:56.460876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:51:56.470700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d185cc1-670c-4356-bf18-91ee0fd60a0b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1466 microversion: 2.1 time: 1.499335 Oct 17 12:51:56.473360 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 447/877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:54 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1466 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:56.574454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid 5a076fb2-b905-428e-8d88-e396a91a80c1 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:51:56.607782 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7ac706b3-7c29-4767-88fd-e4baf728263d tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 2347 microversion: 2.25 time: 0.660581 Oct 17 12:51:56.612228 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 431/878] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:51:55 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 2347 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:51:56.623372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:56.631094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:56.648044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:56.650203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:56.653596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:56.654868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:56.662994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:56.663791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:56.851946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:51:56.852758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:51:56.853468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:51:56.854646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:51:56.863431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:51:57.004156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:57.031045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.037903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0e12edea-bd57-413b-a10c-7925e82d1f8d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa82146f8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-6825240", "description": "tempest-description-532547721"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:57.044716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.046373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.050150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.050902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.051455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.135244 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-91a1d932-d185-43eb-9dd2-ce1f956eeae8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action" status: 202 len: 1068 microversion: 2.1 time: 0.520959 Oct 17 12:51:57.145443 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 432/879] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:51:56 2022] POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action => generated 1068 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 12:51:57.161043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-11d11b54-aa4f-4dd1-b276-efc4728f82d1 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212ea280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:57.264640 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-11d11b54-aa4f-4dd1-b276-efc4728f82d1 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.115793 Oct 17 12:51:57.284050 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 433/880] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:57 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:57.487457 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0e12edea-bd57-413b-a10c-7925e82d1f8d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 1.010687 Oct 17 12:51:57.489236 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 448/881] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:51:56 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:57.494178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f19e198-9e8a-4084-852a-5a4789d8feb8 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:57.504096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f19e198-9e8a-4084-852a-5a4789d8feb8 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.505332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f19e198-9e8a-4084-852a-5a4789d8feb8 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.506020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f19e198-9e8a-4084-852a-5a4789d8feb8 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.507064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f19e198-9e8a-4084-852a-5a4789d8feb8 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.507839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f19e198-9e8a-4084-852a-5a4789d8feb8 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.508495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f19e198-9e8a-4084-852a-5a4789d8feb8 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.548835 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f19e198-9e8a-4084-852a-5a4789d8feb8 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.057668 Oct 17 12:51:57.551828 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 449/882] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 17 12:51:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:51:57.556934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:57.557887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:57.573796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:57.574766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:57.581013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.584864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.586821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.588338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.591337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.592435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.593527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.594268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.594967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.597424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.598719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.601445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.907212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:57.928866 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d74e8a10-f64a-47ca-ac69-2f4de39f3a94 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.373337 Oct 17 12:51:57.929855 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 450/883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:57 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:57.941221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:57.950932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:57.964964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.967070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.968012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:57.969467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:57.971256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:57.974215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:58.242749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:51:58.256415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-069deb50-3ac1-456b-9395-22bf2db35671 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1583 microversion: 2.1 time: 0.321132 Oct 17 12:51:58.258077 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 451/884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:57 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1583 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:58.263961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-45cc8591-068d-46bc-8481-f70477033dbd req-a86d3751-3bed-40e0-9897-7ea990c36940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b339d94-c1ae-4a21-9cc1-980fc71295c4", "tag": "6d73bd0e-3dc4-4afe-88a7-ac7e9316c237"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:58.277517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-45cc8591-068d-46bc-8481-f70477033dbd req-a86d3751-3bed-40e0-9897-7ea990c36940 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:58.278465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-45cc8591-068d-46bc-8481-f70477033dbd req-a86d3751-3bed-40e0-9897-7ea990c36940 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:58.279242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-45cc8591-068d-46bc-8481-f70477033dbd req-a86d3751-3bed-40e0-9897-7ea990c36940 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:58.302055 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-45cc8591-068d-46bc-8481-f70477033dbd req-a86d3751-3bed-40e0-9897-7ea990c36940 service nova] Creating event network-changed:6d73bd0e-3dc4-4afe-88a7-ac7e9316c237 for instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 on n-h1-853316-12 Oct 17 12:51:58.309590 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-45cc8591-068d-46bc-8481-f70477033dbd req-a86d3751-3bed-40e0-9897-7ea990c36940 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049600 Oct 17 12:51:58.318039 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 452/885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:58.328470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7cf4f080-fecf-43f7-8649-8405db734b65 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa82154eee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2142765206", "description": "tempest-description-1573021835"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:58.710496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7cf4f080-fecf-43f7-8649-8405db734b65 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.389609 Oct 17 12:51:58.725469 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 453/886] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:51:58 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:51:58.731540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78cd328b-14f1-41bc-8725-1e45bd6aeeb9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821429ee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:58.858022 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78cd328b-14f1-41bc-8725-1e45bd6aeeb9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.129180 Oct 17 12:51:58.859028 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 454/887] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:51:58 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:58.943258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1112680159", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "5355c351-ce80-4ae7-8b31-a249fb6b4176"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:51:59.089622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] validate_networks() for [('5355c351-ce80-4ae7-8b31-a249fb6b4176', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:51:59.383379 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b0b63d0e-914e-4907-a21f-3a40673cbde6 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1619 microversion: 2.1 time: 2.097063 Oct 17 12:51:59.383379 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 434/888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:57 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1619 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:51:59.395235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:51:59.395926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:51:59.416007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:59.418528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:59.422896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:59.423950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:51:59.428106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:51:59.429142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:51:59.505634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:00.008728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:00.026823 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dfc67a93-6d18-4595-8d0a-99ed57974a8a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.633824 Oct 17 12:52:00.062835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 435/889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:51:59 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:00.069412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-464c04f3-a0d0-47af-947f-54f3401d6762 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Action: 'create', calling method: .version_select at 0x7fa82142d040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1415076909", "policies": ["affinity"]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:00.093526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-464c04f3-a0d0-47af-947f-54f3401d6762 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:00.102594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-464c04f3-a0d0-47af-947f-54f3401d6762 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:00.253824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-464c04f3-a0d0-47af-947f-54f3401d6762 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:00.265864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-464c04f3-a0d0-47af-947f-54f3401d6762 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:00.279610 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-464c04f3-a0d0-47af-947f-54f3401d6762 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.215099 Oct 17 12:52:00.291911 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 436/890] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 17 12:52:00 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:00.298683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-015a551f-37a6-44e5-acec-f05e26907e23 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138cee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:00.352979 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-015a551f-37a6-44e5-acec-f05e26907e23 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.059438 Oct 17 12:52:00.354931 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 437/891] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:00 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:00.599710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1648994031", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8d633d19-155c-46b7-9ed4-0198b3f57b6e"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:00.776176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:52:01.011976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:01.012551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:01.013116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:01.013743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:01.014290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:01.040538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:01.047509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:01.055100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:01.057371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:01.060829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:01.065335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:01.169419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Getting quotas for project 2816d963beca40e6bafbbd722b005ea1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:01.188075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Getting quotas for user 4958dd7065be4821bae0ff2033c5e72a and project 2816d963beca40e6bafbbd722b005ea1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:01.312787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:52:01.316574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:01.468878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:01.529683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:01.530235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:01.530719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:01.531126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:01.531530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:01.571716 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d98b9cd6-fee0-4891-9f2e-bd905921e70b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.632986 Oct 17 12:52:01.573511 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 455/892] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:51:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 12:52:01.593337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:01.594369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:01.629887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:01.630418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:01.646632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:01.652397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:01.653454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:01.654608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:01.654737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:01.655059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:01.655451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:01.656348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:01.656962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:01.657750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:01.695255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:01.706103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:01.729801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Going to run 2 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:52:01.734071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:01.851818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127539) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 17 12:52:01.947836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:01.987371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:02.111717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:02.120082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:02.149858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:02.163749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=05c0e4db-6bcf-4518-be71-cb588bcf1c91,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:02.343929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:02.351743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:02.418885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:02.426684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:02.501355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:02.523879 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78511bce-0fee-416a-8e40-99402eebebc4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.948259 Oct 17 12:52:02.532356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 456/893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:01 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:02.543734 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d3d51da-427b-4165-8260-61dd64ba6af0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.945179 Oct 17 12:52:02.560174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0e582a6d-2b2e-4a97-bdf1-7b92fcaa34ac tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82140ba60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:02.564241 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 438/894] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:52:00 2022] POST /compute/v2.1/servers => generated 32 bytes in 1969 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 17 12:52:02.587815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85bf7671-7766-4f6d-8851-70ed03184f70 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:02.588481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-85bf7671-7766-4f6d-8851-70ed03184f70 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:02.805087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-85bf7671-7766-4f6d-8851-70ed03184f70 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:02.817383 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-85bf7671-7766-4f6d-8851-70ed03184f70 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1216 microversion: 2.1 time: 0.250597 Oct 17 12:52:02.830921 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 439/895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:02 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1216 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:02.841217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:02.846539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:02.847889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Searching by: {'deleted': False, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:52:02.855148 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0e582a6d-2b2e-4a97-bdf1-7b92fcaa34ac tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.281387 Oct 17 12:52:02.855728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 457/896] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:02 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:02.871109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:02.872006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:02.872694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:02.873922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:02.874859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:02.876347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:03.042883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:52:03.309589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:03.314144 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f06b20d-5362-4c54-ae66-461deaddc2e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.480670 Oct 17 12:52:03.317711 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 440/897] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 12:52:02 2022] GET /compute/v2.1/servers => generated 1004 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:03.327920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25a3bdee-2716-4b09-bfab-6eac342bd518 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:03.328538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25a3bdee-2716-4b09-bfab-6eac342bd518 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:03.455351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-25a3bdee-2716-4b09-bfab-6eac342bd518 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:03.471956 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25a3bdee-2716-4b09-bfab-6eac342bd518 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1219 microversion: 2.1 time: 0.147520 Oct 17 12:52:03.477707 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 458/898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:03 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:03.560339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:03.561206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:03.586099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:03.587387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:03.587849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:03.588592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:03.589052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:03.598087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:03.843793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:03.844427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:03.861641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:03.862223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:03.870416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:03.871230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:03.880540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:03.882670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:04.001100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:04.035590 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b940fffc-c19d-448d-a7c1-2653e1fab7c3 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.476383 Oct 17 12:52:04.040166 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 441/899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:03 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:04.060935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c5437381-53d4-4968-95b9-bd511598f378 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138c790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:04.104865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:04.120052 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43344deb-74b5-4322-8926-c9190dd6dd2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1268 microversion: 2.1 time: 0.280370 Oct 17 12:52:04.121610 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 459/900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:03 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1268 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:04.127296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cea59c66-59eb-4293-837e-19971e263ac1", "device": "/dev/xvdb"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:04.130738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:04.138796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:04.139543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:04.140257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:04.141447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:04.142283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:04.142968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:04.199536 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c5437381-53d4-4968-95b9-bd511598f378 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.155683 Oct 17 12:52:04.213953 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 442/901] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:04 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:04.510339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8cd827f-4d21-4aaf-b57b-c7f3e6421cf0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:04.511079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f8cd827f-4d21-4aaf-b57b-c7f3e6421cf0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:04.865122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f8cd827f-4d21-4aaf-b57b-c7f3e6421cf0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:04.874945 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bf7950af-3bec-475f-88f4-c11e324ef9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "POST /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.751740 Oct 17 12:52:04.876014 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 460/902] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 17 12:52:04 2022] POST /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:52:04.916415 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8cd827f-4d21-4aaf-b57b-c7f3e6421cf0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1219 microversion: 2.1 time: 0.405820 Oct 17 12:52:04.917903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 443/903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:04 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1219 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:05.064735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:05.065441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:05.079266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:05.080169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:05.080848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:05.082535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:05.083291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:05.084205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:05.148775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:05.150679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:05.157494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:05.158383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:05.159078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:05.163563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:05.164490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:05.165230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:05.314099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:05.326990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f9bc1ae-43eb-4ef0-9b0e-a974a3de278f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1274 microversion: 2.1 time: 0.183325 Oct 17 12:52:05.328777 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 444/904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:05 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:05.338902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e8ea6e4-edb4-45f8-823c-c252d0d7b914 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138c4c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:05.413461 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e8ea6e4-edb4-45f8-823c-c252d0d7b914 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.083331 Oct 17 12:52:05.414582 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 445/905] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:05 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:05.647540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:05.663211 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a5af4b1d-0958-4830-ae19-32d4a4e97e3e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.603463 Oct 17 12:52:05.664018 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 461/906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:05 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:05.700613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-584589162", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": "none"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:05.834885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:05.835321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:05.835930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:05.836346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:05.836762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:05.885530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:05.886189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:05.889547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:05.898323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:05.900412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:05.902034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:05.950210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:05.952222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:05.960720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Getting quotas for project bfefd211f821498d9b76bad39d673e08. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:05.963592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:05.966729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:05.968635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:05.976344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Getting quotas for user bcd72bd49db141599122d8e94e443ea9 and project bfefd211f821498d9b76bad39d673e08. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:05.977505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:05.978320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:05.979082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:06.009880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:52:06.018385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:06.135530 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c63bde9f-9bed-4c25-9ee7-765ea4268f6a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.716583 Oct 17 12:52:06.142535 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 446/907] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 12:52:06.171635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3bfba1d8-751f-4555-b34e-e2a387a294b9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:06.180640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3bfba1d8-751f-4555-b34e-e2a387a294b9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:06.434506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:06.460159 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ce45b6e-fa5e-4068-91be-065be6aed78e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1215 microversion: 2.1 time: 0.515941 Oct 17 12:52:06.466546 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 462/908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:05 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1215 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:06.476310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:06.495280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:06.502724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3bfba1d8-751f-4555-b34e-e2a387a294b9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:06.511912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3bfba1d8-751f-4555-b34e-e2a387a294b9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:06.518625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3bfba1d8-751f-4555-b34e-e2a387a294b9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:06.535229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:06.535931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:06.536377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:06.537101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:06.537557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:06.537985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:06.548607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3bfba1d8-751f-4555-b34e-e2a387a294b9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "PUT /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1358 microversion: 2.75 time: 0.394405 Oct 17 12:52:06.562188 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 447/909] 10.222.0.27 () {62 vars in 1297 bytes} [Mon Oct 17 12:52:06 2022] PUT /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:06.562188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e57c4f0-f4f7-4709-8455-b2f86d9fa038 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82102ab80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:06.680304 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e57c4f0-f4f7-4709-8455-b2f86d9fa038 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.129179 Oct 17 12:52:06.681016 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 448/910] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:06 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:06.700419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70fd28a1-971e-4388-858a-5ffb79afe0dc tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:06.701057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70fd28a1-971e-4388-858a-5ffb79afe0dc tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:07.017466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:07.035634 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-38d4ffac-744a-463a-bf06-3bedce2e5938 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.566476 Oct 17 12:52:07.039217 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 463/911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:06 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:07.057169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:07.062575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:07.076331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:07.080893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:07.081777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:07.083848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:07.085305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:07.087095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:07.505191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70fd28a1-971e-4388-858a-5ffb79afe0dc tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:07.516165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70fd28a1-971e-4388-858a-5ffb79afe0dc tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:07.521980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70fd28a1-971e-4388-858a-5ffb79afe0dc tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:07.533111 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70fd28a1-971e-4388-858a-5ffb79afe0dc tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1358 microversion: 2.75 time: 0.851115 Oct 17 12:52:07.539538 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 449/912] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:06 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1358 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:07.547585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:07.549524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:07.566492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:07.568123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:07.568732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:07.571882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:07.572800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:07.573417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:07.978290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:07.994655 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0dae67fa-4a2b-4510-85fb-e39de72e9b02 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.952206 Oct 17 12:52:07.995965 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 464/913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:07 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:08.005378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8bd40ee9-21da-42f2-a898-6725569309e2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212ab5e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:08.007302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:08.022059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9cbe6925-31a0-4877-a5d7-2496799a29d6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1277 microversion: 2.1 time: 0.480648 Oct 17 12:52:08.032274 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 450/914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:07 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1277 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:08.065546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:08.066353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:08.071740 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8bd40ee9-21da-42f2-a898-6725569309e2 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.074384 Oct 17 12:52:08.073001 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 465/915] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:07 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:08.083070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:08.084146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:08.084600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:08.085322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:08.085780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:08.093660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:08.495561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:08.505485 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3221777d-8ae7-4386-9fde-11fdff546a0c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.444179 Oct 17 12:52:08.509254 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 451/916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:08 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:08.575519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:08.576316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:08.592273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:08.593285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:08.594913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:08.599427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:08.604058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:08.605319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:08.934988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:08.951988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:08.954131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:08.974922 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-253d3dac-d529-430f-93c8-602d4b428bdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1410 microversion: 2.75 time: 0.403321 Oct 17 12:52:08.976203 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 466/917] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:08 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1410 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:09.021780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:09.022453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:09.039412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:09.045209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:09.046749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:09.047674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:09.050768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:09.053013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:09.061259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:09.062393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:09.080329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:09.087004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:09.089492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:09.094428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:09.098634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:09.104326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:09.471454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:09.483628 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a16bc255-dda8-4b62-a14e-ce365c4c5f31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1277 microversion: 2.1 time: 0.426566 Oct 17 12:52:09.485592 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 467/918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:09 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1277 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:09.513109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03686278-fd8c-4f15-8d37-229e44274c94 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212abdc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:09.623148 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-03686278-fd8c-4f15-8d37-229e44274c94 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.136197 Oct 17 12:52:09.624742 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 468/919] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:09 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:09.654856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:09.677995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:09.713213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:09.713707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:09.725051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:09.726450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:09.742369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:09.749324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:10.339917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:10.366771 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e00f3093-6eac-45ab-b00f-5176d93bd70f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 1.341492 Oct 17 12:52:10.367784 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 452/920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:09 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:10.376438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:10.377053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:10.408173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:10.408668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:10.409109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:10.410460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:10.410914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:10.411350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:10.602987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:10.621709 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-836feede-dc6f-4de8-b096-abb647e4158d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.991025 Oct 17 12:52:10.627454 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 469/921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:09 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:10.632896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:10.640497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:10.656519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:10.660299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:10.662406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:10.667865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:10.672366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:10.672966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:10.882865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:10.899612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:10.902226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:10.922689 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-24a549bb-abb0-46b5-918c-b19c2b0cfa85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1416 microversion: 2.75 time: 0.553253 Oct 17 12:52:10.923785 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 453/922] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:10 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1416 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:10.959747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-57258cac-b77f-47d4-ae9c-fce6a2177faa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820fb1ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:11.041747 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-57258cac-b77f-47d4-ae9c-fce6a2177faa tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.102112 Oct 17 12:52:11.042370 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 454/923] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:10 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:11.125014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=12 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:11.406416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:11.407079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:11.418751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:11.426959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:11.428100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:11.429108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:11.430129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:11.434676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:11.752075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:11.776997 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d6a203b-3f3f-449e-837c-92808d81b6b9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 1.148135 Oct 17 12:52:11.779828 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 470/924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:10 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:11.785471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6812f010-e1d5-4c73-846a-35b97cfd26fb req-5f0daf1b-fc6e-46b3-b142-18ee35109722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f6b019-8c13-4d9a-a8cb-904f872a660e", "tag": "3bd1387b-ebdd-4269-a546-857402226506"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:11.832652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6812f010-e1d5-4c73-846a-35b97cfd26fb req-5f0daf1b-fc6e-46b3-b142-18ee35109722 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:11.833242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6812f010-e1d5-4c73-846a-35b97cfd26fb req-5f0daf1b-fc6e-46b3-b142-18ee35109722 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:11.834521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6812f010-e1d5-4c73-846a-35b97cfd26fb req-5f0daf1b-fc6e-46b3-b142-18ee35109722 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:11.860451 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6812f010-e1d5-4c73-846a-35b97cfd26fb req-5f0daf1b-fc6e-46b3-b142-18ee35109722 service nova] Creating event network-changed:3bd1387b-ebdd-4269-a546-857402226506 for instance 40f6b019-8c13-4d9a-a8cb-904f872a660e on n-h2-853316-12 Oct 17 12:52:11.875971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6812f010-e1d5-4c73-846a-35b97cfd26fb req-5f0daf1b-fc6e-46b3-b142-18ee35109722 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094513 Oct 17 12:52:11.877011 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 471/925] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:11.884740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:11.885702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:11.904651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:11.905621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:11.906254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:11.908042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:11.912217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:11.912979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:12.278836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:12.293886 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7fcac056-a9fe-42c5-8349-a46ec508dc8f tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.891235 Oct 17 12:52:12.306186 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 455/926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:11 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:12.310852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:12.312503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:12.327421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:12.327923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:12.328380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:12.330438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:12.330933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:12.331917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:12.510961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:12.514534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:12.542694 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4bbd9041-6f83-4b2a-8888-1dde753e3f36 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.664050 Oct 17 12:52:12.543912 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 472/927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:11 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:12.548903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07a6650e-b578-4025-bf82-ea485b8c73d3 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821249040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:12.626412 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07a6650e-b578-4025-bf82-ea485b8c73d3 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.081020 Oct 17 12:52:12.628045 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 473/928] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:12 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:12.650133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:12.664762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:12.668586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:12.683155 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd0154de-b9a2-4619-aa88-05de2809f285 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1416 microversion: 2.75 time: 0.386669 Oct 17 12:52:12.684080 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 456/929] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:12 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1416 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:12.814844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:12.815464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:12.845316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:12.847019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:12.847745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:12.849299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:12.849922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:12.850560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:12.954066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cc053532-8406-408b-9f10-9a30fdf68819 req-895c6eab-4ed7-483a-bb57-406a521556c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c0e4db-6bcf-4518-be71-cb588bcf1c91", "tag": "6fde0fbd-1445-4000-9256-6e3c3be90e06"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:12.975120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cc053532-8406-408b-9f10-9a30fdf68819 req-895c6eab-4ed7-483a-bb57-406a521556c1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:12.976524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cc053532-8406-408b-9f10-9a30fdf68819 req-895c6eab-4ed7-483a-bb57-406a521556c1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:12.976978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cc053532-8406-408b-9f10-9a30fdf68819 req-895c6eab-4ed7-483a-bb57-406a521556c1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:13.033041 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cc053532-8406-408b-9f10-9a30fdf68819 req-895c6eab-4ed7-483a-bb57-406a521556c1 service nova] Creating event network-changed:6fde0fbd-1445-4000-9256-6e3c3be90e06 for instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 on n-h2-853316-12 Oct 17 12:52:13.046481 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cc053532-8406-408b-9f10-9a30fdf68819 req-895c6eab-4ed7-483a-bb57-406a521556c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095906 Oct 17 12:52:13.049088 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 457/930] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:13.319109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:13.320281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:13.330207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:13.334091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:13.336590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:13.339200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:13.339906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:13.340568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:13.443812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:13.461154 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31dc78c3-861e-4c32-a2c2-730956bf9aea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.657960 Oct 17 12:52:13.480986 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 474/931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:12 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:13.566717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:13.567702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:13.577548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:13.581064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:13.584611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:13.590318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:13.591434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:13.592285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:13.592986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:13.726011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:13.746479 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-beca65b2-c96a-4221-80aa-e116045c103e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.431896 Oct 17 12:52:13.752922 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 458/932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:13 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:13.758034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a01c258d-b99d-446d-a721-2f9b8efe8bea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215fc430>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:13.838880 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a01c258d-b99d-446d-a721-2f9b8efe8bea tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1453 microversion: 2.1 time: 0.084625 Oct 17 12:52:13.840221 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 459/933] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:13 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:13.845695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:13.846601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:13.854752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:13.855567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:13.856205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:13.857122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:13.857766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:13.858648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:13.942067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:13.950504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:13.951970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:13.957515 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f48c3c3-1e7d-452e-beaa-477bb11d4ff9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1416 microversion: 2.75 time: 0.115478 Oct 17 12:52:13.959441 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 460/934] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:13 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1416 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:14.123506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-1499abcc-90cd-4bf0-a815-d1a60a060044 req-d5221caf-2237-4a48-aefd-0bd1deb924ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "069204c4-71a6-4acd-92cd-c454ac2d1171", "tag": "044e72ed-f732-475b-96fc-c6377eaa29cd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:14.139107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:14.143116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1499abcc-90cd-4bf0-a815-d1a60a060044 req-d5221caf-2237-4a48-aefd-0bd1deb924ff service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:14.144926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1499abcc-90cd-4bf0-a815-d1a60a060044 req-d5221caf-2237-4a48-aefd-0bd1deb924ff service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:14.146886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1499abcc-90cd-4bf0-a815-d1a60a060044 req-d5221caf-2237-4a48-aefd-0bd1deb924ff service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:14.165603 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-1499abcc-90cd-4bf0-a815-d1a60a060044 req-d5221caf-2237-4a48-aefd-0bd1deb924ff service nova] Creating event network-changed:044e72ed-f732-475b-96fc-c6377eaa29cd for instance 069204c4-71a6-4acd-92cd-c454ac2d1171 on n-h2-853316-12 Oct 17 12:52:14.172666 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-1499abcc-90cd-4bf0-a815-d1a60a060044 req-d5221caf-2237-4a48-aefd-0bd1deb924ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054372 Oct 17 12:52:14.173881 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 461/935] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:14.210522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:14.223497 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-105332c9-ffcb-42e7-ab6e-90c3a50b273e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.660935 Oct 17 12:52:14.232128 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 475/936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:13 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:14.499022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:14.502961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:14.543804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:14.546547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:14.551715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:14.553566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:14.556038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:14.556689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:14.775220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:14.775856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:14.784382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:14.785528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:14.798931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:14.801544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:14.802431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:14.803025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.103764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.115423 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93a7eee1-90c9-4d57-8810-6c3ea066dc26 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.632894 Oct 17 12:52:15.116020 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 462/937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:14 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:15.137558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69c925f9-d49f-4406-b0fb-9fd371cd1718 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212eddc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:15.192629 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69c925f9-d49f-4406-b0fb-9fd371cd1718 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1462 microversion: 2.1 time: 0.058930 Oct 17 12:52:15.193175 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 463/938] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:15 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1462 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:15.195939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.205326 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-311915d7-6689-489e-bbf5-975044e5ac9a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1472 microversion: 2.1 time: 0.433886 Oct 17 12:52:15.209712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:15.210459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:15.217249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.217747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.218334 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 476/939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:14 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:15.227279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.228511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.229274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.229931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.230558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1bbd018c-8426-4faa-9a7b-5dfe75b612ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820f1d4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:15.292484 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1bbd018c-8426-4faa-9a7b-5dfe75b612ec tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 200 len: 1462 microversion: 2.1 time: 0.072875 Oct 17 12:52:15.293386 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 477/940] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:15 2022] GET /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 1462 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:15.315665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:15.317459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:15.323877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.324683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.325444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.326524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.327346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.328126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.346016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.355451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.359218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.367123 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad409f14-f16f-439e-8c4a-57859d77c14b tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1437 microversion: 2.75 time: 0.161855 Oct 17 12:52:15.368090 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 464/941] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:15 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1437 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:15.386128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:15.387164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:15.395485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.396515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.400755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.401891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.404684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.407077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.586815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.598763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-198901d4-181b-4534-a86a-10b6a59b9cd8 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1481 microversion: 2.1 time: 0.227677 Oct 17 12:52:15.615816 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 465/942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:15 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1481 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:15.615816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:15.616159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:15.627023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.628334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.629032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.629967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.630669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.631246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.661984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.689247 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fec5466-0e4d-4a90-b492-803a842c3c2a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.394680 Oct 17 12:52:15.706645 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 478/943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:15 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:15.762639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:15.762639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:15.763087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:15.763505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:15.763925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:15.838980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:15.845418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.846074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.846686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.848881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:15.849499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:15.850123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:15.856127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:15.928571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=14 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:15.951543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.961253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.963080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:15.968942 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7cc6d2f-c25e-4af0-8dbe-124a7b3b1e9a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "POST /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4/action" status: 202 len: 1494 microversion: 2.75 time: 0.359900 Oct 17 12:52:15.970139 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 466/944] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:52:15 2022] POST /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4/action => generated 1494 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 12:52:15.999313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:16.000200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:16.015817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.016651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.017184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.017972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.018576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.019683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.105843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:16.115702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:16.117170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:16.122804 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d55ab2d-232e-4bbf-bd45-dc87a54a3b14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.127913 Oct 17 12:52:16.123756 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 479/945] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:15 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:16.149216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:16.149890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:16.160143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.161094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.161541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.162350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.163288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.163787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.244146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:16.245546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:16.260504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.261361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.261875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.262833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.263519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.264179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.381392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:16.390469 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9876d624-03d7-4ef9-8c88-98be48ffbc34 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.254264 Oct 17 12:52:16.391702 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 467/946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:16 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:16.547298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:16.557139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25ded5b5-9fc0-4e05-83cd-14f858df1a70 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1478 microversion: 2.1 time: 0.317344 Oct 17 12:52:16.559640 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 480/947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:16 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1478 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:16.625928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:16.627021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:16.636173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.636768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.637445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.638303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.638827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.639327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.727183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:16.728020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:16.748942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.749697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.750139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:16.755209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:16.757070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:16.757796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:17.056116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:17.064621 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9bb138ae-872b-472b-987a-196f4b65fb47 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.355050 Oct 17 12:52:17.090313 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 481/948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:16 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:17.152518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:17.153128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:17.169694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:17.170401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:17.170976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:17.171697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:17.172159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:17.172590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:17.353622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:17.368713 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f823f92f-a57b-4f63-b20f-06d6277fab73 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1468 microversion: 2.1 time: 0.749244 Oct 17 12:52:17.372832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:17.375146 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 468/949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:16 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1468 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:17.394670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:17.396026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:17.402966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e16a334a-6bfb-412f-b68f-e4a0bb8e0fdd req-ba7d96d7-f53e-4268-8ea2-c5d841438944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f35cc1-58d6-4894-af02-7db8eefeb420", "name": "network-vif-unplugged", "status": "completed", "tag": "9a19bdb4-6892-4689-af82-3c465058331f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:17.403808 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce50b7f4-19d0-4f79-9e76-d63d878164c9 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.255159 Oct 17 12:52:17.404866 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 482/950] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:17 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:17.419274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88e74d11-116a-4125-a9ad-6923b983212a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820f4fe50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:17.451089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e16a334a-6bfb-412f-b68f-e4a0bb8e0fdd req-ba7d96d7-f53e-4268-8ea2-c5d841438944 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:17.451567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e16a334a-6bfb-412f-b68f-e4a0bb8e0fdd req-ba7d96d7-f53e-4268-8ea2-c5d841438944 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:17.451994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e16a334a-6bfb-412f-b68f-e4a0bb8e0fdd req-ba7d96d7-f53e-4268-8ea2-c5d841438944 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:17.480079 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e16a334a-6bfb-412f-b68f-e4a0bb8e0fdd req-ba7d96d7-f53e-4268-8ea2-c5d841438944 service nova] Creating event network-vif-unplugged:9a19bdb4-6892-4689-af82-3c465058331f for instance d7f35cc1-58d6-4894-af02-7db8eefeb420 on n-h1-853316-12 Oct 17 12:52:17.496375 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e16a334a-6bfb-412f-b68f-e4a0bb8e0fdd req-ba7d96d7-f53e-4268-8ea2-c5d841438944 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107011 Oct 17 12:52:17.496979 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 469/951] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:17.509101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:17.510986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:17.524088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=44 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:17.528092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:17.528933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:17.532908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:17.536780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:17.546215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:17.548130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:17.610224 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88e74d11-116a-4125-a9ad-6923b983212a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-10-17T12%3A49%3A55Z" status: 200 len: 1903 microversion: 2.1 time: 0.203785 Oct 17 12:52:17.610545 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 483/952] 10.222.0.27 () {58 vars in 1199 bytes} [Mon Oct 17 12:52:17 2022] GET /compute/v2.1/images?changes-since=2022-10-17T12%3A49%3A55Z => generated 1903 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:17.618118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:17.619043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:17.626847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:17.627350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:17.627797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:17.628977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:17.629446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:17.629880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:17.742471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:17.751079 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a63fcd63-5f9a-4c85-99b1-8f98ed3cd9dd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.252713 Oct 17 12:52:17.763767 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 470/953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:17 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:17.773935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-14b3e41f-0f10-42e2-b7ba-73e5e1cc374c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8215fcc10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:17.782131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:17.791759 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc09719c-b100-46b2-b186-3320f2a58d72 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1478 microversion: 2.1 time: 0.180206 Oct 17 12:52:17.792323 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 484/954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:17 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1478 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:17.865328 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-14b3e41f-0f10-42e2-b7ba-73e5e1cc374c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-727526239" status: 200 len: 484 microversion: 2.1 time: 0.096765 Oct 17 12:52:17.866088 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 471/955] 10.222.0.27 () {58 vars in 1229 bytes} [Mon Oct 17 12:52:17 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-727526239 => generated 484 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:17.867085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-164835982", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5e88905b-7116-441b-85ca-653a8460a5b8"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:17.878584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96f29d9b-07aa-4b11-b89d-3f1ed0a9ecd1 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82138ce50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:17.921420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] validate_networks() for [('5e88905b-7116-441b-85ca-653a8460a5b8', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:52:17.969786 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-96f29d9b-07aa-4b11-b89d-3f1ed0a9ecd1 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images?server=652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 958 microversion: 2.1 time: 0.095144 Oct 17 12:52:17.970545 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 472/956] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 17 12:52:17 2022] GET /compute/v2.1/images?server=652645b9-e4bb-48f1-be51-e9483a163116 => generated 958 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:17.983253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55c54af9-50a6-46f6-a387-141b240dc5e3 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820f75430>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.035498 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55c54af9-50a6-46f6-a387-141b240dc5e3 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fe1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 484 microversion: 2.1 time: 0.055532 Oct 17 12:52:18.036231 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 473/957] 10.222.0.27 () {58 vars in 1317 bytes} [Mon Oct 17 12:52:17 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fe1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 484 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:18.047979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ef1f345-b27d-4631-8a8c-554a23edfd27 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820f26790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.101696 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ef1f345-b27d-4631-8a8c-554a23edfd27 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fe1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 484 microversion: 2.1 time: 0.057326 Oct 17 12:52:18.110387 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 474/958] 10.222.0.27 () {58 vars in 1303 bytes} [Mon Oct 17 12:52:18 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fe1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 484 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:18.110387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.110387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:18.118442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.119030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.119539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.120538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.121076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.121565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.271568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:18.282814 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-28e75176-85df-450b-887e-258e02b15ae9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.177924 Oct 17 12:52:18.285727 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 475/959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:18 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:18.301205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-869b51bf-bdaa-481b-9aa6-a39c001a7cb5 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212eddc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.346553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:18.347248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:18.348105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:18.348625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:18.349090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:18.363363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.364277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.364871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.367080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.367725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.368622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.404664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Getting quotas for project 7ec44846909047db88812217c7186c00. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:18.413707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Getting quotas for user 41512701df1940f28f63705f8fe20a21 and project 7ec44846909047db88812217c7186c00. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:18.444450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Going to run 2 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:52:18.446946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 39582507-c439-43ca-992e-621bd3b85232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:18.470480 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-869b51bf-bdaa-481b-9aa6-a39c001a7cb5 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.183298 Oct 17 12:52:18.471283 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 476/960] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:52:18 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:18.494602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.495392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:18.510989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.511753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.512518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.515502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.516149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.516817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.543098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=39582507-c439-43ca-992e-621bd3b85232,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:18.627978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-63c497cb-bf5d-4c9f-af3a-0bae21e762df tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826429 Oct 17 12:52:18.629418 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 485/961] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 12:52:18.634678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de11bc33-3ca1-4c90-ace3-ab20eaed937a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8214a0af0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.668803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:18.724346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:18.726879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:18.747885 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-affc536a-38be-4577-85c6-063a36c0fe6f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.275118 Oct 17 12:52:18.749558 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 477/962] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:18 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:18.761608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.777792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:18.778658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Searching by: {'deleted': False, 'project_id': '7ec44846909047db88812217c7186c00'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:52:18.817762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.821825 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de11bc33-3ca1-4c90-ace3-ab20eaed937a tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.190702 Oct 17 12:52:18.822567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 486/963] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:52:18 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:18.836030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.836755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.839866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.843379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.844701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.845940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.848049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:18.862316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.863017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.863422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.865627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.866110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.866587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.890889 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a28c4a97-0470-47c9-8817-cbb187e11e0f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.140001 Oct 17 12:52:18.894013 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 478/964] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 12:52:18 2022] GET /compute/v2.1/servers => generated 675 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:18.899185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:18.899805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:18.906904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.907857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.908815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:18.910478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:18.911258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:18.912309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.056613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:19.067619 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e7e0cbc-e294-4cb3-b5a9-821d5fc25a31 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.238657 Oct 17 12:52:19.082558 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 487/965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:18 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:19.089750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17a31d38-77ee-48f1-b455-da10bf2dd818 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa821249040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:19.189369 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-17a31d38-77ee-48f1-b455-da10bf2dd818 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.105488 Oct 17 12:52:19.201107 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 488/966] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:52:19 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:19.207347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:19.208151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:19.214818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.215665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.216330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.217326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.218000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.218664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.296791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:19.312623 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a4d4da29-d331-48bb-9e8b-f65296184ccb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1478 microversion: 2.1 time: 0.417050 Oct 17 12:52:19.327237 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 479/967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:18 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1478 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:19.327237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1df460e1-62be-48bf-9ac3-d9594c7e4ffc tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:19.327237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1df460e1-62be-48bf-9ac3-d9594c7e4ffc tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:19.399580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid 5a076fb2-b905-428e-8d88-e396a91a80c1 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:52:19.421185 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d7afebe-97b7-468f-a69c-edae8fc36496 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 2425 microversion: 2.25 time: 0.218825 Oct 17 12:52:19.435319 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 489/968] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:19 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 2425 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:19.446601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1df460e1-62be-48bf-9ac3-d9594c7e4ffc tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:19.450514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a72c767d-ec18-45d0-b194-376cd1d7aadb tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8211dac10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:19.452119 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1df460e1-62be-48bf-9ac3-d9594c7e4ffc tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1219 microversion: 2.1 time: 0.135962 Oct 17 12:52:19.453853 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 480/969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:19 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:19.460357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:19.461335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:19.467737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.468899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.469848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.470811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.471362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.471812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.604422 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a72c767d-ec18-45d0-b194-376cd1d7aadb tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-10-17T12%3A49%3A49Z" status: 200 len: 6328 microversion: 2.1 time: 0.166996 Oct 17 12:52:19.605628 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 490/970] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Oct 17 12:52:19 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-17T12%3A49%3A49Z => generated 6328 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:19.611467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853316-12", "block_migration": "auto"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:19.615463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:19.623630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.624895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.625525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.626486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.627372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.628190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.658972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'flavor' on Instance uuid 5a076fb2-b905-428e-8d88-e396a91a80c1 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:52:19.660344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:19.675152 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9355034e-1064-4294-bebf-42daa6c0f3b6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.219882 Oct 17 12:52:19.675909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Going to try to live migrate instance to n-h1-853316-12 {{(pid=127540) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 12:52:19.677147 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 481/971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:19 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:19.687095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fc2d9e8a-51e5-4132-b841-bc817d1385fc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820f26c10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:19.788496 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fc2d9e8a-51e5-4132-b841-bc817d1385fc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-727526239" status: 200 len: 664 microversion: 2.1 time: 0.107377 Oct 17 12:52:19.791149 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 482/972] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Oct 17 12:52:19 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-727526239 => generated 664 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:19.801575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-34de4e7d-8caa-4fc4-8885-665f1a0d0e1c req-15959e37-5bfb-4cba-a44d-f880ce6fcf64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f6b019-8c13-4d9a-a8cb-904f872a660e", "name": "network-vif-plugged", "status": "completed", "tag": "3bd1387b-ebdd-4269-a546-857402226506"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:19.815716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-34de4e7d-8caa-4fc4-8885-665f1a0d0e1c req-15959e37-5bfb-4cba-a44d-f880ce6fcf64 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.817943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-34de4e7d-8caa-4fc4-8885-665f1a0d0e1c req-15959e37-5bfb-4cba-a44d-f880ce6fcf64 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.818492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-34de4e7d-8caa-4fc4-8885-665f1a0d0e1c req-15959e37-5bfb-4cba-a44d-f880ce6fcf64 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.832765 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-34de4e7d-8caa-4fc4-8885-665f1a0d0e1c req-15959e37-5bfb-4cba-a44d-f880ce6fcf64 service nova] Creating event network-vif-plugged:3bd1387b-ebdd-4269-a546-857402226506 for instance 40f6b019-8c13-4d9a-a8cb-904f872a660e on n-h2-853316-12 Oct 17 12:52:19.839938 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-34de4e7d-8caa-4fc4-8885-665f1a0d0e1c req-15959e37-5bfb-4cba-a44d-f880ce6fcf64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046704 Oct 17 12:52:19.840750 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 483/973] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:19.846373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:19.848358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:19.879709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.881472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.882412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:19.884152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:19.884784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:19.885360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:20.030874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:20.042433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:20.043774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:20.053533 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6226c95c-6f35-4558-99b8-17927a9fdb15 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.211801 Oct 17 12:52:20.054527 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 484/974] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:19 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:20.059018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-343bf2cb-3a96-4bff-a8a8-113206410ee9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212f81f0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:20.222141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-343bf2cb-3a96-4bff-a8a8-113206410ee9 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fe1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1464 microversion: 2.1 time: 0.166410 Oct 17 12:52:20.233141 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 485/975] 10.222.0.27 () {58 vars in 1338 bytes} [Mon Oct 17 12:52:20 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fe1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:20.233141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:20.233141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:20.237058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:20.237855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:20.238682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:20.239391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:20.239840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:20.240258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:20.433529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:20.454437 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-85e04741-ff05-4ec2-8497-7bade73a1065 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.226598 Oct 17 12:52:20.455309 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 486/976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:20 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:20.461253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-773dbc69-4aa7-488e-b2a1-7e87f0c66c95 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa82323ff70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:20.544331 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-773dbc69-4aa7-488e-b2a1-7e87f0c66c95 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fe1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1464 microversion: 2.1 time: 0.087957 Oct 17 12:52:20.547152 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 487/977] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Oct 17 12:52:20 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fe1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1464 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:20.553024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:20.563418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:20.570930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:20.571512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:20.572020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:20.572740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:20.573199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:20.573631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:20.714212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:20.724809 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-63e5e4bd-e087-4069-97b1-d42a5039c1c7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1478 microversion: 2.1 time: 0.176266 Oct 17 12:52:20.725937 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 488/978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:20 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1478 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:20.731020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:20.731801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:20.739653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:20.740390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:20.741152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:20.742094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:20.742578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:20.743012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:20.817959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:20.835410 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9fd05b30-4e38-44a5-8640-5f4cbdcd53c1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1271 microversion: 2.1 time: 0.108091 Oct 17 12:52:20.836403 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 489/979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:20 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:20.846290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ea494fd-ca4d-4c50-a990-575d08a46b96 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820fb1a60>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:20.993366 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ea494fd-ca4d-4c50-a990-575d08a46b96 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.153636 Oct 17 12:52:21.009722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 490/980] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 17 12:52:20 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:21.016071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:21.016531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:21.024561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:21.025495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:21.025622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:21.026512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:21.027056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:21.027549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:21.306265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:21.318543 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6a2f1ff5-d4f5-46f6-9669-445be82999ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1316 microversion: 2.1 time: 0.306917 Oct 17 12:52:21.320204 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 491/981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:21 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:21.325757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be235600-c773-4fb6-8d4a-012df06d8385 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8210a6e50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:21.436811 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be235600-c773-4fb6-8d4a-012df06d8385 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.115321 Oct 17 12:52:21.437417 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 492/982] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 17 12:52:21 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:21.443609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:21.454963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:21.463068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:21.463554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:21.464154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:21.465033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:21.466321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:21.466798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:21.598886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:21.627693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:21.630029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:21.642115 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ce533112-659c-43f1-b430-5c00c3d3a954 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.202638 Oct 17 12:52:21.642738 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 493/983] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:21 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:21.649938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68c4af63-8f9d-4b66-b1de-97ae8e4a8bc5 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212edc10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:21.725529 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68c4af63-8f9d-4b66-b1de-97ae8e4a8bc5 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/c0b8bbed-67fa-4bc6-93c9-ab1f864c501f" status: 200 len: 784 microversion: 2.1 time: 0.081416 Oct 17 12:52:21.726777 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 494/984] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:21 2022] GET /compute/v2.1/images/c0b8bbed-67fa-4bc6-93c9-ab1f864c501f => generated 784 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:21.740780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:21.741411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:21.754517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:21.755891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:21.756619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:21.757975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:21.758611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:21.759719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.102454 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9cd15ee4-848d-4d14-b9de-7fb070ec5261 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/action" status: 202 len: 0 microversion: 2.25 time: 2.495247 Oct 17 12:52:22.103904 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 491/985] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:52:19 2022] POST /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/action => generated 0 bytes in 2497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:22.116628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-569b9e46-b78e-4a8d-9f42-1c938dd4856f tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820f1d820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:22.155782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:22.172625 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-809cc27f-efde-4818-b773-d69628a8a64b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.444345 Oct 17 12:52:22.190186 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 495/986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:21 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:22.190186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:22.190186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:22.215697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.216872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.217006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.219372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.231913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.232902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.234835 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-569b9e46-b78e-4a8d-9f42-1c938dd4856f tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.126381 Oct 17 12:52:22.242334 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 492/987] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:52:22 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:22.270720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:22.271803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:22.289156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.291463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.294199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.295706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.296198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.296638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.392377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:22.411014 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-23477518-8060-4bbf-98fc-e26a68a77d22 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1277 microversion: 2.1 time: 0.165038 Oct 17 12:52:22.411603 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 493/988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:22 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:22.418493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3ee99b32-b4c8-4f45-8eab-c7f3ed48d984 req-63d7be4a-3c87-4f30-a225-a1d27e7ca1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652645b9-e4bb-48f1-be51-e9483a163116", "name": "network-vif-unplugged", "status": "completed", "tag": "29f3ca43-09a3-4d2b-9a04-d9d3003b14d2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:22.432251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3ee99b32-b4c8-4f45-8eab-c7f3ed48d984 req-63d7be4a-3c87-4f30-a225-a1d27e7ca1c0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.432966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3ee99b32-b4c8-4f45-8eab-c7f3ed48d984 req-63d7be4a-3c87-4f30-a225-a1d27e7ca1c0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.434458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3ee99b32-b4c8-4f45-8eab-c7f3ed48d984 req-63d7be4a-3c87-4f30-a225-a1d27e7ca1c0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.462999 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3ee99b32-b4c8-4f45-8eab-c7f3ed48d984 req-63d7be4a-3c87-4f30-a225-a1d27e7ca1c0 service nova] Creating event network-vif-unplugged:29f3ca43-09a3-4d2b-9a04-d9d3003b14d2 for instance 652645b9-e4bb-48f1-be51-e9483a163116 on n-h1-853316-12 Oct 17 12:52:22.468704 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3ee99b32-b4c8-4f45-8eab-c7f3ed48d984 req-63d7be4a-3c87-4f30-a225-a1d27e7ca1c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055828 Oct 17 12:52:22.469407 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 494/989] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:22.487286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:22.488636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:22.497518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.498014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.498493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.499264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.499664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.500093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.517074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:22.721207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:22.733711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:22.735637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:22.737406 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11820d7e-bff5-41d2-be84-44525f3a09b2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.266781 Oct 17 12:52:22.739020 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 495/990] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:22 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:22.752084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-42cac060-81b8-481b-b4fe-6906dff60c34 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820f4fca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:22.787656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:22.790251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:22.798650 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-60963a04-b4cb-4755-ba07-0fd6ef55fe08 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1478 microversion: 2.1 time: 0.618396 Oct 17 12:52:22.799329 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 496/991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:22 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1478 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:22.819226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:22.819904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:22.832732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.833593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.835066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:22.836042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:22.836779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:22.837655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:23.297711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:23.308599 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-796defaa-6752-4f61-8397-a3115f38ee4e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1504 microversion: 2.1 time: 0.507340 Oct 17 12:52:23.310217 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 497/992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:22 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1504 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:23.315490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:23.319173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:23.331767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:23.341209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:23.341849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:23.342766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:23.343315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:23.343811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:23.542719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:23.554275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:23.555756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:23.572004 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-362a90e4-2bb8-4ec4-b585-f3b256995934 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.258897 Oct 17 12:52:23.572627 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 498/993] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:23 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:23.599061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:23.599746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:23.606109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:23.606642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:23.607085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:23.607806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:23.608261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:23.608696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:23.653500 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-42cac060-81b8-481b-b4fe-6906dff60c34 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "DELETE /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61" status: 204 len: 0 microversion: 2.1 time: 0.913247 Oct 17 12:52:23.657312 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 496/994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:22 2022] DELETE /compute/v2.1/images/13547126-0abe-443b-acb9-29d2cd473e61 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:23.663094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-6825240"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:23.663696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:23.674668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:23.676033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:23.676637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:23.677536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:23.678323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:23.679228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:23.860415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.network.security_group_api [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Adding security group 385fa152-dac0-4f5e-9183-a64e6b4d6527 to port 3bd1387b-ebdd-4269-a546-857402226506 Oct 17 12:52:24.208362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:24.224042 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad8e68bc-befa-497a-a313-498ac358f44a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.633959 Oct 17 12:52:24.227897 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 499/995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:23 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:24.234005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:24.235186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:24.265756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:24.266282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:24.266902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:24.275807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:24.276351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:24.276760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:24.306418 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56f3ad58-2034-432a-8d7e-a8cf5baea714 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e/action" status: 202 len: 0 microversion: 2.1 time: 0.647315 Oct 17 12:52:24.307039 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 497/996] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:52:23 2022] POST /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:52:24.325519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-27e5edb6-f089-4fe8-892a-446d830f4061 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820f4fc10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:24.832899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:24.844652 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f9faf25-9963-4290-a931-cf800ff700e6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.615085 Oct 17 12:52:24.846002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 500/997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:24 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:24.853919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:24.854854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:24.862704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:24.863441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:24.864685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:24.865740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:24.866489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:24.867288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:24.925514 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-27e5edb6-f089-4fe8-892a-446d830f4061 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "DELETE /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0" status: 204 len: 0 microversion: 2.1 time: 0.607370 Oct 17 12:52:24.926124 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 498/998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:24 2022] DELETE /compute/v2.1/images/0a51406f-89be-4763-99b3-b1de90017ab0 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:24.932791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:24.933406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:24.939870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:24.940366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:24.941440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:24.942443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:24.943141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:24.944053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:25.096515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:25.104856 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-380dc1eb-58ed-47b0-9efe-723ef9f681de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1478 microversion: 2.1 time: 0.177448 Oct 17 12:52:25.105425 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 499/999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:24 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1478 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:25.110454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2142765206"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:25.110988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:25.117641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:25.118369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:25.118953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:25.119933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:25.120490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:25.120981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:25.269000 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.network.security_group_api [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Adding security group cf870153-5e69-4b05-a72d-6b42d1dabb7d to port 3bd1387b-ebdd-4269-a546-857402226506 Oct 17 12:52:25.307598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:25.320682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:25.323381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:25.325229 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7d441715-50ad-4871-8075-5171bf6f1648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.477896 Oct 17 12:52:25.326231 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 501/1000] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:24 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:25.330967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-74b340d6-6492-4540-9a79-159ec97fc127 req-32d33ce7-916f-48bd-b9d9-eb434188a7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f6b019-8c13-4d9a-a8cb-904f872a660e", "tag": "3bd1387b-ebdd-4269-a546-857402226506"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:25.341548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-74b340d6-6492-4540-9a79-159ec97fc127 req-32d33ce7-916f-48bd-b9d9-eb434188a7e6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:25.342359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-74b340d6-6492-4540-9a79-159ec97fc127 req-32d33ce7-916f-48bd-b9d9-eb434188a7e6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:25.343193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-74b340d6-6492-4540-9a79-159ec97fc127 req-32d33ce7-916f-48bd-b9d9-eb434188a7e6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:25.357100 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-74b340d6-6492-4540-9a79-159ec97fc127 req-32d33ce7-916f-48bd-b9d9-eb434188a7e6 service nova] Creating event network-changed:3bd1387b-ebdd-4269-a546-857402226506 for instance 40f6b019-8c13-4d9a-a8cb-904f872a660e on n-h2-853316-12 Oct 17 12:52:25.365965 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-74b340d6-6492-4540-9a79-159ec97fc127 req-32d33ce7-916f-48bd-b9d9-eb434188a7e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038306 Oct 17 12:52:25.366697 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 502/1001] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:25.372129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7d870819-369d-4fd9-b51d-a2cc2130faee req-cb632bd0-96cf-46f5-be12-098f4692bb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c0e4db-6bcf-4518-be71-cb588bcf1c91", "name": "network-vif-plugged", "status": "completed", "tag": "6fde0fbd-1445-4000-9256-6e3c3be90e06"}, {"server_uuid": "069204c4-71a6-4acd-92cd-c454ac2d1171", "name": "network-vif-plugged", "status": "completed", "tag": "044e72ed-f732-475b-96fc-c6377eaa29cd"}, {"server_uuid": "d7f35cc1-58d6-4894-af02-7db8eefeb420", "name": "network-vif-plugged", "status": "completed", "tag": "9a19bdb4-6892-4689-af82-3c465058331f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:25.386731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d870819-369d-4fd9-b51d-a2cc2130faee req-cb632bd0-96cf-46f5-be12-098f4692bb4a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:25.387537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d870819-369d-4fd9-b51d-a2cc2130faee req-cb632bd0-96cf-46f5-be12-098f4692bb4a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:25.388120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d870819-369d-4fd9-b51d-a2cc2130faee req-cb632bd0-96cf-46f5-be12-098f4692bb4a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:25.404846 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7d870819-369d-4fd9-b51d-a2cc2130faee req-cb632bd0-96cf-46f5-be12-098f4692bb4a service nova] Creating event network-vif-plugged:6fde0fbd-1445-4000-9256-6e3c3be90e06 for instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 on n-h2-853316-12 Oct 17 12:52:25.405377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7d870819-369d-4fd9-b51d-a2cc2130faee req-cb632bd0-96cf-46f5-be12-098f4692bb4a service nova] Creating event network-vif-plugged:044e72ed-f732-475b-96fc-c6377eaa29cd for instance 069204c4-71a6-4acd-92cd-c454ac2d1171 on n-h2-853316-12 Oct 17 12:52:25.406007 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7d870819-369d-4fd9-b51d-a2cc2130faee req-cb632bd0-96cf-46f5-be12-098f4692bb4a service nova] Creating event network-vif-plugged:9a19bdb4-6892-4689-af82-3c465058331f for instance d7f35cc1-58d6-4894-af02-7db8eefeb420 on n-h1-853316-12 Oct 17 12:52:25.419094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7d870819-369d-4fd9-b51d-a2cc2130faee req-cb632bd0-96cf-46f5-be12-098f4692bb4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050176 Oct 17 12:52:25.419703 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 503/1002] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:25.427306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:25.441106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:25.462644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:25.468048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:25.469061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:25.470318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:25.471001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:25.471496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:25.745931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:25.756268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:25.757984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:25.763656 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ed36a60f-cb1d-4f9c-89d0-e9005cc406e8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.342547 Oct 17 12:52:25.782601 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 504/1003] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:25 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:25.791345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0d2f3ff2-4c92-4219-a748-0b90ab3dc2a0 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820fb1d30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:26.346009 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d16d0b6b-4d9e-41f7-a8cd-8f2bc33b55bd tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e/action" status: 202 len: 0 microversion: 2.1 time: 1.239371 Oct 17 12:52:26.349033 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 500/1004] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:52:25 2022] POST /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e/action => generated 0 bytes in 1243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:52:26.355974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:26.356789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:26.375950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.379880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.380547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.381883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.383706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.385324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.470073 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0d2f3ff2-4c92-4219-a748-0b90ab3dc2a0 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "DELETE /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4" status: 204 len: 0 microversion: 2.1 time: 0.685130 Oct 17 12:52:26.471325 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 505/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:25 2022] DELETE /compute/v2.1/images/04bbd28e-cf9c-425f-9a75-41d7e52bf7d4 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:26.478109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:26.478889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:26.505140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.506085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.508261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.511591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.512735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.514967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.639798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:26.650429 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3365af44-e11a-4b07-822b-b0c333e1ca8c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1319 microversion: 2.1 time: 0.299952 Oct 17 12:52:26.651673 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 501/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:26 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:26.670658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:26.672000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:26.676848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:26.681075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.682096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.683086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.684091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.684708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.685316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.830574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:26.845800 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-821c7ac3-7c7b-47aa-8625-2a16a3147f35 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.369199 Oct 17 12:52:26.846642 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 506/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:26 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:26.859618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:26.864857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:26.865040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:26.874424 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9a1dda1f-417f-469f-baaa-f4acb6541d78 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1478 microversion: 2.1 time: 0.221189 Oct 17 12:52:26.875351 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 502/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:26 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1478 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:26.880715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:26.880914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.881200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:26.881735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.882406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.885336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.886098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.886711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.888426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.889560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.890009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:26.891561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:26.892028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:26.893196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.126131 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f65d8c5c-f164-4992-aedb-ddde6fdd9ed2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.249682 Oct 17 12:52:27.128604 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 503/1009] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 17 12:52:26 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e/os-security-groups => generated 1155 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:27.140770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:27.147378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:27.147989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:27.155272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:27.156593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.157138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.157278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:27.157934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.158461 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74873d62-4fee-42b4-bd0f-4d54eec6bc48 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.310632 Oct 17 12:52:27.159163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.159284 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 507/1010] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:26 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:27.160030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.161687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.184284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b60324f5-3bda-4962-8b21-d3132f21b049 req-1e7c32ba-3217-496b-9dd0-157e5ba32391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39582507-c439-43ca-992e-621bd3b85232", "tag": "03eb1e0c-ef96-4ec2-8985-3c92af43c535"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:27.196345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b60324f5-3bda-4962-8b21-d3132f21b049 req-1e7c32ba-3217-496b-9dd0-157e5ba32391 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.197104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b60324f5-3bda-4962-8b21-d3132f21b049 req-1e7c32ba-3217-496b-9dd0-157e5ba32391 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.197544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b60324f5-3bda-4962-8b21-d3132f21b049 req-1e7c32ba-3217-496b-9dd0-157e5ba32391 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.199840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:52:27.215769 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b60324f5-3bda-4962-8b21-d3132f21b049 req-1e7c32ba-3217-496b-9dd0-157e5ba32391 service nova] Creating event network-changed:03eb1e0c-ef96-4ec2-8985-3c92af43c535 for instance 39582507-c439-43ca-992e-621bd3b85232 on n-h1-853316-12 Oct 17 12:52:27.231603 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b60324f5-3bda-4962-8b21-d3132f21b049 req-1e7c32ba-3217-496b-9dd0-157e5ba32391 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063616 Oct 17 12:52:27.232341 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 508/1011] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:27.239138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:27.240138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:27.246451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.246942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.247397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.248084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.248752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.249238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.307151 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ecaa1d9f-c053-4bbf-bacc-d928b78397b7 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 204 len: 0 microversion: 2.1 time: 0.176628 Oct 17 12:52:27.308007 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 504/1012] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:52:27 2022] DELETE /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:27.320538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54193cea-e2a6-4145-825b-4e9e78b2cd3a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa821244d30>, body: {"security_group": {"name": " tempest-securitygroup -265561866 ", "description": "tempest-description-1808433342"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:27.341656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:27.351472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:27.353229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:27.359628 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb3d778e-cb9c-4fe8-b2c1-4b698176d407 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.125869 Oct 17 12:52:27.360922 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 509/1013] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:27 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:27.365973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:27.367583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:27.373794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.374770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.375380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.376248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.376873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.377340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.531226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:27.543865 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ea15f1d3-a345-4f3e-9c00-f1cc88f09df4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1473 microversion: 2.1 time: 0.181345 Oct 17 12:52:27.562142 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 510/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:27 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1473 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:27.566763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4a78411c-4dea-4e4f-8708-e3001adf9858 req-e56a96f7-f325-411e-b61b-0ac8a686a3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f6b019-8c13-4d9a-a8cb-904f872a660e", "tag": "3bd1387b-ebdd-4269-a546-857402226506"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:27.579891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4a78411c-4dea-4e4f-8708-e3001adf9858 req-e56a96f7-f325-411e-b61b-0ac8a686a3e5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.580454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4a78411c-4dea-4e4f-8708-e3001adf9858 req-e56a96f7-f325-411e-b61b-0ac8a686a3e5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.580898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4a78411c-4dea-4e4f-8708-e3001adf9858 req-e56a96f7-f325-411e-b61b-0ac8a686a3e5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.595092 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4a78411c-4dea-4e4f-8708-e3001adf9858 req-e56a96f7-f325-411e-b61b-0ac8a686a3e5 service nova] Creating event network-changed:3bd1387b-ebdd-4269-a546-857402226506 for instance 40f6b019-8c13-4d9a-a8cb-904f872a660e on n-h2-853316-12 Oct 17 12:52:27.601396 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4a78411c-4dea-4e4f-8708-e3001adf9858 req-e56a96f7-f325-411e-b61b-0ac8a686a3e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042165 Oct 17 12:52:27.602376 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 511/1015] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:27.611770 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-54193cea-e2a6-4145-825b-4e9e78b2cd3a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.297976 Oct 17 12:52:27.613460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 505/1016] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:52:27 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:27.627478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-239cbaae-a860-47bd-8350-86617afe722e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa82138c940>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:27.675009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:27.676044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:27.680473 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-239cbaae-a860-47bd-8350-86617afe722e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1" status: 200 len: 223 microversion: 2.1 time: 0.057468 Oct 17 12:52:27.681383 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 512/1017] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 12:52:27 2022] GET /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1 => generated 223 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:27.683851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.684409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.684914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.685972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.686558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.687079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.694679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-326f3398-dba1-49c1-9da9-3c60353a9414 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa82323ff70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:27.837780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:27.846054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-34b2190c-d827-4e19-acc9-f3f098dca4cc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1469 microversion: 2.1 time: 0.174908 Oct 17 12:52:27.850207 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 506/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:27 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:27.869131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:27.869741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:27.875868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.876586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.877420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.878855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.879530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.880198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.896157 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-326f3398-dba1-49c1-9da9-3c60353a9414 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1" status: 202 len: 0 microversion: 2.1 time: 0.205829 Oct 17 12:52:27.896955 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 513/1019] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:52:27 2022] DELETE /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:52:27.903007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:27.903909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:27.911702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.912418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.913089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:27.913957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:27.914607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:27.915187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:28.042576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:28.052205 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7ba01986-0ae4-4305-a78d-68e9493885c3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 200 len: 1319 microversion: 2.1 time: 0.186785 Oct 17 12:52:28.067456 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 507/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:27 2022] GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:28.075286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:28.075913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:28.076198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:28.084095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:28.084592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:28.085032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:28.085318 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ca5129b3-05d4-4c18-8088-353dfeb1539e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.187172 Oct 17 12:52:28.085738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:28.097719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:28.097719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:28.097988 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 514/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:27 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:28.105678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a3ee410-1236-451c-bfc8-f99fac6a34c8 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820f26b80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:28.135920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-1a3ee410-1236-451c-bfc8-f99fac6a34c8 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:52:28.136622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.security_group_api [None req-1a3ee410-1236-451c-bfc8-f99fac6a34c8 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 not found {{(pid=127539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:52:28.137169 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1a3ee410-1236-451c-bfc8-f99fac6a34c8 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:52:28.137169 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-22e146af-d6e3-4c9e-ad72-17164bb37383'] Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a3ee410-1236-451c-bfc8-f99fac6a34c8 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1 HTTP/1.1 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-22e146af-d6e3-4c9e-ad72-17164bb37383'] Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'feb4bc6a-b772-4fe5-9e9e-65578c9459d1'} Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:52:28.142012 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e146af-d6e3-4c9e-ad72-17164bb37383'] Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e146af-d6e3-4c9e-ad72-17164bb37383'] Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e146af-d6e3-4c9e-ad72-17164bb37383'] Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e146af-d6e3-4c9e-ad72-17164bb37383'] Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a3ee410-1236-451c-bfc8-f99fac6a34c8 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-22e146af-d6e3-4c9e-ad72-17164bb37383'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a3ee410-1236-451c-bfc8-f99fac6a34c8 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1" status: 404 len: 194 microversion: 2.1 time: 0.052482 Oct 17 12:52:28.146580 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 515/1022] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 12:52:28 2022] GET /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:52:28.155622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d0af8b6-8c2c-416e-9f84-be93152dce3c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa820e1eee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2071569978", "description": "tempest-description-820078077"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:28.383640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:28.422413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:28.433349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:28.455123 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d0af8b6-8c2c-416e-9f84-be93152dce3c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.304148 Oct 17 12:52:28.458629 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 516/1023] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:52:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:28.467382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:28.469962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:28.472415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-641b957a-e8ba-4500-bc8f-0f5ba896b3d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1478 microversion: 2.1 time: 0.399939 Oct 17 12:52:28.474528 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 508/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:28 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1478 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:28.484905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:28.485936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:28.492948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:28.493841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:28.494042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:28.494767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:28.495837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:28.496613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:28.496806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:28.497254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:28.497599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:28.497953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:28.498777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:28.499532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:28.500096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:28.612650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:28.625209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:28.627433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:28.643714 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72671d84-843f-41d4-98e5-f47be18a2513 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.167569 Oct 17 12:52:28.650273 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 509/1025] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:28 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:28.667903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c39e2792-b20d-451e-b8d0-08e0ed2a74df tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa8212ab5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1672502765", "description": "tempest-description-2132124164"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:28.855407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:28.947778 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c39e2792-b20d-451e-b8d0-08e0ed2a74df tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.295559 Oct 17 12:52:28.948628 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 510/1026] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:52:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:28.953954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:28.954641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:28.962883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:28.964069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:28.964543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:28.965606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:28.966413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:28.966856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:29.200431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:29.212154 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-351dbc7c-d38d-4b64-a38c-a49d9af1edde tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1473 microversion: 2.1 time: 0.262376 Oct 17 12:52:29.227049 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 511/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:28 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1473 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:29.233961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86471ebf-f14c-4709-ab1a-446b60dd7c85 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa82137a9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1626980397", "description": "tempest-description-158796545"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:29.235556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:29.245565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:29.247364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:29.248789 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a0a45ab3-390e-49a6-93fb-a365fefcfe5f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.788772 Oct 17 12:52:29.262748 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 517/1028] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:28 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:29.275391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:29.276916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:29.283961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:29.285251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:29.286387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:29.287412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:29.288197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:29.289059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:29.448198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:29.560225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:29.570977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86471ebf-f14c-4709-ab1a-446b60dd7c85 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.345075 Oct 17 12:52:29.572473 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 512/1029] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:52:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:29.579355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:29.580331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:29.584273 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-33158971-8f91-4ca5-b320-35a1eba9195f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 200 len: 1468 microversion: 2.1 time: 0.319920 Oct 17 12:52:29.584867 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 518/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:29 2022] GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 1468 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:29.589513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fd38cfa3-85fd-4316-9160-757320ad106d req-69c280c5-a39d-45a4-aebe-64cbed1abea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb60687-e9bc-4dd8-8021-5fa3e12b8224", "tag": "2d6270fb-9cfa-49e4-a711-7bf73af0af63"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:29.595404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:29.596191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:29.596838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:29.597727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:29.599354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:29.600036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:29.608344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd38cfa3-85fd-4316-9160-757320ad106d req-69c280c5-a39d-45a4-aebe-64cbed1abea6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:29.609057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd38cfa3-85fd-4316-9160-757320ad106d req-69c280c5-a39d-45a4-aebe-64cbed1abea6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:29.609753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd38cfa3-85fd-4316-9160-757320ad106d req-69c280c5-a39d-45a4-aebe-64cbed1abea6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:29.623091 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fd38cfa3-85fd-4316-9160-757320ad106d req-69c280c5-a39d-45a4-aebe-64cbed1abea6 service nova] Creating event network-changed:2d6270fb-9cfa-49e4-a711-7bf73af0af63 for instance bcb60687-e9bc-4dd8-8021-5fa3e12b8224 on n-h2-853316-12 Oct 17 12:52:29.629641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fd38cfa3-85fd-4316-9160-757320ad106d req-69c280c5-a39d-45a4-aebe-64cbed1abea6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043391 Oct 17 12:52:29.630807 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 519/1031] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:29.635916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:29.636785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:29.643181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:29.644409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:29.645647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:29.646548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:29.647155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:29.647732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:29.770388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:29.778952 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-80822f2e-c2c0-4a48-8005-a05afdc9717b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.204777 Oct 17 12:52:29.793216 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 513/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:29 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:29.793216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-10210b07-f430-49e8-ae98-ea0e5e9132ef tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa82154e550>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.004069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.011909 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-10210b07-f430-49e8-ae98-ea0e5e9132ef tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.230602 Oct 17 12:52:30.012289 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 514/1033] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:52:29 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:30.017097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.018075 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4082bce7-ed83-4d80-9038-3488b29d04ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1464 microversion: 2.1 time: 0.385219 Oct 17 12:52:30.019446 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 520/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:29 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1464 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:30.024206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.025049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Searching by: {'reservation_id': 'r-kzpmvv0o', 'deleted': False, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:52:30.027394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.028346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:30.031173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.032140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.032140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.032994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.033521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.034016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.038039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.039388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.040187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.041413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.042112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.042716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.189342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:52:30.191264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.199604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:30.210007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.213455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.222649 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a751e630-b24c-480c-abff-48bb421e46a1 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.201241 Oct 17 12:52:30.223690 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 521/1035] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:30 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:30.229768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71c9075e-447e-47bf-9218-067db5301a25 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820dd9160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.275681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.283029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.283508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.284016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.445616 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe512ca9-d10c-4d47-be5d-9fcff065c533 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-kzpmvv0o" status: 200 len: 2930 microversion: 2.1 time: 0.432121 Oct 17 12:52:30.479294 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 515/1036] 10.222.0.27 () {58 vars in 1197 bytes} [Mon Oct 17 12:52:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-kzpmvv0o => generated 2930 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:30.501196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.504767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:30.527113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.527961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.528561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.529523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.530775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.531345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.633680 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71c9075e-447e-47bf-9218-067db5301a25 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/01990610-2d88-4951-bdc3-9ad1beb46650" status: 202 len: 0 microversion: 2.1 time: 0.407946 Oct 17 12:52:30.634305 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 522/1037] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:52:30 2022] DELETE /compute/v2.1/os-security-groups/01990610-2d88-4951-bdc3-9ad1beb46650 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:52:30.642584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.643196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:30.660685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.661363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.661811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.663104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.663573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.664210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.730370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.732846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:30.742953 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e42dba40-83c2-4a57-94dd-3d6e809e4d41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1464 microversion: 2.1 time: 0.262306 Oct 17 12:52:30.743746 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 516/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:30 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:30.748478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.749237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:30.756638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.757500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.758102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.758997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.759600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.760356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.770577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.781063 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31486eea-9420-4308-bf37-ba9c549ee930 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1431 microversion: 2.1 time: 0.145717 Oct 17 12:52:30.782423 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 523/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:30 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1431 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:30.789558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad0d77da-38d5-4255-830a-9a83998a81f9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.822596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.compute.server_groups [None req-ad0d77da-38d5-4255-830a-9a83998a81f9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Querying cell 77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) for 2 instances {{(pid=127539) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 12:52:30.823752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad0d77da-38d5-4255-830a-9a83998a81f9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.824868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad0d77da-38d5-4255-830a-9a83998a81f9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.825463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad0d77da-38d5-4255-830a-9a83998a81f9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.870997 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad0d77da-38d5-4255-830a-9a83998a81f9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/8d633d19-155c-46b7-9ed4-0198b3f57b6e" status: 200 len: 266 microversion: 2.1 time: 0.087431 Oct 17 12:52:30.872158 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 524/1040] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:52:30 2022] GET /compute/v2.1/os-server-groups/8d633d19-155c-46b7-9ed4-0198b3f57b6e => generated 266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:30.876953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-592b814a-4fe6-4af7-a22c-98a101cef74e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa821423d30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:30.937252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-592b814a-4fe6-4af7-a22c-98a101cef74e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:52:30.937901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.security_group_api [None req-592b814a-4fe6-4af7-a22c-98a101cef74e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group 01990610-2d88-4951-bdc3-9ad1beb46650 not found {{(pid=127539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:52:30.938483 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-592b814a-4fe6-4af7-a22c-98a101cef74e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:52:30.938483 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-23ab3450-c12c-4a27-b263-4610b0f61b83'] Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-592b814a-4fe6-4af7-a22c-98a101cef74e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-security-groups/01990610-2d88-4951-bdc3-9ad1beb46650 HTTP/1.1 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-23ab3450-c12c-4a27-b263-4610b0f61b83'] Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '01990610-2d88-4951-bdc3-9ad1beb46650'} Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:52:30.941988 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23ab3450-c12c-4a27-b263-4610b0f61b83'] Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23ab3450-c12c-4a27-b263-4610b0f61b83'] Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23ab3450-c12c-4a27-b263-4610b0f61b83'] Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23ab3450-c12c-4a27-b263-4610b0f61b83'] Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-592b814a-4fe6-4af7-a22c-98a101cef74e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-23ab3450-c12c-4a27-b263-4610b0f61b83'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-592b814a-4fe6-4af7-a22c-98a101cef74e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/01990610-2d88-4951-bdc3-9ad1beb46650" status: 404 len: 194 microversion: 2.1 time: 0.070435 Oct 17 12:52:30.945817 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 525/1041] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 12:52:30 2022] GET /compute/v2.1/os-security-groups/01990610-2d88-4951-bdc3-9ad1beb46650 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:52:30.956189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:30.960957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:30.967429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.967920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.968354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.969050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:30.969209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.969719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:30.969906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:30.989889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.991282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:30.992480 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ba6d8007-983f-4f4d-8960-98ec4630c835 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.247669 Oct 17 12:52:30.998303 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 517/1042] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:30 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:31.010023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.010633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:31.017499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.017997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.018499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.020509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.020509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.020509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.090336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:31.090912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:31.091204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:31.091606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:31.092010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:31.180479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:31.187591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.188300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.188891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.189783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.190413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.191903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.224452 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-36b836c6-8893-4162-84c4-ff76d98df5ac tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action" status: 202 len: 1068 microversion: 2.1 time: 0.275927 Oct 17 12:52:31.225093 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 526/1043] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:52:30 2022] POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action => generated 1068 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 12:52:31.232133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.232686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:31.240498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.240992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.241437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.242129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.242664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.243505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.281351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:31.292487 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-47adb213-2a83-47a4-9987-f02eb29c57bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.297903 Oct 17 12:52:31.306782 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 518/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:30 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:31.314763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4da77ea4-149f-4a54-8f1b-6ff6e5fdfe98 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa82120a700>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.412396 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4b0facec-541c-48d1-bb12-64f890ed936b tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 200 len: 1622 microversion: 2.1 time: 0.186236 Oct 17 12:52:31.413059 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 527/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:31 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 1622 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:31.417821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.418471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:31.424294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.424849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.425600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.426553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.427075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.427566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.509165 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4da77ea4-149f-4a54-8f1b-6ff6e5fdfe98 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9e250f21-2974-45e4-8a60-032e9d107f92" status: 202 len: 0 microversion: 2.1 time: 0.201086 Oct 17 12:52:31.511401 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 519/1046] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:52:31 2022] DELETE /compute/v2.1/os-security-groups/9e250f21-2974-45e4-8a60-032e9d107f92 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:52:31.516208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.516838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:31.528302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.529088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.529531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.530539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.530995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.531498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.577925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:31.586319 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68d5c5b1-5376-40ce-bb5c-3899e40bf37a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.172184 Oct 17 12:52:31.587068 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 528/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:31 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:31.591679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.592504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:31.599231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.599799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.600327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.601099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.601624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.602118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.615004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:31.623367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:31.624892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:31.630584 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b091f29e-a419-4681-aa88-4e139bca2599 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.118140 Oct 17 12:52:31.631148 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 520/1048] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:31 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:31.637315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc4cfe67-4362-411f-93c4-d6ad7c832f9a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820edb280>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.661372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-cc4cfe67-4362-411f-93c4-d6ad7c832f9a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:52:31.662097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-cc4cfe67-4362-411f-93c4-d6ad7c832f9a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group 9e250f21-2974-45e4-8a60-032e9d107f92 not found {{(pid=127540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:52:31.662757 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-cc4cfe67-4362-411f-93c4-d6ad7c832f9a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:52:31.662757 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-5998643e-c16b-4d17-afd9-e483bbea4baf'] Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc4cfe67-4362-411f-93c4-d6ad7c832f9a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-security-groups/9e250f21-2974-45e4-8a60-032e9d107f92 HTTP/1.1 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: exception: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-5998643e-c16b-4d17-afd9-e483bbea4baf'] Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9e250f21-2974-45e4-8a60-032e9d107f92'} Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:52:31.664852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5998643e-c16b-4d17-afd9-e483bbea4baf'] Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5998643e-c16b-4d17-afd9-e483bbea4baf'] Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5998643e-c16b-4d17-afd9-e483bbea4baf'] Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5998643e-c16b-4d17-afd9-e483bbea4baf'] Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc4cfe67-4362-411f-93c4-d6ad7c832f9a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-5998643e-c16b-4d17-afd9-e483bbea4baf'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc4cfe67-4362-411f-93c4-d6ad7c832f9a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/9e250f21-2974-45e4-8a60-032e9d107f92" status: 404 len: 194 microversion: 2.1 time: 0.034026 Oct 17 12:52:31.668848 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 521/1049] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 12:52:31 2022] GET /compute/v2.1/os-security-groups/9e250f21-2974-45e4-8a60-032e9d107f92 => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:52:31.674582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f96cc89-876d-45b2-ba7d-2e15417a5232 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820e3bf70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.740231 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f356b4a-dfac-4ea0-8084-07c70b6415e8 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 200 len: 1621 microversion: 2.1 time: 0.152048 Oct 17 12:52:31.740805 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 529/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:31 2022] GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 1621 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:31.745231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8de4cece-5acc-4639-9e96-137f60d58906 req-b7a51ab6-1ee5-4574-8f8d-2fad9f7e3201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1584fb0-8664-4fa6-8ef7-58b1107b78c2", "name": "network-vif-deleted", "tag": "14eafe5b-088e-4dfd-853c-16d4a0e15ed1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:31.755023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8de4cece-5acc-4639-9e96-137f60d58906 req-b7a51ab6-1ee5-4574-8f8d-2fad9f7e3201 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.755489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8de4cece-5acc-4639-9e96-137f60d58906 req-b7a51ab6-1ee5-4574-8f8d-2fad9f7e3201 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.755919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8de4cece-5acc-4639-9e96-137f60d58906 req-b7a51ab6-1ee5-4574-8f8d-2fad9f7e3201 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.767551 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8de4cece-5acc-4639-9e96-137f60d58906 req-b7a51ab6-1ee5-4574-8f8d-2fad9f7e3201 service nova] Creating event network-vif-deleted:14eafe5b-088e-4dfd-853c-16d4a0e15ed1 for instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 on n-h1-853316-12 Oct 17 12:52:31.773357 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8de4cece-5acc-4639-9e96-137f60d58906 req-b7a51ab6-1ee5-4574-8f8d-2fad9f7e3201 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031419 Oct 17 12:52:31.774122 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 530/1051] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:31.779281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c5ce5ec-1e4f-4033-a8f2-9610989fe44f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Action: 'create', calling method: .version_select at 0x7fa8212f8700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-597292424", "policies": ["anti-affinity"]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:31.796983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0c5ce5ec-1e4f-4033-a8f2-9610989fe44f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:31.801472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0c5ce5ec-1e4f-4033-a8f2-9610989fe44f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:31.847756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0c5ce5ec-1e4f-4033-a8f2-9610989fe44f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:31.851757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0c5ce5ec-1e4f-4033-a8f2-9610989fe44f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:31.864325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c5ce5ec-1e4f-4033-a8f2-9610989fe44f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.089172 Oct 17 12:52:31.864926 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 531/1052] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 17 12:52:31 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:31.874404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.875125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:31.882443 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f96cc89-876d-45b2-ba7d-2e15417a5232 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b2b077a3-d56b-4353-a775-cbaf61609c12" status: 202 len: 0 microversion: 2.1 time: 0.211248 Oct 17 12:52:31.886921 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 522/1053] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:52:31 2022] DELETE /compute/v2.1/os-security-groups/b2b077a3-d56b-4353-a775-cbaf61609c12 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:52:31.887061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.887894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.888048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.888768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:31.889258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:31.889743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:31.895030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8492efc2-1890-47b7-b2f1-ac2ee448b531 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820f259d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.921462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-8492efc2-1890-47b7-b2f1-ac2ee448b531 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:52:31.922271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-8492efc2-1890-47b7-b2f1-ac2ee448b531 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group b2b077a3-d56b-4353-a775-cbaf61609c12 not found {{(pid=127540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:52:31.923227 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8492efc2-1890-47b7-b2f1-ac2ee448b531 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:52:31.923227 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-3c05bae0-604c-4e58-b44d-8111acae97e2'] Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8492efc2-1890-47b7-b2f1-ac2ee448b531 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-security-groups/b2b077a3-d56b-4353-a775-cbaf61609c12 HTTP/1.1 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: exception: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-3c05bae0-604c-4e58-b44d-8111acae97e2'] Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b2b077a3-d56b-4353-a775-cbaf61609c12'} Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:52:31.926195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c05bae0-604c-4e58-b44d-8111acae97e2'] Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c05bae0-604c-4e58-b44d-8111acae97e2'] Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c05bae0-604c-4e58-b44d-8111acae97e2'] Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c05bae0-604c-4e58-b44d-8111acae97e2'] Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8492efc2-1890-47b7-b2f1-ac2ee448b531 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-3c05bae0-604c-4e58-b44d-8111acae97e2'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:31.930493 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8492efc2-1890-47b7-b2f1-ac2ee448b531 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/b2b077a3-d56b-4353-a775-cbaf61609c12" status: 404 len: 194 microversion: 2.1 time: 0.038167 Oct 17 12:52:31.934519 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 523/1054] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 12:52:31 2022] GET /compute/v2.1/os-security-groups/b2b077a3-d56b-4353-a775-cbaf61609c12 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:52:31.939972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e82f3264-174c-488d-9caa-508ab2d65f5c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa82120af70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:31.966987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:31.978047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d785f92c-d970-4014-88ab-17f4a23bad6c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1431 microversion: 2.1 time: 0.111237 Oct 17 12:52:31.979143 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 532/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:31 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1431 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:32.001367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-703400003", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ddd7d891-47fe-455e-a024-f1d9ae7bafb3"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:32.054618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:52:32.116844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e82f3264-174c-488d-9caa-508ab2d65f5c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.181267 Oct 17 12:52:32.117532 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 524/1056] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:52:31 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:32.122387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:32.122857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:32.130202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.130691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.131132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.131836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.132299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.132714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.262457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:32.271773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:32.272388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:32.272862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:32.273220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:32.273345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:32.273711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:32.274126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:32.274415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-37c2d95c-77c4-4b35-8f22-10b00fb652fa tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.155816 Oct 17 12:52:32.274972 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 525/1057] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:32 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:32.279788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a33ecd3-f1e8-4341-87a1-f6dc7340ec2e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa820edbca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1088477243", "description": "tempest-description-1409629"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:32.290502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.291347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.291884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.292715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.293240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.293855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.312317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:32.317096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:32.328755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Going to run 2 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:52:32.331244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: b7f172c4-86e8-4996-bbd3-70fbbd71f382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:32.384641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:32.390007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:32.428089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:32.432108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:32.432913 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a33ecd3-f1e8-4341-87a1-f6dc7340ec2e tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.156743 Oct 17 12:52:32.434014 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 526/1058] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:52:32 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:32.439073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:32.439708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:32.447035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.447767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.448431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.449483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.450055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:32.450212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.450843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.454683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=b7f172c4-86e8-4996-bbd3-70fbbd71f382,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:32.509248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:32.513003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:32.548984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:32.553390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'server_group_members'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:32.587710 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-29cea750-eb84-43d6-b200-cf357979a632 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.590214 Oct 17 12:52:32.588470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:32.588609 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 533/1059] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:52:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 17 12:52:32.593653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d999c80c-8597-4ccc-8022-37cdc2c3a732 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa820dd9ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-546223636", "description": "tempest-description-1022099875"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:32.598929 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d026d8c-2c0b-4e71-8d0b-8ee4935203f5 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.163864 Oct 17 12:52:32.599505 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 527/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:32 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:32.604552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:32.610410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:32.611376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Searching by: {'deleted': False, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:52:32.627135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.627621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.628054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.629075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.629537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.629966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.721999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:52:32.761818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d999c80c-8597-4ccc-8022-37cdc2c3a732 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.166378 Oct 17 12:52:32.763369 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 534/1061] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:52:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:32.771541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:32.776193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:32.792823 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1414808d-06ad-4140-ae0d-d490f3a9d702 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.191869 Oct 17 12:52:32.793920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 528/1062] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 12:52:32 2022] GET /compute/v2.1/servers => generated 1664 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:32.799210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:32.799820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:32.806605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.807104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.807544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.808259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.808713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.809139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.816104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.816912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.817514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.818251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:32.818860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:32.819877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:32.919886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:32.933017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:32.935647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:32.954807 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-606f4ce4-9695-42b9-96f6-0894f4097532 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.159172 Oct 17 12:52:32.955399 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 529/1063] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:32 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:32.963462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff688b24-f9d4-42d0-9fb7-0ab2ca8b69a2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:32.964168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff688b24-f9d4-42d0-9fb7-0ab2ca8b69a2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:33.016413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:33.030549 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a88b27e4-a363-42a5-b5e7-4444ed867c17 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.264580 Oct 17 12:52:33.032041 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 535/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:32 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:33.032532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff688b24-f9d4-42d0-9fb7-0ab2ca8b69a2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:33.039558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2135767822", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "5355c351-ce80-4ae7-8b31-a249fb6b4176"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:33.041438 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff688b24-f9d4-42d0-9fb7-0ab2ca8b69a2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1218 microversion: 2.1 time: 0.082123 Oct 17 12:52:33.044626 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 530/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:32 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:33.052091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:33.052698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:33.062683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:33.063194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:33.063619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:33.064377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:33.064770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:33.065336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:33.133520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] validate_networks() for [('5355c351-ce80-4ae7-8b31-a249fb6b4176', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:52:33.146152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:33.154489 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8870c15-3330-4d19-85ca-5e57015e4d11 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1431 microversion: 2.1 time: 0.108688 Oct 17 12:52:33.165124 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 531/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:33 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1431 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:33.301223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:33.301973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:33.308579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:33.309683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:33.310380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:33.311651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:33.312394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:33.313176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:33.504258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:33.516450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:33.521236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:33.526415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a6c59a4-fcd0-460f-91bd-24eaf51d7cd8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.229901 Oct 17 12:52:33.527004 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 532/1067] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:33 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:33.621820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:33.622543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:33.632472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:33.633031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:33.634384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:33.635722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:33.636208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:33.636944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:33.860614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:33.871011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f05f0d77-e9c0-4677-89c0-f0f57b7ab18d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.253811 Oct 17 12:52:33.872177 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 533/1068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:33 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:33.983952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:33.985569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:33.992633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:33.993119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:33.993579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:33.994314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:33.994762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:33.995182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.065948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:34.066520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:34.066880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:34.067298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:34.067715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:34.076750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.077095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.078020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.079091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.079765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.080354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.085779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.099640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.101128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.106524 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea3e1db3-59fb-477e-846a-8f15ad4df045 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.126630 Oct 17 12:52:34.119018 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 534/1069] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:33 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:34.120714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Getting quotas for project 2816d963beca40e6bafbbd722b005ea1. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:34.127165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Getting quotas for user 4958dd7065be4821bae0ff2033c5e72a and project 2816d963beca40e6bafbbd722b005ea1. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:34.132312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:34.133116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:34.140522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.141750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.142377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.142731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:52:34.143493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.144977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.145472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:34.145925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.209626 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2e071da-d442-4df6-8355-3c9a7892329a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176184 Oct 17 12:52:34.210720 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 536/1070] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:52:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:52:34.215496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:34.216782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:34.223970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.224581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.225028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.225735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.226239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.226675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.323224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.326609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.333484 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a713a321-2af0-423f-b57f-d7d20f2aab33 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1214 microversion: 2.1 time: 0.121494 Oct 17 12:52:34.336924 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e7fa0843-53d5-45a4-bafe-5cfe8a57c59e tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.216443 Oct 17 12:52:34.338382 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 537/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:34 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:34.345157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:34.345973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:34.349775 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 535/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:34 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:34.355958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.356674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.360894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3fc0c38c-010a-4efc-88bd-e533c401023f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:34.362214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3fc0c38c-010a-4efc-88bd-e533c401023f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:34.362715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.365709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.366617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.367762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.417433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.417925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.418397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.418924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lazy-loading 'fault' on Instance uuid e1584fb0-8664-4fa6-8ef7-58b1107b78c2 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:52:34.429307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3fc0c38c-010a-4efc-88bd-e533c401023f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.438895 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3fc0c38c-010a-4efc-88bd-e533c401023f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1216 microversion: 2.1 time: 0.087554 Oct 17 12:52:34.439679 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 536/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:34 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:34.475852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.484745 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-58f20786-386f-47a2-a155-4b08a0463cca tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 200 len: 1308 microversion: 2.1 time: 0.144531 Oct 17 12:52:34.485507 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 538/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:34 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:34.553618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:34.554378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:34.560573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.561389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.561926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.562721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.563180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.563607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.759896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.771515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.772987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:34.775558 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fccf5f21-a4ad-4be1-9241-3977f9a35af6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.226293 Oct 17 12:52:34.776333 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 537/1075] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:34 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:34.898591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:34.899703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:34.911087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.915315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.915963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:34.917295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:34.917764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:34.920198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.003160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-60ade0b1-37cd-4433-aaa9-5d2f5db08130 req-78294e75-340f-44d5-ad78-f1ce1cc2dd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb60687-e9bc-4dd8-8021-5fa3e12b8224", "name": "network-vif-plugged", "status": "completed", "tag": "2d6270fb-9cfa-49e4-a711-7bf73af0af63"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:35.019257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-60ade0b1-37cd-4433-aaa9-5d2f5db08130 req-78294e75-340f-44d5-ad78-f1ce1cc2dd54 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.020935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-60ade0b1-37cd-4433-aaa9-5d2f5db08130 req-78294e75-340f-44d5-ad78-f1ce1cc2dd54 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.021588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-60ade0b1-37cd-4433-aaa9-5d2f5db08130 req-78294e75-340f-44d5-ad78-f1ce1cc2dd54 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.051156 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-60ade0b1-37cd-4433-aaa9-5d2f5db08130 req-78294e75-340f-44d5-ad78-f1ce1cc2dd54 service nova] Creating event network-vif-plugged:2d6270fb-9cfa-49e4-a711-7bf73af0af63 for instance bcb60687-e9bc-4dd8-8021-5fa3e12b8224 on n-h2-853316-12 Oct 17 12:52:35.058078 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-60ade0b1-37cd-4433-aaa9-5d2f5db08130 req-78294e75-340f-44d5-ad78-f1ce1cc2dd54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059064 Oct 17 12:52:35.061695 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 538/1076] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:35.145405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:35.146656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:35.158054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.159071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.160129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.162258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.162906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.163527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.262561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:35.276736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:35.286141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be42b659-8859-497e-9a52-7a77c2ec03cb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.392926 Oct 17 12:52:35.288902 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 539/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:34 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:35.293088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:35.300020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:35.314463 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86e23f58-60e1-4e21-a6f8-f753b3cebb62 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.176445 Oct 17 12:52:35.315363 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 539/1078] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:35 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:35.363685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:35.363972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:35.364426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:35.364591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:35.373397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.373898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.374022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.374368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.375084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.375544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.375974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.377536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.380264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.381452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.383046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.384294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.470903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:35.484299 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6c415273-b0cf-4c3a-85ff-ce6bd94c0b81 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1270 microversion: 2.1 time: 0.124588 Oct 17 12:52:35.484984 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 540/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:35 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:35.490110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:35.491039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:35.499220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.500010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.500875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.501865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.502611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.503640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.531235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:35.540195 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0263bdbe-0957-4d19-a301-d3da3ecccae7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.180297 Oct 17 12:52:35.541016 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 540/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:35 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:35.546184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:35.546815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: e1584fb0-8664-4fa6-8ef7-58b1107b78c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:35.553568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.554383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.555013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.555938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.556767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.557255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.572253 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] HTTP exception thrown: Instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 could not be found. Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Request method failure captured: Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 HTTP/1.1 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU9sbRURpEgRvpwwrLqJ-Va7cuVBFsY_ukIQKA--khIXxm76uKt6pLx8DCSgudft7vYJdWZzprym91xCp7WhQdr9s3VK5niesq65kz8C9q2dUfP5l8NUm4yOtPXQiFrvP84aCVkbFoVRDnQvUJWlUPxdK5u6iVB6p8GUUvNCqohqr5o Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 6c080d0ac46242b190000e3b8726fe80 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListImageFiltersTestJSON-196858915 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c080d0ac46242b190000e3b8726fe80", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c080d0ac46242b190000e3b8726fe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c080d0ac46242b190000e3b8726fe80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c080d0ac46242b190000e3b8726fe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListImageFiltersTestJSON-196858915 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 6c080d0ac46242b190000e3b8726fe80 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-196858915 Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListImageFiltersTestJSON-196858915-project Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 39934c0a585849b4bef5f4ae8cf4a49e Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListImageFiltersTestJSON-196858915-project Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 could not be found. Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e1584fb0-8664-4fa6-8ef7-58b1107b78c2'} Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 could not be found. Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 could not be found. Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:35.573901 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 could not be found. Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Returning 404 to user: Instance e1584fb0-8664-4fa6-8ef7-58b1107b78c2 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91077cc2-edba-4326-ac5e-b50488635be4 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2" status: 404 len: 111 microversion: 2.1 time: 0.033252 Oct 17 12:52:35.577988 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 541/1081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:35 2022] GET /compute/v2.1/servers/e1584fb0-8664-4fa6-8ef7-58b1107b78c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:52:35.587351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:35.588169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:35.589174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:35.594844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.595339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.595775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.596477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.597130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.597642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.600514 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb7b5c51-d044-4292-a17a-508dd0a4edd3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1268 microversion: 2.1 time: 0.114187 Oct 17 12:52:35.602385 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 541/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:35 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1268 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:35.645964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:35.660925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:52:35.788220 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31d7dd2d-86b1-4a2b-bb71-20ba0c12cd9c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "DELETE /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 204 len: 0 microversion: 2.1 time: 0.204661 Oct 17 12:52:35.792079 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 542/1083] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:52:35 2022] DELETE /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:52:35.797351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:35.798195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:35.809747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:35.811329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:35.815258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.816027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.816716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.818632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.818911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.819625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.837990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.838471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.840515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.841406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:35.847540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:35.848010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:35.871256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:36.041038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.053669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.057264 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31888e9c-e650-4bcf-a522-2ece3e3c0bef tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1474 microversion: 2.1 time: 0.263725 Oct 17 12:52:36.058007 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 542/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:35 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1474 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:36.064277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.067879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.073288 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56292758-257a-4035-8b2f-bb03a546755c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.265904 Oct 17 12:52:36.074341 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 543/1085] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:35 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:36.310620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:36.311469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:36.317648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.318133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.318593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.319329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.319789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.320344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.343332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:36.343963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:36.351151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.351725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.352166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.352868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.353323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.353750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.422244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.431351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.433061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.440177 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2b830005-cd5e-432c-a125-4cecedac32fd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.100740 Oct 17 12:52:36.441672 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 544/1086] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:36 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:36.509526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:36.510549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:36.517779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.518616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.520310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.521523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.521523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.522223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.594100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.603713 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-73faf92d-4379-4b63-bdf1-241f09083df0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1270 microversion: 2.1 time: 0.098883 Oct 17 12:52:36.604307 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 545/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:36 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:36.622997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:36.623629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:36.631248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.631750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.632191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.632909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.633360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.633785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.776366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.789178 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2aec1339-bf71-4b10-89f5-4d1a4c6d4b82 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.183820 Oct 17 12:52:36.790849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 546/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:36 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:36.806754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:36.807754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:36.818515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:36.821692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.822454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.823098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.824547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:36.825123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:36.825670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:36.894964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.905097 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3edb0fc9-a6b4-4c2b-80f1-0e3b3d578fc7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1319 microversion: 2.1 time: 0.598554 Oct 17 12:52:36.906221 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 543/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:36 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:36.944578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:36.953771 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-082cf803-3c69-4297-af48-420dc837012a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1276 microversion: 2.1 time: 0.154209 Oct 17 12:52:36.954643 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 547/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:36 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:37.083080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:37.083939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:37.094436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.095059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.095581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.096572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.097923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.098498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.102043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:37.103368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:37.110963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.120620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.121411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.122442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.123049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.123628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.292122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:37.299909 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7ccd3c67-6614-430a-962a-68b089b61bdc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1474 microversion: 2.1 time: 0.221822 Oct 17 12:52:37.301537 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 544/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:37 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:37.351596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:37.360956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:37.362923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:37.365373 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-833d114d-921e-4787-8699-2b09b2eee08d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.267885 Oct 17 12:52:37.365373 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 548/1092] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:37 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:37.444558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-57622d2a-e4a7-4a3f-8477-ce0ec503acd7 req-68deabf1-6d56-4511-8142-0cb7964aa3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f172c4-86e8-4996-bbd3-70fbbd71f382", "tag": "af064635-ae9c-4661-b2fa-1d7e93368c37"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:37.457808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-57622d2a-e4a7-4a3f-8477-ce0ec503acd7 req-68deabf1-6d56-4511-8142-0cb7964aa3a6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.458656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-57622d2a-e4a7-4a3f-8477-ce0ec503acd7 req-68deabf1-6d56-4511-8142-0cb7964aa3a6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.459845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-57622d2a-e4a7-4a3f-8477-ce0ec503acd7 req-68deabf1-6d56-4511-8142-0cb7964aa3a6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.473394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:37.474041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:37.480270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-57622d2a-e4a7-4a3f-8477-ce0ec503acd7 req-68deabf1-6d56-4511-8142-0cb7964aa3a6 service nova] Creating event network-changed:af064635-ae9c-4661-b2fa-1d7e93368c37 for instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 on n-h2-853316-12 Oct 17 12:52:37.481256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.481742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.482191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.482914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.483529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.483948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.485719 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-57622d2a-e4a7-4a3f-8477-ce0ec503acd7 req-68deabf1-6d56-4511-8142-0cb7964aa3a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049411 Oct 17 12:52:37.488374 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 545/1093] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:37.563376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:37.573924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:37.575416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:37.580406 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3f8e42b-1095-4774-87ee-d34127a05cdf tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.111972 Oct 17 12:52:37.581112 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 549/1094] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:37 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:37.631467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:37.632788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:37.643373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.644945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.646320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.647301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.650664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.651406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.814464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:37.816166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:37.825655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.826141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.826607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.827307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.833616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.834435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:37.954072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:37.965775 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c284489a-59a1-478a-a984-72de26e523da tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1270 microversion: 2.1 time: 0.337880 Oct 17 12:52:37.981807 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 546/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:37 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1270 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:37.988040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:37.988869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:37.997904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:37.999028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:37.999684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.000644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.001252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.002121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.288211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:38.299819 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-743f87fb-d44e-40a0-b24c-f0ad44f8b755 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.490579 Oct 17 12:52:38.307131 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 550/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:37 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:38.321052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:38.322137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:38.332208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.333838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.335019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.336912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.337703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.338586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.341507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:38.355426 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad401d6c-047d-4216-a964-5ff6d906fa85 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 200 len: 1508 microversion: 2.1 time: 0.371581 Oct 17 12:52:38.355426 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 547/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:37 2022] GET /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:38.360048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c3eb5337-7f85-4cfe-a5e4-6f3b2c0d8063 req-8455323e-079c-4487-ad00-045bd96653eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39582507-c439-43ca-992e-621bd3b85232", "name": "network-vif-plugged", "status": "completed", "tag": "03eb1e0c-ef96-4ec2-8985-3c92af43c535"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:38.369564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c3eb5337-7f85-4cfe-a5e4-6f3b2c0d8063 req-8455323e-079c-4487-ad00-045bd96653eb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.370338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c3eb5337-7f85-4cfe-a5e4-6f3b2c0d8063 req-8455323e-079c-4487-ad00-045bd96653eb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.370769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c3eb5337-7f85-4cfe-a5e4-6f3b2c0d8063 req-8455323e-079c-4487-ad00-045bd96653eb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.385576 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c3eb5337-7f85-4cfe-a5e4-6f3b2c0d8063 req-8455323e-079c-4487-ad00-045bd96653eb service nova] Creating event network-vif-plugged:03eb1e0c-ef96-4ec2-8985-3c92af43c535 for instance 39582507-c439-43ca-992e-621bd3b85232 on n-h1-853316-12 Oct 17 12:52:38.389569 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c3eb5337-7f85-4cfe-a5e4-6f3b2c0d8063 req-8455323e-079c-4487-ad00-045bd96653eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032985 Oct 17 12:52:38.390657 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 548/1098] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:38.396108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:38.397013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:38.403842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.404535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.405172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.405879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.406370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.406957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.728627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:38.737352 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3caa442c-0225-4ad2-a205-2c71d9693d0c tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1474 microversion: 2.1 time: 0.345663 Oct 17 12:52:38.738496 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 549/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:38 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1474 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:38.743789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:38.744624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 39582507-c439-43ca-992e-621bd3b85232] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:38.751416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.752112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.752710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.754215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.754681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.755098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.770441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:38.784058 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eb27dd1f-0106-4cb0-bd66-57ce67408791 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.474136 Oct 17 12:52:38.794099 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 551/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:38 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:38.807506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:38.808470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:38.818447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.818943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.819381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:38.820122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:38.820576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:38.821100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.099090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.107818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c6d42bc7-bae9-4699-8313-5b5fc9805fee tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232" status: 200 len: 1319 microversion: 2.1 time: 0.367912 Oct 17 12:52:39.122595 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 550/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:38 2022] GET /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:39.130518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:39.131128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:39.137162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.137647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.138079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.138814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.139262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.139679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.236953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.248276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.249713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.255931 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-16e57299-2aa1-4890-955f-f1a4665eb38e tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.132179 Oct 17 12:52:39.264682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 551/1102] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:39 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:39.264682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:39.264682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:39.268283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.269408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.270464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.271333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.271944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.272521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.354365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.362967 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71e52c0d-d84d-47b1-85d0-7a61d287799b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1276 microversion: 2.1 time: 0.105422 Oct 17 12:52:39.363738 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 552/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:39 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:39.377746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:39.379737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:39.388979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.388979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.388979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.391447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.392051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.392586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.435439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.450184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.452039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.453651 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d9d21d1-ccc1-4e57-b140-14a6dd58cacf tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.655675 Oct 17 12:52:39.455972 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 552/1104] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:38 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:39.623408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c1016525-93f8-4177-b821-bee9bebd6933 req-9d472a88-d8e9-4d1f-b543-407ab2f7ab11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a922b229-3a89-4a60-b461-dc6ca0ff580a", "tag": "af5f4111-7e89-4450-ac8a-fabcdcf51f6d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:39.653070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1016525-93f8-4177-b821-bee9bebd6933 req-9d472a88-d8e9-4d1f-b543-407ab2f7ab11 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.653995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1016525-93f8-4177-b821-bee9bebd6933 req-9d472a88-d8e9-4d1f-b543-407ab2f7ab11 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.654839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1016525-93f8-4177-b821-bee9bebd6933 req-9d472a88-d8e9-4d1f-b543-407ab2f7ab11 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.669941 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c1016525-93f8-4177-b821-bee9bebd6933 req-9d472a88-d8e9-4d1f-b543-407ab2f7ab11 service nova] Creating event network-changed:af5f4111-7e89-4450-ac8a-fabcdcf51f6d for instance a922b229-3a89-4a60-b461-dc6ca0ff580a on n-h2-853316-12 Oct 17 12:52:39.682179 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c1016525-93f8-4177-b821-bee9bebd6933 req-9d472a88-d8e9-4d1f-b543-407ab2f7ab11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064924 Oct 17 12:52:39.684029 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 553/1105] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:39.761583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:39.763168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:39.778444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.780386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.782368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.783808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.785296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.787014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.816058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.825799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e16857f9-6954-4fce-a29d-48370ceefccd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.453274 Oct 17 12:52:39.826974 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 553/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:39 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:39.833693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:39.834521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:39.841475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.842148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.842792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.843625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:39.844212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:39.844771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:39.909302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:39.918827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-166541eb-9038-4083-8f23-f5ca34125e47 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1432 microversion: 2.1 time: 0.161480 Oct 17 12:52:39.919633 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 554/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:39 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1432 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:40.085102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.093093 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-45d86619-b9fd-4e9f-a07a-8aa3190b3876 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.264907 Oct 17 12:52:40.093598 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 554/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:39 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:40.137184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:40.138284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 39582507-c439-43ca-992e-621bd3b85232] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:40.146074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.146700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.147206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.148104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.148629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.149158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.285813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:40.287096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:40.295170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.296912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.297607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.298616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.299311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.299963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.378325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.391018 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3346d9bf-a4fe-4d85-aa85-52274094114d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232" status: 200 len: 1319 microversion: 2.1 time: 0.258621 Oct 17 12:52:40.391647 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 555/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:40 2022] GET /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:40.395457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.405346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.407476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.408209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:40.411088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:40.414215 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-29c460ef-cfc0-42fa-8d44-4cd5fb9f4122 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.132972 Oct 17 12:52:40.414949 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 555/1110] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:40 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:40.422047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.422604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.423040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.423757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.424208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.424630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.483164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:40.483773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:40.490084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.490668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.491099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.491787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.492233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.492649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.564429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.573608 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a8c552df-bdf7-4ff0-b309-721aca40c367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.180714 Oct 17 12:52:40.574213 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 556/1111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:40 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:40.622575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.632131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.633578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:40.634778 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-692b4616-7dac-4355-b20d-c335600ab4ce tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.155573 Oct 17 12:52:40.635349 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 556/1112] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:40 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:40.853108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:40.853717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:40.860105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.860586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.861021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.861706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.862156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.863112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.943997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:40.944658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:40.950751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.951229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.951657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.952346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:40.952793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:40.953223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:40.998743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:41.009857 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da33712e-a45b-4701-9fb0-68d91a01a8eb tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.160553 Oct 17 12:52:41.010557 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 557/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:40 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:41.021406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:41.029514 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-11e5e526-77c9-4669-9246-4a23ce988a41 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1432 microversion: 2.1 time: 0.090472 Oct 17 12:52:41.030082 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 557/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:40 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1432 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:41.116235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:41.120545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:41.132417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.133056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.133566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.134536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.134999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.135426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.138646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:41.291740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:41.303180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0f142e9a-762d-4377-80f7-431d9b913bbe tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.190682 Oct 17 12:52:41.304362 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 558/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:41 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:41.416298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:41.417279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 39582507-c439-43ca-992e-621bd3b85232] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:41.423552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.424325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.426195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.427227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.427959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.428599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.444664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:41.445312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:41.453873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.455837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.457383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.458410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.459168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.460061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.531004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:41.541445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:41.543089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:41.549294 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9f9a137-48b4-4153-9c98-aa4ac9981544 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.109344 Oct 17 12:52:41.550442 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 559/1116] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:41 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:41.600288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:41.601050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:41.609978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.610853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.611576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.612954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.614337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.614873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.666425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:41.677917 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-47197f2c-0519-4eed-a011-12d1d3550b34 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232" status: 200 len: 1319 microversion: 2.1 time: 0.265323 Oct 17 12:52:41.679582 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 558/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:41 2022] GET /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:41.686828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:41.687674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:41.700968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.702601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.703570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.705992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.707876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.708752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.844241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:41.858342 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-589ee187-321e-40c3-bdf2-fd19ab41aa6f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.263403 Oct 17 12:52:41.874594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 560/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:41 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:41.882777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-ca3fcf01-03c0-4f55-b835-2c8e9d21cdca req-7bd4ff13-78a4-4ce0-89f3-b71d01fdb247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652645b9-e4bb-48f1-be51-e9483a163116", "name": "network-vif-deleted", "tag": "29f3ca43-09a3-4d2b-9a04-d9d3003b14d2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:41.894079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ca3fcf01-03c0-4f55-b835-2c8e9d21cdca req-7bd4ff13-78a4-4ce0-89f3-b71d01fdb247 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:41.895373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ca3fcf01-03c0-4f55-b835-2c8e9d21cdca req-7bd4ff13-78a4-4ce0-89f3-b71d01fdb247 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:41.896057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ca3fcf01-03c0-4f55-b835-2c8e9d21cdca req-7bd4ff13-78a4-4ce0-89f3-b71d01fdb247 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:41.910232 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-ca3fcf01-03c0-4f55-b835-2c8e9d21cdca req-7bd4ff13-78a4-4ce0-89f3-b71d01fdb247 service nova] Creating event network-vif-deleted:29f3ca43-09a3-4d2b-9a04-d9d3003b14d2 for instance 652645b9-e4bb-48f1-be51-e9483a163116 on n-h1-853316-12 Oct 17 12:52:41.917155 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-ca3fcf01-03c0-4f55-b835-2c8e9d21cdca req-7bd4ff13-78a4-4ce0-89f3-b71d01fdb247 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040811 Oct 17 12:52:41.918510 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 561/1119] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:42.035451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:42.036331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:42.043374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.043926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.044464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.045274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.045828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.046383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.193278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.200993 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c5e66af2-14aa-4188-9359-a5a64110ec30 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.170993 Oct 17 12:52:42.201564 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 562/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:42 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:42.207413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:42.207413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:42.212832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.213241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.213869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.214766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.215380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.215980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.286552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.295674 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c8ab9f56-f11f-4c12-9726-a7f84b4696cc tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1303 microversion: 2.1 time: 0.092974 Oct 17 12:52:42.296329 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 563/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:42 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:42.328091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:42.328766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:42.335520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.336007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.336439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.337130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.337577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.337993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.401957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.414078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.415857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.417228 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-29593a0d-8dea-44da-b45f-6f981ce41433 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.736378 Oct 17 12:52:42.417790 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 559/1122] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:41 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:42.476253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.488932 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e7395f3-328a-4db0-a176-ee2ac0bafa2b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.164424 Oct 17 12:52:42.489561 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 564/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:42 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:42.578682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:42.579315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:42.581459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:42.587125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.587913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.588700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.589679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.590309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.590878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.607449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:42.687180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.696688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.698411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.704462 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c81b631d-a7c1-451b-983e-9d21004365e3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.129611 Oct 17 12:52:42.704907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:42.705352 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 560/1124] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:42 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:42.705702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 39582507-c439-43ca-992e-621bd3b85232] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:42.711332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:42.713068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.713783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.714358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.715163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.715686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.716177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.770620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2202ef1e-b72f-4d4e-a8ad-b652791f8164 req-dd92b599-85bd-4085-a72a-163be96f9edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaad0a9a-92c7-4a1c-b7de-a0818785dff5", "tag": "16e3a732-45d1-4e38-8f45-ed7b0da98a9b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:42.780520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2202ef1e-b72f-4d4e-a8ad-b652791f8164 req-dd92b599-85bd-4085-a72a-163be96f9edd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.781367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2202ef1e-b72f-4d4e-a8ad-b652791f8164 req-dd92b599-85bd-4085-a72a-163be96f9edd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.781863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2202ef1e-b72f-4d4e-a8ad-b652791f8164 req-dd92b599-85bd-4085-a72a-163be96f9edd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.794182 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2202ef1e-b72f-4d4e-a8ad-b652791f8164 req-dd92b599-85bd-4085-a72a-163be96f9edd service nova] Creating event network-changed:16e3a732-45d1-4e38-8f45-ed7b0da98a9b for instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 on n-h1-853316-12 Oct 17 12:52:42.799524 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2202ef1e-b72f-4d4e-a8ad-b652791f8164 req-dd92b599-85bd-4085-a72a-163be96f9edd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032796 Oct 17 12:52:42.800287 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 561/1125] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:42.859764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:42.868633 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d50de49-5337-4486-8289-c3f0c25f5aa8 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232" status: 200 len: 1508 microversion: 2.1 time: 0.169516 Oct 17 12:52:42.869207 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 565/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:42 2022] GET /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:42.891579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:42.892558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:42.904573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.906765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.907384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:42.907995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.908895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 39582507-c439-43ca-992e-621bd3b85232] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:42.910150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.913979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.914662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.922949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.923705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.924313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.925091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:42.930707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:42.931169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:42.961001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 39582507-c439-43ca-992e-621bd3b85232] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:52:43.043306 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2d343efb-c533-46ab-9709-b12fcedbc7c9 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "DELETE /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232" status: 204 len: 0 microversion: 2.1 time: 0.145103 Oct 17 12:52:43.044448 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 566/1127] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:52:42 2022] DELETE /compute/v2.1/servers/39582507-c439-43ca-992e-621bd3b85232 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:43.054536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:43.055124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:43.061409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.061831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.062294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.062999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.063455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.063885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.074368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:43.083454 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f4fc9f1-5477-44d7-9c61-bbf4716555d8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.199551 Oct 17 12:52:43.084250 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 562/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:42 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:43.102125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: bcb60687-e9bc-4dd8-8021-5fa3e12b8224] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:52:43.171720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-dd1806bf-d82f-4207-9e4b-46e2d250b29b req-703f8890-6c85-4b0e-b3df-361636c5e089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f172c4-86e8-4996-bbd3-70fbbd71f382", "name": "network-vif-plugged", "status": "completed", "tag": "af064635-ae9c-4661-b2fa-1d7e93368c37"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:43.182823 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7cc12bb6-3ed7-4b1e-b98a-36c5bc2a704a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224" status: 204 len: 0 microversion: 2.1 time: 0.133300 Oct 17 12:52:43.183069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd1806bf-d82f-4207-9e4b-46e2d250b29b req-703f8890-6c85-4b0e-b3df-361636c5e089 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.183720 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 567/1129] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:52:43 2022] DELETE /compute/v2.1/servers/bcb60687-e9bc-4dd8-8021-5fa3e12b8224 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:43.183846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd1806bf-d82f-4207-9e4b-46e2d250b29b req-703f8890-6c85-4b0e-b3df-361636c5e089 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.195958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd1806bf-d82f-4207-9e4b-46e2d250b29b req-703f8890-6c85-4b0e-b3df-361636c5e089 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.223407 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-dd1806bf-d82f-4207-9e4b-46e2d250b29b req-703f8890-6c85-4b0e-b3df-361636c5e089 service nova] Creating event network-vif-plugged:af064635-ae9c-4661-b2fa-1d7e93368c37 for instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 on n-h2-853316-12 Oct 17 12:52:43.229769 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-dd1806bf-d82f-4207-9e4b-46e2d250b29b req-703f8890-6c85-4b0e-b3df-361636c5e089 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062546 Oct 17 12:52:43.230684 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 563/1130] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:43.232294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:43.233227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:43.239674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.240166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.240637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.241638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.241848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.248562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.265016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-144993852", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5e88905b-7116-441b-85ca-653a8460a5b8"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:43.322432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] validate_networks() for [('5e88905b-7116-441b-85ca-653a8460a5b8', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:52:43.401794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:43.409684 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4f37a48-627c-47de-b16d-34dce1eb6dfd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.182015 Oct 17 12:52:43.410292 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 568/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:43 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:43.414836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:43.415443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:43.421989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.422583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.423038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.423728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.424190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.424612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.461048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.461664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.461975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.462464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lazy-loading 'fault' on Instance uuid 652645b9-e4bb-48f1-be51-e9483a163116 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:52:43.506609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:43.520137 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-608cc5a3-f67e-4cde-9f26-49417863559b tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1308 microversion: 2.1 time: 0.108763 Oct 17 12:52:43.520936 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 569/1132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:43 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:43.537391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:43.538003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:43.544689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.545181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.545622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.546368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.546836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.547251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.719308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:43.729376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:43.730849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:43.732029 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2ec58978-01cf-44ec-b42b-c3073b91a2d2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.204074 Oct 17 12:52:43.742006 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 570/1133] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:43 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:43.746916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:43.747754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:43.753889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.754385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.754831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.755535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.756046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.756508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.774472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:52:43.774949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:52:43.775433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:52:43.775850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:52:43.776264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:52:43.785792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.786333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.786773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.787503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.787962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.788390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.806221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Getting quotas for project 7ec44846909047db88812217c7186c00. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:52:43.809917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Getting quotas for user 41512701df1940f28f63705f8fe20a21 and project 7ec44846909047db88812217c7186c00. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:52:43.821814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Going to run 2 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:52:43.824563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 084effc1-ed15-42e0-9690-86c8e72ad0af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:43.859819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=084effc1-ed15-42e0-9690-86c8e72ad0af,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:52:43.893202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:43.897727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:43.903381 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0421a181-5cc7-4ced-be8f-a02a71b5df39 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.160010 Oct 17 12:52:43.903712 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 571/1134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:43 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:43.910814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:43.911417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:43.921819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.922415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.923040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.923695 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5ad5ab66-1b85-47dd-84c8-27b88951c91b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.663785 Oct 17 12:52:43.924122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.924619 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 564/1135] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:52:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 17 12:52:43.925071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.925846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.933935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:43.940154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:43.941724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Searching by: {'deleted': False, 'project_id': '7ec44846909047db88812217c7186c00'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:52:43.970583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.971188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.971709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:43.973177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:43.973704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:43.974241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.004916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.005283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:52:44.014178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.015906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.022670 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-220426ca-48e8-4698-a18b-07ac0d7e2a13 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.117911 Oct 17 12:52:44.023827 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 572/1136] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:43 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:44.045126 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-38308d22-8603-4866-9c50-2d3932e505f6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.116532 Oct 17 12:52:44.045716 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 565/1137] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 12:52:43 2022] GET /compute/v2.1/servers => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:44.058557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d499262-4e59-4c8b-bbb6-012c7d1a5775 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:44.059172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d499262-4e59-4c8b-bbb6-012c7d1a5775 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:44.107133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:44.107631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:44.113798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.114318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.114765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.115440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.115889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.116311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.122712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d499262-4e59-4c8b-bbb6-012c7d1a5775 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.132540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d499262-4e59-4c8b-bbb6-012c7d1a5775 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1217 microversion: 2.1 time: 0.077714 Oct 17 12:52:44.146270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 573/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:44 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:44.258873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.266420 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4b8140de-447b-496b-bbc6-5097b71b50e9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.163263 Oct 17 12:52:44.266973 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 566/1139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:44 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:44.434255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:44.434997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:44.442431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.442928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.443370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.444167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.444629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.445056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.544992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:44.545885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:44.554500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.555305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.555976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.557167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.557954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.558609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.597291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.598034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.598212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.598899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lazy-loading 'fault' on Instance uuid 652645b9-e4bb-48f1-be51-e9483a163116 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:52:44.602195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.610461 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-66e7928e-310a-4733-84f2-13936d777718 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.180283 Oct 17 12:52:44.611039 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 574/1140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:44 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:44.644414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.652434 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f4d2e991-f761-4b63-b7fe-5a5a32f36694 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1308 microversion: 2.1 time: 0.112134 Oct 17 12:52:44.653001 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 567/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:44 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:44.759410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:44.760201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:44.768008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.768223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.768685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.769955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.774539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.784233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.928580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:44.929057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.929428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:44.935401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.935888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.936598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.937332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:44.937821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:44.938173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.938322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:44.939678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:44.940925 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2ace0a7d-ddd8-4076-8a36-87ccd235bd79 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.185522 Oct 17 12:52:44.941564 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 575/1142] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:44 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:45.052559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:45.053599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:45.065125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.066051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.066737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.067802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.069064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.070392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.146450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:45.161278 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4aa25323-28b5-4b12-9770-4d73c8f065ee tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.237252 Oct 17 12:52:45.164324 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 568/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:44 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:45.172166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:45.172790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:45.185608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.186383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.186832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.187561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.188012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.188451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.268126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:45.285970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:45.287468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:45.295129 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a468bb8-6f45-4f5e-ab80-71bd2b10149d tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.248270 Oct 17 12:52:45.299073 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 576/1144] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:45 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:45.317896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:45.318544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:45.330510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:45.347695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.347897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.348258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.348994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.349454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.349885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.356843 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8c14c69e-3d0d-4b9a-8231-9077faf403b1 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1221 microversion: 2.1 time: 0.190122 Oct 17 12:52:45.357636 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 569/1145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:45 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:45.485068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a6a6de67-927a-43d7-a5ab-1dff98b311b4 req-34c7ce12-ef4d-401e-97cb-d88eb627dd7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a076fb2-b905-428e-8d88-e396a91a80c1", "name": "network-vif-unplugged", "status": "completed", "tag": "271b29d9-801d-45ee-9eb8-0cc803f60d9a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:45.499538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a6a6de67-927a-43d7-a5ab-1dff98b311b4 req-34c7ce12-ef4d-401e-97cb-d88eb627dd7b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.499877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a6a6de67-927a-43d7-a5ab-1dff98b311b4 req-34c7ce12-ef4d-401e-97cb-d88eb627dd7b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.500671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a6a6de67-927a-43d7-a5ab-1dff98b311b4 req-34c7ce12-ef4d-401e-97cb-d88eb627dd7b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.515866 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a6a6de67-927a-43d7-a5ab-1dff98b311b4 req-34c7ce12-ef4d-401e-97cb-d88eb627dd7b service nova] Creating event network-vif-unplugged:271b29d9-801d-45ee-9eb8-0cc803f60d9a for instance 5a076fb2-b905-428e-8d88-e396a91a80c1 on n-h2-853316-12 Oct 17 12:52:45.521776 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a6a6de67-927a-43d7-a5ab-1dff98b311b4 req-34c7ce12-ef4d-401e-97cb-d88eb627dd7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040917 Oct 17 12:52:45.522702 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 570/1146] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:45.591481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:45.606273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d6a7e13-2389-40c2-9b6f-e2bd6a5fccfa tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.306601 Oct 17 12:52:45.607409 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 577/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:45 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:45.636871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:45.637727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:45.645351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.645850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.646333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.647040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.647732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.648264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.675229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:45.676115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:45.682929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.683426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.684684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.685469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.686983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.687692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.726921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:45.727437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:45.727881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:45.728342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lazy-loading 'fault' on Instance uuid 652645b9-e4bb-48f1-be51-e9483a163116 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:52:45.965586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:45.978740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ed440133-0090-4ce4-8908-d3f6230528d5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.346695 Oct 17 12:52:45.978996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39934c0a585849b4bef5f4ae8cf4a49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c080d0ac46242b190000e3b8726fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:45.979653 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 571/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:45 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:45.991028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:45.991670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:45.998683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9145c556-0490-4db8-ae42-4077ea4b7cdd tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 200 len: 1308 microversion: 2.1 time: 0.316470 Oct 17 12:52:46.000384 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 578/1149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:45 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:46.005887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.007635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.008086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.014737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.015261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.015704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.108084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-20a58e29-9693-47ef-a56d-2b0067d51599 req-a02e8e2d-34f5-495f-845f-655398562724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb60687-e9bc-4dd8-8021-5fa3e12b8224", "name": "network-vif-deleted", "tag": "2d6270fb-9cfa-49e4-a711-7bf73af0af63"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:46.131721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-20a58e29-9693-47ef-a56d-2b0067d51599 req-a02e8e2d-34f5-495f-845f-655398562724 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.141793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-20a58e29-9693-47ef-a56d-2b0067d51599 req-a02e8e2d-34f5-495f-845f-655398562724 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.142593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-20a58e29-9693-47ef-a56d-2b0067d51599 req-a02e8e2d-34f5-495f-845f-655398562724 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.167200 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-20a58e29-9693-47ef-a56d-2b0067d51599 req-a02e8e2d-34f5-495f-845f-655398562724 service nova] Creating event network-vif-deleted:2d6270fb-9cfa-49e4-a711-7bf73af0af63 for instance bcb60687-e9bc-4dd8-8021-5fa3e12b8224 on n-h2-853316-12 Oct 17 12:52:46.180492 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-20a58e29-9693-47ef-a56d-2b0067d51599 req-a02e8e2d-34f5-495f-845f-655398562724 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075895 Oct 17 12:52:46.181192 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 579/1150] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:46.198812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:46.202767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:46.258068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.259358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.260082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.262215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.262971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.263859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.455783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.473283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.476565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.481022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e62c56a-d7f8-4d75-a492-82a53d80e1da tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.500191 Oct 17 12:52:46.482022 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 572/1151] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:45 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:46.490409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:46.491192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:46.497509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.498119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.498974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.499875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.500680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.501106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.570611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.577356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.578723 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c566fe8-624c-4afe-9248-594ffc619747 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.389693 Oct 17 12:52:46.579604 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 580/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:46 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:46.585100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:46.585909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:46.588235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.589984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.591793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.592281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.592716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.593413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.593871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.594410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.596631 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a50a71e7-0cbb-4d5e-b0dc-695d30c0c627 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.113416 Oct 17 12:52:46.598599 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 573/1153] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:46 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:46.632788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:46.633603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:46.640198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.640934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.641392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.642087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:46.642570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:46.643005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:46.720736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.742345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cbfa3caf-2870-457d-a022-80c53037a06d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1213 microversion: 2.1 time: 0.160909 Oct 17 12:52:46.744099 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 581/1154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:46 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:46.857386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:46.866552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e30986ce-2e52-4b66-b38c-8d6497c9205b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.240109 Oct 17 12:52:46.879056 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 574/1155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:46 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:47.014893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:47.015805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:47.031007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.031510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.031956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.032670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.033035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:47.033541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.033541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.035286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] [instance: 652645b9-e4bb-48f1-be51-e9483a163116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:47.060382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.061502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.062684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.064303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.065125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.066278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.084343 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] HTTP exception thrown: Instance 652645b9-e4bb-48f1-be51-e9483a163116 could not be found. Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Request method failure captured: Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 HTTP/1.1 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU9sbRURpEgRvpwwrLqJ-Va7cuVBFsY_ukIQKA--khIXxm76uKt6pLx8DCSgudft7vYJdWZzprym91xCp7WhQdr9s3VK5niesq65kz8C9q2dUfP5l8NUm4yOtPXQiFrvP84aCVkbFoVRDnQvUJWlUPxdK5u6iVB6p8GUUvNCqohqr5o Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 6c080d0ac46242b190000e3b8726fe80 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ListImageFiltersTestJSON-196858915 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c080d0ac46242b190000e3b8726fe80", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c080d0ac46242b190000e3b8726fe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c080d0ac46242b190000e3b8726fe80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c080d0ac46242b190000e3b8726fe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ListImageFiltersTestJSON-196858915 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 6c080d0ac46242b190000e3b8726fe80 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-196858915 Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ListImageFiltersTestJSON-196858915-project Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 39934c0a585849b4bef5f4ae8cf4a49e Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ListImageFiltersTestJSON-196858915-project Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 652645b9-e4bb-48f1-be51-e9483a163116 could not be found. Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '652645b9-e4bb-48f1-be51-e9483a163116'} Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652645b9-e4bb-48f1-be51-e9483a163116 could not be found. Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652645b9-e4bb-48f1-be51-e9483a163116 could not be found. Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:47.086812 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:47.092118 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:47.092118 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:47.092118 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:47.092118 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:47.092118 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:47.092118 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652645b9-e4bb-48f1-be51-e9483a163116 could not be found. Oct 17 12:52:47.092118 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:47.096243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Returning 404 to user: Instance 652645b9-e4bb-48f1-be51-e9483a163116 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:47.097996 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b2033134-10c5-4863-98e7-6def82619b77 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116" status: 404 len: 111 microversion: 2.1 time: 0.076634 Oct 17 12:52:47.098919 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 575/1156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:47 2022] GET /compute/v2.1/servers/652645b9-e4bb-48f1-be51-e9483a163116 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:52:47.108252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e71648e5-42bb-423b-9c59-f9449f4e4918 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa8212f8e50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:47.534445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:47.545706 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9b2b03e0-c0af-4b65-8a1f-eefb2b522ef2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.540226 Oct 17 12:52:47.546310 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 582/1157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:47 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:47.564347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-cf9442de-46ae-4e50-aef3-ad3e3ea5fa5f req-1ff85fed-854d-4213-a9b2-04301300bde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a922b229-3a89-4a60-b461-dc6ca0ff580a", "name": "network-vif-plugged", "status": "completed", "tag": "af5f4111-7e89-4450-ac8a-fabcdcf51f6d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:47.582354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cf9442de-46ae-4e50-aef3-ad3e3ea5fa5f req-1ff85fed-854d-4213-a9b2-04301300bde8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.583210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cf9442de-46ae-4e50-aef3-ad3e3ea5fa5f req-1ff85fed-854d-4213-a9b2-04301300bde8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.583606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cf9442de-46ae-4e50-aef3-ad3e3ea5fa5f req-1ff85fed-854d-4213-a9b2-04301300bde8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.584227 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e71648e5-42bb-423b-9c59-f9449f4e4918 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "DELETE /compute/v2.1/images/0420036c-8237-4541-a69f-cf8136c54c8f" status: 204 len: 0 microversion: 2.1 time: 0.479816 Oct 17 12:52:47.584865 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 576/1158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:47 2022] DELETE /compute/v2.1/images/0420036c-8237-4541-a69f-cf8136c54c8f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:47.591260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:47.592550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:47.607768 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-cf9442de-46ae-4e50-aef3-ad3e3ea5fa5f req-1ff85fed-854d-4213-a9b2-04301300bde8 service nova] Creating event network-vif-plugged:af5f4111-7e89-4450-ac8a-fabcdcf51f6d for instance a922b229-3a89-4a60-b461-dc6ca0ff580a on n-h2-853316-12 Oct 17 12:52:47.614770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.615366 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-cf9442de-46ae-4e50-aef3-ad3e3ea5fa5f req-1ff85fed-854d-4213-a9b2-04301300bde8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063144 Oct 17 12:52:47.616133 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 583/1159] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:47.616656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.617132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.619880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.619880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.619880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.625377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-fddbd535-7d9e-47b6-9886-125d12088777 req-9e7db3b7-1dd7-4b8a-a26b-f2a4590da793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a076fb2-b905-428e-8d88-e396a91a80c1", "tag": "271b29d9-801d-45ee-9eb8-0cc803f60d9a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:47.632487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:47.637133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fddbd535-7d9e-47b6-9886-125d12088777 req-9e7db3b7-1dd7-4b8a-a26b-f2a4590da793 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.637609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fddbd535-7d9e-47b6-9886-125d12088777 req-9e7db3b7-1dd7-4b8a-a26b-f2a4590da793 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.638037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fddbd535-7d9e-47b6-9886-125d12088777 req-9e7db3b7-1dd7-4b8a-a26b-f2a4590da793 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.652674 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-fddbd535-7d9e-47b6-9886-125d12088777 req-9e7db3b7-1dd7-4b8a-a26b-f2a4590da793 service nova] Creating event network-changed:271b29d9-801d-45ee-9eb8-0cc803f60d9a for instance 5a076fb2-b905-428e-8d88-e396a91a80c1 on n-h2-853316-12 Oct 17 12:52:47.657680 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-fddbd535-7d9e-47b6-9886-125d12088777 req-9e7db3b7-1dd7-4b8a-a26b-f2a4590da793 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039483 Oct 17 12:52:47.658346 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 584/1160] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:47.677080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2aa0c8fb-7efe-4d5e-9d2f-212cb7019576 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820cf1a60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:47.917839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:47.950306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:47.954072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:47.958523 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ee3660d-3b9b-46bc-bfc5-5f9e8b787871 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.372492 Oct 17 12:52:47.959121 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 577/1161] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:47 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:47.965209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:47.965870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:47.973504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.974076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.975065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:47.975896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:47.977489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:47.978063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.011472 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2aa0c8fb-7efe-4d5e-9d2f-212cb7019576 tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "DELETE /compute/v2.1/images/54f14943-57c4-419c-a2be-cdf7cf400625" status: 204 len: 0 microversion: 2.1 time: 0.349069 Oct 17 12:52:48.012160 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 585/1162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:47 2022] DELETE /compute/v2.1/images/54f14943-57c4-419c-a2be-cdf7cf400625 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:48.017376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:48.018249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:48.025431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.026076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.026822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.027630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.028302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.028955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.123596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:48.125946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:48.132948 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e9f5bb9-e34e-4cd5-adc3-bf7e4e7fe715 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.171379 Oct 17 12:52:48.134128 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 578/1163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:47 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:48.138814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:48.139608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:48.142523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:48.144781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:48.146472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.146977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.147423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.148161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.148624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.149063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.150517 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d4ea9de-06f0-4563-b6c6-5387e26db266 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.137257 Oct 17 12:52:48.151419 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 586/1164] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:48 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:48.157106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:48.157938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:48.168832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.170108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.172320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.173102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.174141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.176944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.255593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:48.265648 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c2747166-fe54-47f4-a686-99773267d488 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1277 microversion: 2.1 time: 0.130146 Oct 17 12:52:48.279819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 579/1165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:48 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:48.286922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5f7eacfd-ea46-4c7c-a6ad-bf1cd6bc9adf tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] Calling method '.version_select at 0x7fa820df9670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:48.562139 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5f7eacfd-ea46-4c7c-a6ad-bf1cd6bc9adf tempest-ListImageFiltersTestJSON-196858915 tempest-ListImageFiltersTestJSON-196858915-project] 10.222.0.27 "DELETE /compute/v2.1/images/8ab3c518-5412-45df-9359-fa31fbc46c32" status: 204 len: 0 microversion: 2.1 time: 0.280946 Oct 17 12:52:48.566448 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 580/1166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:48 2022] DELETE /compute/v2.1/images/8ab3c518-5412-45df-9359-fa31fbc46c32 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:48.568194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-73d69c2f-fdd2-4641-86cd-cea25c17e4a9 req-254d0d8c-3080-4f91-9070-94ed7d692366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39582507-c439-43ca-992e-621bd3b85232", "name": "network-vif-deleted", "tag": "03eb1e0c-ef96-4ec2-8985-3c92af43c535"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:48.579918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-73d69c2f-fdd2-4641-86cd-cea25c17e4a9 req-254d0d8c-3080-4f91-9070-94ed7d692366 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.580435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-73d69c2f-fdd2-4641-86cd-cea25c17e4a9 req-254d0d8c-3080-4f91-9070-94ed7d692366 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.580955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-73d69c2f-fdd2-4641-86cd-cea25c17e4a9 req-254d0d8c-3080-4f91-9070-94ed7d692366 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.595009 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-73d69c2f-fdd2-4641-86cd-cea25c17e4a9 req-254d0d8c-3080-4f91-9070-94ed7d692366 service nova] Creating event network-vif-deleted:03eb1e0c-ef96-4ec2-8985-3c92af43c535 for instance 39582507-c439-43ca-992e-621bd3b85232 on n-h1-853316-12 Oct 17 12:52:48.601562 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-73d69c2f-fdd2-4641-86cd-cea25c17e4a9 req-254d0d8c-3080-4f91-9070-94ed7d692366 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037549 Oct 17 12:52:48.603832 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 581/1167] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:48.610819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:48.624453 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3ee4b2a-8d01-46d4-84e8-66372b9b669f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.471279 Oct 17 12:52:48.626188 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 587/1168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:48 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:48.626607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:48.627558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:48.634756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.635597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.636317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.637578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.638259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.638865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.655137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:48.854365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:48.862594 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-276c71f8-da39-4cc4-baa9-b1ddc673b246 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.257001 Oct 17 12:52:48.863375 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 582/1169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:48 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:48.984490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:48.985451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:48.992519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.992945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.993381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:48.994075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:48.994554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:48.994972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.130138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.139231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.140701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.141872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85441fcf-8318-433d-a54b-438335c35347 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.161593 Oct 17 12:52:49.142608 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 588/1170] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:48 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:49.165190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:49.165806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:49.173772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.174297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.174745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.175982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.176435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.177406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.181886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:49.182517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:49.189168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.189651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.190082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.191019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.191850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.192462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.295026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.305972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.307980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.318232 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f5f73b25-64d1-4097-b756-4dbe99d34774 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.139182 Oct 17 12:52:49.319659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 589/1171] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:49 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:49.324774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:49.326439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:49.332566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.333123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.333803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.334639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.335179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.335851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.423182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.429991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.440700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d1fde08-b0a0-4fbe-9a87-ae5f030db24e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1277 microversion: 2.1 time: 0.119484 Oct 17 12:52:49.442624 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-54bf935a-2ef9-499d-b3c4-9e96de66460f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1316 microversion: 2.1 time: 0.280856 Oct 17 12:52:49.451873 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 583/1172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:49 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:49.452058 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 590/1173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:49 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:49.652036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:49.653285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:49.661407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.664722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.665533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.666499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.670761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.671595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.824195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:49.842308 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-12a2d286-9a53-41ea-ba30-f49181ffec9b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.185779 Oct 17 12:52:49.842308 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 584/1174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:49 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:49.890617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:49.891604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:49.898679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.899339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.900010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:49.901060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:49.901742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:49.902484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.117692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.125446 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dcc8a62b-4955-44dc-87f9-80a5847a71c6 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.241997 Oct 17 12:52:50.126253 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 591/1175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:49 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:50.168535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:50.169953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:50.176906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.177539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.178190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.179150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.179955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.180379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.185095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:50.242322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fd0b05c-7495-4eaa-808a-775b8be82e9b tempest-ListImageFiltersNegativeTestJSON-596782620 tempest-ListImageFiltersNegativeTestJSON-596782620-project] Calling method '.version_select at 0x7fa82142ddc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:50.268525 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-7fd0b05c-7495-4eaa-808a-775b8be82e9b tempest-ListImageFiltersNegativeTestJSON-596782620 tempest-ListImageFiltersNegativeTestJSON-596782620-project] HTTP exception thrown: Image not found. Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fd0b05c-7495-4eaa-808a-775b8be82e9b tempest-ListImageFiltersNegativeTestJSON-596782620 tempest-ListImageFiltersNegativeTestJSON-596782620-project] Request method failure captured: Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/images/4e3bd7ea-48ad-439e-a314-98e38d5240d5 HTTP/1.1 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVAi1NFM9wl7kuzghiVQPA7CuQqZMDThYkH-q66heIUfUHVlMhqmLjEISbdDKNY-uMRdqhyc5s6REz4cfj-fSSyhaWwIPQJ3HKZd6vbarJAYIrxaqJOSJJXwctKFf5k2D5UiDjIYVORchIbz6nqWQgPk7aDZG6nNzPPk4DyOgVcQbgQ Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ecc4b874b724482a90d183be1f15037c Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-596782620 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ecc4b874b724482a90d183be1f15037c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ecc4b874b724482a90d183be1f15037c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ecc4b874b724482a90d183be1f15037c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ecc4b874b724482a90d183be1f15037c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-596782620 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ecc4b874b724482a90d183be1f15037c Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-596782620 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ListImageFiltersNegativeTestJSON-596782620-project Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e11ce782fbb241c6b03cee4bf1a687b8 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-596782620-project Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '4e3bd7ea-48ad-439e-a314-98e38d5240d5'} Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4e3bd7ea-48ad-439e-a314-98e38d5240d5 Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 12:52:50.271324 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e3bd7ea-48ad-439e-a314-98e38d5240d5 could not be found. Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fd0b05c-7495-4eaa-808a-775b8be82e9b tempest-ListImageFiltersNegativeTestJSON-596782620 tempest-ListImageFiltersNegativeTestJSON-596782620-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7fd0b05c-7495-4eaa-808a-775b8be82e9b tempest-ListImageFiltersNegativeTestJSON-596782620 tempest-ListImageFiltersNegativeTestJSON-596782620-project] 10.222.0.27 "GET /compute/v2.1/images/4e3bd7ea-48ad-439e-a314-98e38d5240d5" status: 404 len: 62 microversion: 2.1 time: 0.166722 Oct 17 12:52:50.275675 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 585/1176] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:50 2022] GET /compute/v2.1/images/4e3bd7ea-48ad-439e-a314-98e38d5240d5 => generated 62 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 12:52:50.349697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:50.351988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:50.360256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.361070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.361709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.362716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.363364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.363855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.434566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.446515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.448668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.450446 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11379880-6a1d-4bca-9af7-07e6836d07ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.287422 Oct 17 12:52:50.452501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 592/1177] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:50 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:50.453558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.462423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.464014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.469173 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-933663a8-2574-44c3-a918-710eef909e81 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.124176 Oct 17 12:52:50.470742 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 586/1178] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:50 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:50.486526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:50.488050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:50.489019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:50.492332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:50.495262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.495955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.496699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.497590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.498232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.498461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.498947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.499174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.499443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.500141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.500596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.501022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.583068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.592976 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91894e76-b49a-4251-9933-28f0741a91bb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1277 microversion: 2.1 time: 0.112425 Oct 17 12:52:50.593764 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 593/1179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:50 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:50.640805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-23a4076e-0a2a-4fdf-8ee4-c7a454520554 req-8a40c222-636c-4d8a-bff1-63553c531cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084effc1-ed15-42e0-9690-86c8e72ad0af", "tag": "ac3d1d21-5465-412e-867b-78afbadd0b2a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:50.650839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23a4076e-0a2a-4fdf-8ee4-c7a454520554 req-8a40c222-636c-4d8a-bff1-63553c531cb7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.651876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23a4076e-0a2a-4fdf-8ee4-c7a454520554 req-8a40c222-636c-4d8a-bff1-63553c531cb7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.652518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23a4076e-0a2a-4fdf-8ee4-c7a454520554 req-8a40c222-636c-4d8a-bff1-63553c531cb7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.654418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:50.664358 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be368229-1774-4d28-be2a-d416c3ebdd46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1503 microversion: 2.1 time: 0.182539 Oct 17 12:52:50.666615 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-23a4076e-0a2a-4fdf-8ee4-c7a454520554 req-8a40c222-636c-4d8a-bff1-63553c531cb7 service nova] Creating event network-changed:ac3d1d21-5465-412e-867b-78afbadd0b2a for instance 084effc1-ed15-42e0-9690-86c8e72ad0af on n-h2-853316-12 Oct 17 12:52:50.678709 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 587/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:50 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:50.681811 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-23a4076e-0a2a-4fdf-8ee4-c7a454520554 req-8a40c222-636c-4d8a-bff1-63553c531cb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044209 Oct 17 12:52:50.682752 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 594/1181] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:50.688537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1088477243"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:50.689311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:50.697194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.697695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.698141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.698887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.699351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.699782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.858058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:50.858807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:50.866921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.867406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.867838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.868528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:50.868978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:50.869395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:50.888295 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.network.security_group_api [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Adding security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 to port af5f4111-7e89-4450-ac8a-fabcdcf51f6d Oct 17 12:52:51.042079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.052104 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c59fb52-a331-411c-bce8-6706fb2c8df9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.197792 Oct 17 12:52:51.052939 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 595/1182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:50 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:51.149779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:51.150487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:51.156550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.157031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.157462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.158152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.158823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.159246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.303771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.323872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58de28aa-74ae-4dbc-9575-a3c93f486618 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.178291 Oct 17 12:52:51.324799 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 596/1183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:51 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:51.375745 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-758dc251-6b7d-44a5-8f05-941d85873d6a tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a/action" status: 202 len: 0 microversion: 2.1 time: 0.691499 Oct 17 12:52:51.376245 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 588/1184] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:52:50 2022] POST /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:52:51.385030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19a84c4f-2470-410d-b7b5-0b02211c7d43 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d3baf0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:51.392919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-75f96a42-0d38-414f-b28e-e62752f05bda req-b6ae5b62-5b84-441b-b966-153a73888f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a922b229-3a89-4a60-b461-dc6ca0ff580a", "tag": "af5f4111-7e89-4450-ac8a-fabcdcf51f6d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:51.403865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-75f96a42-0d38-414f-b28e-e62752f05bda req-b6ae5b62-5b84-441b-b966-153a73888f60 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.404649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-75f96a42-0d38-414f-b28e-e62752f05bda req-b6ae5b62-5b84-441b-b966-153a73888f60 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.405299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-75f96a42-0d38-414f-b28e-e62752f05bda req-b6ae5b62-5b84-441b-b966-153a73888f60 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.425581 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-75f96a42-0d38-414f-b28e-e62752f05bda req-b6ae5b62-5b84-441b-b966-153a73888f60 service nova] Creating event network-changed:af5f4111-7e89-4450-ac8a-fabcdcf51f6d for instance a922b229-3a89-4a60-b461-dc6ca0ff580a on n-h2-853316-12 Oct 17 12:52:51.440976 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-75f96a42-0d38-414f-b28e-e62752f05bda req-b6ae5b62-5b84-441b-b966-153a73888f60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050547 Oct 17 12:52:51.444287 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 589/1185] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:51.490505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:51.491272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:51.505038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.505886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.507167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.507999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.508536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.509044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.535431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-19a84c4f-2470-410d-b7b5-0b02211c7d43 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 in use.", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:52:51.536119 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-19a84c4f-2470-410d-b7b5-0b02211c7d43 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security Group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 in use. Oct 17 12:52:51.536119 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-2100d34e-d121-4d15-a482-62c82cb0d12a'] Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19a84c4f-2470-410d-b7b5-0b02211c7d43 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-security-groups/acf3e7a0-9047-4f70-b776-2c2d7df5fa21 HTTP/1.1 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: exception: Security Group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 in use. Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-2100d34e-d121-4d15-a482-62c82cb0d12a'] Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'acf3e7a0-9047-4f70-b776-2c2d7df5fa21'} Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:52:51.538430 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 in use. Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2100d34e-d121-4d15-a482-62c82cb0d12a'] Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 in use. Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2100d34e-d121-4d15-a482-62c82cb0d12a'] Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 in use. Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2100d34e-d121-4d15-a482-62c82cb0d12a'] Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 in use. Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2100d34e-d121-4d15-a482-62c82cb0d12a'] Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19a84c4f-2470-410d-b7b5-0b02211c7d43 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 400 to user: Security Group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 in use. Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-2100d34e-d121-4d15-a482-62c82cb0d12a'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19a84c4f-2470-410d-b7b5-0b02211c7d43 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/acf3e7a0-9047-4f70-b776-2c2d7df5fa21" status: 400 len: 185 microversion: 2.1 time: 0.159138 Oct 17 12:52:51.543309 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 597/1186] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:52:51 2022] DELETE /compute/v2.1/os-security-groups/acf3e7a0-9047-4f70-b776-2c2d7df5fa21 => generated 185 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:52:51.551757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:51.552587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:51.571480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.572022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.574447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.575224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.575729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.576169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.666832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.677076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.678865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.685270 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a1f5e5f-3cbf-4a2b-be2a-a630b0baccd0 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.143636 Oct 17 12:52:51.686101 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 598/1187] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:51 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:51.692405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:51.695996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:51.696687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.703228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.704209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.704934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.706083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.707311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.707897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.710072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.712195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.713575 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f978c589-d64f-45e8-9c25-1109af43ca35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.228277 Oct 17 12:52:51.714636 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 590/1188] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:51 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:51.719463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:51.720193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:51.731302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.732035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.732677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.733391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.733850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.734311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.805965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:51.814433 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-50defc6a-0639-442e-b830-c31093663204 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1277 microversion: 2.1 time: 0.098637 Oct 17 12:52:51.815276 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 591/1189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:51 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:51.817617 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ce422cd-2c91-409b-bdce-c0d895b393ff tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a/action" status: 202 len: 0 microversion: 2.1 time: 0.129874 Oct 17 12:52:51.818749 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 599/1190] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:52:51 2022] POST /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:52:51.836966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:51.837843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:51.844506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.845133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.845585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:51.846649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:51.847336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:51.848062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.001513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:52.015856 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1917eb4a-9609-4905-b488-6bb78b5f6fa9 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1574 microversion: 2.1 time: 0.182669 Oct 17 12:52:52.027823 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 592/1191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:51 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:52.077035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:52.077815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:52.084340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.084902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.085427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.086224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.086756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.087260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.330822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:52.348562 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7a29bee-8485-41fa-9746-0c47da953d74 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.276829 Oct 17 12:52:52.365936 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 600/1192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:52 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:52.377230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:52.377919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:52.384260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.385561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.386073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.387046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.387563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.388062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.395026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-81a9f4c7-54a6-47f1-9c35-8d148e457ea7 tempest-ListImagesTestJSON-1518527786 tempest-ListImagesTestJSON-1518527786-project] Calling method '.version_select at 0x7fa820d97d30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:52.445742 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-81a9f4c7-54a6-47f1-9c35-8d148e457ea7 tempest-ListImagesTestJSON-1518527786 tempest-ListImagesTestJSON-1518527786-project] 10.222.0.27 "GET /compute/v2.1/images/c0b8bbed-67fa-4bc6-93c9-ab1f864c501f" status: 200 len: 784 microversion: 2.1 time: 0.182345 Oct 17 12:52:52.447414 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 593/1193] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:52:52 2022] GET /compute/v2.1/images/c0b8bbed-67fa-4bc6-93c9-ab1f864c501f => generated 784 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:52.464165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d919978-1fa1-4d50-b4be-db7605169498 tempest-ListImagesTestJSON-1518527786 tempest-ListImagesTestJSON-1518527786-project] Calling method '.version_select at 0x7fa82142ddc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:52.519745 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d919978-1fa1-4d50-b4be-db7605169498 tempest-ListImagesTestJSON-1518527786 tempest-ListImagesTestJSON-1518527786-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.059537 Oct 17 12:52:52.520329 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 594/1194] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 17 12:52:52 2022] GET /compute/v2.1/images => generated 445 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:52.532803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b0d67c1-2418-4258-bb34-071348f61a36 tempest-ListImagesTestJSON-1518527786 tempest-ListImagesTestJSON-1518527786-project] Calling method '.version_select at 0x7fa820e1ed30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:52.581901 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b0d67c1-2418-4258-bb34-071348f61a36 tempest-ListImagesTestJSON-1518527786 tempest-ListImagesTestJSON-1518527786-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.052796 Oct 17 12:52:52.582731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 595/1195] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 12:52:52 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:52:52.588302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:52.599479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86801ca7-583d-46a6-b8e2-ab661b8b47ba tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.229005 Oct 17 12:52:52.600228 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 601/1196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:52 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:52.720630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:52.722345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:52.730727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.731198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.731637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.732913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.733370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.741220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:52.741863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:52.746783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.752465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.753260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.753915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.756170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.756803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.758669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.847665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:52.857774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:52.859964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:52.876223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e8f5ed68-4ea1-45a6-bde8-fe5e7d6e98bd tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1446 microversion: 2.75 time: 0.159485 Oct 17 12:52:52.907270 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 596/1197] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:52 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:52.921121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:52.923653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:52.938211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.943952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.944601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:52.945861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:52.946531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:52.947129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.070478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:53.092372 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51354149-710e-4b6f-bc7a-feb78ca6df5a tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1277 microversion: 2.1 time: 0.179554 Oct 17 12:52:53.106845 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 597/1198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:52 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:53.140057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:53.140918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:53.164683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:53.165256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:53.165711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.169618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:53.169999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:53.170602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.283572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:53.293495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:53.294980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:53.296153 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7a3c644-0d41-459a-86a6-d5c2eca39d9e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.559623 Oct 17 12:52:53.296739 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 602/1199] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:52 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:53.376982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:53.380120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:53.387802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:53.388569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:53.389914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.390698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:53.391163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:53.391605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.626469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:53.636721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a14a4394-b4d3-4a19-b6d3-d54b650708d2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.263848 Oct 17 12:52:53.638245 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 603/1200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:53 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:53.643476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:53.644556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:53.651237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:53.652662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:53.653336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.654423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:53.655553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:53.656221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.793080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:53.806685 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c388d1d-b35c-4901-9f56-d8d28a0f54f0 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1574 microversion: 2.1 time: 0.696154 Oct 17 12:52:53.807922 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 598/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:53 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1574 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:53.872295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:53.882039 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85759546-7b41-4ffd-85fa-8a8c4916f5ee tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.241587 Oct 17 12:52:53.883045 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 604/1202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:53 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:53.916584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:53.917688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:53.920480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=42 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:53.934188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:53.934924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:53.935594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.937481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:53.938221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:53.939053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:53.991689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:54.106436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:54.119001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:54.119170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:54.119693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:54.120445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:54.131493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:54.138500 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d264906c-bec4-42d6-bd44-12116403f4b8 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1452 microversion: 2.75 time: 0.230672 Oct 17 12:52:54.139277 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 599/1203] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:53 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:54.140940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.141549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.143022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.143929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.144401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.144994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.324409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:54.325405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:54.334251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:54.339524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.340153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.340694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.341533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.342085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.343739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.344659 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e508ca96-e281-4dac-b4c3-3755459cc3fd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.230139 Oct 17 12:52:54.345726 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 605/1204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:54 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:54.511955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:54.522232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:54.523860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:54.525034 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f3548af-902b-4bdb-8a2f-85bdde8643ca tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.206685 Oct 17 12:52:54.525600 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 600/1205] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:54 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:54.662515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:54.663221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:54.669504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.670056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.670588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.671278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.671726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.672163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.830698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:54.834483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:54.835590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:54.837488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:54.839990 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7539143-d723-466a-a01c-3e58fcc7e5fd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.181977 Oct 17 12:52:54.842213 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 606/1206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:54 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:54.845947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.846472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.847642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.848522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.849140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.849729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.905938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:54.906636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:54.913917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.914447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.914880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:54.915581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:54.916030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:54.916450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.019904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.029694 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5730542a-1ed5-4cc2-bc47-dfd6d5c6c387 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1572 microversion: 2.1 time: 0.200623 Oct 17 12:52:55.043352 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 601/1207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:54 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1572 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:55.052718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-546223636"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:55.053267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:55.059331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.059822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.060263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.060972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.061684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.062114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.062882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.073093 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b272fe77-476f-4a20-bb06-8179981b2533 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.170859 Oct 17 12:52:55.074566 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 607/1208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:54 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:55.171852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:55.172658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:55.181293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.182689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.183326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.184585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.185222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.186194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.224326 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.network.security_group_api [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Adding security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f to port af5f4111-7e89-4450-ac8a-fabcdcf51f6d Oct 17 12:52:55.286915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.309235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.313638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.326055 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6d58343-5274-4821-8cc1-a7f6e7af1485 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1452 microversion: 2.75 time: 0.158248 Oct 17 12:52:55.329794 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 608/1209] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:55 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:52:55.367585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:55.368744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:55.375294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.375997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.376592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.377457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.378391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.379020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.398039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:55.626297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.639911 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7aa17079-c94e-4702-b493-81ef95a4e74d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.276480 Oct 17 12:52:55.640618 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 609/1210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:55 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:55.646218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:55.647079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:55.653185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.653781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.654361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.655200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.656164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.656810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.689710 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-241f5155-0157-4f72-9990-8ab1315dda46 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a/action" status: 202 len: 0 microversion: 2.1 time: 0.641338 Oct 17 12:52:55.691195 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 602/1211] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:52:55 2022] POST /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:52:55.698884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-953f3a59-49bb-4fcb-9530-eb0c38ada601 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d974c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:55.799734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.827494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.829578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:55.831421 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a7007b5-4c3a-4ff7-8f59-f90d2af91a40 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.189536 Oct 17 12:52:55.831987 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 610/1212] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:55 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:55.836929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9515e495-263b-4211-a2bb-8b2a414b1cd7 req-270c3542-961e-482b-81aa-2bf516449ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a922b229-3a89-4a60-b461-dc6ca0ff580a", "tag": "af5f4111-7e89-4450-ac8a-fabcdcf51f6d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:55.847412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9515e495-263b-4211-a2bb-8b2a414b1cd7 req-270c3542-961e-482b-81aa-2bf516449ff6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.848144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9515e495-263b-4211-a2bb-8b2a414b1cd7 req-270c3542-961e-482b-81aa-2bf516449ff6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.848771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9515e495-263b-4211-a2bb-8b2a414b1cd7 req-270c3542-961e-482b-81aa-2bf516449ff6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.861633 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9515e495-263b-4211-a2bb-8b2a414b1cd7 req-270c3542-961e-482b-81aa-2bf516449ff6 service nova] Creating event network-changed:af5f4111-7e89-4450-ac8a-fabcdcf51f6d for instance a922b229-3a89-4a60-b461-dc6ca0ff580a on n-h2-853316-12 Oct 17 12:52:55.867723 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9515e495-263b-4211-a2bb-8b2a414b1cd7 req-270c3542-961e-482b-81aa-2bf516449ff6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034136 Oct 17 12:52:55.868391 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 611/1213] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:55.874689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:55.875268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:55.883251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.883876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.884510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:55.885381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:55.886003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:55.886823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.049628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-953f3a59-49bb-4fcb-9530-eb0c38ada601 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f in use.", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:52:56.050654 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-953f3a59-49bb-4fcb-9530-eb0c38ada601 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security Group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f in use. Oct 17 12:52:56.050654 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-36d88e45-5cbf-4631-9d90-8e57c5fc7f86'] Oct 17 12:52:56.051352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-953f3a59-49bb-4fcb-9530-eb0c38ada601 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-security-groups/10f79b2a-d45f-4217-a5ac-ed8bcab6087f HTTP/1.1 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: exception: Security Group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f in use. Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-36d88e45-5cbf-4631-9d90-8e57c5fc7f86'] Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '10f79b2a-d45f-4217-a5ac-ed8bcab6087f'} Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:52:56.052710 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f in use. Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36d88e45-5cbf-4631-9d90-8e57c5fc7f86'] Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f in use. Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36d88e45-5cbf-4631-9d90-8e57c5fc7f86'] Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f in use. Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36d88e45-5cbf-4631-9d90-8e57c5fc7f86'] Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f in use. Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36d88e45-5cbf-4631-9d90-8e57c5fc7f86'] Oct 17 12:52:56.057325 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:52:56.061228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-953f3a59-49bb-4fcb-9530-eb0c38ada601 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 400 to user: Security Group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f in use. Oct 17 12:52:56.061228 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-36d88e45-5cbf-4631-9d90-8e57c5fc7f86'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:52:56.062949 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-953f3a59-49bb-4fcb-9530-eb0c38ada601 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/10f79b2a-d45f-4217-a5ac-ed8bcab6087f" status: 400 len: 185 microversion: 2.1 time: 0.367956 Oct 17 12:52:56.064050 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 603/1214] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:52:55 2022] DELETE /compute/v2.1/os-security-groups/10f79b2a-d45f-4217-a5ac-ed8bcab6087f => generated 185 bytes in 369 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 12:52:56.064882 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9b27f989-9bf9-4f11-9323-5edbc4c777d0 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.195095 Oct 17 12:52:56.065454 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 612/1215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:55 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:56.072740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:56.073318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:56.084208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.084633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.085074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.085801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.086460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.087090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.098752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:56.099701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:56.113359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.114591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.115770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.117886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.118562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:52:56.118893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.119520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.149127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:52:56.223898 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-adabd4a3-1955-420b-8955-f2a5581978a3 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 204 len: 0 microversion: 2.1 time: 0.154300 Oct 17 12:52:56.224613 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 604/1216] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:52:56 2022] DELETE /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:52:56.237619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:56.239247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:56.247520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.247994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.248435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.249183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.249959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.250421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.321648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:56.329485 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b06ea51-a681-4759-9d03-2ab1949be585 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.236333 Oct 17 12:52:56.330091 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 613/1217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:56 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:56.361766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:56.363246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:56.370895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.371612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.372510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.373217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.373676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.374099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.461608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:56.471513 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-99930df8-dcf9-4a5a-b78e-64ace539edf2 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1646 microversion: 2.1 time: 0.240383 Oct 17 12:52:56.475664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:56.482538 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 605/1218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:56 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1646 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:56.485075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:56.486904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:56.493826 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e44017f-1e74-4342-9810-84ddbc501a7f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1452 microversion: 2.75 time: 0.137557 Oct 17 12:52:56.494786 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 614/1219] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:56 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:56.664954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:56.665928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:56.672653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.673384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.673917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.676163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.676741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.678292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.836445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:56.845553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7e99bbe-2391-449a-a447-6f0cf65d435d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.183908 Oct 17 12:52:56.850216 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 606/1220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:56 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:56.859491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:56.861231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:56.869760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.870292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.870759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:56.871484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:56.872160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:56.872789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.087930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:57.088543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:57.095054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:57.095958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:57.096555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.098193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:57.098817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:57.099404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.100055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:57.123289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:57.125839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:57.129663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9cd6850-0c63-4285-bd90-0defa2b19648 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.274933 Oct 17 12:52:57.130649 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 615/1221] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:56 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:57.255336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:57.266458 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0558b88d-b9ee-4ae5-86e4-8dab7b2e37db tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.181947 Oct 17 12:52:57.268261 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 607/1222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:57 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:57.433606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:57.434364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:57.443004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:57.443884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:57.444685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.445673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:57.446199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:57.446631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.500174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:57.501318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:57.509184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:57.509910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:57.510550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.511486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:57.512348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:57.512981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.711127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:57.720385 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-df2f5d08-32b1-4448-9fd6-938ad0422677 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1646 microversion: 2.1 time: 0.224432 Oct 17 12:52:57.722372 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 608/1223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:57 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1646 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:57.746529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:57.747501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:57.758760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:57.759442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:57.760005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.760918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:57.761370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:57.761824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:57.960358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:57.979460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:57.982207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:57.988978 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93d39d29-559b-48d0-937b-17ca932709f3 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1452 microversion: 2.75 time: 0.264879 Oct 17 12:52:57.990366 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 609/1224] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:57 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1452 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:57.996404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-db6182c1-6ef1-4b12-8e9b-585f6a40ebfe req-aa4a2088-fcf4-416c-8478-63c00519adf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaad0a9a-92c7-4a1c-b7de-a0818785dff5", "name": "network-vif-plugged", "status": "completed", "tag": "16e3a732-45d1-4e38-8f45-ed7b0da98a9b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:52:58.010228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-db6182c1-6ef1-4b12-8e9b-585f6a40ebfe req-aa4a2088-fcf4-416c-8478-63c00519adf0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.011380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-db6182c1-6ef1-4b12-8e9b-585f6a40ebfe req-aa4a2088-fcf4-416c-8478-63c00519adf0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.012683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-db6182c1-6ef1-4b12-8e9b-585f6a40ebfe req-aa4a2088-fcf4-416c-8478-63c00519adf0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.032216 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-db6182c1-6ef1-4b12-8e9b-585f6a40ebfe req-aa4a2088-fcf4-416c-8478-63c00519adf0 service nova] Creating event network-vif-plugged:16e3a732-45d1-4e38-8f45-ed7b0da98a9b for instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 on n-h1-853316-12 Oct 17 12:52:58.047894 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-db6182c1-6ef1-4b12-8e9b-585f6a40ebfe req-aa4a2088-fcf4-416c-8478-63c00519adf0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053664 Oct 17 12:52:58.049020 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 610/1225] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:52:58.062281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:58.063213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:58.085839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.087254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.087957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.089893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.090748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.091394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.184103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:58.202966 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-82b23f21-9d15-422a-81b8-9954c312c774 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.773633 Oct 17 12:52:58.203563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 616/1226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:57 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:58.218335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:58.219155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:58.233669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.234477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.235106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.235979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.236593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.237176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.364859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:58.373299 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-32e9ab85-91da-4f87-bc5e-a66b7a21e4ba tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.323074 Oct 17 12:52:58.374274 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 611/1227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:58 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:58.379343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:58.380584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:58.388330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.388330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.388330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.388330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.388777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.389022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.653189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:58.662550 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-83e346e3-691a-4a3a-b895-5e9b33a3acea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.287015 Oct 17 12:52:58.677995 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 612/1228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:58 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:58.746444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:58.747070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:58.748889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:58.756984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.762144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.765914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.766859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:58.769026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:58.770831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:58.778740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:58.784444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:58.785886 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-94dda25a-f7ff-4200-93f1-c4fe5b6c0143 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.581391 Oct 17 12:52:58.810956 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 617/1229] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:58 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:59.024596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:59.025111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:59.040250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.042621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.043250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.044136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.044746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.045343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.095001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:59.104304 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-407aa6b1-000d-4f50-9fe1-940008c5c74d tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1646 microversion: 2.1 time: 0.362392 Oct 17 12:52:59.106936 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 613/1230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:58 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1646 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:59.207150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:59.232617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:59.233418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:59.242769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:59.245625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.245836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:59.246123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.246679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.247381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.248357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.248357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.273730 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5bec8e80-3553-48eb-97c7-a1491910c73f tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1452 microversion: 2.75 time: 0.252347 Oct 17 12:52:59.298526 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 618/1231] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:59 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1452 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:52:59.409184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:59.411751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:59.451034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.451526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.451977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.453754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.454305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.454747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.505184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:59.513424 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4295a586-d034-4153-8076-35f69bcf5bce tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.284755 Oct 17 12:52:59.515181 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 614/1232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:59 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:59.685531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:59.686706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:59.695286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.696072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.696507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.697219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.697668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.698380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.862309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:59.873090 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-52f4f130-5707-40ff-b6ff-7e8dd7da1c01 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.479592 Oct 17 12:52:59.878214 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 619/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:59 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:52:59.886256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:52:59.889887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:52:59.907136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:52:59.921287 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93685c64-1769-4cdb-919f-e59ba4ef4166 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1318 microversion: 2.1 time: 0.239696 Oct 17 12:52:59.929199 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 615/1234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:52:59 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:52:59.934476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.935731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.936968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:52:59.937848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:52:59.938474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:52:59.939045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.024225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b7c600d7-f464-4886-9176-eea4aaf817a9 req-344a5576-9c06-49f0-9be0-e59b22d050a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a922b229-3a89-4a60-b461-dc6ca0ff580a", "name": "network-vif-deleted", "tag": "af5f4111-7e89-4450-ac8a-fabcdcf51f6d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:00.052225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b7c600d7-f464-4886-9176-eea4aaf817a9 req-344a5576-9c06-49f0-9be0-e59b22d050a4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.052715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b7c600d7-f464-4886-9176-eea4aaf817a9 req-344a5576-9c06-49f0-9be0-e59b22d050a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.053340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b7c600d7-f464-4886-9176-eea4aaf817a9 req-344a5576-9c06-49f0-9be0-e59b22d050a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.070259 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b7c600d7-f464-4886-9176-eea4aaf817a9 req-344a5576-9c06-49f0-9be0-e59b22d050a4 service nova] Creating event network-vif-deleted:af5f4111-7e89-4450-ac8a-fabcdcf51f6d for instance a922b229-3a89-4a60-b461-dc6ca0ff580a on n-h2-853316-12 Oct 17 12:53:00.086510 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b7c600d7-f464-4886-9176-eea4aaf817a9 req-344a5576-9c06-49f0-9be0-e59b22d050a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068547 Oct 17 12:53:00.087666 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 616/1235] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:53:00.106443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3a538cb3-4ab9-4453-bffc-ba69a3f0c6bc req-728c5825-6811-48fa-b42b-bc3cfe4791ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084effc1-ed15-42e0-9690-86c8e72ad0af", "name": "network-vif-plugged", "status": "completed", "tag": "ac3d1d21-5465-412e-867b-78afbadd0b2a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:00.117827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a538cb3-4ab9-4453-bffc-ba69a3f0c6bc req-728c5825-6811-48fa-b42b-bc3cfe4791ad service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.118923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a538cb3-4ab9-4453-bffc-ba69a3f0c6bc req-728c5825-6811-48fa-b42b-bc3cfe4791ad service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.119453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a538cb3-4ab9-4453-bffc-ba69a3f0c6bc req-728c5825-6811-48fa-b42b-bc3cfe4791ad service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.146427 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3a538cb3-4ab9-4453-bffc-ba69a3f0c6bc req-728c5825-6811-48fa-b42b-bc3cfe4791ad service nova] Creating event network-vif-plugged:ac3d1d21-5465-412e-867b-78afbadd0b2a for instance 084effc1-ed15-42e0-9690-86c8e72ad0af on n-h2-853316-12 Oct 17 12:53:00.165717 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3a538cb3-4ab9-4453-bffc-ba69a3f0c6bc req-728c5825-6811-48fa-b42b-bc3cfe4791ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076358 Oct 17 12:53:00.166364 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 617/1236] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:00.177224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:00.177934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:00.202187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.202942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.203577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.204454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.205072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.206856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.279386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.280170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.280773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.281385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lazy-loading 'fault' on Instance uuid a922b229-3a89-4a60-b461-dc6ca0ff580a {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:00.388636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:00.412780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:00.428179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:00.429793 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43e05fd6-f708-4e1b-9901-dfa1a0f12129 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.550231 Oct 17 12:53:00.430960 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 620/1237] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:52:59 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:00.437090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:00.438007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:00.455513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.469718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.470828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.473258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.474625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.475303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.595294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:00.630108 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f09564f-66c1-4441-95ce-3d79d9c421b4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 200 len: 1306 microversion: 2.1 time: 0.456800 Oct 17 12:53:00.631667 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 618/1238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:00 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 1306 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:00.648742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:00.653961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:00.658277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:00.662915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:00.664373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:00.684223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.687935 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e3282a6-316b-42a9-b47d-5909993cdb85 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1437 microversion: 2.75 time: 0.255566 Oct 17 12:53:00.689305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.693097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.696985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:00.700139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:00.701250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:00.702669 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 621/1239] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:00 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1437 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:01.098630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:01.101936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:01.118411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.119200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.119798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.120676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.121297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.123560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.125843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:01.137052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02258016-294b-4ea8-8b8c-eba5827d7356 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.502643 Oct 17 12:53:01.137644 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 619/1240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:00 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:01.145781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:01.146666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:01.169981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.183045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.183505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.184259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.184720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.185177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.259518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:53:01.260382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:53:01.261747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:53:01.264572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:53:01.265651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:53:01.360748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:01.371409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.372252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.372878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.375238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.375554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.376404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.545114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:01.562027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:01.579706 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-213294c1-fc0b-4164-90f2-678683d32d2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.440735 Oct 17 12:53:01.580584 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 620/1241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:01 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:01.586276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:01.587308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:01.591090 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8178cc80-7c35-4481-ab9a-e67708b29842 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4/action" status: 202 len: 1942 microversion: 2.75 time: 0.873546 Oct 17 12:53:01.594639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.595524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.596355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.597848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.598578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.599228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.610534 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 622/1242] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:53:00 2022] POST /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4/action => generated 1942 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 17 12:53:01.617416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:01.618776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:01.625031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.625649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.626093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.626895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.627424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.628017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.849222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:01.860143 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fc122b99-1bf9-4579-be9b-8378a5578490 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1468 microversion: 2.1 time: 0.277997 Oct 17 12:53:01.860985 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 621/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:01 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:01.875928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:01.876581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:01.894582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.895138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.895610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.896350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:01.896807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:01.897236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:01.900871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:02.076695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:02.118240 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d57dbd35-b8be-4d8b-a096-3b71fe2cee86 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.242834 Oct 17 12:53:02.119253 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 622/1244] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:01 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:02.147714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:02.149055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:02.156485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.157598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.158684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.159680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.160345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.160930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.176644 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a HTTP/1.1 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a922b229-3a89-4a60-b461-dc6ca0ff580a'} Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:02.178711 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:02.183288 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:02.183288 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:02.183288 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:02.183288 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:02.183288 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:02.183288 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:02.183288 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:02.183918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:02.185052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:02.186945 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8bda55d1-58d2-472a-8136-095b3564ce23 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 404 len: 111 microversion: 2.1 time: 0.044165 Oct 17 12:53:02.187677 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 623/1245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:02 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:02.193924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:02.194960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: b7f172c4-86e8-4996-bbd3-70fbbd71f382] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:02.195510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:02.196960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:02.198141 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c4835676-9e06-4a28-95ac-614b693d17eb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.586628 Oct 17 12:53:02.200797 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 623/1246] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:01 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:02.202275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.202911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.203479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.204322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.205097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.205293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-63a7645c-1bcd-45ce-b9f3-8355900a2ba9 req-38d07705-ae36-47ae-bf56-4154ab059bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f", "tag": "9f4a095c-f1f7-4a15-8f40-4f486877220d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:02.205809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.214920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-63a7645c-1bcd-45ce-b9f3-8355900a2ba9 req-38d07705-ae36-47ae-bf56-4154ab059bdc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.215385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-63a7645c-1bcd-45ce-b9f3-8355900a2ba9 req-38d07705-ae36-47ae-bf56-4154ab059bdc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.215816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-63a7645c-1bcd-45ce-b9f3-8355900a2ba9 req-38d07705-ae36-47ae-bf56-4154ab059bdc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.220120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:02.228093 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-63a7645c-1bcd-45ce-b9f3-8355900a2ba9 req-38d07705-ae36-47ae-bf56-4154ab059bdc service nova] Creating event network-changed:9f4a095c-f1f7-4a15-8f40-4f486877220d for instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f on n-h1-853316-12 Oct 17 12:53:02.233782 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-63a7645c-1bcd-45ce-b9f3-8355900a2ba9 req-38d07705-ae36-47ae-bf56-4154ab059bdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031761 Oct 17 12:53:02.238053 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 624/1247] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:02.243495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:02.244196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:02.251083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.251578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.252020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.252727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.253785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.254245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.454380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:02.469034 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0fd13440-f473-48ff-bb0b-448e09a16140 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382" status: 200 len: 1468 microversion: 2.1 time: 0.280122 Oct 17 12:53:02.470274 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 624/1248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:02 2022] GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382 => generated 1468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:02.479406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff857fb2-a752-40ed-bae9-610d607a84ea tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820df9dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:02.563902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:02.579670 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3698a2e-f3e5-4fc3-8e62-c2663bb1d689 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.337679 Oct 17 12:53:02.580669 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 625/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:02 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:02.590392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:02.605081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:02.606032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Searching by: {'reservation_id': 'r-nidha6pb', 'deleted': False, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:53:02.619554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:02.641559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.646042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.647803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.648695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.649161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.650019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.857674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:53:02.911236 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff857fb2-a752-40ed-bae9-610d607a84ea tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/acf3e7a0-9047-4f70-b776-2c2d7df5fa21" status: 202 len: 0 microversion: 2.1 time: 0.439476 Oct 17 12:53:02.912611 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 625/1250] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:02 2022] DELETE /compute/v2.1/os-security-groups/acf3e7a0-9047-4f70-b776-2c2d7df5fa21 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:02.918255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:02.919259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:02.933464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.935436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.937176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:02.941612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:02.943808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:02.945842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:03.023508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:03.031001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:03.031561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:03.032284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:03.250026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:03.259607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c3207c19-51ea-4d2b-a59c-0639dfcf73b6 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.345566 Oct 17 12:53:03.260969 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 626/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:02 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:03.266024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b49d26a7-c404-4037-a086-4ab838538931 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d97790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:03.410638 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-534e75be-ac6d-4d7a-9e33-1714461ff0d4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-nidha6pb" status: 200 len: 2929 microversion: 2.1 time: 0.827826 Oct 17 12:53:03.412183 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 626/1252] 10.222.0.27 () {58 vars in 1197 bytes} [Mon Oct 17 12:53:02 2022] GET /compute/v2.1/servers/detail?reservation_id=r-nidha6pb => generated 2929 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:03.425651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:03.426835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:03.440170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:03.443955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:03.446800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:03.447883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:03.448896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:03.451196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:03.759149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:03.779981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a95690c-93b7-4bec-8b07-5b3e2d37836c tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.365408 Oct 17 12:53:03.786125 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 627/1253] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:03 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:03.792978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:03.793603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:03.801463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:03.802020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:03.802497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:03.803229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:03.803690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:03.810124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:03.978208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:03.993049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:03.994898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:03.996123 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9bdf619-f188-4f82-b6b0-25455ef424ae tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.214597 Oct 17 12:53:04.010191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 628/1254] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:03 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:04.010191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-685c4d12-f298-451f-8055-1940c5930d19 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:04.025216 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b49d26a7-c404-4037-a086-4ab838538931 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/10f79b2a-d45f-4217-a5ac-ed8bcab6087f" status: 202 len: 0 microversion: 2.1 time: 0.762729 Oct 17 12:53:04.026876 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 627/1255] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:03 2022] DELETE /compute/v2.1/os-security-groups/10f79b2a-d45f-4217-a5ac-ed8bcab6087f => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:04.037587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:04.038307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:04.046041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.047284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.047738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.048462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.049210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.049832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.070448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.server_groups [None req-685c4d12-f298-451f-8055-1940c5930d19 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Querying cell 77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) for 2 instances {{(pid=127540) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 12:53:04.071183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-685c4d12-f298-451f-8055-1940c5930d19 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.071907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-685c4d12-f298-451f-8055-1940c5930d19 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.072096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-685c4d12-f298-451f-8055-1940c5930d19 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.124982 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-685c4d12-f298-451f-8055-1940c5930d19 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/ddd7d891-47fe-455e-a024-f1d9ae7bafb3" status: 200 len: 270 microversion: 2.1 time: 0.127201 Oct 17 12:53:04.127689 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 629/1256] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:53:03 2022] GET /compute/v2.1/os-server-groups/ddd7d891-47fe-455e-a024-f1d9ae7bafb3 => generated 270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:04.139583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a79e9b8b-e36b-4e67-9616-385628599cda tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'create', calling method: .version_select at 0x7fa820ccc790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-271136027", "description": "tempest-description-1528866804"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:04.326668 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a79e9b8b-e36b-4e67-9616-385628599cda tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.190785 Oct 17 12:53:04.327825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 630/1257] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 12:53:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:04.333812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:04.334870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:04.342941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:04.352755 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4361e801-f9ac-4560-8506-7f5fccab3114 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.324362 Oct 17 12:53:04.353352 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 628/1258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:04 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:04.362396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.362396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.362396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.362396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.362396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.362396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.379924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:04.380538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:04.388416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.388910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.389352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.390265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.390880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.391315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.536681 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b260249-5eb1-4f78-a2d3-2aec641c60be tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 200 len: 1621 microversion: 2.1 time: 0.206983 Oct 17 12:53:04.537217 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 631/1259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:04 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 1621 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:04.543772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f02901f-d6b7-4e46-bd9e-0c3dae995d7f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Action: 'update', calling method: .version_select at 0x7fa820cc18b0>, body: {"security_group": {"name": "tempest-sg-hth-2000553481", "description": "tempest-description-hth-1282258740"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:04.561168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:04.569991 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c61df6eb-cba5-4140-ae3b-076bff97e2dd tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.198844 Oct 17 12:53:04.570599 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 629/1260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:04 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:04.579735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:04.580680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] [instance: b7f172c4-86e8-4996-bbd3-70fbbd71f382] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:04.588917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.589404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.590030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.590890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.591348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.591773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.733647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f02901f-d6b7-4e46-bd9e-0c3dae995d7f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/b5acd3dc-f2bc-48f4-a74d-ee5f5f4716d5" status: 200 len: 218 microversion: 2.1 time: 0.195326 Oct 17 12:53:04.734846 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 632/1261] 10.222.0.27 () {60 vars in 1290 bytes} [Mon Oct 17 12:53:04 2022] PUT /compute/v2.1/os-security-groups/b5acd3dc-f2bc-48f4-a74d-ee5f5f4716d5 => generated 218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:04.735388 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3419b214-9814-42e8-bbc1-0b310859a9d1 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382" status: 200 len: 1621 microversion: 2.1 time: 0.159629 Oct 17 12:53:04.735976 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 630/1262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:04 2022] GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382 => generated 1621 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:04.757758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7edba8e5-0cc9-4aa2-82ff-c30b2cd156a4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820dd9790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:04.883139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-790374317", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "8f2aff18-6550-46dd-a8fa-f437ccf160b2"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:04.892080 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7edba8e5-0cc9-4aa2-82ff-c30b2cd156a4 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/b5acd3dc-f2bc-48f4-a74d-ee5f5f4716d5" status: 200 len: 218 microversion: 2.1 time: 0.147225 Oct 17 12:53:04.892937 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 631/1263] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 12:53:04 2022] GET /compute/v2.1/os-security-groups/b5acd3dc-f2bc-48f4-a74d-ee5f5f4716d5 => generated 218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:04.903836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:04.904797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:04.913214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.913800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.914351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.915359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:04.916089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:04.916778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:04.944124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] validate_networks() for [('8f2aff18-6550-46dd-a8fa-f437ccf160b2', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:53:05.002602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:05.023936 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0732b82f-bffe-49b0-b3bb-93cd25173d37 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.124429 Oct 17 12:53:05.024538 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 632/1264] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:04 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:05.029635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9424e802-ac88-49d0-9938-25197e6d79d1 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa8212f8e50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:05.227160 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9424e802-ac88-49d0-9938-25197e6d79d1 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b5acd3dc-f2bc-48f4-a74d-ee5f5f4716d5" status: 202 len: 0 microversion: 2.1 time: 0.200820 Oct 17 12:53:05.228036 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 633/1265] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:05 2022] DELETE /compute/v2.1/os-security-groups/b5acd3dc-f2bc-48f4-a74d-ee5f5f4716d5 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:05.239773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1396275941", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "e2607f9b-b14e-4bad-a241-9cd51a932b94"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:05.299016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:53:05.386027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:53:05.387340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:53:05.387340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:53:05.387559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:53:05.387945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:53:05.402753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.403243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.403746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.404495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.405376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.405376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.425503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Getting quotas for project db52cce04e8449979f4fbc6bd8d8e777. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:53:05.429792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Getting quotas for user d916f6475fa544ea9bf8afe0663ed5b9 and project db52cce04e8449979f4fbc6bd8d8e777. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:53:05.443281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:53:05.445660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:53:05.506798 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a4ca862-f33b-4e74-b827-119e4223cfa3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770296 Oct 17 12:53:05.508085 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 633/1266] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:53:05.513026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:05.514036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:05.521074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.521841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.522537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.523442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.524120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.524760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.552526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:53:05.553092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:53:05.553423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:53:05.553892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:53:05.554434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:53:05.564940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.565428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.566020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.566796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.567253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.567685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.586074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:53:05.592224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:53:05.604694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:53:05.607088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:53:05.664198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-efc45d45-d3f1-4605-8f3a-55d228f02efe tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.429485 Oct 17 12:53:05.671028 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 634/1267] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:53:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:53:05.685053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:05.685511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:05.693474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.693979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.694451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.695730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.696700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.697288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.714885 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a HTTP/1.1 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a922b229-3a89-4a60-b461-dc6ca0ff580a'} Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:05.716514 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:05.720534 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-744e4d87-2366-4fec-9bd9-bcb80ce8e186 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 404 len: 111 microversion: 2.1 time: 0.045374 Oct 17 12:53:05.721849 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 635/1268] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:05 2022] DELETE /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:05.726872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:05.727366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:05.736628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.738567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.739257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.739978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.740485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.740850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.756133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:05.772877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:05.776077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:05.779893 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-523ce977-5613-4a58-9591-17e7f22a42e1 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.270331 Oct 17 12:53:05.794204 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 634/1269] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:05 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:05.794204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f398a2e-3a01-4721-98cd-0443f1e26689 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:05.794204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f398a2e-3a01-4721-98cd-0443f1e26689 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:05.850344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f398a2e-3a01-4721-98cd-0443f1e26689 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:05.865785 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f398a2e-3a01-4721-98cd-0443f1e26689 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1216 microversion: 2.1 time: 0.083658 Oct 17 12:53:05.873024 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 635/1270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:05 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:05.895485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:05.896130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:05.903716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.904593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.905306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:05.906428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:05.907219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:05.908170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.005576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:06.017228 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e3f8e84-16c7-4613-b7ea-1dffdf68d771 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1473 microversion: 2.1 time: 0.294222 Oct 17 12:53:06.017813 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 636/1271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:05 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:06.032995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-98774cda-1457-4563-b10a-7f702a83f699 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.035672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-98774cda-1457-4563-b10a-7f702a83f699 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:06.116760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-98774cda-1457-4563-b10a-7f702a83f699 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:06.127110 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-98774cda-1457-4563-b10a-7f702a83f699 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1217 microversion: 2.1 time: 0.103068 Oct 17 12:53:06.129514 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 637/1272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:06 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:06.143137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.146642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: a922b229-3a89-4a60-b461-dc6ca0ff580a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:06.146792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:06.155832 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13eaba3e-8b58-48b5-b144-e2d9d0a7cf2f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.272168 Oct 17 12:53:06.156415 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 636/1273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:05 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:06.168788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.169406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:06.175281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.176050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.176387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.177244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.177809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.178250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.178796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.178927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.179426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.180107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.180870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.181410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.200888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a HTTP/1.1 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a922b229-3a89-4a60-b461-dc6ca0ff580a'} Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.203082 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.208995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.208995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.208995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.208995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:06.208995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:06.208995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. Oct 17 12:53:06.208995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.211212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Instance a922b229-3a89-4a60-b461-dc6ca0ff580a could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:06.212572 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ed447776-1ef9-4426-95a5-e15141b19862 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a" status: 404 len: 111 microversion: 2.1 time: 0.081400 Oct 17 12:53:06.213983 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 638/1274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:06 2022] GET /compute/v2.1/servers/a922b229-3a89-4a60-b461-dc6ca0ff580a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:06.225301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-60e63e8e-0015-48b5-812c-6865a8b1e6cf tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820df9040>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.256123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-60e63e8e-0015-48b5-812c-6865a8b1e6cf tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f does not exist", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:53:06.256934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.security_group_api [None req-60e63e8e-0015-48b5-812c-6865a8b1e6cf tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f not found {{(pid=127539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:53:06.257632 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-60e63e8e-0015-48b5-812c-6865a8b1e6cf tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f does not exist Oct 17 12:53:06.257632 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-68f174be-9f2a-4857-aedd-2081a2523d28'] Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-60e63e8e-0015-48b5-812c-6865a8b1e6cf tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-security-groups/10f79b2a-d45f-4217-a5ac-ed8bcab6087f HTTP/1.1 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f does not exist Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-68f174be-9f2a-4857-aedd-2081a2523d28'] Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '10f79b2a-d45f-4217-a5ac-ed8bcab6087f'} Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:53:06.259730 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f does not exist Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68f174be-9f2a-4857-aedd-2081a2523d28'] Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f does not exist Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68f174be-9f2a-4857-aedd-2081a2523d28'] Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f does not exist Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68f174be-9f2a-4857-aedd-2081a2523d28'] Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f does not exist Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68f174be-9f2a-4857-aedd-2081a2523d28'] Oct 17 12:53:06.264138 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.268230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-60e63e8e-0015-48b5-812c-6865a8b1e6cf tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group 10f79b2a-d45f-4217-a5ac-ed8bcab6087f does not exist Oct 17 12:53:06.268230 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-68f174be-9f2a-4857-aedd-2081a2523d28'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:06.269626 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-60e63e8e-0015-48b5-812c-6865a8b1e6cf tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/10f79b2a-d45f-4217-a5ac-ed8bcab6087f" status: 404 len: 194 microversion: 2.1 time: 0.050201 Oct 17 12:53:06.271819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 639/1275] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:06 2022] DELETE /compute/v2.1/os-security-groups/10f79b2a-d45f-4217-a5ac-ed8bcab6087f => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:06.281589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-501a48fb-4575-4057-b0c2-a13de96bd0eb tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d97b80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.299081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:06.316484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-501a48fb-4575-4057-b0c2-a13de96bd0eb tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 does not exist", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:53:06.317100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.security_group_api [None req-501a48fb-4575-4057-b0c2-a13de96bd0eb tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 not found {{(pid=127539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:53:06.317663 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-501a48fb-4575-4057-b0c2-a13de96bd0eb tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 does not exist Oct 17 12:53:06.317663 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-cff980b7-5112-4139-b79c-b00473a39f4e'] Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-501a48fb-4575-4057-b0c2-a13de96bd0eb tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-security-groups/acf3e7a0-9047-4f70-b776-2c2d7df5fa21 HTTP/1.1 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 does not exist Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-cff980b7-5112-4139-b79c-b00473a39f4e'] Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'acf3e7a0-9047-4f70-b776-2c2d7df5fa21'} Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:53:06.319937 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 does not exist Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cff980b7-5112-4139-b79c-b00473a39f4e'] Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 does not exist Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cff980b7-5112-4139-b79c-b00473a39f4e'] Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 does not exist Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cff980b7-5112-4139-b79c-b00473a39f4e'] Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 does not exist Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cff980b7-5112-4139-b79c-b00473a39f4e'] Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-501a48fb-4575-4057-b0c2-a13de96bd0eb tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group acf3e7a0-9047-4f70-b776-2c2d7df5fa21 does not exist Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-cff980b7-5112-4139-b79c-b00473a39f4e'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-501a48fb-4575-4057-b0c2-a13de96bd0eb tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/acf3e7a0-9047-4f70-b776-2c2d7df5fa21" status: 404 len: 194 microversion: 2.1 time: 0.045377 Oct 17 12:53:06.324535 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 640/1276] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:06 2022] DELETE /compute/v2.1/os-security-groups/acf3e7a0-9047-4f70-b776-2c2d7df5fa21 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:06.330652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-353b6b4a-e5f4-41ef-a3e3-fd677afb9f6b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820e1ea60>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.332877 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c09e57eb-fd92-4bd2-9d37-26fc278fe962 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.171756 Oct 17 12:53:06.333595 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 637/1277] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:06 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:06.373471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-353b6b4a-e5f4-41ef-a3e3-fd677afb9f6b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:53:06.374355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.security_group_api [None req-353b6b4a-e5f4-41ef-a3e3-fd677afb9f6b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group b2b077a3-d56b-4353-a775-cbaf61609c12 not found {{(pid=127539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:53:06.374977 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-353b6b4a-e5f4-41ef-a3e3-fd677afb9f6b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:53:06.374977 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-871f6e87-1984-485d-97d2-fc2d2539151c'] Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-353b6b4a-e5f4-41ef-a3e3-fd677afb9f6b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-security-groups/b2b077a3-d56b-4353-a775-cbaf61609c12 HTTP/1.1 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-871f6e87-1984-485d-97d2-fc2d2539151c'] Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'b2b077a3-d56b-4353-a775-cbaf61609c12'} Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:53:06.376813 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-871f6e87-1984-485d-97d2-fc2d2539151c'] Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-871f6e87-1984-485d-97d2-fc2d2539151c'] Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-871f6e87-1984-485d-97d2-fc2d2539151c'] Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-871f6e87-1984-485d-97d2-fc2d2539151c'] Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-353b6b4a-e5f4-41ef-a3e3-fd677afb9f6b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group b2b077a3-d56b-4353-a775-cbaf61609c12 does not exist Oct 17 12:53:06.382115 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-871f6e87-1984-485d-97d2-fc2d2539151c'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:06.390228 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-353b6b4a-e5f4-41ef-a3e3-fd677afb9f6b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b2b077a3-d56b-4353-a775-cbaf61609c12" status: 404 len: 194 microversion: 2.1 time: 0.051851 Oct 17 12:53:06.390228 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 641/1278] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:06 2022] DELETE /compute/v2.1/os-security-groups/b2b077a3-d56b-4353-a775-cbaf61609c12 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:06.397497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff390f3f-f2b3-466a-a84b-da39ad6f3ac6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d3be50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.423493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-ff390f3f-f2b3-466a-a84b-da39ad6f3ac6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:53:06.424119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-ff390f3f-f2b3-466a-a84b-da39ad6f3ac6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group 9e250f21-2974-45e4-8a60-032e9d107f92 not found {{(pid=127540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:53:06.424654 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ff390f3f-f2b3-466a-a84b-da39ad6f3ac6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:53:06.424654 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-d55fbe0f-fa7e-4e60-8a08-66df8b35e6ed'] Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff390f3f-f2b3-466a-a84b-da39ad6f3ac6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-security-groups/9e250f21-2974-45e4-8a60-032e9d107f92 HTTP/1.1 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: exception: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-d55fbe0f-fa7e-4e60-8a08-66df8b35e6ed'] Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9e250f21-2974-45e4-8a60-032e9d107f92'} Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:53:06.427394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d55fbe0f-fa7e-4e60-8a08-66df8b35e6ed'] Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d55fbe0f-fa7e-4e60-8a08-66df8b35e6ed'] Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d55fbe0f-fa7e-4e60-8a08-66df8b35e6ed'] Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d55fbe0f-fa7e-4e60-8a08-66df8b35e6ed'] Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff390f3f-f2b3-466a-a84b-da39ad6f3ac6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group 9e250f21-2974-45e4-8a60-032e9d107f92 does not exist Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-d55fbe0f-fa7e-4e60-8a08-66df8b35e6ed'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff390f3f-f2b3-466a-a84b-da39ad6f3ac6 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9e250f21-2974-45e4-8a60-032e9d107f92" status: 404 len: 194 microversion: 2.1 time: 0.037352 Oct 17 12:53:06.432911 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 638/1279] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:06 2022] DELETE /compute/v2.1/os-security-groups/9e250f21-2974-45e4-8a60-032e9d107f92 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:06.439501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bbfa17d4-7229-4517-8c46-d4a1197e1b9c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d549d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.470312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-bbfa17d4-7229-4517-8c46-d4a1197e1b9c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:53:06.470923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.security_group_api [None req-bbfa17d4-7229-4517-8c46-d4a1197e1b9c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group 01990610-2d88-4951-bdc3-9ad1beb46650 not found {{(pid=127539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:53:06.471639 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-bbfa17d4-7229-4517-8c46-d4a1197e1b9c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:53:06.471639 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-23cbbe9a-df79-4d32-b728-253982f3f0ab'] Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bbfa17d4-7229-4517-8c46-d4a1197e1b9c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-security-groups/01990610-2d88-4951-bdc3-9ad1beb46650 HTTP/1.1 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-23cbbe9a-df79-4d32-b728-253982f3f0ab'] Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '01990610-2d88-4951-bdc3-9ad1beb46650'} Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:53:06.474429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23cbbe9a-df79-4d32-b728-253982f3f0ab'] Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23cbbe9a-df79-4d32-b728-253982f3f0ab'] Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23cbbe9a-df79-4d32-b728-253982f3f0ab'] Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23cbbe9a-df79-4d32-b728-253982f3f0ab'] Oct 17 12:53:06.478221 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.482551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bbfa17d4-7229-4517-8c46-d4a1197e1b9c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group 01990610-2d88-4951-bdc3-9ad1beb46650 does not exist Oct 17 12:53:06.482551 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-23cbbe9a-df79-4d32-b728-253982f3f0ab'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:06.483536 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bbfa17d4-7229-4517-8c46-d4a1197e1b9c tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/01990610-2d88-4951-bdc3-9ad1beb46650" status: 404 len: 194 microversion: 2.1 time: 0.048709 Oct 17 12:53:06.484100 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 642/1280] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:06 2022] DELETE /compute/v2.1/os-security-groups/01990610-2d88-4951-bdc3-9ad1beb46650 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:06.493538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6efa7d1-d876-4769-8b02-2bd8152f4c62 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d480d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.521867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-a6efa7d1-d876-4769-8b02-2bd8152f4c62 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 12:53:06.522611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-a6efa7d1-d876-4769-8b02-2bd8152f4c62 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Neutron security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 not found {{(pid=127540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 12:53:06.523758 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a6efa7d1-d876-4769-8b02-2bd8152f4c62 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:53:06.523758 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-7b289f98-6056-4ecc-80f9-e403fabe6d8e'] Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6efa7d1-d876-4769-8b02-2bd8152f4c62 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1 HTTP/1.1 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: exception: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-7b289f98-6056-4ecc-80f9-e403fabe6d8e'] Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'feb4bc6a-b772-4fe5-9e9e-65578c9459d1'} Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 12:53:06.525926 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b289f98-6056-4ecc-80f9-e403fabe6d8e'] Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b289f98-6056-4ecc-80f9-e403fabe6d8e'] Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b289f98-6056-4ecc-80f9-e403fabe6d8e'] Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b289f98-6056-4ecc-80f9-e403fabe6d8e'] Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6efa7d1-d876-4769-8b02-2bd8152f4c62 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Security group feb4bc6a-b772-4fe5-9e9e-65578c9459d1 does not exist Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-7b289f98-6056-4ecc-80f9-e403fabe6d8e'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6efa7d1-d876-4769-8b02-2bd8152f4c62 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1" status: 404 len: 194 microversion: 2.1 time: 0.038638 Oct 17 12:53:06.529738 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 639/1281] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:06 2022] DELETE /compute/v2.1/os-security-groups/feb4bc6a-b772-4fe5-9e9e-65578c9459d1 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:06.538895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.539606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:06.545892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.546488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.547054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.547805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.548271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.548910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.579270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:06.682652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:06.685724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ccc46581-2a52-4a47-9b04-c8858a697069 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 204 len: 0 microversion: 2.1 time: 0.151081 Oct 17 12:53:06.686338 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 643/1282] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:06 2022] DELETE /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:06.697427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.698203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:06.705428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.705917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.706512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.708013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.708773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.709403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.816675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:06.817729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:06.825878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.826403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.826849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.827609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:06.828429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:06.828672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:06.992769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:07.005773 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a55c5ba6-b078-42e8-9b59-2433d6b5933f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1645 microversion: 2.1 time: 0.313654 Oct 17 12:53:07.007467 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 640/1283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:06 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1645 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:07.016534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:07.017589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:07.042743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.043677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.049816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.053807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.054847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.056852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.148241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:07.159407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:07.162914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:07.164377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5125ed8e-3660-42ee-b8b7-4c291ae77fb6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.355101 Oct 17 12:53:07.165508 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 644/1284] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:06 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:07.170749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:07.171912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:07.198346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.202844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.203454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.204831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.205944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.211465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.275990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:07.291080 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d67bd8d-5181-45c2-81c7-db41e311210d tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1268 microversion: 2.1 time: 0.281830 Oct 17 12:53:07.292226 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 641/1285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:07 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1268 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:07.298053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:07.298865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:07.316145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.316924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.317575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.322130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.322866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.323467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.496702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:07.510631 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f026d5d7-bc05-4f17-b6aa-88cadd55318b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1269 microversion: 2.1 time: 0.217139 Oct 17 12:53:07.511605 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 642/1286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:07 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1269 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:07.519639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:07.520718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:07.531404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.532623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.533241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.534139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.535324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.535960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.718945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:07.728270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f46707a9-ddee-4924-a4c4-8012ae853e28 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.561354 Oct 17 12:53:07.729268 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 645/1287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:07 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:07.734449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:07.735692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:07.754655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.755210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.755654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.756578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:07.757042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:07.757572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:07.827728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:07.838837 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e4651fe7-7dc8-49de-a3f2-5f0e0eaab313 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.326103 Oct 17 12:53:07.839421 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 643/1288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:07 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:07.876462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:07.900141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d85a47b8-5268-4325-91fd-e7df449848a9 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.169545 Oct 17 12:53:07.900867 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 646/1289] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:07 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:08.035937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:08.036507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:08.043244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.043910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.044368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.045088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.045556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.045988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.199863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:08.200769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:08.213230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.213954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.214635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.215579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.216256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.216845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.245316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:08.268511 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-59754383-a378-4ec4-8c59-40ae216f78ce tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1645 microversion: 2.1 time: 0.237292 Oct 17 12:53:08.290204 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 644/1290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:08 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1645 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:08.316810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:08.317617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:08.331131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.331897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.332651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.333901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.334561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.335156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.417868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:08.420378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:08.431569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:08.432408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:08.434295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:08.435632 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6f45f3e4-01d1-4e63-abe3-496a22dc7e19 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.242902 Oct 17 12:53:08.447486 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 647/1291] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:08 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:08.447677 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b62fc31b-1cb5-4015-a6df-f0001fc2a197 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1268 microversion: 2.1 time: 0.129557 Oct 17 12:53:08.447677 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 645/1292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:08 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1268 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:08.541160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:08.541684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:08.548006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.548492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.548925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.549616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.550121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.550927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.617391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:08.625385 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7203652-eff8-43df-87ff-9ae00b520f30 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1269 microversion: 2.1 time: 0.088907 Oct 17 12:53:08.625947 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 648/1293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:08 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:08.754249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:08.754973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:08.774106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.774676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.775171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.775968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.776493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.777281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.779851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:08.865567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:08.866772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:08.880655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.881172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.881641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:08.882427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:08.882910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:08.883365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.016265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:09.030499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de13cf62-2a84-45f8-b4d4-3b95f08b7ea1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.281334 Oct 17 12:53:09.031634 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 646/1294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:08 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:09.039235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e3e26245-6453-4dd2-ba11-c37c890a7367 req-aa0b1be8-8126-4c98-bb8b-06f81f2685db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f6b019-8c13-4d9a-a8cb-904f872a660e", "name": "network-vif-deleted", "tag": "3bd1387b-ebdd-4269-a546-857402226506"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:09.056053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e3e26245-6453-4dd2-ba11-c37c890a7367 req-aa0b1be8-8126-4c98-bb8b-06f81f2685db service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.056891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e3e26245-6453-4dd2-ba11-c37c890a7367 req-aa0b1be8-8126-4c98-bb8b-06f81f2685db service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.057863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e3e26245-6453-4dd2-ba11-c37c890a7367 req-aa0b1be8-8126-4c98-bb8b-06f81f2685db service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.071606 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e3e26245-6453-4dd2-ba11-c37c890a7367 req-aa0b1be8-8126-4c98-bb8b-06f81f2685db service nova] Creating event network-vif-deleted:3bd1387b-ebdd-4269-a546-857402226506 for instance 40f6b019-8c13-4d9a-a8cb-904f872a660e on n-h2-853316-12 Oct 17 12:53:09.078640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e3e26245-6453-4dd2-ba11-c37c890a7367 req-aa0b1be8-8126-4c98-bb8b-06f81f2685db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044811 Oct 17 12:53:09.079933 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 647/1295] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:09.088501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:09.089512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:09.099060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.099607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.100077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.100791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.101483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.102297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.151284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:09.161930 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7b71bbd0-b230-4f47-96b3-eda882606370 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.301920 Oct 17 12:53:09.162760 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 649/1296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:08 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:09.204599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:09.225755 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9b579989-2170-4154-901b-92d1b3d9ba55 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.143527 Oct 17 12:53:09.226869 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 648/1297] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:09 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:09.296817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:09.297423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:09.307933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.308791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.310065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.311093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.311558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.312409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.365698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.366489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.367264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.367884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lazy-loading 'fault' on Instance uuid 40f6b019-8c13-4d9a-a8cb-904f872a660e {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:09.430095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4958dd7065be4821bae0ff2033c5e72a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2816d963beca40e6bafbbd722b005ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:09.439240 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d92152b-2920-41c9-9f13-8df677cb3f1b tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 200 len: 1306 microversion: 2.1 time: 0.146211 Oct 17 12:53:09.439998 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 650/1298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:09 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 1306 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:09.463458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:09.464186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:09.470349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.470925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.471441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.472303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.472899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.473070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:09.473485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.473766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:09.479767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.480252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.480685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.481383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.481833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.482588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.562967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:09.572783 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e078d80-78c6-40d1-81b9-3c098aba0455 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1274 microversion: 2.1 time: 0.103716 Oct 17 12:53:09.573355 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 651/1299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:09 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:09.614801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:09.623998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:09.625498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:09.626763 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20dc67b9-8dac-4c18-8c32-c0aeedb9c136 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.167522 Oct 17 12:53:09.627335 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 649/1300] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:09 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:09.649843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:09.650696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:09.656805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.657336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.657841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.658632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:09.659093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:09.660182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:09.741054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:09.763732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ab0dbfa-9fd3-46de-a0af-a3ca92631e3d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1269 microversion: 2.1 time: 0.115785 Oct 17 12:53:09.764461 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 652/1301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:09 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:10.058495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:10.059098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:10.066236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.067606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.068051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.068760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.069217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.069637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.089786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f4d7a37c-d739-470a-a7fa-77b351b8f632 req-6f2468c2-f4ac-42e0-a6f1-256a477afd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f", "name": "network-vif-plugged", "status": "completed", "tag": "9f4a095c-f1f7-4a15-8f40-4f486877220d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:10.101064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4d7a37c-d739-470a-a7fa-77b351b8f632 req-6f2468c2-f4ac-42e0-a6f1-256a477afd56 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.101549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4d7a37c-d739-470a-a7fa-77b351b8f632 req-6f2468c2-f4ac-42e0-a6f1-256a477afd56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.101984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4d7a37c-d739-470a-a7fa-77b351b8f632 req-6f2468c2-f4ac-42e0-a6f1-256a477afd56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.127043 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f4d7a37c-d739-470a-a7fa-77b351b8f632 req-6f2468c2-f4ac-42e0-a6f1-256a477afd56 service nova] Creating event network-vif-plugged:9f4a095c-f1f7-4a15-8f40-4f486877220d for instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f on n-h1-853316-12 Oct 17 12:53:10.143261 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f4d7a37c-d739-470a-a7fa-77b351b8f632 req-6f2468c2-f4ac-42e0-a6f1-256a477afd56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047543 Oct 17 12:53:10.144851 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 653/1302] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:53:10.187748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:10.188783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:10.197789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.198628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.199081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.199796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.200712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.200997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.234496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:10.242980 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d32bec52-eeb7-483d-bfb6-2d064c1a1b01 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.189658 Oct 17 12:53:10.244220 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 650/1303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:10 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:10.257168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:10.257899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:10.264330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.264823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.265274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.265986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.266480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.266913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.344938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:10.361841 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7827911b-c8b7-44a3-a5be-f2d057c586f6 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.108729 Oct 17 12:53:10.363667 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 651/1304] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:10 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:10.421599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:10.430084 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-edeb8237-a643-41ca-9020-daf26224957f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.247291 Oct 17 12:53:10.430822 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 654/1305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:10 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:10.463524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:10.464185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] [instance: 40f6b019-8c13-4d9a-a8cb-904f872a660e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:10.470372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.470871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.471308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.472559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.473064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.473492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.487231 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] HTTP exception thrown: Instance 40f6b019-8c13-4d9a-a8cb-904f872a660e could not be found. Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Request method failure captured: Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e HTTP/1.1 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_rgK-fbhqvA577u9OXgN_yvT5O-idiIMfz_bUImkevRdU8dTcwFt6V2OCptck9JB_DQ1r47MYszC73wHw44ywz3hznDIGf4hG4yuiB8FwfyBBYVtgKPaqbrE4pP82xVu0T40FMKvbxu9U2FD8KlJZQuud15-VOZcyk0eYi5-gLUi8 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2816d963beca40e6bafbbd722b005ea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2816d963beca40e6bafbbd722b005ea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2816d963beca40e6bafbbd722b005ea1 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-196038409 Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 4958dd7065be4821bae0ff2033c5e72a Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupsTestJSON-196038409-project Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 40f6b019-8c13-4d9a-a8cb-904f872a660e could not be found. Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '40f6b019-8c13-4d9a-a8cb-904f872a660e'} Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f6b019-8c13-4d9a-a8cb-904f872a660e could not be found. Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f6b019-8c13-4d9a-a8cb-904f872a660e could not be found. Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:10.489657 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f6b019-8c13-4d9a-a8cb-904f872a660e could not be found. Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Returning 404 to user: Instance 40f6b019-8c13-4d9a-a8cb-904f872a660e could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9bf51e69-09ab-4ee3-8be4-bc7fcaf93161 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e" status: 404 len: 111 microversion: 2.1 time: 0.031907 Oct 17 12:53:10.495509 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 652/1306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:10 2022] GET /compute/v2.1/servers/40f6b019-8c13-4d9a-a8cb-904f872a660e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:10.499932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf930870-52d3-490d-bcbe-3b253ab0ad3f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d31310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:10.599740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:10.600371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:10.606642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.607476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.607933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.608683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.609144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.609576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.749188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:10.757304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2aa2e936-cc39-4a2f-8062-a62e6c958519 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1316 microversion: 2.1 time: 0.164167 Oct 17 12:53:10.757877 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 653/1307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:10 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:10.762531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a3ddad5e-688a-4d86-916b-fb387bc985a0 req-0ef213d3-d9db-4781-97ad-3c03bad5eb1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92363ed-7f92-4095-9f84-dd331d79fb29", "tag": "f2093533-a437-4a2d-9b3b-8dd4414db0a1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:10.772649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a3ddad5e-688a-4d86-916b-fb387bc985a0 req-0ef213d3-d9db-4781-97ad-3c03bad5eb1c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.773132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a3ddad5e-688a-4d86-916b-fb387bc985a0 req-0ef213d3-d9db-4781-97ad-3c03bad5eb1c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.773592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a3ddad5e-688a-4d86-916b-fb387bc985a0 req-0ef213d3-d9db-4781-97ad-3c03bad5eb1c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.784858 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a3ddad5e-688a-4d86-916b-fb387bc985a0 req-0ef213d3-d9db-4781-97ad-3c03bad5eb1c service nova] Creating event network-changed:f2093533-a437-4a2d-9b3b-8dd4414db0a1 for instance a92363ed-7f92-4095-9f84-dd331d79fb29 on n-h2-853316-12 Oct 17 12:53:10.789817 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a3ddad5e-688a-4d86-916b-fb387bc985a0 req-0ef213d3-d9db-4781-97ad-3c03bad5eb1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030758 Oct 17 12:53:10.790585 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 654/1308] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:10.795740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:10.796333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:10.803302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.803798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.804240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.804946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.805408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.805833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.935700 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf930870-52d3-490d-bcbe-3b253ab0ad3f tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/cf870153-5e69-4b05-a72d-6b42d1dabb7d" status: 202 len: 0 microversion: 2.1 time: 0.439475 Oct 17 12:53:10.936346 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 655/1309] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:10 2022] DELETE /compute/v2.1/os-security-groups/cf870153-5e69-4b05-a72d-6b42d1dabb7d => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:10.942543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:10.943467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:10.949969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.950932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.951407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:10.951571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.952255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:10.952822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:10.953477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:10.961143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:10.962642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:10.963847 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac018efb-4a10-4524-966b-1ca98a5e4fd4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.172190 Oct 17 12:53:10.978872 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 655/1310] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:10 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:10.988257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62f6d9b3-5a5a-4714-af95-72603139d4f1 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] Calling method '.version_select at 0x7fa820d1a8b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:11.050676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:11.060154 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-987be9a2-8e99-4564-8ba4-e95dc8eb0fe3 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1269 microversion: 2.1 time: 0.122013 Oct 17 12:53:11.060802 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 656/1311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:10 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:11.174496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62f6d9b3-5a5a-4714-af95-72603139d4f1 tempest-SecurityGroupsTestJSON-196038409 tempest-SecurityGroupsTestJSON-196038409-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/385fa152-dac0-4f5e-9183-a64e6b4d6527" status: 202 len: 0 microversion: 2.1 time: 0.194388 Oct 17 12:53:11.175223 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 656/1312] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 12:53:10 2022] DELETE /compute/v2.1/os-security-groups/385fa152-dac0-4f5e-9183-a64e6b4d6527 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:11.266910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:11.267727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:11.273869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:11.274475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:11.275007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:11.275779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:11.276311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:11.276802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:11.391580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:11.392241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:11.398507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:11.399048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:11.399488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:11.400245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:11.400701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:11.401365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:11.408251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:11.420588 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d7bee50-10f5-4003-95e3-e7332409c3a2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.157557 Oct 17 12:53:11.434646 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 657/1313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:11 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:11.456778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:11.457887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:11.464883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:11.465811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:11.466479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:11.468108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:11.468778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:11.470764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:11.532649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:11.558673 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-12e949f3-409a-4e05-95d5-dd8bcb2d5764 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.170924 Oct 17 12:53:11.559709 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 657/1314] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:11 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:11.750760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:11.761211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5d6cc9a-c9da-445a-a7ae-a98a52caf16f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.311656 Oct 17 12:53:11.775251 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 658/1315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:11 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:11.780976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:11.781600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:11.788215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:11.788719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:11.789165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:11.789882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:11.790374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:11.790814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:11.993933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:11.994685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:12.011534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.012132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.012644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.014047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.014604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.015110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.229672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:12.239694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:12.241231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:12.242596 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-156781e0-0b46-42e0-a031-e465f1eb28f5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1815 microversion: 2.25 time: 0.252727 Oct 17 12:53:12.243556 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 659/1316] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:11 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1815 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:12.250794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:12.252145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:12.265162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.265880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.267058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.267804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.268271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.269464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.365701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:12.376949 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-571890a7-67db-482f-a24c-85ef041654ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1275 microversion: 2.1 time: 0.132164 Oct 17 12:53:12.379827 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 660/1317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:12 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:12.431252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:12.441797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-909b7c00-e788-49d6-9ead-1bde18f91480 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1316 microversion: 2.1 time: 0.664005 Oct 17 12:53:12.443251 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 658/1318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:11 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:12.450496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:12.451252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:12.460018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.460636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.461070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.461766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.462239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.462675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.590979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:12.591786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:12.599796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.600598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.601217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.602383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.603644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.604103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.713760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:12.727618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:12.743562 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72210ade-c14f-4659-9b80-cd7eeeba8f23 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.298988 Oct 17 12:53:12.744608 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 661/1319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:12 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:12.770589 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-53bbf76a-a27b-4964-b091-d5c1fe27447a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.184849 Oct 17 12:53:12.771851 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 659/1320] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:12 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:12.793862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:12.794870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:12.802476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.803253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.803922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.804703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:12.805164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:12.805588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:12.950381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:12.958669 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9da7d073-c5ec-4776-ad65-d0e489fa2287 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1317 microversion: 2.1 time: 0.170921 Oct 17 12:53:12.959166 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 662/1321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:12 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:13.272217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:13.272830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:13.299663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:13.302794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:13.303458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:13.304470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:13.306971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:13.307430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:13.403451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:13.404670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:13.427484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:13.431106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:13.432801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:13.435675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:13.437190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:13.439148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:13.721282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:13.733657 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34ceb0c3-414c-4f2c-b8bc-fbed065c5424 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.335062 Oct 17 12:53:13.734283 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 663/1322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:13 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:13.739049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:13.739660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:13.760854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:13.762111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:13.768497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:13.769309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:13.769931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:13.770395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:13.859821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:13.883028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:13.885432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:13.887948 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d6921cf7-f8d1-4152-aacb-7afd2932e87b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1805 microversion: 2.25 time: 0.620615 Oct 17 12:53:13.894883 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 660/1323] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:13 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1805 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:13.906931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:13.909752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:13.922836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:13.923338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:13.924614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:13.927926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:13.928580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:13.929615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:13.972733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:13.984085 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79d7aec0-97bc-4edb-8a07-fe459cae5ee1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1316 microversion: 2.1 time: 0.248647 Oct 17 12:53:13.984676 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 664/1324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:13 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:13.991564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:13.992513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:14.006549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.007338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.008098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.008858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.009485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.010073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.104751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:14.111785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:14.131321 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e703cf4-ec7f-44bc-8d45-cec69aad8919 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.145306 Oct 17 12:53:14.132254 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 665/1325] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:13 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:14.138864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-312ec0ac-fb12-4d91-b238-875de9be8f62 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '.version_select at 0x7fa820df9310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:14.142871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-312ec0ac-fb12-4d91-b238-875de9be8f62 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.144802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-312ec0ac-fb12-4d91-b238-875de9be8f62 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.145603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-312ec0ac-fb12-4d91-b238-875de9be8f62 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.171787 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-312ec0ac-fb12-4d91-b238-875de9be8f62 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1288 microversion: 2.25 time: 0.038152 Oct 17 12:53:14.173546 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 666/1326] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 17 12:53:14 2022] GET /compute/v2.1/os-migrations => generated 1288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:14.178920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:14.179872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:14.187372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.188392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.188994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.190013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.190348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.191514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.350698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:14.359592 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7abfa2e-9fc8-48b8-bd90-69cbfe652c0e tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1505 microversion: 2.1 time: 0.184555 Oct 17 12:53:14.374534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:14.375160 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 667/1327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:14 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:14.384458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:14.385272 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d989bc5a-0172-496b-9fcc-8b5dec7f2ea7 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.488955 Oct 17 12:53:14.385713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:14.387206 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 661/1328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:13 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:14.394438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:14.395307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 084effc1-ed15-42e0-9690-86c8e72ad0af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:14.407781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.408973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.409834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.410695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.411628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.411916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.412578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.413231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.413827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.414610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.415288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.415732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.573847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid 5a076fb2-b905-428e-8d88-e396a91a80c1 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:14.593626 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31b44c89-3bcd-42fb-a0c9-44c87bfb2cee tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 2425 microversion: 2.25 time: 0.216997 Oct 17 12:53:14.602830 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 668/1329] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:14 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 2425 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:14.631632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:14.632620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:14.639970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.640602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.641105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.641927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.642535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.643239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.874436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:14.888377 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea05c610-fac4-445f-89ad-457d4d6ea8c3 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af" status: 200 len: 1505 microversion: 2.1 time: 0.499626 Oct 17 12:53:14.889003 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 662/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:14 2022] GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:14.905972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:14.907217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:14.930518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.931540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.932196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:14.933146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:14.934403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:14.935058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.225418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:15.237010 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e62cf48d-0bda-4593-8feb-00b00bffc37e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.343843 Oct 17 12:53:15.238155 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 663/1331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:14 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:15.247327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1fe3d91f-6685-420e-aa3e-b8ac867da205 req-512cb712-b392-4598-9d25-c2e585213ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f35cc1-58d6-4894-af02-7db8eefeb420", "name": "network-vif-plugged", "status": "completed", "tag": "9a19bdb4-6892-4689-af82-3c465058331f"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:15.267325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1fe3d91f-6685-420e-aa3e-b8ac867da205 req-512cb712-b392-4598-9d25-c2e585213ef0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.267846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1fe3d91f-6685-420e-aa3e-b8ac867da205 req-512cb712-b392-4598-9d25-c2e585213ef0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.268741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1fe3d91f-6685-420e-aa3e-b8ac867da205 req-512cb712-b392-4598-9d25-c2e585213ef0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.312175 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1fe3d91f-6685-420e-aa3e-b8ac867da205 req-512cb712-b392-4598-9d25-c2e585213ef0 service nova] Creating event network-vif-plugged:9a19bdb4-6892-4689-af82-3c465058331f for instance d7f35cc1-58d6-4894-af02-7db8eefeb420 on n-h1-853316-12 Oct 17 12:53:15.323046 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1fe3d91f-6685-420e-aa3e-b8ac867da205 req-512cb712-b392-4598-9d25-c2e585213ef0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083216 Oct 17 12:53:15.324537 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 664/1332] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:15.335137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:15.335986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 084effc1-ed15-42e0-9690-86c8e72ad0af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:15.344261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:15.348701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.349406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.350142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.351070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.351684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.352267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.365981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid 5a076fb2-b905-428e-8d88-e396a91a80c1 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:15.389773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:15.403530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 084effc1-ed15-42e0-9690-86c8e72ad0af] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:15.416704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:15.432022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d577d1ad-257e-4c68-9684-5d1679dc2968 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 2425 microversion: 2.25 time: 0.811007 Oct 17 12:53:15.452014 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 669/1333] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:14 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 2425 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:15.461050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:15.461689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:15.477803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.478465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.478793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.479933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.480606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.481252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.583887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:15.604168 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f0a06bf-3d44-4d0c-ab18-da5d223ab587 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "DELETE /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af" status: 204 len: 0 microversion: 2.1 time: 0.277190 Oct 17 12:53:15.609953 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 665/1334] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:15 2022] DELETE /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:15.625077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:15.625763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:15.633607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.633849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.634387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.635173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.635694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.636567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.857186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:15.866749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:15.886024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-441f833d-3de8-485b-a6b0-70e2f989fc80 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.270772 Oct 17 12:53:15.902687 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 666/1335] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:15 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:15.915350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-74d124c7-d855-43c1-aefe-8bcbe505b00b req-15ec1d1f-01c3-4861-ad86-a9319292e011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d262a90f-1d00-482c-9097-8d9aff357605", "tag": "9180ba16-60cc-465f-a1a6-eff8a4460d61"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:15.926000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-74d124c7-d855-43c1-aefe-8bcbe505b00b req-15ec1d1f-01c3-4861-ad86-a9319292e011 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.926755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-74d124c7-d855-43c1-aefe-8bcbe505b00b req-15ec1d1f-01c3-4861-ad86-a9319292e011 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.927394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-74d124c7-d855-43c1-aefe-8bcbe505b00b req-15ec1d1f-01c3-4861-ad86-a9319292e011 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.940066 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-74d124c7-d855-43c1-aefe-8bcbe505b00b req-15ec1d1f-01c3-4861-ad86-a9319292e011 service nova] Creating event network-changed:9180ba16-60cc-465f-a1a6-eff8a4460d61 for instance d262a90f-1d00-482c-9097-8d9aff357605 on n-h1-853316-12 Oct 17 12:53:15.945780 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-74d124c7-d855-43c1-aefe-8bcbe505b00b req-15ec1d1f-01c3-4861-ad86-a9319292e011 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041697 Oct 17 12:53:15.946816 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 667/1336] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:15.952283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:15.953104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:15.959762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.960515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.960665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:15.961432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:15.962737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:15.962737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.003518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:16.013338 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be35b398-659c-487a-885a-5e78982c5db2 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1316 microversion: 2.1 time: 0.560147 Oct 17 12:53:16.014187 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 670/1337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:15 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:16.027988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:16.028768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:16.036590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.037085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.037583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.038297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.038755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.039386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.140577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:16.246223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:16.255369 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7249d93-dd05-4b39-951c-0e7e7896c964 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.307475 Oct 17 12:53:16.256113 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 668/1338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:15 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:16.262547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lazy-loading 'services' on Instance uuid 5a076fb2-b905-428e-8d88-e396a91a80c1 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:16.287322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:16.288158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:16.297645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.298499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.299179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.300733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.301528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.302617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.339997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:16.466452 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d153ea74-674b-48f3-9323-c2cf5afb2240 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "DELETE /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 204 len: 0 microversion: 2.1 time: 0.193522 Oct 17 12:53:16.467153 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 669/1339] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:16 2022] DELETE /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:16.473391 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b1763bc4-b75a-45fa-91ca-6cbf7a82d467 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments/cea59c66-59eb-4293-837e-19971e263ac1" status: 202 len: 0 microversion: 2.25 time: 0.448136 Oct 17 12:53:16.474007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:16.475459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:16.478465 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 671/1340] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 17 12:53:16 2022] DELETE /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments/cea59c66-59eb-4293-837e-19971e263ac1 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:16.482050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.482592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.483067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.483776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.484135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:16.484403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.484844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 084effc1-ed15-42e0-9690-86c8e72ad0af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:16.484995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.491552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.492059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.492625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.494586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.495646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.496473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.629312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:16.637832 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e881fdfc-60ae-4c5a-9476-998266cd6519 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.169339 Oct 17 12:53:16.638474 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 670/1341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:16 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:16.644604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:16.646999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:16.653423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.653955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.654597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.655322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.655843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.656367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.692859 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fbd70de1-fd45-408a-a5db-0016549131a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053210 Oct 17 12:53:16.695936 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 671/1342] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:16 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:16.731699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:16.743346 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ec60cee-84bf-4a11-afc3-c84b9360cb5d tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af" status: 200 len: 1511 microversion: 2.1 time: 0.263063 Oct 17 12:53:16.744312 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 672/1343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:16 2022] GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:16.921492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:16.922106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:16.929122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.929616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.930059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:16.930790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:16.931263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:16.931693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.025815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:17.040669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:17.041552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:17.047819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.048518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.048908 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-54ba7997-43e0-4a6a-bdf6-519d56cd3400 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.131066 Oct 17 12:53:17.049318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.050509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.050771 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 672/1344] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:16 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:17.051297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.051883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.281735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:17.282770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:17.290677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.291589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.292283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.293240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.294108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.294789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.380601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:17.399750 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e103b495-9f50-46c9-a1d4-abeb37f0d4e1 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1316 microversion: 2.1 time: 0.362952 Oct 17 12:53:17.401482 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 673/1345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:17 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:17.477238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:17.487717 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-908fc542-3d2d-439f-b4ed-3d8bec1bb234 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.210457 Oct 17 12:53:17.488704 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 673/1346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:17 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:17.612349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-5883d8f7-86eb-4c1f-9b74-437d12ffb502 req-247e0abe-ef98-4db7-bf5c-42eeefb0a10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92363ed-7f92-4095-9f84-dd331d79fb29", "name": "network-vif-plugged", "status": "completed", "tag": "f2093533-a437-4a2d-9b3b-8dd4414db0a1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:17.633387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5883d8f7-86eb-4c1f-9b74-437d12ffb502 req-247e0abe-ef98-4db7-bf5c-42eeefb0a10b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.633968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5883d8f7-86eb-4c1f-9b74-437d12ffb502 req-247e0abe-ef98-4db7-bf5c-42eeefb0a10b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.634504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5883d8f7-86eb-4c1f-9b74-437d12ffb502 req-247e0abe-ef98-4db7-bf5c-42eeefb0a10b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.649269 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-5883d8f7-86eb-4c1f-9b74-437d12ffb502 req-247e0abe-ef98-4db7-bf5c-42eeefb0a10b service nova] Creating event network-vif-plugged:f2093533-a437-4a2d-9b3b-8dd4414db0a1 for instance a92363ed-7f92-4095-9f84-dd331d79fb29 on n-h2-853316-12 Oct 17 12:53:17.658586 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-5883d8f7-86eb-4c1f-9b74-437d12ffb502 req-247e0abe-ef98-4db7-bf5c-42eeefb0a10b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049585 Oct 17 12:53:17.659405 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 674/1347] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:17.664581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:17.665104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:17.678389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.679429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.680174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.681293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.683090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.684314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.709914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:17.716876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:17.729261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.730341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.731027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.732104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.732996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.733662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.770924 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-011623e2-d06f-4fc5-8ca0-1a874a108fa9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066482 Oct 17 12:53:17.771509 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 675/1348] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:17 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:17.776219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:17.777007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 084effc1-ed15-42e0-9690-86c8e72ad0af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:17.783195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.783936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.784868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.785795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:17.786244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:17.786940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:17.910628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:17.919138 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dada8ee4-811e-42a6-bcb4-0523934c21ea tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.261147 Oct 17 12:53:17.919718 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 674/1349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:17 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:18.080753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:18.081419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:18.088330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.088901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.089598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.090409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.095847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.096547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.100225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:18.122873 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-05948094-3dc1-4703-be57-21906ff639ed tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af" status: 200 len: 1511 microversion: 2.1 time: 0.338433 Oct 17 12:53:18.124204 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 676/1350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:17 2022] GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:18.217148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d566361b-5435-4bad-9c73-679499af354c req-fd327c76-0446-4f2b-ac2c-f00ebe23b1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084effc1-ed15-42e0-9690-86c8e72ad0af", "name": "network-vif-deleted", "tag": "ac3d1d21-5465-412e-867b-78afbadd0b2a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:18.265436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:18.279341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d566361b-5435-4bad-9c73-679499af354c req-fd327c76-0446-4f2b-ac2c-f00ebe23b1b6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.279991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d566361b-5435-4bad-9c73-679499af354c req-fd327c76-0446-4f2b-ac2c-f00ebe23b1b6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.280537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d566361b-5435-4bad-9c73-679499af354c req-fd327c76-0446-4f2b-ac2c-f00ebe23b1b6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.295956 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7bbe86bb-7535-486f-b880-abab87d0aa02 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.218903 Oct 17 12:53:18.302081 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d566361b-5435-4bad-9c73-679499af354c req-fd327c76-0446-4f2b-ac2c-f00ebe23b1b6 service nova] Creating event network-vif-deleted:ac3d1d21-5465-412e-867b-78afbadd0b2a for instance 084effc1-ed15-42e0-9690-86c8e72ad0af on n-h2-853316-12 Oct 17 12:53:18.302317 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 675/1351] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:18 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:18.311864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d566361b-5435-4bad-9c73-679499af354c req-fd327c76-0446-4f2b-ac2c-f00ebe23b1b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099571 Oct 17 12:53:18.317265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 677/1352] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:53:18.423566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:18.424108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:18.431177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.431677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.432119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.432853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.433294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.433725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.512848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:18.513604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:18.527016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.527628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.528220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.528996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.529678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.530156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.575194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:18.588646 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20a8a2a5-51aa-4e09-97bc-443505987308 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1316 microversion: 2.1 time: 0.168973 Oct 17 12:53:18.589449 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 676/1353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:18 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:18.692384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:18.700424 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-698f5cf1-a2e3-4e9e-ad95-0c78d575582b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.192149 Oct 17 12:53:18.701443 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 678/1354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:18 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:18.788497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:18.788649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:18.796593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.797121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.797594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.798500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.799148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.799748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.847446 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d15eff9d-eda5-4a6c-b7cf-7ee9d9bdadf0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067904 Oct 17 12:53:18.848440 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 677/1355] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:18 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 12:53:18.943534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:18.944229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:18.950652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.951143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.951587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:18.952325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:18.952819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:18.953450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.107447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:19.115462 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a57c4202-5e70-4419-8f08-bb464ca5c56a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.176355 Oct 17 12:53:19.116047 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 679/1356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:18 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:19.150364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:19.150806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 084effc1-ed15-42e0-9690-86c8e72ad0af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:19.157594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.158543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.158918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.161021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.161697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.162350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.165919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:19.208807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.209300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.209734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.210243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lazy-loading 'fault' on Instance uuid 084effc1-ed15-42e0-9690-86c8e72ad0af {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:19.253560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:19.261632 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b27951d-9c5a-435f-830c-f51bc56a2efb tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af" status: 200 len: 1307 microversion: 2.1 time: 0.117827 Oct 17 12:53:19.262229 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 678/1357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:19 2022] GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:19.327136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:19.327847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:19.334327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.335378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.335378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.336046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.336506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.336936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.417763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:19.441050 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0312d5d6-8d0d-4a72-a159-b774c6184dac tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.117489 Oct 17 12:53:19.442253 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 680/1358] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:19 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:19.614056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:19.614660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:19.621659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.622173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.622630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.623352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.623797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.624617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.725965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:19.727382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:19.733406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.733905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.734392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.735133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.735860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.736271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.852865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:19.862901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bb40bc21-e11e-487f-b952-85f26b3b979f tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1506 microversion: 2.1 time: 0.253651 Oct 17 12:53:19.878472 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 679/1359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:19 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:19.889221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:19.892107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:19.899259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:19.908094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-398c8ec1-1100-413c-9caf-0174c0fe9e41 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.186978 Oct 17 12:53:19.913735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.914488 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 681/1360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:19 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:19.918583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.920470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:19.920911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.921767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.922280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.922709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.926795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:19.939355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.940290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.940955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.941884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:19.942623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:19.943733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:19.958863 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae6ae8d4-6f95-4d28-92cc-b5c07db40cb8 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078298 Oct 17 12:53:19.960150 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 680/1361] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:19 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:19.965543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:19.989871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:19.991117 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a5f4fbbf-58f1-4acc-bbbd-98e4771ead6a tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29/os-instance-actions/req-7a4ca862-f33b-4e74-b827-119e4223cfa3" status: 200 len: 313 microversion: 2.1 time: 0.075270 Oct 17 12:53:19.991832 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 682/1362] 10.222.0.27 () {58 vars in 1419 bytes} [Mon Oct 17 12:53:19 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29/os-instance-actions/req-7a4ca862-f33b-4e74-b827-119e4223cfa3 => generated 313 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:20.006784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:20.009254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:20.016032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.016525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.017068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.017778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.018267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.019278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.108722 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51d6a417-5959-4f87-a709-b0a865548302 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "POST /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29/action" status: 202 len: 0 microversion: 2.1 time: 0.107033 Oct 17 12:53:20.109618 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 681/1363] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:53:20 2022] POST /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:20.118663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:20.119580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:20.126293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.127022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.127462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.128828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.129643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.130070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.143126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:20.146016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:20.155142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.156564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.157625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.159867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.160612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.161402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.392006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:20.400636 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ca729c8-20c1-4051-a274-28ac57229b12 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1508 microversion: 2.1 time: 0.286139 Oct 17 12:53:20.401256 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 683/1364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:20 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:20.406372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:20.407293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 084effc1-ed15-42e0-9690-86c8e72ad0af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:20.414260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.414999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.415608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.416492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.417093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.417685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.432646 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] HTTP exception thrown: Instance 084effc1-ed15-42e0-9690-86c8e72ad0af could not be found. Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Request method failure captured: Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af HTTP/1.1 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVABB27l-FLFuLIRIuscwgn02yZvdHKkte1RT8rO5noMdISMQjjeRpf8fzDpgeDbcydr0AXgI8lzVQKAhLkMlokqyNk39JcNKoZD9zluLJU3lChsoiP5eCoE04n7E_CJMMiV7G1offY_lF9Gwy_2pD9xFz2jB8O9WzHXNVq4wnnjPIk Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 7ec44846909047db88812217c7186c00 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-MultipleCreateTestJSON-1557092558 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ec44846909047db88812217c7186c00", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ec44846909047db88812217c7186c00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ec44846909047db88812217c7186c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ec44846909047db88812217c7186c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-MultipleCreateTestJSON-1557092558 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 7ec44846909047db88812217c7186c00 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1557092558 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-MultipleCreateTestJSON-1557092558-project Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 41512701df1940f28f63705f8fe20a21 Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-MultipleCreateTestJSON-1557092558-project Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 084effc1-ed15-42e0-9690-86c8e72ad0af could not be found. Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '084effc1-ed15-42e0-9690-86c8e72ad0af'} Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084effc1-ed15-42e0-9690-86c8e72ad0af could not be found. Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084effc1-ed15-42e0-9690-86c8e72ad0af could not be found. Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:20.434427 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084effc1-ed15-42e0-9690-86c8e72ad0af could not be found. Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Returning 404 to user: Instance 084effc1-ed15-42e0-9690-86c8e72ad0af could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-974d4f66-4232-4075-bdcf-e738a8e6ff5f tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af" status: 404 len: 111 microversion: 2.1 time: 0.034605 Oct 17 12:53:20.443990 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 684/1365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:20 2022] GET /compute/v2.1/servers/084effc1-ed15-42e0-9690-86c8e72ad0af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:20.449871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:20.450577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:20.457478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.458076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.458621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.459481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.459998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.460482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.614678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:20.625000 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-865329b3-66e6-4d5b-98a8-a2cc410b0c73 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.487409 Oct 17 12:53:20.626273 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 682/1366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:20 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:20.633698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:20.634636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:20.645463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.645966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.646549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.647258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.647604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.648037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.681810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:20.699117 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cdd44740-c3cb-4fec-8c9f-655a28ed3e8b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1511 microversion: 2.1 time: 0.253908 Oct 17 12:53:20.714844 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 685/1367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:20 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:20.771252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:20.795025 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ba927085-e5f5-48db-bc5f-723439d099f3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.167125 Oct 17 12:53:20.803963 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 683/1368] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:20 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:20.944792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:20.946269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:20.954711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.955209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.955661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.957525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.958248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.958864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.975054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:20.977419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:20.994580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.995364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.996005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:20.997009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:20.997698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:20.998420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.046703 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-82ff30e7-8029-4569-aa71-11db4d8066c5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077725 Oct 17 12:53:21.047593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 684/1369] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:20 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 12:53:21.151053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:21.159445 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb70f117-4867-4743-a99a-8b20731c1908 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.222334 Oct 17 12:53:21.160031 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 686/1370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:20 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:21.429182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:21.430615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:21.438199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:21.438981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:21.439832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.440942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:21.441684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:21.442402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.649690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:21.650482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:21.657806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:21.659919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:21.660561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.661836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:21.663047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:21.663192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:21.663825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.678921 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91ca01ec-7d89-490d-a5d2-b3b371ab88a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1513 microversion: 2.1 time: 0.255616 Oct 17 12:53:21.679608 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 685/1371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:21 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:21.735541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:21.736476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:21.750719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:21.751207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:21.751646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.752345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:21.752796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:21.753550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.857593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:21.870750 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-faaf0051-2d42-44f5-a7b7-fa81042ad8b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.225345 Oct 17 12:53:21.871335 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 687/1372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:21 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:21.877119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:21.881032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:21.888662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:21.889353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:21.890128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.890868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:21.891362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:21.891937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:21.982633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:22.005370 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f3316a7-0095-4e3a-ba60-ececbbe3b35a tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.132638 Oct 17 12:53:22.006783 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 688/1373] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:21 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:22.053281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:22.060917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:22.063677 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a7c29290-4abb-4e86-abaa-259a837487fa tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1511 microversion: 2.1 time: 0.335280 Oct 17 12:53:22.064177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:22.064563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 686/1374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:21 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:22.066668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:22.072624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:22.073390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:22.074059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:22.075038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:22.075748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:22.076636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:22.117697 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b94d0148-07f5-4520-91c5-0ae7ceaaeb58 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060773 Oct 17 12:53:22.118412 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 689/1375] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:22 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 12:53:22.184105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:22.184756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:22.193085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:22.193882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:22.194272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:22.195185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:22.195658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:22.196107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:22.471593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:22.480970 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c29f45fb-9c2b-4266-9600-141716d20584 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1479 microversion: 2.1 time: 0.301195 Oct 17 12:53:22.481554 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 687/1376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:22 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1479 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:22.702787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:22.703927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:22.712258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:22.712872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:22.713389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:22.714472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:22.714757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:22.715436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:22.896818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:22.897712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:22.909014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:22.909868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:22.910560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:22.911923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:22.912592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:22.913241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:22.992373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:23.001677 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c54db8b-444f-4792-9283-b44db1037618 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1506 microversion: 2.1 time: 0.302972 Oct 17 12:53:23.003440 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 690/1377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:22 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:23.030192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '.version_select at 0x7fa820c0b430>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:23.031053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:23.042299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.047427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.048168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.049095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.054116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.054934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.107174 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34b11989-1591-4c84-b760-29b2c70b18a3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.081203 Oct 17 12:53:23.108573 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 691/1378] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 17 12:53:23 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29/os-instance-actions => generated 611 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:53:23.126693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:23.127367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:23.151991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.153262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.154499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.155933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.157614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.158850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.274859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:23.278029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:23.291345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3a435313-2c23-4b76-ac87-59c4a77cf4c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.399477 Oct 17 12:53:23.293292 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 688/1379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:22 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:23.304237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:23.304859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:23.308102 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-605cd5a9-d351-440d-8492-0856b3bf3892 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.197977 Oct 17 12:53:23.309928 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 692/1380] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:23 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:23.317097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:23.317385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.318019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:23.318724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.321423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.322380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.322999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.324396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.325293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.326191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.326750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.327668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.328230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.328763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.370475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:23.481903 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7b2f4b96-05f6-4846-89af-67e393a17409 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 204 len: 0 microversion: 2.1 time: 0.169807 Oct 17 12:53:23.483236 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 693/1381] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:23 2022] DELETE /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:23.490922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:23.493570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:23.504951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.506411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.507296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.508720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.510194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.510758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.556600 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2d9049a-90d1-4d6e-ac42-05e6e9c59970 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071744 Oct 17 12:53:23.563036 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 694/1382] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:23 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:23.570099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:23.570915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:23.584635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.585693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.586298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.588105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.588795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.589345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.769245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:23.777580 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-89d7f08f-8919-4b89-ab1c-199619141ee7 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1511 microversion: 2.1 time: 0.483225 Oct 17 12:53:23.778428 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 689/1383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:23 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:23.788866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:23.789484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:23.800902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.801918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.801918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.802490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:23.802939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:23.803378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:23.865625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:23.875456 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ffc8b9f-805b-4e49-b699-6c017dd83bbe tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1512 microversion: 2.1 time: 0.310514 Oct 17 12:53:23.886179 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 695/1384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:23 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:24.023869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-28c538e3-6b08-4e2a-b196-ff6fd5bbcf76 req-03e2fc4c-a930-4d8f-9f78-a0cb985c9c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f", "name": "network-vif-deleted", "tag": "9f4a095c-f1f7-4a15-8f40-4f486877220d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:24.039683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-28c538e3-6b08-4e2a-b196-ff6fd5bbcf76 req-03e2fc4c-a930-4d8f-9f78-a0cb985c9c7c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.040621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-28c538e3-6b08-4e2a-b196-ff6fd5bbcf76 req-03e2fc4c-a930-4d8f-9f78-a0cb985c9c7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.041981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-28c538e3-6b08-4e2a-b196-ff6fd5bbcf76 req-03e2fc4c-a930-4d8f-9f78-a0cb985c9c7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.070687 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-28c538e3-6b08-4e2a-b196-ff6fd5bbcf76 req-03e2fc4c-a930-4d8f-9f78-a0cb985c9c7c service nova] Creating event network-vif-deleted:9f4a095c-f1f7-4a15-8f40-4f486877220d for instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f on n-h1-853316-12 Oct 17 12:53:24.084751 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-28c538e3-6b08-4e2a-b196-ff6fd5bbcf76 req-03e2fc4c-a930-4d8f-9f78-a0cb985c9c7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064829 Oct 17 12:53:24.089212 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 696/1385] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:53:24.189099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:24.201533 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d252c925-7f11-4988-b3bb-9746e4ebbfd2 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1464 microversion: 2.1 time: 0.422292 Oct 17 12:53:24.209984 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 690/1386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:23 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1464 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:24.257903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:24.261101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:24.270072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.272443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.273400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.274661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.275412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.276430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.315662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:24.316661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:24.325593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.328269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.328921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.333132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.333537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.333995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.423712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:24.474716 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7530fa13-718a-4f98-a035-5ec8b8c2c51e tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action" status: 202 len: 0 microversion: 2.1 time: 0.222266 Oct 17 12:53:24.479728 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 697/1387] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:53:24 2022] POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:24.502331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:24.504069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:24.514806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.515567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.516244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.517178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.517805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.518432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.666690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:24.709025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79b28a53-09e1-4daa-8301-d9cfe820f1e2 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.217188 Oct 17 12:53:24.710059 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 698/1388] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:24 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:24.742965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:24.743637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:24.751431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.751895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.752628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.754100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.754826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.755352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.807749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.808510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.809077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.814976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lazy-loading 'fault' on Instance uuid d7f35cc1-58d6-4894-af02-7db8eefeb420 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:24.936095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:24.950495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-457044ff-604c-4bcf-8564-7a38f8900ed4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.638607 Oct 17 12:53:24.951673 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 691/1389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:24 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:24.970244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:24.973939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:24.981489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.986995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.991362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:24.992310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:24.992984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:24.993681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.064046 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0e370bbb-52a6-4469-8134-02ab5a909a49 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109029 Oct 17 12:53:25.076450 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 692/1390] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:24 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:25.077692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0dd10924-19d7-4ee4-961b-948e2dcb00d1 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1600 microversion: 2.1 time: 0.338507 Oct 17 12:53:25.080945 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 699/1391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:24 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1600 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:25.091669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:25.092427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:25.096139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:25.097255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:25.103801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.107891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.108539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.109562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.110531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.113555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.117472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.118595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.121780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.122868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.125314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.125707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.148179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:25.205354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.206752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.207583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.208266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lazy-loading 'fault' on Instance uuid 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:25.294189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41512701df1940f28f63705f8fe20a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec44846909047db88812217c7186c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:25.309540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-763ec6a1-b807-4949-b376-9086424a106b tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 200 len: 1307 microversion: 2.1 time: 0.231841 Oct 17 12:53:25.322738 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 693/1392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:25 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 1307 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:25.332147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d3b81212-85a1-4c48-9594-215941f79afd req-c87e581d-b5fe-4ec1-899e-fcc621a19563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d262a90f-1d00-482c-9097-8d9aff357605", "name": "network-vif-plugged", "status": "completed", "tag": "9180ba16-60cc-465f-a1a6-eff8a4460d61"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:25.342453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3b81212-85a1-4c48-9594-215941f79afd req-c87e581d-b5fe-4ec1-899e-fcc621a19563 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.343304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3b81212-85a1-4c48-9594-215941f79afd req-c87e581d-b5fe-4ec1-899e-fcc621a19563 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.343981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3b81212-85a1-4c48-9594-215941f79afd req-c87e581d-b5fe-4ec1-899e-fcc621a19563 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.356811 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d3b81212-85a1-4c48-9594-215941f79afd req-c87e581d-b5fe-4ec1-899e-fcc621a19563 service nova] Creating event network-vif-plugged:9180ba16-60cc-465f-a1a6-eff8a4460d61 for instance d262a90f-1d00-482c-9097-8d9aff357605 on n-h1-853316-12 Oct 17 12:53:25.363179 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d3b81212-85a1-4c48-9594-215941f79afd req-c87e581d-b5fe-4ec1-899e-fcc621a19563 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038174 Oct 17 12:53:25.364203 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 694/1393] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:25.369639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:25.373786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:25.380669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.381555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.382267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.383218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.383919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.384573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.479476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:25.493084 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c89f0180-8c7e-4b91-bc5e-224d857f2433 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1512 microversion: 2.1 time: 0.407766 Oct 17 12:53:25.506546 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 700/1394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:25 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:25.523358 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6cad16b0-08f2-468e-aa69-1483a8d6a1b4 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action" status: 202 len: 0 microversion: 2.1 time: 0.157063 Oct 17 12:53:25.528492 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 695/1395] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:53:25 2022] POST /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:25.535339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:25.536166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:25.547224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.547732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.548173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.548932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.549388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.549866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.741483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:25.742590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:25.749793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.755816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.756784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.757431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.758892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:25.760678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:25.967402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-56e77504-19b0-498b-b484-b245ce818854 tempest-ServersAdminTestJSON-352567235 tempest-ServersAdminTestJSON-352567235-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1617 microversion: 2.1 time: 0.437698 Oct 17 12:53:25.968434 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 701/1396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:25 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1617 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:25.974201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:25.979049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:25.993530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:25.996510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.000646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.001730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.002346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.002889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.061879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:26.114006 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3be5543-aaad-4464-bdbe-2395fc817dff tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.376459 Oct 17 12:53:26.115573 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 696/1397] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:25 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:26.151239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:26.153746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:26.180947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.181466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.185131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.186045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.188737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.189528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.247322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:26.268420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:26.278936 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-244b647d-30ef-4ef4-a9f3-0f05428574b1 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.308809 Oct 17 12:53:26.291717 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 702/1398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:25 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:26.303021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:26.305513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:26.312013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.313211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.313821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.315046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.316183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.316834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.368412 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2eea3ccf-0ebe-42e1-b300-94698ac20e41 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075445 Oct 17 12:53:26.369601 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 703/1399] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:26 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:26.381063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:26.384245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] [instance: 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:26.389218 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9b2aa762-1a97-4671-bb88-5b5bba4b77d8 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 204 len: 0 microversion: 2.1 time: 0.259606 Oct 17 12:53:26.393479 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 697/1400] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:26 2022] DELETE /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:26.399630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.400316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.400872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.403426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.403426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.404391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:26.404973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.405541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:26.413741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.414571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.415222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.416189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.417175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.417765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.431619 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] HTTP exception thrown: Instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f could not be found. Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Request method failure captured: Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f HTTP/1.1 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVABB27l-FLFuLIRIuscwgn02yZvdHKkte1RT8rO5noMdISMQjjeRpf8fzDpgeDbcydr0AXgI8lzVQKAhLkMlokqyNk39JcNKoZD9zluLJU3lChsoiP5eCoE04n7E_CJMMiV7G1offY_lF9Gwy_2pD9xFz2jB8O9WzHXNVq4wnnjPIk Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 7ec44846909047db88812217c7186c00 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-MultipleCreateTestJSON-1557092558 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ec44846909047db88812217c7186c00", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ec44846909047db88812217c7186c00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ec44846909047db88812217c7186c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ec44846909047db88812217c7186c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-MultipleCreateTestJSON-1557092558 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 7ec44846909047db88812217c7186c00 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1557092558 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-MultipleCreateTestJSON-1557092558-project Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 41512701df1940f28f63705f8fe20a21 Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-MultipleCreateTestJSON-1557092558-project Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f could not be found. Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f'} Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f could not be found. Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f could not be found. Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:26.437858 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:26.442652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:26.442652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:26.442652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:26.442652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:26.442652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:26.442652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f could not be found. Oct 17 12:53:26.442652 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:26.448700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] Returning 404 to user: Instance 24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:26.451144 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0910fe76-eb32-4d0f-bf79-d1eb1ea0d5e4 tempest-MultipleCreateTestJSON-1557092558 tempest-MultipleCreateTestJSON-1557092558-project] 10.222.0.27 "GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f" status: 404 len: 111 microversion: 2.1 time: 0.080196 Oct 17 12:53:26.453960 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 704/1401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:26 2022] GET /compute/v2.1/servers/24a1a0a4-d6f9-4f54-a2ff-03e3d91b181f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:26.521266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:26.521970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:26.532086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.537670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.538401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.539267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:26.539846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:26.540385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:26.918475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:26.958519 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c7d2e4f-baf6-4c8e-ac22-fd5c1b6ac569 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1467 microversion: 2.1 time: 0.562456 Oct 17 12:53:26.962304 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 698/1402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:26 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1467 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:26.978774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2d294d1a-0319-4254-937c-8ab5722d137d req-076a8576-31fa-47cd-bc27-d3be7f72ec99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92363ed-7f92-4095-9f84-dd331d79fb29", "name": "network-vif-deleted", "tag": "f2093533-a437-4a2d-9b3b-8dd4414db0a1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:26.992518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:27.023018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2d294d1a-0319-4254-937c-8ab5722d137d req-076a8576-31fa-47cd-bc27-d3be7f72ec99 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:27.023653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2d294d1a-0319-4254-937c-8ab5722d137d req-076a8576-31fa-47cd-bc27-d3be7f72ec99 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:27.024209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2d294d1a-0319-4254-937c-8ab5722d137d req-076a8576-31fa-47cd-bc27-d3be7f72ec99 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:27.063235 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2d294d1a-0319-4254-937c-8ab5722d137d req-076a8576-31fa-47cd-bc27-d3be7f72ec99 service nova] Creating event network-vif-deleted:f2093533-a437-4a2d-9b3b-8dd4414db0a1 for instance a92363ed-7f92-4095-9f84-dd331d79fb29 on n-h2-853316-12 Oct 17 12:53:27.076557 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2d294d1a-0319-4254-937c-8ab5722d137d req-076a8576-31fa-47cd-bc27-d3be7f72ec99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108460 Oct 17 12:53:27.077294 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 699/1403] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:27.152307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:27.153117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:27.171748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:27.174525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:27.176631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:27.177489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:27.181349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:27.181993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:27.288036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd916f6475fa544ea9bf8afe0663ed5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db52cce04e8449979f4fbc6bd8d8e777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:27.302874 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5247ea66-f805-4ecc-ab67-ff5ac5949fde tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 200 len: 1470 microversion: 2.1 time: 0.783070 Oct 17 12:53:27.310597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:27.318910 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 705/1404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:26 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 1470 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:27.331789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:27.332638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:27.351921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:27.352748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:27.353395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:27.354323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:27.354964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:27.355553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:27.368775 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a79e1c77-94b3-408e-a47d-383204efede8 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.217393 Oct 17 12:53:27.370494 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 700/1405] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:27 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:27.388611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:27.397963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:27.419659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:27.420632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:27.422244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:27.427857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:27.430916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:27.431649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:27.512486 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21dca83f-3c60-4204-bdb0-136516a5fd12 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135158 Oct 17 12:53:27.514082 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 701/1406] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:27 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:27.747996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:27.771647 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff360ed6-858d-4835-a1c0-dcca59d449ae tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.451524 Oct 17 12:53:27.772539 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 706/1407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:27 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:27.989349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:27.990005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:28.007866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.008364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.008841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.011218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.011741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.012338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.253742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:28.288642 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ceba77e3-9f85-44da-a0f3-9bbbaa05dd33 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1467 microversion: 2.1 time: 0.304656 Oct 17 12:53:28.302268 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 702/1408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:27 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1467 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:28.306548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-409f5696-7296-4622-ba9e-fb66d2c89dc3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Action: 'create', calling method: .version_select at 0x7fa820c43ee0>, body: {"keypair": {"name": "tempest-keypair-823391073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDpydH5paqsjhsiEgYL5EjVUUkPk44s4T1aB91VFZiNzOxD6OtM+sS7j76tlCy3kKeMXtm5uCWo+4+SskzCzDnsXcYxS6qzwMzfF2uMaB5QzZFC4e0v7ru9OOO8N//ywA=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:28.321348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-409f5696-7296-4622-ba9e-fb66d2c89dc3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Getting quotas for project 2035f4fadc8741738c4d0bf67e555717. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:53:28.325723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-409f5696-7296-4622-ba9e-fb66d2c89dc3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Getting quotas for user 564a2e749d644c5f8906c175cd34d6cd and project 2035f4fadc8741738c4d0bf67e555717. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:53:28.334317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:28.335156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] [instance: a92363ed-7f92-4095-9f84-dd331d79fb29] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:28.341549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.342307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.343158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.344364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.344982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.345691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.352354 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-409f5696-7296-4622-ba9e-fb66d2c89dc3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.239579 Oct 17 12:53:28.353563 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 707/1409] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:53:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:53:28.380275 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] HTTP exception thrown: Instance a92363ed-7f92-4095-9f84-dd331d79fb29 could not be found. Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Request method failure captured: Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 HTTP/1.1 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVAwr2sfUPjDE0dvrhO3lbRIxjDcW7GQpihFvo7rwjaycC8AwRC1znDQ5O9Zs5YKZwY6nxApU2_01ic9SQhIgkzWiZmPTuUr1soFFGKa7xYIfzS_xoMg3puTScZW_JVwNqBrVEmKwj5nekDzCkexCBas4G35ULn_UUav56PwNv5USfo Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: db52cce04e8449979f4fbc6bd8d8e777 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-InstanceActionsTestJSON-1196823013 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_db52cce04e8449979f4fbc6bd8d8e777", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db52cce04e8449979f4fbc6bd8d8e777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/db52cce04e8449979f4fbc6bd8d8e777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db52cce04e8449979f4fbc6bd8d8e777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-InstanceActionsTestJSON-1196823013 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: db52cce04e8449979f4fbc6bd8d8e777 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1196823013 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-InstanceActionsTestJSON-1196823013-project Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: d916f6475fa544ea9bf8afe0663ed5b9 Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-InstanceActionsTestJSON-1196823013-project Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance a92363ed-7f92-4095-9f84-dd331d79fb29 could not be found. Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a92363ed-7f92-4095-9f84-dd331d79fb29'} Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92363ed-7f92-4095-9f84-dd331d79fb29 could not be found. Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92363ed-7f92-4095-9f84-dd331d79fb29 could not be found. Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:28.382025 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92363ed-7f92-4095-9f84-dd331d79fb29 could not be found. Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] Returning 404 to user: Instance a92363ed-7f92-4095-9f84-dd331d79fb29 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6535c00e-06c0-4b70-95ae-91cfcc5468c3 tempest-InstanceActionsTestJSON-1196823013 tempest-InstanceActionsTestJSON-1196823013-project] 10.222.0.27 "GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29" status: 404 len: 111 microversion: 2.1 time: 0.055978 Oct 17 12:53:28.394541 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 703/1410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:28 2022] GET /compute/v2.1/servers/a92363ed-7f92-4095-9f84-dd331d79fb29 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:53:28.397780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:28.398452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:28.404957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.405900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.406633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.407658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.408512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.409143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.526718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:28.529173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:28.538885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.548830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.549488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.551156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.551803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.552512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.565253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:28.623494 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13914243-de03-4485-bec0-b1cea1899032 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101168 Oct 17 12:53:28.624368 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 704/1411] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:28 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 12:53:28.624712 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af810486-d421-4252-bdb6-9f046ff3b55e tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.231148 Oct 17 12:53:28.646252 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 708/1412] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:28 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:28.799713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:28.799713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:28.817026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.817995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.818622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:28.819564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:28.820195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:28.825938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:29.293184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:29.303049 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab2f1498-1430-489b-b6f8-6ceef81fe7e8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1317 microversion: 2.1 time: 0.512020 Oct 17 12:53:29.308649 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 705/1413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:28 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:29.318666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:29.320005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:29.353662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:29.354455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:29.355047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:29.355970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:29.363421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:29.364133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:29.640052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:29.651556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:29.685987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:29.703424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:29.705414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:29.708299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:29.711054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:29.714116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:29.780296 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-193df85a-3f12-4d99-b2f7-da77a66428bd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.147525 Oct 17 12:53:29.786670 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 706/1414] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:29 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:29.797142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:29.799203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:29.816869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:29.822380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:29.823152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:29.824072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:29.824699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:29.825280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:29.871368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:30.061647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:30.084928 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9001ab43-98bd-4c9b-b491-4c484e233a0b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1467 microversion: 2.1 time: 0.771073 Oct 17 12:53:30.088796 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 709/1415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:29 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1467 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:30.329322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:30.331764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:30.345699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:30.351322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:30.352109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:30.353817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:30.356548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:30.357950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:31.022858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:31.072101 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2b4764f8-d85a-451e-a84c-e85af76eae26 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 1.280991 Oct 17 12:53:31.072755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 707/1416] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:29 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:31.091404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:31.093842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:31.107498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:31.108028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:31.108504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:31.109251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:31.109742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:31.110233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:31.185565 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ca965cf-7c49-491d-8cc3-0cd31ce3a48c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111670 Oct 17 12:53:31.186156 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 708/1417] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:31 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:53:31.216997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:31.217855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:31.242824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:31.243590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:31.246953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:31.247966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:31.248816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:31.249506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:31.279286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:31.290453 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-809cf52e-0b39-471d-95b6-f699e8b6c883 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1467 microversion: 2.1 time: 0.965494 Oct 17 12:53:31.294042 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 710/1418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:30 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1467 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:31.321634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:31.322573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:31.329725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:31.331886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:31.332595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:31.333971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:31.334657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:31.335297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:31.426436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:31.442383 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-827e11b7-8ac4-4ec1-9bd4-61315d7d4dea tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1425 microversion: 2.1 time: 0.239054 Oct 17 12:53:31.443822 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 709/1419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:31 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1425 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:31.453765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-54ee28ff-336c-4ee6-8056-94a483be62a2 req-9a6e22d0-5f89-4653-af0e-75d570e124e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2cda5e5-f691-4333-9658-96e88d5a2600", "name": "network-vif-deleted", "tag": "57009ad5-805d-4dec-a5f3-f5ac7ebef5df"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:31.481657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-54ee28ff-336c-4ee6-8056-94a483be62a2 req-9a6e22d0-5f89-4653-af0e-75d570e124e8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:31.482151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-54ee28ff-336c-4ee6-8056-94a483be62a2 req-9a6e22d0-5f89-4653-af0e-75d570e124e8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:31.484571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-54ee28ff-336c-4ee6-8056-94a483be62a2 req-9a6e22d0-5f89-4653-af0e-75d570e124e8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:31.513094 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-54ee28ff-336c-4ee6-8056-94a483be62a2 req-9a6e22d0-5f89-4653-af0e-75d570e124e8 service nova] Creating event network-vif-deleted:57009ad5-805d-4dec-a5f3-f5ac7ebef5df for instance d2cda5e5-f691-4333-9658-96e88d5a2600 on n-h1-853316-12 Oct 17 12:53:31.529275 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-54ee28ff-336c-4ee6-8056-94a483be62a2 req-9a6e22d0-5f89-4653-af0e-75d570e124e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083763 Oct 17 12:53:31.529976 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 710/1420] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:31.881271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-172f07c6-5f11-486f-8ed7-a08f288dca12 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1620 microversion: 2.1 time: 0.564795 Oct 17 12:53:31.883434 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 711/1421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:31 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1620 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:32.106371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:32.107292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:32.126902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:32.127630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:32.128266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:32.129062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:32.129691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:32.130243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:32.200098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:32.207540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:32.229998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:32.231342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:32.232902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:32.234868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:32.238577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:32.239453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:32.319244 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f9e6e57-7553-42dd-a8be-109c990f9164 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.123575 Oct 17 12:53:32.320187 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 712/1422] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:53:32 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:32.330376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1710718949", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["e2607f9b-b14e-4bad-a241-9cd51a932b94"]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:32.475055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:53:32.480844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:32.544307 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f815616b-bbdb-4f6d-a886-1b5a00c2aaad tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.442842 Oct 17 12:53:32.545290 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 711/1423] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:32 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:32.550684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:32.551298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:32.569768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:32.570290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:32.570730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:32.571439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:32.571896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:32.572323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:32.635639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:32.636139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:32.636576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:32.637031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lazy-loading 'fault' on Instance uuid d2cda5e5-f691-4333-9658-96e88d5a2600 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:32.730699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:32.739922 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68ff6349-72c9-4d85-9b80-6e937a691758 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 200 len: 1302 microversion: 2.1 time: 0.193426 Oct 17 12:53:32.751635 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 712/1424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:32 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 1302 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:33.561855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:53:33.562722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:53:33.563199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:53:33.563610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:53:33.564023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:53:33.594685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:33.595593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:33.597502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:33.600684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:33.600844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:33.601572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:33.604877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:33.608026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:33.613859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:33.614745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:33.618927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:33.620033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:33.620724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:33.621374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:33.712505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:53:33.734629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:53:33.771429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:53:33.776852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:53:33.815377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:33.897098 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d587e420-44d0-49be-8d9b-eccc33e3edbc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572104 Oct 17 12:53:33.898203 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 713/1425] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:53:33.911435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:33.912168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d2cda5e5-f691-4333-9658-96e88d5a2600] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:33.912622 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b35dc9e4-0fcb-4149-a206-228319be2847 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.332101 Oct 17 12:53:33.926443 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 713/1426] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:33 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:33.926815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:33.927527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:33.929949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:33.932048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:33.933221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:33.934411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:33.936172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-02ad3a60-39b8-4abf-b95a-9b0fa605e68f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:33.947156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-02ad3a60-39b8-4abf-b95a-9b0fa605e68f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:33.989803 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] HTTP exception thrown: Instance d2cda5e5-f691-4333-9658-96e88d5a2600 could not be found. Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Request method failure captured: Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 HTTP/1.1 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU-TYATSFihnIuD1z8pDGXOpTzGUYGoDTcLJozTSY6z85yV1j6vZO1F4wafwVJq3Ij_1v2I2iKJX5_V4lAQpUfk6GujNofGAzWrV7mSYugj2Xx3q0PrAPJGOwzMozTwkVOB7Lj2ykObVPxIeShmSfIY2ERdo3oxb9ApjStXHDo7aNls Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 398c14a84792484ba396062bf18c6933 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_398c14a84792484ba396062bf18c6933", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c14a84792484ba396062bf18c6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/398c14a84792484ba396062bf18c6933"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c14a84792484ba396062bf18c6933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 398c14a84792484ba396062bf18c6933 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersAdminTestJSON-136227960-project Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6e904404abe5420bb929ff9ab97f0a02 Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersAdminTestJSON-136227960-project Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance d2cda5e5-f691-4333-9658-96e88d5a2600 could not be found. Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'd2cda5e5-f691-4333-9658-96e88d5a2600'} Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2cda5e5-f691-4333-9658-96e88d5a2600 could not be found. Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2cda5e5-f691-4333-9658-96e88d5a2600 could not be found. Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:34.006099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:34.011057 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:34.011057 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:34.011057 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:34.011057 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:34.011057 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:34.011057 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2cda5e5-f691-4333-9658-96e88d5a2600 could not be found. Oct 17 12:53:34.011057 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:34.012742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Returning 404 to user: Instance d2cda5e5-f691-4333-9658-96e88d5a2600 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:34.013831 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-809c5733-bc5f-423a-bbd5-1dc060501d55 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600" status: 404 len: 111 microversion: 2.1 time: 0.114433 Oct 17 12:53:34.014904 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 714/1427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:33 2022] GET /compute/v2.1/servers/d2cda5e5-f691-4333-9658-96e88d5a2600 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:34.023407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:34.024171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:34.051280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:34.051781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:34.052233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:34.056882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:34.057411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:34.058324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:34.074330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:34.155951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:34.290684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-02ad3a60-39b8-4abf-b95a-9b0fa605e68f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:34.299684 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-02ad3a60-39b8-4abf-b95a-9b0fa605e68f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1217 microversion: 2.1 time: 0.379503 Oct 17 12:53:34.302147 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 714/1428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:33 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1217 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:34.431796 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a862bf3a-34ef-41ac-8ab2-dd2e76226f22 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "DELETE /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 204 len: 0 microversion: 2.1 time: 0.412721 Oct 17 12:53:34.435385 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 715/1429] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:34 2022] DELETE /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:34.442027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:34.442767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:34.456036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:34.457492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:34.459913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:34.466559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:34.469580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:34.471363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:34.951371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:34.952312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:34.984710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:34.985525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:34.989893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:34.991705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:34.993495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:34.996923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:35.013694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:35.025009 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d92625f-3ca7-4aa8-ae6c-e2bbe9ef0365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1470 microversion: 2.1 time: 0.587145 Oct 17 12:53:35.028173 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 715/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:34 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1470 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:35.274617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:35.310564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:35.329254 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0a56fd7e-93be-4532-afc1-75b4e34be839 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.380840 Oct 17 12:53:35.331230 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 716/1431] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:34 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:35.354476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:35.355445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:35.363468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:35.364200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:35.364931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:35.366435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:35.367047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:35.367642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:35.508952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:35.517582 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-846d3c2d-c2c4-4ba3-9d4d-8f9293f37229 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1213 microversion: 2.1 time: 0.189878 Oct 17 12:53:35.519580 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 716/1432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:35 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:36.050476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:36.051698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:36.063500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:36.064968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:36.068110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:36.070052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:36.071437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:36.072405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:36.363339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:36.364095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:36.378643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:36.379112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:36.379556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:36.380279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:36.380740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:36.381168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:36.515384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:36.560871 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ade17bcf-1f9f-4fb8-bbae-d93fdd41f446 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.202513 Oct 17 12:53:36.561650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 717/1433] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:36 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:53:36.580770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:36.586985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:36.594203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:36.594917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:36.595569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:36.596637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:36.597557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:36.598298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:36.722490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:36.758953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:36.761786 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f26febe0-adfd-4bbf-89a1-e92d4a31c907 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1277 microversion: 2.1 time: 0.185992 Oct 17 12:53:36.762337 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 718/1434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:36 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:36.785449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a28262f9-4e4c-4338-93fd-46655132690d req-f13de579-e350-4592-a7af-1769c42be15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beab481d-f8f2-4ad4-b54e-dc0da55403c6", "name": "network-vif-deleted", "tag": "0a12bacf-e64c-4255-a09d-edb9ed6a43cf"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:36.787365 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-92db3895-305f-4f0a-8d3b-1dca4b41df5a tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1428 microversion: 2.1 time: 0.740828 Oct 17 12:53:36.788450 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 717/1435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:36 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1428 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:36.834013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a28262f9-4e4c-4338-93fd-46655132690d req-f13de579-e350-4592-a7af-1769c42be15d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:36.834828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a28262f9-4e4c-4338-93fd-46655132690d req-f13de579-e350-4592-a7af-1769c42be15d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:36.835499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a28262f9-4e4c-4338-93fd-46655132690d req-f13de579-e350-4592-a7af-1769c42be15d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:36.851601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a28262f9-4e4c-4338-93fd-46655132690d req-f13de579-e350-4592-a7af-1769c42be15d service nova] Creating event network-vif-deleted:0a12bacf-e64c-4255-a09d-edb9ed6a43cf for instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 on n-h2-853316-12 Oct 17 12:53:36.857806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a28262f9-4e4c-4338-93fd-46655132690d req-f13de579-e350-4592-a7af-1769c42be15d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089295 Oct 17 12:53:36.860639 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 719/1436] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:37.193731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:37.195054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:37.215545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:37.222975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:37.243673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:37.246329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:37.247027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:37.248519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:37.350005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:37.553678 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d9c43f55-a91a-4758-a38e-a71290955797 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 204 len: 0 microversion: 2.1 time: 0.363797 Oct 17 12:53:37.555712 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 718/1437] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:37 2022] DELETE /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:37.568759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:37.569934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:37.576918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:37.577682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:37.578331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:37.579272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:37.580044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:37.580475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:37.593562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:37.594784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:37.605673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:37.609342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:37.609824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:37.611147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:37.611782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:37.614154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:37.744692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:37.779077 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aea7254a-b689-4fc2-ae49-a764d8d60096 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.185438 Oct 17 12:53:37.799111 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 719/1438] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:37 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:37.818045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:37.826598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:37.850363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:37.852390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:37.852854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:37.853608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:37.854074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:37.854533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:37.980032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:38.001048 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2bb8b6af-22d2-43e7-99a3-c9d46e6e7c3b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1275 microversion: 2.1 time: 0.200726 Oct 17 12:53:38.005467 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 720/1439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:37 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:38.016423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:38.017598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:38.025792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:38.029774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:38.029774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:38.031679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:38.031679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:38.031679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:38.083472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:38.084053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:38.084483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:38.085005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lazy-loading 'fault' on Instance uuid beab481d-f8f2-4ad4-b54e-dc0da55403c6 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:38.153873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:38.165647 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-23f0fa84-35c9-44c5-aa34-e47443c437de tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 200 len: 1304 microversion: 2.1 time: 0.158239 Oct 17 12:53:38.167037 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 721/1440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:38 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:38.396035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:38.409966 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ddf7590f-6c97-4c9f-a572-023202bf241d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1707 microversion: 2.1 time: 0.847019 Oct 17 12:53:38.410869 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 720/1441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:37 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1707 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:38.813542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:38.814434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:38.836340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:38.836843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:38.838962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:38.841416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:38.842057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:38.844345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.017804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:39.042771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:39.043384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:39.081913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:39.084586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:39.090229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.092701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:39.093736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:39.100555 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c6c0423-624c-4591-bc77-75fc33b9c0bb tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.293487 Oct 17 12:53:39.101998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.109942 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 722/1442] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:38 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:39.189096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:39.189697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: beab481d-f8f2-4ad4-b54e-dc0da55403c6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:39.206911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:39.207624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:39.208066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.208780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:39.209233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:39.209648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.237267 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] HTTP exception thrown: Instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 could not be found. Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Request method failure captured: Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 HTTP/1.1 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU-TYATSFihnIuD1z8pDGXOpTzGUYGoDTcLJozTSY6z85yV1j6vZO1F4wafwVJq3Ij_1v2I2iKJX5_V4lAQpUfk6GujNofGAzWrV7mSYugj2Xx3q0PrAPJGOwzMozTwkVOB7Lj2ykObVPxIeShmSfIY2ERdo3oxb9ApjStXHDo7aNls Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 398c14a84792484ba396062bf18c6933 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_398c14a84792484ba396062bf18c6933", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c14a84792484ba396062bf18c6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/398c14a84792484ba396062bf18c6933"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c14a84792484ba396062bf18c6933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 398c14a84792484ba396062bf18c6933 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersAdminTestJSON-136227960-project Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6e904404abe5420bb929ff9ab97f0a02 Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersAdminTestJSON-136227960-project Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 could not be found. Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'beab481d-f8f2-4ad4-b54e-dc0da55403c6'} Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 could not be found. Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 could not be found. Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:39.246336 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:39.253772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:39.253772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:39.253772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:39.253772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:39.253772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:39.253772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 could not be found. Oct 17 12:53:39.253772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:39.255311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Returning 404 to user: Instance beab481d-f8f2-4ad4-b54e-dc0da55403c6 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:39.258087 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b6a173b3-dc7b-4421-887b-6de8af6cf756 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6" status: 404 len: 111 microversion: 2.1 time: 0.073079 Oct 17 12:53:39.280509 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 723/1443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:39 2022] GET /compute/v2.1/servers/beab481d-f8f2-4ad4-b54e-dc0da55403c6 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:39.295593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:39.296487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:39.328197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:39.330976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:39.334379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.336688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:39.337181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:39.339306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.439609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:39.646195 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43bf84b4-57d0-4bd6-af40-78433399d5d1 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 204 len: 0 microversion: 2.1 time: 0.362080 Oct 17 12:53:39.652544 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 724/1444] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:39 2022] DELETE /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:53:39.662409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:39.666363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:39.682743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:39.683782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:39.684928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.686713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:39.687507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:39.688544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:39.945988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:39.958494 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6bef4220-4a61-4294-9767-ffcfe68329f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.920803 Oct 17 12:53:39.959384 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 721/1445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:39 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:39.973835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:39.980234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:40.001817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:40.003484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:40.004985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:40.005920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:40.006574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:40.007359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:40.013336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:40.031178 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c72f56a4-a515-4ffb-8962-61ef2747a026 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1707 microversion: 2.1 time: 0.376673 Oct 17 12:53:40.032880 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 725/1446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:39 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1707 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:40.149928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:40.150928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:40.162456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:40.163133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:40.163687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:40.164580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:40.165185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:40.165729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:40.174466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:40.267854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:40.325254 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-395892aa-a821-4b5e-aec0-a820570d7ed5 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.183879 Oct 17 12:53:40.327315 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 726/1447] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:40 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:40.598223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:40.615592 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-34483340-d67b-4450-ac65-521a9a85b302 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1470 microversion: 2.1 time: 0.648369 Oct 17 12:53:40.616182 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 722/1448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:39 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1470 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:40.983605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:40.984612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:40.994592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:40.995337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:40.996012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:40.996979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:40.997702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:40.998413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:41.058124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:41.058756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:41.079969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:41.080481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:41.080927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:41.086479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:41.087038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:41.087486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:41.385445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:41.404344 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ba93aeaa-c864-41e3-a84a-04ac90a4e86c tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1707 microversion: 2.1 time: 0.347391 Oct 17 12:53:41.407508 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 723/1449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:41 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1707 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:41.417658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:41.422007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:41.437418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:41.443625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:41.447089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:41.448075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:41.449711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:41.451116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:41.632723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:41.639910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:41.678646 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1fbde0cf-6a17-4f9f-95b2-9635628b9a52 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.269604 Oct 17 12:53:41.679636 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 724/1450] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:41 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:41.684631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-83adadda-c48c-410c-a266-82cd9eed6ee2 req-1c394010-97d8-4a35-9084-1c8e02f30608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222a4599-cec5-40bf-8491-6396b6760322", "tag": "0e863af4-158a-4246-b335-b61ce5106bac"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:41.695535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-83adadda-c48c-410c-a266-82cd9eed6ee2 req-1c394010-97d8-4a35-9084-1c8e02f30608 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:41.696258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-83adadda-c48c-410c-a266-82cd9eed6ee2 req-1c394010-97d8-4a35-9084-1c8e02f30608 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:41.696879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-83adadda-c48c-410c-a266-82cd9eed6ee2 req-1c394010-97d8-4a35-9084-1c8e02f30608 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:41.710012 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-83adadda-c48c-410c-a266-82cd9eed6ee2 req-1c394010-97d8-4a35-9084-1c8e02f30608 service nova] Creating event network-changed:0e863af4-158a-4246-b335-b61ce5106bac for instance 222a4599-cec5-40bf-8491-6396b6760322 on n-h1-853316-12 Oct 17 12:53:41.715187 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-83adadda-c48c-410c-a266-82cd9eed6ee2 req-1c394010-97d8-4a35-9084-1c8e02f30608 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034270 Oct 17 12:53:41.716083 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 725/1451] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:41.726975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:41.727957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:41.735494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:41.736982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:41.738126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:41.739118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:41.739756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:41.740422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:41.749602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:41.758598 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-069c75fe-e0e4-4e02-ae99-7ee436dbc0c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.779545 Oct 17 12:53:41.759188 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 727/1452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:40 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:42.027370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2042725137", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": "none"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:42.479833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:42.488739 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8556817e-ea97-4ab6-b6d7-4dfc79f10cb4 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1470 microversion: 2.1 time: 0.766688 Oct 17 12:53:42.493130 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 726/1453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:41 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1470 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:42.503788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:42.508025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:42.526837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:42.527600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:42.528465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:42.529344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:42.529945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:42.531739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:42.904250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:42.914288 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8d2449b7-bc65-4af1-b773-543cbb898289 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1707 microversion: 2.1 time: 0.420058 Oct 17 12:53:42.938207 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 727/1454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:42 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1707 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:42.944730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:42.945624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:42.951995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:42.952816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:42.953468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:42.954466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:42.958775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:42.959475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:43.169678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:43.289710 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fa1f04b6-eac7-47bc-b971-75fe8c30ea83 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1929 microversion: 2.75 time: 0.345448 Oct 17 12:53:43.293026 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 728/1455] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:42 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1929 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:43.299588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:43.301012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:43.309652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:43.310459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:43.311080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:43.312253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:43.313181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:43.313770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:43.635318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:43.668705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:43.708745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cb2e37eb-df4d-4da2-8d75-2491a8cdc39e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.407781 Oct 17 12:53:43.710025 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 729/1456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:43 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:43.725226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:43.726456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:43.736691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:43.737483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:43.739445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:43.740423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:43.743836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:43.747804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:43.752011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:43.946959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:43.961636 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a65bdac6-04c6-41cf-bf0d-a2e2aa1a0cc5 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1428 microversion: 2.1 time: 0.247387 Oct 17 12:53:43.964271 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 730/1457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:43 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1428 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:43.980309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f4af1dd8-bc19-45a2-907f-9cb661786c2e req-24285ab0-2a76-4fc8-9928-245c4a4462fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f35cc1-58d6-4894-af02-7db8eefeb420", "name": "network-vif-deleted", "tag": "9a19bdb4-6892-4689-af82-3c465058331f"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:44.004967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f4af1dd8-bc19-45a2-907f-9cb661786c2e req-24285ab0-2a76-4fc8-9928-245c4a4462fe service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:44.005720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f4af1dd8-bc19-45a2-907f-9cb661786c2e req-24285ab0-2a76-4fc8-9928-245c4a4462fe service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:44.006183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f4af1dd8-bc19-45a2-907f-9cb661786c2e req-24285ab0-2a76-4fc8-9928-245c4a4462fe service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:44.024120 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f4af1dd8-bc19-45a2-907f-9cb661786c2e req-24285ab0-2a76-4fc8-9928-245c4a4462fe service nova] Creating event network-vif-deleted:9a19bdb4-6892-4689-af82-3c465058331f for instance d7f35cc1-58d6-4894-af02-7db8eefeb420 on n-h1-853316-12 Oct 17 12:53:44.029953 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f4af1dd8-bc19-45a2-907f-9cb661786c2e req-24285ab0-2a76-4fc8-9928-245c4a4462fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063697 Oct 17 12:53:44.031038 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 731/1458] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:44.052833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:44.058971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:44.075980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:44.076482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:44.076921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:44.077644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:44.078101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:44.078561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:44.201385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:44.212652 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-80fe1b50-1814-4f27-9c8c-2640e93aa6ad tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1640 microversion: 2.1 time: 0.180221 Oct 17 12:53:44.213800 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 732/1459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:44 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1640 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:44.331050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:44.332375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:44.345069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:44.349732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:44.350528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:44.351165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:44.352082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:44.352708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:44.353302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:44.459820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:44.487502 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4288d341-0a77-4ce4-8d9a-cff4892afecd tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1947 microversion: 2.75 time: 0.165336 Oct 17 12:53:44.488807 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 733/1460] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:44 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1947 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:44.495852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0a97e46c-bf5b-4553-b11f-847a287d2473 req-b74de834-7225-48ee-85d4-38277bd1ccb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b339d94-c1ae-4a21-9cc1-980fc71295c4", "name": "network-vif-deleted", "tag": "6d73bd0e-3dc4-4afe-88a7-ac7e9316c237"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:44.515426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0a97e46c-bf5b-4553-b11f-847a287d2473 req-b74de834-7225-48ee-85d4-38277bd1ccb6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:44.517283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0a97e46c-bf5b-4553-b11f-847a287d2473 req-b74de834-7225-48ee-85d4-38277bd1ccb6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:44.518978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0a97e46c-bf5b-4553-b11f-847a287d2473 req-b74de834-7225-48ee-85d4-38277bd1ccb6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:44.547695 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0a97e46c-bf5b-4553-b11f-847a287d2473 req-b74de834-7225-48ee-85d4-38277bd1ccb6 service nova] Creating event network-vif-deleted:6d73bd0e-3dc4-4afe-88a7-ac7e9316c237 for instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 on n-h1-853316-12 Oct 17 12:53:44.554418 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0a97e46c-bf5b-4553-b11f-847a287d2473 req-b74de834-7225-48ee-85d4-38277bd1ccb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064010 Oct 17 12:53:44.555847 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 734/1461] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:44.740049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:44.740777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:44.749049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:44.749818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:44.750340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:44.751256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:44.751718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:44.752156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:45.011482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:45.021369 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11310731-21da-42b5-93b2-5cca8ed2e9c8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.288249 Oct 17 12:53:45.023350 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 735/1462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:44 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:45.028303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:45.029093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:45.044892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:45.045783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:45.046505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:45.047459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:45.048364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:45.049026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:45.101936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:45.103106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:45.103770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:45.104949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lazy-loading 'fault' on Instance uuid d7f35cc1-58d6-4894-af02-7db8eefeb420 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:45.160312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:45.171253 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3a88b22-9368-4bcb-97df-49c13b089365 tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1304 microversion: 2.1 time: 0.146829 Oct 17 12:53:45.192638 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 736/1463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:45 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:45.237068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:45.238613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:45.248651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:45.249171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:45.249653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:45.250326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:45.250784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:45.251199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:45.365726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:45.375971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45ab9030-1d75-492a-9afd-c2aedd6a95b0 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1640 microversion: 2.1 time: 0.142232 Oct 17 12:53:45.376597 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 737/1464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:45 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1640 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:45.528795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:45.529468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:45.533297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:45.541617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:45.542136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:45.544973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:45.545753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:45.547959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:45.552912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:45.663285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:45.681737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-167799ec-94f4-4539-8330-6ff9cba8ed17 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1947 microversion: 2.75 time: 0.157814 Oct 17 12:53:45.701003 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 738/1465] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:45 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1947 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:46.046297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:46.047831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:46.068059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.072281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.072997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.074019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.074810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.075752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.356040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:46.367395 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-091bd021-1d22-4cce-88ae-832ef7bee01a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.324930 Oct 17 12:53:46.368011 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 739/1466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:46 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:46.374045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:46.374701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:46.383965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.384460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.384903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.385621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.387071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.387071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.428814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.429249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.429698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.430208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lazy-loading 'fault' on Instance uuid d7f35cc1-58d6-4894-af02-7db8eefeb420 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:46.549936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e904404abe5420bb929ff9ab97f0a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c14a84792484ba396062bf18c6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:46.568192 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b3fe4f9-73be-4831-8bc5-ac4de72e8e1b tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 200 len: 1304 microversion: 2.1 time: 0.199115 Oct 17 12:53:46.590591 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 740/1467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:46 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 1304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:46.601308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:46.601452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:46.620195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.620810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.621337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.622153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.623096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.623096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.672195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:46.727978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:46.739637 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-79bd459c-5c45-4c2e-b830-acdaf4b57d8b tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1344 microversion: 2.1 time: 0.147584 Oct 17 12:53:46.747218 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 741/1468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:46 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1344 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:46.761038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:46.761674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:46.778263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.778678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.779130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.779869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:46.782394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:46.782909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:46.969182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:46.998622 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0f7453b-2695-458a-be17-c2afc9bab499 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1935 microversion: 2.75 time: 0.245500 Oct 17 12:53:46.999943 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 742/1469] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:46 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1935 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:47.401684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:47.401684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:47.423718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:47.424279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:47.425620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:47.426671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:47.427130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:47.427571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:47.683100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:47.695281 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0572848-5c3f-4eec-9035-453ceffa0598 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.298168 Oct 17 12:53:47.696719 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 743/1470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:47 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:47.707448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:47.708449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] [instance: d7f35cc1-58d6-4894-af02-7db8eefeb420] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:47.717833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:47.719067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:47.719910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:47.721300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:47.722657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:47.723435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:47.742904 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] HTTP exception thrown: Instance d7f35cc1-58d6-4894-af02-7db8eefeb420 could not be found. Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Request method failure captured: Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 HTTP/1.1 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU-TYATSFihnIuD1z8pDGXOpTzGUYGoDTcLJozTSY6z85yV1j6vZO1F4wafwVJq3Ij_1v2I2iKJX5_V4lAQpUfk6GujNofGAzWrV7mSYugj2Xx3q0PrAPJGOwzMozTwkVOB7Lj2ykObVPxIeShmSfIY2ERdo3oxb9ApjStXHDo7aNls Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 398c14a84792484ba396062bf18c6933 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_398c14a84792484ba396062bf18c6933", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c14a84792484ba396062bf18c6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/398c14a84792484ba396062bf18c6933"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/398c14a84792484ba396062bf18c6933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 398c14a84792484ba396062bf18c6933 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersAdminTestJSON-136227960 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersAdminTestJSON-136227960-project Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6e904404abe5420bb929ff9ab97f0a02 Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersAdminTestJSON-136227960-project Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d7f35cc1-58d6-4894-af02-7db8eefeb420 could not be found. Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd7f35cc1-58d6-4894-af02-7db8eefeb420'} Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f35cc1-58d6-4894-af02-7db8eefeb420 could not be found. Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f35cc1-58d6-4894-af02-7db8eefeb420 could not be found. Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:47.744920 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f35cc1-58d6-4894-af02-7db8eefeb420 could not be found. Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] Returning 404 to user: Instance d7f35cc1-58d6-4894-af02-7db8eefeb420 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:47.749401 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-903419dd-2830-4feb-b9a6-981bf9c7ebcd tempest-ServersAdminTestJSON-136227960 tempest-ServersAdminTestJSON-136227960-project] 10.222.0.27 "GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420" status: 404 len: 111 microversion: 2.1 time: 0.048554 Oct 17 12:53:47.751250 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 744/1471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:47 2022] GET /compute/v2.1/servers/d7f35cc1-58d6-4894-af02-7db8eefeb420 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:47.772576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:47.774007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:47.784338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:47.785103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:47.786995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:47.789696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:47.790963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:47.791583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:47.866484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:47.867329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:47.867955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:47.869110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lazy-loading 'fault' on Instance uuid 1b339d94-c1ae-4a21-9cc1-980fc71295c4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:47.943489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:47.959545 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc2ae8e5-e064-4d6a-b070-2070be9520b8 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1349 microversion: 2.1 time: 0.198394 Oct 17 12:53:47.960637 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 745/1472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:47 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1349 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:48.030500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:48.031263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:48.061529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:48.062021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:48.064085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:48.064868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:48.065373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:48.066453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:48.251262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:48.274214 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4bb4c75e-bcd7-4b2e-a619-87364e9a67e4 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1935 microversion: 2.75 time: 0.248949 Oct 17 12:53:48.274824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 746/1473] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:48 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1935 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:48.721384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:48.722786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:48.755730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:48.757820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:48.759326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:48.763220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:48.765262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:48.765589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:49.126040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:49.144681 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de438b56-a548-45d2-b62d-ba242eae947a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.425708 Oct 17 12:53:49.147332 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 747/1474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:48 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:53:49.158039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:49.158789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:49.171618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:49.182448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:49.195579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:49.197625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:49.199642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:49.200466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:49.278243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:49.281630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:49.282234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:49.282773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lazy-loading 'fault' on Instance uuid 1b339d94-c1ae-4a21-9cc1-980fc71295c4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:49.371356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68dd6904cebc42b48e4f421267cafd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e42d050ee6400786fb16b79e54355b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:49.381990 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a0967ac2-a079-480c-96a7-88a426b1bd4a tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 200 len: 1349 microversion: 2.1 time: 0.232759 Oct 17 12:53:49.386657 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 748/1475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:49 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 1349 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:49.401880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:49.402726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:49.417840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:49.418369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:49.418813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:49.419965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:49.420379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:49.420813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:49.567363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:49.614053 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d473b32-4377-483e-b8e4-a33a88b31be3 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1935 microversion: 2.75 time: 0.216094 Oct 17 12:53:49.615393 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 749/1476] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:49 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1935 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:49.996853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1504042780", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:51.754588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:52.048743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:53:56.585584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:53:56.586506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:53:56.587093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:53:56.587569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:53:56.588047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:53:56.588975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] validate_networks() for [('72b73ea2-395b-41ae-96b0-5158721d65ab', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:53:56.597838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:56.598628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:56.599069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:56.599803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:56.600448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:56.600888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:56.622512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Getting quotas for project 006813c91a564419a261ab51bdc12ffc. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:53:56.626612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Getting quotas for user 00f12fd3b1bf475ea08c24a9706b99fe and project 006813c91a564419a261ab51bdc12ffc. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:53:56.642487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:53:56.644957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:53:56.705582 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0975502b-f2d6-4f4b-99f5-7928dcce398c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 14.945338 Oct 17 12:53:56.706790 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 728/1477] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 14947 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 12:53:56.717357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:56.719039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:56.726044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:56.726575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:56.727014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:56.727720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:56.728171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:56.728597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:56.962731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:56.971612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-040ec89b-3cfc-45fd-b8c2-89db1e2ef4bc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.263630 Oct 17 12:53:56.991624 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 729/1478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:56 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:56.997003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:56.997668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:57.006563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.007052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.007506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.008329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.008794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.009250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.031234 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] HTTP exception thrown: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Request method failure captured: Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 HTTP/1.1 Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8v1YgS9fXqByvS2mdEgVNDKgxCzqBsdWyO2u5DtTR0rG74Ili-cQOOk6bOi4mCG5ewcyiz1bvepwuU-SF-reYthoI19cIHrzQ6LUFW7AQ9EefFTK7uAJAsqIq2QJZEg2dtTtvdJ1Wf9IItrst778LH8zPcEAokyl1dxHavHxrwjh8 Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18e42d050ee6400786fb16b79e54355b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 68dd6904cebc42b48e4f421267cafd9d Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1b339d94-c1ae-4a21-9cc1-980fc71295c4'} Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.040953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Returning 404 to user: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:57.046269 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e2f9804-8b57-4188-99a3-4b7df6d4046d tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 404 len: 111 microversion: 2.1 time: 0.051876 Oct 17 12:53:57.057937 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 730/1479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:56 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:57.075121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:57.077068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:57.086487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.087413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.088005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.089094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.090579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.091295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.129076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:53:57.129467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:53:57.130247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:53:57.130569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:53:57.131165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:53:57.140623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.141105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.141653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.142415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.142868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.143348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.188816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Getting quotas for project 626e075834e746638f9ce7a8b2387def. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:53:57.197629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Getting quotas for user 99a154e10393432e8f47c705612c3fcf and project 626e075834e746638f9ce7a8b2387def. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:53:57.209687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:53:57.212381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:53:57.220226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] Lazy-loading 'services' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:53:57.251731 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ae218f09-f31a-43e3-bb0f-2890b68ae275 tempest-ServersAdmin275Test-1867444842 tempest-ServersAdmin275Test-1867444842-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1920 microversion: 2.75 time: 0.192014 Oct 17 12:53:57.266372 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 731/1480] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:57 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1920 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:57.266372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-00966d14-9e27-47de-907e-dcff78d5798e req-85c55ce7-7d1e-4e32-88e5-bc7d71a034c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222a4599-cec5-40bf-8491-6396b6760322", "name": "network-vif-plugged", "status": "completed", "tag": "0e863af4-158a-4246-b335-b61ce5106bac"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:57.266702 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d9f4953b-85bd-44b3-b751-7b5bfdd790d5 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.650032 Oct 17 12:53:57.274522 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 750/1481] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:53:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 7658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:53:57.295631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00966d14-9e27-47de-907e-dcff78d5798e req-85c55ce7-7d1e-4e32-88e5-bc7d71a034c3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.296151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00966d14-9e27-47de-907e-dcff78d5798e req-85c55ce7-7d1e-4e32-88e5-bc7d71a034c3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.296646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00966d14-9e27-47de-907e-dcff78d5798e req-85c55ce7-7d1e-4e32-88e5-bc7d71a034c3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.314192 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-00966d14-9e27-47de-907e-dcff78d5798e req-85c55ce7-7d1e-4e32-88e5-bc7d71a034c3 service nova] Creating event network-vif-plugged:0e863af4-158a-4246-b335-b61ce5106bac for instance 222a4599-cec5-40bf-8491-6396b6760322 on n-h1-853316-12 Oct 17 12:53:57.320004 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-00966d14-9e27-47de-907e-dcff78d5798e req-85c55ce7-7d1e-4e32-88e5-bc7d71a034c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066485 Oct 17 12:53:57.324579 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 732/1482] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:53:57.352923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f060b317-9b16-4992-9121-1fd3b83b5016 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:57.355571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f060b317-9b16-4992-9121-1fd3b83b5016 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:57.473548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f060b317-9b16-4992-9121-1fd3b83b5016 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:57.477892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1166492901", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": "none"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:53:57.483517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f060b317-9b16-4992-9121-1fd3b83b5016 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:57.485249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f060b317-9b16-4992-9121-1fd3b83b5016 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:57.491095 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f060b317-9b16-4992-9121-1fd3b83b5016 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1281 microversion: 2.47 time: 0.160692 Oct 17 12:53:57.491851 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 733/1483] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:57 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:57.501553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:57.509760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:57.523140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.530655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.531546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.534538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.540407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.541195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.571055 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] HTTP exception thrown: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Request method failure captured: Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf HTTP/1.1 Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8v1YgS9fXqByvS2mdEgVNDKgxCzqBsdWyO2u5DtTR0rG74Ili-cQOOk6bOi4mCG5ewcyiz1bvepwuU-SF-reYthoI19cIHrzQ6LUFW7AQ9EefFTK7uAJAsqIq2QJZEg2dtTtvdJ1Wf9IItrst778LH8zPcEAokyl1dxHavHxrwjh8 Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18e42d050ee6400786fb16b79e54355b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 68dd6904cebc42b48e4f421267cafd9d Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '4ac5965b-fa19-4a90-bfdb-3953192e5cbf'} Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:57.574728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:57.579952 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:57.582613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Returning 404 to user: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:57.583482 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7c00231-c43d-49fc-949a-1411c49f3359 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 404 len: 111 microversion: 2.1 time: 0.090470 Oct 17 12:53:57.588884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 734/1484] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:57 2022] DELETE /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:57.591243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:53:57.591662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:53:57.592113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:53:57.592592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:53:57.594743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf1aa7d0-1c41-4a49-a020-3b59b5ec0d48 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:57.595395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf1aa7d0-1c41-4a49-a020-3b59b5ec0d48 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:57.599800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:53:57.618997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.619764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.620171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.621003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.622678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.623119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.660999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Getting quotas for project 91ecd4f9330143ddb5817579fab9b163. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:53:57.681298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Getting quotas for user a3b6b183dbf44cd684c5030b272bff4f and project 91ecd4f9330143ddb5817579fab9b163. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:53:57.729158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:53:57.731702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:53:57.872874 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f182300f-5e4b-4e44-a4fd-1b8e8fc696e8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.596877 Oct 17 12:53:57.875783 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 751/1485] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 12:53:57.908185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:57.908693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:57.928010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.928521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.928957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:57.929695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:57.935316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:57.954661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.034023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf1aa7d0-1c41-4a49-a020-3b59b5ec0d48 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.042516 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf1aa7d0-1c41-4a49-a020-3b59b5ec0d48 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1224 microversion: 2.1 time: 0.452594 Oct 17 12:53:58.055249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:53:58.059586 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 735/1486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:57 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1224 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:58.075471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:58.076353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:58.091614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:58.092622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:58.093280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.098384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:58.099079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:58.099703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.124688 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] HTTP exception thrown: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Request method failure captured: Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf HTTP/1.1 Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8v1YgS9fXqByvS2mdEgVNDKgxCzqBsdWyO2u5DtTR0rG74Ili-cQOOk6bOi4mCG5ewcyiz1bvepwuU-SF-reYthoI19cIHrzQ6LUFW7AQ9EefFTK7uAJAsqIq2QJZEg2dtTtvdJ1Wf9IItrst778LH8zPcEAokyl1dxHavHxrwjh8 Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18e42d050ee6400786fb16b79e54355b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 68dd6904cebc42b48e4f421267cafd9d Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '4ac5965b-fa19-4a90-bfdb-3953192e5cbf'} Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:58.126850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:53:58.133637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:58.133637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:53:58.133637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:53:58.133637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:53:58.133637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:53:58.133637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:53:58.133637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:53:58.133637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:53:58.135845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Returning 404 to user: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:53:58.137045 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9f8977a-c122-40ee-ac74-b6e44c2a6036 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 404 len: 111 microversion: 2.1 time: 0.076287 Oct 17 12:53:58.139336 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 736/1487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:58 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:53:58.145972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-282a0a0b-307d-4e22-9950-2f22746a8d6b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:58.147048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-282a0a0b-307d-4e22-9950-2f22746a8d6b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:58.221247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-282a0a0b-307d-4e22-9950-2f22746a8d6b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.230288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-282a0a0b-307d-4e22-9950-2f22746a8d6b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.233186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-282a0a0b-307d-4e22-9950-2f22746a8d6b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.239933 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-282a0a0b-307d-4e22-9950-2f22746a8d6b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1454 microversion: 2.91 time: 0.099244 Oct 17 12:53:58.240517 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 737/1488] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:58 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:58.246089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:58.246817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:58.254698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:58.255412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:58.256020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.256897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:58.257508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:58.258082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.365344 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9fe907d7-9f3c-4fc1-94c6-2dd09465d942 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 204 len: 0 microversion: 2.75 time: 0.481174 Oct 17 12:53:58.366316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 752/1489] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:53:57 2022] DELETE /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:53:58.381599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dfa4f0ba-8c72-4eca-8da9-fc6b28c434b6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '.version_select at 0x7fa820f25940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:58.432174 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dfa4f0ba-8c72-4eca-8da9-fc6b28c434b6 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-633989678" status: 202 len: 0 microversion: 2.1 time: 0.063275 Oct 17 12:53:58.435213 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 753/1490] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 12:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-633989678 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:58.452695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:58.454349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:58.474904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:58.476454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:58.477250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.478311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:58.479151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:58.481023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.518985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.532517 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d4899ef-c13c-4140-80ce-076be6938fdc tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.290926 Oct 17 12:53:58.540383 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 738/1491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:58 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:58.558751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:58.566709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:58.578972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:58.580353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:58.581784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.584157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:58.584700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:58.587623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:58.679066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.689579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.691873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.699786 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-61594c3f-1ce5-408a-ac2c-b0201668a960 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1443 microversion: 2.75 time: 0.262440 Oct 17 12:53:58.702652 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 754/1492] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:58 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1443 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:58.809560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.819848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.826825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:58.828063 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-192627ef-b0d2-4ec3-8da7-5aa67ac518c2 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1333 microversion: 2.47 time: 0.285240 Oct 17 12:53:58.829920 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 739/1493] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:58 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1333 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:59.073903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.078119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:59.113971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.116820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.118769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.121074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.121680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.122245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.219289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:59.229325 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf6ac6d7-d24e-4b87-b2dd-155700ae928b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1276 microversion: 2.1 time: 0.159450 Oct 17 12:53:59.234197 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 755/1494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:59 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:59.272392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.273010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:59.280789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.285215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.287085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.287843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.291959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.292531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.443589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:59.469283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:59.472141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:59.479576 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2399ad5b-1917-48a3-a2a6-da2cb8192b09 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1450 microversion: 2.91 time: 0.211622 Oct 17 12:53:59.497495 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 740/1495] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:59 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1450 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:59.561611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.562731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:59.570357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.571255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.571922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.573387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.574095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.574759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.704438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d3eaca4e-645a-49a0-9b29-79ce75628600 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.731517 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d3eaca4e-645a-49a0-9b29-79ce75628600 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/744708008" status: 202 len: 0 microversion: 2.1 time: 0.029605 Oct 17 12:53:59.738030 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 741/1496] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 12:53:59 2022] DELETE /compute/v2.1/flavors/744708008 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:53:59.745707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.747398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:59.760829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.761727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.762915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.763955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.764608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.765230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.780498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:59.790828 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c27cd6f-efe6-4132-906f-e3f996b58367 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1317 microversion: 2.1 time: 0.233031 Oct 17 12:53:59.792319 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 756/1497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:53:59 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:59.798398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fbf7374b-dab9-42a1-9ecb-d0314be4f557 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.826197 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fbf7374b-dab9-42a1-9ecb-d0314be4f557 tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.031747 Oct 17 12:53:59.827593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 757/1498] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:53:59 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:59.852143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-507e92a7-ab00-41a7-a8a4-5108ffd1e11b tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.858804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:59.869587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:59.871566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:53:59.877401 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-507e92a7-ab00-41a7-a8a4-5108ffd1e11b tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/53009762" status: 202 len: 0 microversion: 2.1 time: 0.029583 Oct 17 12:53:59.878322 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9c09334f-cc6d-4d24-ac9e-b5efbe504183 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1443 microversion: 2.75 time: 0.137407 Oct 17 12:53:59.881633 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 758/1499] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:53:59 2022] DELETE /compute/v2.1/flavors/53009762 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:53:59.886695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.887745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:59.899682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 742/1500] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:59 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:53:59.907929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.908434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.909322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.910756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.911385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.911512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d75d5ba8-03b8-47ac-825b-cbbe8db7632b tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.912150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.935861 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d75d5ba8-03b8-47ac-825b-cbbe8db7632b tempest-ServersWithSpecificFlavorTestJSON-746322450 tempest-ServersWithSpecificFlavorTestJSON-746322450-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034454 Oct 17 12:53:59.936924 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 743/1501] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:53:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:53:59.974566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:53:59.975085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:53:59.983588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.984089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.984561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:53:59.985338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:53:59.985822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:53:59.986312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.033680 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] HTTP exception thrown: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Request method failure captured: Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 HTTP/1.1 Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8v1YgS9fXqByvS2mdEgVNDKgxCzqBsdWyO2u5DtTR0rG74Ili-cQOOk6bOi4mCG5ewcyiz1bvepwuU-SF-reYthoI19cIHrzQ6LUFW7AQ9EefFTK7uAJAsqIq2QJZEg2dtTtvdJ1Wf9IItrst778LH8zPcEAokyl1dxHavHxrwjh8 Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18e42d050ee6400786fb16b79e54355b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 68dd6904cebc42b48e4f421267cafd9d Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1b339d94-c1ae-4a21-9cc1-980fc71295c4'} Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:00.038254 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Returning 404 to user: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:00.043157 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-839beee1-fc98-4454-a216-3b82d986bd20 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 404 len: 111 microversion: 2.1 time: 0.068049 Oct 17 12:54:00.047267 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 744/1502] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:53:59 2022] DELETE /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:00.055497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:00.056733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 1b339d94-c1ae-4a21-9cc1-980fc71295c4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:00.061111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:00.063694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.064260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.064854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.066539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.066841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:00.066995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.067431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.075251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:00.077782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:00.079282 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a5967b8c-ba68-4aae-96f0-515c081000c3 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1339 microversion: 2.47 time: 0.198844 Oct 17 12:54:00.090217 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 759/1503] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:53:59 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1339 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] HTTP exception thrown: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Request method failure captured: Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 HTTP/1.1 Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8v1YgS9fXqByvS2mdEgVNDKgxCzqBsdWyO2u5DtTR0rG74Ili-cQOOk6bOi4mCG5ewcyiz1bvepwuU-SF-reYthoI19cIHrzQ6LUFW7AQ9EefFTK7uAJAsqIq2QJZEg2dtTtvdJ1Wf9IItrst778LH8zPcEAokyl1dxHavHxrwjh8 Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18e42d050ee6400786fb16b79e54355b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 68dd6904cebc42b48e4f421267cafd9d Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1b339d94-c1ae-4a21-9cc1-980fc71295c4'} Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:00.090422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Returning 404 to user: Instance 1b339d94-c1ae-4a21-9cc1-980fc71295c4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2e5688b-b88a-4813-9368-3ccb491b1878 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4" status: 404 len: 111 microversion: 2.1 time: 0.035397 Oct 17 12:54:00.094815 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 745/1504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:00 2022] GET /compute/v2.1/servers/1b339d94-c1ae-4a21-9cc1-980fc71295c4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:54:00.101108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:00.101689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:00.104438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:00.111318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.111885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.112496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.113472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.114002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.114524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.131877 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] HTTP exception thrown: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Request method failure captured: Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf HTTP/1.1 Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8v1YgS9fXqByvS2mdEgVNDKgxCzqBsdWyO2u5DtTR0rG74Ili-cQOOk6bOi4mCG5ewcyiz1bvepwuU-SF-reYthoI19cIHrzQ6LUFW7AQ9EefFTK7uAJAsqIq2QJZEg2dtTtvdJ1Wf9IItrst778LH8zPcEAokyl1dxHavHxrwjh8 Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18e42d050ee6400786fb16b79e54355b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 68dd6904cebc42b48e4f421267cafd9d Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '4ac5965b-fa19-4a90-bfdb-3953192e5cbf'} Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:00.133641 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Returning 404 to user: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:00.138182 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-41ec5417-abe1-4a1a-8cfe-c75f174e9925 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 404 len: 111 microversion: 2.1 time: 0.041243 Oct 17 12:54:00.139050 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 760/1505] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:00 2022] DELETE /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:00.147258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:00.147881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] [instance: 4ac5965b-fa19-4a90-bfdb-3953192e5cbf] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:00.154457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.154951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.155398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.156109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.156572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.157005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.171751 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] HTTP exception thrown: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Request method failure captured: Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf HTTP/1.1 Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8v1YgS9fXqByvS2mdEgVNDKgxCzqBsdWyO2u5DtTR0rG74Ili-cQOOk6bOi4mCG5ewcyiz1bvepwuU-SF-reYthoI19cIHrzQ6LUFW7AQ9EefFTK7uAJAsqIq2QJZEg2dtTtvdJ1Wf9IItrst778LH8zPcEAokyl1dxHavHxrwjh8 Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18e42d050ee6400786fb16b79e54355b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18e42d050ee6400786fb16b79e54355b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 18e42d050ee6400786fb16b79e54355b Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258 Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 68dd6904cebc42b48e4f421267cafd9d Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-447908258-project Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '4ac5965b-fa19-4a90-bfdb-3953192e5cbf'} Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.173333 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] Returning 404 to user: Instance 4ac5965b-fa19-4a90-bfdb-3953192e5cbf could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0b46946c-8052-453c-9c63-3e77f06a9db9 tempest-ServersWithSpecificFlavorTestJSON-447908258 tempest-ServersWithSpecificFlavorTestJSON-447908258-project] 10.222.0.27 "GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf" status: 404 len: 111 microversion: 2.1 time: 0.032086 Oct 17 12:54:00.178279 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 746/1506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:00 2022] GET /compute/v2.1/servers/4ac5965b-fa19-4a90-bfdb-3953192e5cbf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:00.257387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:00.257845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:00.264212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.264677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.265446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.266432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.267337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.267969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.337297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:00.346403 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b778666-12dc-484f-8ba5-80fa33b0344b tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1276 microversion: 2.1 time: 0.093547 Oct 17 12:54:00.347304 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 761/1507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:00 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:00.511995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:00.513025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:00.522793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.523732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.524793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.526174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.526870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.528693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.626069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:00.649563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:00.652646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:00.662112 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dd98ed07-24e7-4cb3-b18c-80ef85295f05 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1450 microversion: 2.91 time: 0.156211 Oct 17 12:54:00.665304 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 747/1508] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:00 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:00.822516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:00.825660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:00.845088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.845852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.851034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.858367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.859892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.860891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.915376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:00.916767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:00.926846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.929463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.931541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:00.933910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:00.935137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:00.936970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.087247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.106061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.110304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.132702 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-56038f40-1939-4ccf-94a6-ff9dfea0dd14 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1443 microversion: 2.75 time: 0.225109 Oct 17 12:54:01.135361 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 748/1509] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:00 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1443 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:01.165310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:01.168747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:01.171883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.197170 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c56b8fcc-2264-4f2a-ba1f-4355c9d1f42e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1467 microversion: 2.1 time: 0.379601 Oct 17 12:54:01.199115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:01.199955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:01.200642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.201617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:01.202338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:01.203021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.209709 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 762/1510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:00 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1467 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:01.226826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:01.227467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:01.235468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:01.235971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:01.236418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.247377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:01.249509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:01.252247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.453646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.464013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.471193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.480361 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-37227443-8010-4ccc-a328-6e8a0ac2ad06 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1339 microversion: 2.47 time: 0.342569 Oct 17 12:54:01.481342 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c9e2cc07-0db6-4209-a56f-4dafafb64337 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1620 microversion: 2.1 time: 0.258547 Oct 17 12:54:01.481812 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 749/1511] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:01 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1339 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:01.496717 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 763/1512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:01 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1620 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:01.500362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:01.501236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:01.514694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:01.515754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:01.516761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.519415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:01.521076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:01.522924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.698123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:01.699264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:01.715483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:01.718297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:01.720393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.723197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:01.726668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:01.731583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:01.883647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.895493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.897294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:01.911272 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81641bd3-720a-445c-9e1d-ba0ecbaef9ec tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1506 microversion: 2.91 time: 0.214211 Oct 17 12:54:01.912469 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 764/1513] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:01 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:01.922876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1720456477", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e2607f9b-b14e-4bad-a241-9cd51a932b94"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:02.032222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:54:02.069367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:02.082251 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c01953b-42a3-4473-99a9-6b90d45f2550 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1294 microversion: 2.1 time: 0.598321 Oct 17 12:54:02.085027 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 750/1514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:01 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1294 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:02.165881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:02.167304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:02.183150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:02.199153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:02.199866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:02.200778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:02.202392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:02.203020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:02.325981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:02.326925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:02.327695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:02.328352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lazy-loading 'fault' on Instance uuid 89394b0c-71d5-4289-96fa-deb00aae6fa4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:02.602700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:02.625052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:02.630205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd72bd49db141599122d8e94e443ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfefd211f821498d9b76bad39d673e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:02.644683 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e60346f-a7fe-47c9-a512-fc29599ed95a tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 200 len: 1448 microversion: 2.75 time: 0.483346 Oct 17 12:54:02.654996 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 751/1515] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:02 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 1448 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:02.665162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:02.665787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:02.698195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:02.699011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:02.699472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:02.700205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:02.700657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:02.701077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:02.905032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:02.916768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:02.918253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:02.919449 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd4198e6-a586-4961-85e8-31e6306b9594 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1360 microversion: 2.47 time: 0.263497 Oct 17 12:54:02.941661 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 752/1516] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:02 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1360 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:02.951170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:02.953884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:02.967153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:02.969654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:02.972278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:02.976996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:02.977724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:02.978425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:03.140102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:03.157657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:03.162963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:03.175128 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-40d59e99-5dc2-48ea-b152-1573ac73514f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1512 microversion: 2.91 time: 0.231845 Oct 17 12:54:03.180129 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 753/1517] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:02 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:03.195272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1508632458"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:03.198017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:03.217037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:03.217888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:03.219152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:03.220049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:03.228944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:03.229571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:03.284946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:03.650557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:54:03.651230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:54:03.652134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:54:03.652826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:54:03.653454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:54:03.667767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:03.668650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:03.669565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:03.671952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:03.673365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:03.674013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:03.687127 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79404aa5-1eb2-476a-984e-0413173fcde0 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "POST /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492/action" status: 202 len: 52 microversion: 2.47 time: 0.504102 Oct 17 12:54:03.689590 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 754/1518] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:54:03 2022] POST /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492/action => generated 52 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 17 12:54:03.724267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:03.732732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:03.735609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:03.735775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Getting quotas for user 6e4b8603784d4a3ca87cb2b6d1412b89 and project f4fdb785bf6b41a68f157d51d763052a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:03.751541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:03.752104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:03.753721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:03.754538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:03.755033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:03.755469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:03.763093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:54:03.766393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:54:03.920745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d877a7c5-52bd-4230-a944-1421b4f83fd7 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.006945 Oct 17 12:54:03.921774 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 765/1519] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:54:03.926760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:03.927379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] [instance: 89394b0c-71d5-4289-96fa-deb00aae6fa4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:03.948501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:03.956586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:03.957133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:03.957906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:03.960654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:03.961136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:04.016592 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] HTTP exception thrown: Instance 89394b0c-71d5-4289-96fa-deb00aae6fa4 could not be found. Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Request method failure captured: Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 HTTP/1.1 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_zRIs_v-SUVBQJj96MQ5cNCXvurC2Dk1_-8dFjDeBTadrokopkcZRD4HQoR7kG7HfXA2uhw7SUO4PGKzPokpMEbf343_vRvlavGcCDc5WJw3iLg1_y2xm6YN6o3gK8V8W6-B4PxXVYJXrEN_EsXi5OFlFEo3tivy13Bub9eisNlrE Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.75 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: bfefd211f821498d9b76bad39d673e08 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersAdmin275Test-542823908 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfefd211f821498d9b76bad39d673e08", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfefd211f821498d9b76bad39d673e08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfefd211f821498d9b76bad39d673e08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfefd211f821498d9b76bad39d673e08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersAdmin275Test-542823908 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: bfefd211f821498d9b76bad39d673e08 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersAdmin275Test-542823908 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersAdmin275Test-542823908-project Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: bcd72bd49db141599122d8e94e443ea9 Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersAdmin275Test-542823908-project Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 89394b0c-71d5-4289-96fa-deb00aae6fa4 could not be found. Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '89394b0c-71d5-4289-96fa-deb00aae6fa4'} Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89394b0c-71d5-4289-96fa-deb00aae6fa4 could not be found. Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89394b0c-71d5-4289-96fa-deb00aae6fa4 could not be found. Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:04.023123 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:04.028376 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:04.028376 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:04.028376 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:04.028376 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:04.028376 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:04.028376 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89394b0c-71d5-4289-96fa-deb00aae6fa4 could not be found. Oct 17 12:54:04.028376 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:04.028376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] Returning 404 to user: Instance 89394b0c-71d5-4289-96fa-deb00aae6fa4 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:04.029182 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc1234db-752e-41de-ae43-170db2df0e17 tempest-ServersAdmin275Test-542823908 tempest-ServersAdmin275Test-542823908-project] 10.222.0.27 "GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4" status: 404 len: 111 microversion: 2.75 time: 0.106191 Oct 17 12:54:04.029710 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 766/1520] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:03 2022] GET /compute/v2.1/servers/89394b0c-71d5-4289-96fa-deb00aae6fa4 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:54:04.042848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:04.043360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:04.057208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:04.057715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:04.058189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:04.058893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:04.065182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:04.065817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:04.131696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:04.372191 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f09a2123-49ec-4493-bb19-2d9b70d3acca tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 204 len: 0 microversion: 2.47 time: 0.340798 Oct 17 12:54:04.376934 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 767/1521] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:54:04 2022] DELETE /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:54:04.384341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df25036f-c151-416f-88f9-6e752cb05be4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:04.384815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df25036f-c151-416f-88f9-6e752cb05be4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:04.479179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:04.490897 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6a0b4e2-c555-454b-b7c9-da08dba7e869 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1324 microversion: 2.1 time: 0.800015 Oct 17 12:54:04.493396 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 755/1522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:03 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1324 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:04.511694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:04.523867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:04.538558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:04.539403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:04.540175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:04.541111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:04.545656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:04.546577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:04.761560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:04.772185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:04.773720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:04.787405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:04.790808 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1706a4cc-5ac9-4db3-a6dd-055fce64418c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1512 microversion: 2.91 time: 0.290842 Oct 17 12:54:04.794523 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 756/1523] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:04 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:04.816908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:04.817899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:04.845725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:04.846310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:04.846825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:04.847568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:04.848032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:04.848466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:04.863330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df25036f-c151-416f-88f9-6e752cb05be4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:04.883605 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df25036f-c151-416f-88f9-6e752cb05be4 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1217 microversion: 2.1 time: 0.507700 Oct 17 12:54:04.886602 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 768/1524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:04 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1217 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:05.121539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:05.141766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:05.149323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:05.153043 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8677b8fa-412d-4e06-a31c-20f286046760 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1366 microversion: 2.47 time: 0.355557 Oct 17 12:54:05.154925 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 757/1525] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:04 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:05.521986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:05.524199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:05.554987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:05.561319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:05.562731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:05.567251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:05.568022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:05.568642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:05.834199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:05.838669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:05.871630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:05.874579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:05.878409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:05.880667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:05.883194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:05.887815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:06.062640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:06.115522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:06.120279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:06.143421 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ff44e1e-2f84-4bb9-b4c6-c43e6867c32f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1533 microversion: 2.91 time: 0.322677 Oct 17 12:54:06.151850 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 758/1526] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:05 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1533 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:06.183265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:06.193631 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c8097703-32f6-4c70-967e-70b6e2304c51 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1324 microversion: 2.1 time: 0.679341 Oct 17 12:54:06.197231 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 769/1527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:05 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1324 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:06.224931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:06.224931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:06.247682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:06.249063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:06.249520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:06.250569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:06.251043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:06.251476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:06.362683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:06.385549 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eec423ad-b9c9-4b6d-b1dd-03ea59471fa9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1269 microversion: 2.1 time: 0.187048 Oct 17 12:54:06.398206 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 770/1528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:06 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:06.408482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:06.408482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:06.425411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:06.425770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:06.426090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:06.427036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:06.427543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:06.432590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:06.569870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:06.580896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:06.583281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:06.584907 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ae3f808-9201-41b4-8abc-9e52addb3669 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1366 microversion: 2.47 time: 0.196495 Oct 17 12:54:06.586044 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 771/1529] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:06 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:06.608743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:06.623330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-16f10123-9bda-4180-ac66-11699ce0b5a4 req-121b6c49-4ed4-4558-8356-2c83b193f585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e795d8ed-6984-4792-ba68-003eb9d05fb4", "tag": "8d49af75-f418-4520-9527-0ce094566c70"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:06.655117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-16f10123-9bda-4180-ac66-11699ce0b5a4 req-121b6c49-4ed4-4558-8356-2c83b193f585 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:06.655805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-16f10123-9bda-4180-ac66-11699ce0b5a4 req-121b6c49-4ed4-4558-8356-2c83b193f585 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:06.656894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-16f10123-9bda-4180-ac66-11699ce0b5a4 req-121b6c49-4ed4-4558-8356-2c83b193f585 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:06.695763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-16f10123-9bda-4180-ac66-11699ce0b5a4 req-121b6c49-4ed4-4558-8356-2c83b193f585 service nova] Creating event network-changed:8d49af75-f418-4520-9527-0ce094566c70 for instance e795d8ed-6984-4792-ba68-003eb9d05fb4 on n-h2-853316-12 Oct 17 12:54:06.704379 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-16f10123-9bda-4180-ac66-11699ce0b5a4 req-121b6c49-4ed4-4558-8356-2c83b193f585 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.550184 Oct 17 12:54:06.714815 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 759/1530] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:06.921543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:06.924320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:06.935618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:06.937172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:06.937894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:06.939455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:06.940284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:06.941919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.071736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lazy-loading 'services' on Instance uuid 4989d7ea-4d14-4eff-9da0-417d549e10f5 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:07.156453 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-968ba559-0eed-45ef-aeb9-f4b128641b7e tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1940 microversion: 2.91 time: 0.568849 Oct 17 12:54:07.187520 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 772/1531] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:06 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1940 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:07.198030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:07.201115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:07.227022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:07.227630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:07.233667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.234192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.241289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.242044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.242529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.242955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.255586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.256093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.256539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.257254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.257708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.258130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.445184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lazy-loading 'services' on Instance uuid 4989d7ea-4d14-4eff-9da0-417d549e10f5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:07.480976 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-73d7f144-23c6-40b6-afaa-10a1f34642a8 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1940 microversion: 2.91 time: 0.295665 Oct 17 12:54:07.494115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 760/1532] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:07 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1940 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:07.512390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:07.515044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:07.537218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.542080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.543825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.552219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.552706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.553141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.712150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:07.720537 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e065243-6afc-4be8-b974-3001cfe9da06 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1269 microversion: 2.1 time: 0.224938 Oct 17 12:54:07.723300 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 761/1533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:07 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:07.730339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-974f6fbb-3c24-44a9-b5ff-a05272774312 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:07.740723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974f6fbb-3c24-44a9-b5ff-a05272774312 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.741267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974f6fbb-3c24-44a9-b5ff-a05272774312 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.741686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974f6fbb-3c24-44a9-b5ff-a05272774312 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.746506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974f6fbb-3c24-44a9-b5ff-a05272774312 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.747026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974f6fbb-3c24-44a9-b5ff-a05272774312 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.747474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-974f6fbb-3c24-44a9-b5ff-a05272774312 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.777718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:07.793233 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ecfe91fa-a355-44b0-9cf3-573cd23bbe0a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1324 microversion: 2.1 time: 0.570260 Oct 17 12:54:07.808482 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 773/1534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:07 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1324 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:07.810862 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-974f6fbb-3c24-44a9-b5ff-a05272774312 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.086264 Oct 17 12:54:07.814304 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 762/1535] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 17 12:54:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:54:07.824351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:07.824983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:07.825299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:07.826140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:07.849613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.850204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.850342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.852997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.853472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.853658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.854643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.855302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.855930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.856769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:07.857921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:07.858601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:07.933947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lazy-loading 'flavor' on Instance uuid 4989d7ea-4d14-4eff-9da0-417d549e10f5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:08.228514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:08.240514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:08.280432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:08.320297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:08.320297 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69191c2b-10d6-4983-8230-1cfda310ba7c tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1366 microversion: 2.47 time: 0.478512 Oct 17 12:54:08.320297 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 774/1536] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:07 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:08.651572 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8e89e8b-0f00-4ee7-a4c2-725db59fef2f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "POST /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5/action" status: 202 len: 0 microversion: 2.91 time: 0.830732 Oct 17 12:54:08.655215 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 763/1537] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:54:07 2022] POST /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:54:08.666064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:08.666829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:08.711118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:08.713283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:08.715477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:08.720185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:08.722252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:08.725569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:08.757968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:08.759342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:08.786934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:08.789822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:08.793185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:08.812255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:08.813925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:08.817742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:09.025882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:09.035733 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e735bc4-1af2-4b4c-93ff-f242122408f6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1275 microversion: 2.1 time: 0.287526 Oct 17 12:54:09.046927 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 764/1538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:08 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1275 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:09.052602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:09.053557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:09.066258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:09.069273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:09.069848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:09.070712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:09.073203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:09.074234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:09.094008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:09.108142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:09.110124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:09.118484 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7011dab2-df07-4b6a-8b19-56fe855cc3f0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.458014 Oct 17 12:54:09.119436 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 775/1539] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:08 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:09.327127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:09.328775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:09.336475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:09.337231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:09.337840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:09.338902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:09.339529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:09.340257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:09.345326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:09.354673 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-900649c0-a443-4c95-878a-f7833cb651e3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1324 microversion: 2.1 time: 0.306241 Oct 17 12:54:09.358509 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 765/1540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:09 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:09.393242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:09.394978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:09.395430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:09.395943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lazy-loading 'fault' on Instance uuid 3ed32f78-2e21-4ecc-b139-c7e821908492 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:09.453747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:09.462989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:09.464456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00f12fd3b1bf475ea08c24a9706b99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006813c91a564419a261ab51bdc12ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:09.467173 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21df0011-4d7e-42a7-a495-94120c84db90 tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 200 len: 1371 microversion: 2.47 time: 0.148398 Oct 17 12:54:09.479159 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 776/1541] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:09 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:10.075632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:10.077217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:10.088406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:10.089749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:10.090970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:10.108142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:10.111346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:10.112015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:10.146634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:10.146634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:10.181092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:10.181092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:10.194758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:10.203273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:10.203273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:10.207935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:10.270625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:10.428866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:10.447432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:10.454668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:10.462321 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a87ad70-2247-4b01-bbdb-b78e8fa0a689 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.320492 Oct 17 12:54:10.463663 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 777/1542] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:10 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:10.469141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1665596288", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e9442b7e-a211-428d-b994-b659608d7553"}], "block_device_mapping_v2": [{"uuid": "7283db71-e18f-4943-bb0c-f0699cfe71ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:10.553673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] validate_networks() for [('e9442b7e-a211-428d-b994-b659608d7553', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:54:10.631817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:10.661058 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d47e395-349c-413e-8ec6-316539c1644c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1317 microversion: 2.1 time: 0.581774 Oct 17 12:54:10.663391 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 766/1543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:10 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:10.672065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:10.673092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:10.695674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:10.700116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:10.704011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:10.707507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:10.709042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:10.709612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:11.115651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:11.127645 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09173c2f-e91d-41c0-b27e-33b066f8781c tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1324 microversion: 2.1 time: 0.462578 Oct 17 12:54:11.128636 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 767/1544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:10 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:11.150141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:11.158829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] [instance: 3ed32f78-2e21-4ecc-b139-c7e821908492] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:11.171418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:11.171906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:11.172497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:11.173204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:11.173659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:11.174078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:11.218059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] HTTP exception thrown: Instance 3ed32f78-2e21-4ecc-b139-c7e821908492 could not be found. Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Request method failure captured: Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 HTTP/1.1 Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVBVcQkZc0YQpXs9BYU4v_kYS6jx9uw00FWhuwtSyVFK7b8J4QeN8I0QYyoGw8kiqbqwlGLyK6QE0aLD6BDfwSz70s8pCe73UncCvZ77l0P3via1TG7Bai8i22J4EOz38eLNiHhjvtC7yEayrhUBHqmWjHnuGGZgpnjfHx--597bJPc Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 006813c91a564419a261ab51bdc12ffc Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersAaction247Test-55175035 Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_006813c91a564419a261ab51bdc12ffc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/006813c91a564419a261ab51bdc12ffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/006813c91a564419a261ab51bdc12ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/006813c91a564419a261ab51bdc12ffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersAaction247Test-55175035 Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 006813c91a564419a261ab51bdc12ffc Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersAaction247Test-55175035 Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersAaction247Test-55175035-project Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 00f12fd3b1bf475ea08c24a9706b99fe Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersAaction247Test-55175035-project Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 3ed32f78-2e21-4ecc-b139-c7e821908492 could not be found. Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '3ed32f78-2e21-4ecc-b139-c7e821908492'} Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed32f78-2e21-4ecc-b139-c7e821908492 could not be found. Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed32f78-2e21-4ecc-b139-c7e821908492 could not be found. Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:11.222352 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed32f78-2e21-4ecc-b139-c7e821908492 could not be found. Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] Returning 404 to user: Instance 3ed32f78-2e21-4ecc-b139-c7e821908492 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-789e16ca-c148-43ed-aa99-83a1b1669a9f tempest-ServersAaction247Test-55175035 tempest-ServersAaction247Test-55175035-project] 10.222.0.27 "GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492" status: 404 len: 111 microversion: 2.47 time: 0.094197 Oct 17 12:54:11.227552 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 768/1545] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:11 2022] GET /compute/v2.1/servers/3ed32f78-2e21-4ecc-b139-c7e821908492 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:54:11.267672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1595279748", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "016630fa-22c3-4bc0-ad9d-9a86c64e0681"}], "security_groups": [{"name": "tempest-securitygroup--1723858346"}], "key_name": "tempest-keypair-823391073", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c26b6075-681a-4109-a8fd-2942c749843d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:11.507047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] validate_networks() for [('016630fa-22c3-4bc0-ad9d-9a86c64e0681', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:54:11.990336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:54:11.991912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:54:11.993240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:54:11.993814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:54:11.994909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:54:12.005437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.006248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.006889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.007901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.008359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.008784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.030768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for project c964bbec50ba4a2480831a33d6a935c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:12.035845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Getting quotas for user 8dfeceb58cdd47b8b82d905614ba3d5b and project c964bbec50ba4a2480831a33d6a935c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:12.102031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:54:12.104320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7283db71-e18f-4943-bb0c-f0699cfe71ec',volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:54:12.285859 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c133d91e-b05a-4c58-822f-022f5403b39a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.820912 Oct 17 12:54:12.299328 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 778/1546] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 12:54:12.612742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Getting quotas for project 2035f4fadc8741738c4d0bf67e555717. Resources: dict_keys(['metadata_items']) {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:12.624943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08a58dea-d6ae-4c89-a05b-0ac686f74d99 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:12.629075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a58dea-d6ae-4c89-a05b-0ac686f74d99 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.631756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a58dea-d6ae-4c89-a05b-0ac686f74d99 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.633755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a58dea-d6ae-4c89-a05b-0ac686f74d99 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.635761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a58dea-d6ae-4c89-a05b-0ac686f74d99 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.636311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a58dea-d6ae-4c89-a05b-0ac686f74d99 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.639853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a58dea-d6ae-4c89-a05b-0ac686f74d99 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.644940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Getting quotas for user 564a2e749d644c5f8906c175cd34d6cd and project 2035f4fadc8741738c4d0bf67e555717. Resources: dict_keys(['metadata_items']) {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:12.702072 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08a58dea-d6ae-4c89-a05b-0ac686f74d99 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.400866 Oct 17 12:54:12.702733 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 779/1547] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:12 2022] GET /compute/v2.1/os-services => generated 949 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:12.719453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:12.723607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:12.726854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:54:12.735521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:54:12.736208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:54:12.736329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.736638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:54:12.736754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.737155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:54:12.738712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.739682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.740668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.741354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.757275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.761339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.762357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.765488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.768058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.768871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.804928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:12.837823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Getting quotas for project 2035f4fadc8741738c4d0bf67e555717. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:12.853565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Getting quotas for user 564a2e749d644c5f8906c175cd34d6cd and project 2035f4fadc8741738c4d0bf67e555717. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:12.862747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:12.878687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:12.881386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:12.901368 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee6b483a-3d9d-4512-a7f1-10a496407157 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.197503 Oct 17 12:54:12.903695 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 780/1548] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:12 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:12.908685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:12.920724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:12.934300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.935081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.936216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:12.937198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:12.938419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:12.939458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.014511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:54:13.017787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c26b6075-681a-4109-a8fd-2942c749843d',volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:54:13.283688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:13.313848 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ebc38020-0d8b-4d77-8074-05885fcdb200 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1317 microversion: 2.1 time: 0.398744 Oct 17 12:54:13.333749 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c5dd8a11-484e-458e-80f2-88d05572f56e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.108351 Oct 17 12:54:13.336727 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 769/1549] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:54:11 2022] POST /compute/v2.1/servers => generated 407 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:54:13.342929 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 781/1550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:12 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:13.347477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:13.349237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:13.349695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f607ee16-67ef-44a5-83ac-7895f980a1cf req-6a4aa52e-13db-49e1-b4eb-74897be74e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfd732b-cff1-436f-b1d2-730b231b20ca", "tag": "d78bd15c-f2c4-45f2-96f4-927fc55d20fc"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:13.371699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f607ee16-67ef-44a5-83ac-7895f980a1cf req-6a4aa52e-13db-49e1-b4eb-74897be74e1a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.372366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f607ee16-67ef-44a5-83ac-7895f980a1cf req-6a4aa52e-13db-49e1-b4eb-74897be74e1a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.372797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f607ee16-67ef-44a5-83ac-7895f980a1cf req-6a4aa52e-13db-49e1-b4eb-74897be74e1a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.390769 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f607ee16-67ef-44a5-83ac-7895f980a1cf req-6a4aa52e-13db-49e1-b4eb-74897be74e1a service nova] Creating event network-changed:d78bd15c-f2c4-45f2-96f4-927fc55d20fc for instance 4cfd732b-cff1-436f-b1d2-730b231b20ca on n-h2-853316-12 Oct 17 12:54:13.395015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.398573 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f607ee16-67ef-44a5-83ac-7895f980a1cf req-6a4aa52e-13db-49e1-b4eb-74897be74e1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053971 Oct 17 12:54:13.400102 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 782/1551] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:13.404048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.406640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:13.407398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:13.408091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.411400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.415613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.416772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.417451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.418597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.420872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.421661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.422385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.424636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.539443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:13.551389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:13.553408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:13.554832 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51cdbff4-578a-467a-8ade-973369b6ed96 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1177 microversion: 2.25 time: 0.153369 Oct 17 12:54:13.567191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 783/1552] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:13 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1177 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:13.579764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40815569-1f3e-4bd5-883d-7dba152b503b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:13.589180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40815569-1f3e-4bd5-883d-7dba152b503b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.589676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40815569-1f3e-4bd5-883d-7dba152b503b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.590114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40815569-1f3e-4bd5-883d-7dba152b503b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.594534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40815569-1f3e-4bd5-883d-7dba152b503b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.595359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40815569-1f3e-4bd5-883d-7dba152b503b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.597474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40815569-1f3e-4bd5-883d-7dba152b503b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.635157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:13.677145 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40815569-1f3e-4bd5-883d-7dba152b503b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-853316-12" status: 200 len: 581 microversion: 2.1 time: 0.113723 Oct 17 12:54:13.680612 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 784/1553] 10.222.0.27 () {58 vars in 1174 bytes} [Mon Oct 17 12:54:13 2022] GET /compute/v2.1/os-services?host=n-d-853316-12 => generated 581 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:13.689168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c739c63-ee6b-4140-a266-4df91f786026 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:13.697894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c739c63-ee6b-4140-a266-4df91f786026 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:13.804192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c739c63-ee6b-4140-a266-4df91f786026 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:13.814761 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c739c63-ee6b-4140-a266-4df91f786026 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1121 microversion: 2.1 time: 0.131002 Oct 17 12:54:13.816058 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 785/1554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:13 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1121 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:13.824957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03ab8e20-f094-4be3-b967-6f224693734b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:13.836257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03ab8e20-f094-4be3-b967-6f224693734b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.838321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03ab8e20-f094-4be3-b967-6f224693734b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.839008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03ab8e20-f094-4be3-b967-6f224693734b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.840692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03ab8e20-f094-4be3-b967-6f224693734b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.842723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03ab8e20-f094-4be3-b967-6f224693734b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.843586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03ab8e20-f094-4be3-b967-6f224693734b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.955906 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-03ab8e20-f094-4be3-b967-6f224693734b tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.131485 Oct 17 12:54:13.966109 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 786/1555] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 12:54:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:13.972027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:13.973057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:13.982291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.982989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.983682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:13.984590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:13.985227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:13.986053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.044743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:14.057978 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7edca0dd-ffc6-4129-b7a0-800fa466d693 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1324 microversion: 2.1 time: 0.717322 Oct 17 12:54:14.076316 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 770/1556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:13 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1324 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:14.085361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b019c8f1-62b1-4e7e-876c-12a6e52d2260 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:14.089996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b019c8f1-62b1-4e7e-876c-12a6e52d2260 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.090848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b019c8f1-62b1-4e7e-876c-12a6e52d2260 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.091557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b019c8f1-62b1-4e7e-876c-12a6e52d2260 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.093310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b019c8f1-62b1-4e7e-876c-12a6e52d2260 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.094034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b019c8f1-62b1-4e7e-876c-12a6e52d2260 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.094821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b019c8f1-62b1-4e7e-876c-12a6e52d2260 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.119028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:14.130648 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b019c8f1-62b1-4e7e-876c-12a6e52d2260 tempest-ServicesAdminTestJSON-485047165 tempest-ServicesAdminTestJSON-485047165-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.052292 Oct 17 12:54:14.131209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:14.131893 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 771/1557] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:14 2022] GET /compute/v2.1/os-services => generated 949 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:14.146040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:14.153166 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6be98e71-f8f4-48c2-b53e-3fb658585a71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.185350 Oct 17 12:54:14.155053 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 787/1558] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:13 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:14.342239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:14.343866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:14.366571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.369758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.370772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.373036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.375549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.376296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.531657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d39d8db8-1149-4895-a8da-e98495f33b60 req-501bf74f-012a-4601-a390-f8325fb27878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e795d8ed-6984-4792-ba68-003eb9d05fb4", "name": "network-vif-plugged", "status": "completed", "tag": "8d49af75-f418-4520-9527-0ce094566c70"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:14.558198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d39d8db8-1149-4895-a8da-e98495f33b60 req-501bf74f-012a-4601-a390-f8325fb27878 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.560801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d39d8db8-1149-4895-a8da-e98495f33b60 req-501bf74f-012a-4601-a390-f8325fb27878 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.561696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d39d8db8-1149-4895-a8da-e98495f33b60 req-501bf74f-012a-4601-a390-f8325fb27878 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.620831 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d39d8db8-1149-4895-a8da-e98495f33b60 req-501bf74f-012a-4601-a390-f8325fb27878 service nova] Creating event network-vif-plugged:8d49af75-f418-4520-9527-0ce094566c70 for instance e795d8ed-6984-4792-ba68-003eb9d05fb4 on n-h2-853316-12 Oct 17 12:54:14.632679 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d39d8db8-1149-4895-a8da-e98495f33b60 req-501bf74f-012a-4601-a390-f8325fb27878 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.499261 Oct 17 12:54:14.633543 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 772/1559] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:14.642312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:14.644625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:14.655417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.656510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.657503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.658877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.663066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.664176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.784091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:14.796863 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3865d12f-6abe-4121-a1ac-c8bd53aa7738 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1317 microversion: 2.1 time: 0.462692 Oct 17 12:54:14.797477 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 788/1560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:14 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:14.842279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:14.842920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:14.850780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.851277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.851719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.852431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:14.852875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:14.853320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:14.931870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:14.941913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:14.963428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:14.966670 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-03619fa6-e2c7-413c-b67b-8f4e22bc9b0a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1241 microversion: 2.25 time: 0.331768 Oct 17 12:54:14.969265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 773/1561] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:14 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1241 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:15.085838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:15.088242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:15.099878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:15.101518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:15.101977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:15.102765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:15.103222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:15.103651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:15.135598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:15.145454 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7b1dfef-0d6d-4391-a4e0-a51dbd7f1661 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1163 microversion: 2.1 time: 0.306858 Oct 17 12:54:15.148927 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 789/1562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:14 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1163 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:15.185816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:15.186691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:15.195680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:15.198879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:15.199546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:15.203498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:15.204397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:15.205025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:15.330500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:15.346882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:15.354319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:15.363788 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e932a854-041e-41c6-8f83-603179d676cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.182562 Oct 17 12:54:15.368943 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 790/1563] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:15 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:15.648618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:15.667525 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c08c2f03-e0d7-4578-974b-4a0371012d5a tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1324 microversion: 2.1 time: 0.586972 Oct 17 12:54:15.682577 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 774/1564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:15 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:15.823584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:15.824279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:15.837114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:15.837573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:15.839368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:15.841749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:15.844353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:15.847125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:15.996276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:15.997615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:16.012213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:16.014485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:16.015498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:16.019303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:16.020087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:16.023010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:16.312160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:16.334121 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2110a166-daf6-44fb-8524-160360729815 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1317 microversion: 2.1 time: 0.516515 Oct 17 12:54:16.334756 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 791/1565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:15 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:16.369422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:16.373417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:16.391294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:16.394804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:16.396147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:16.399947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:16.400720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:16.401320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:16.581954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:16.601062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:16.602549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:16.603674 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6cba69fc-339d-47d4-8af5-df0fae02d45a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1251 microversion: 2.25 time: 0.611848 Oct 17 12:54:16.614603 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 775/1566] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:15 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1251 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:16.630853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:16.637845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:16.649062 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16937220-2583-4d71-a3aa-eee8237739cc tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1237 microversion: 2.1 time: 0.295629 Oct 17 12:54:16.659203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:16.659471 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 792/1567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:16 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1237 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:16.676693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:16.677187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:16.677625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:16.680918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:16.683384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:16.683845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:16.701228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:16.702109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:16.714485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:16.715189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:16.718758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:16.719713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:16.720830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:16.721430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:17.179517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:17.196997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:17.203069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:17.218239 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ae3be97-954a-47df-a825-547e587be29e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.601798 Oct 17 12:54:17.220963 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 776/1568] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:16 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:17.364364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:17.365203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:17.379402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:17.382785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:17.383364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:17.384919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:17.385380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:17.385995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:17.460175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:17.473018 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-825d149f-8a7e-4db3-bda7-aa48cc62d31e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1521 microversion: 2.1 time: 0.775753 Oct 17 12:54:17.487816 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 793/1569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:16 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1521 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:17.634371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:17.634992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:17.649075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:17.649833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:17.651125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:17.652908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:17.655007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:17.657301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:18.189693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:18.204844 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff7d4a59-3653-4b6f-a9de-a7d542cfed94 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1317 microversion: 2.1 time: 0.845828 Oct 17 12:54:18.205434 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 777/1570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:17 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1317 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:18.216690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:18.221381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:18.240332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:18.245440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:18.246291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:18.249635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:18.250357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:18.250963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:18.404454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:18.419284 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3a319e49-4928-4851-8564-2e233a774eec tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1237 microversion: 2.1 time: 0.207983 Oct 17 12:54:18.426223 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 778/1571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:18 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1237 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:18.437241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-470ad409-1071-4f6a-94b8-f1f52e4cbc59 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-120185473", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-470ad409-1071-4f6a-94b8-f1f52e4cbc59 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Request method failure captured: Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 242 Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVBc6L1IYp6_7nj2yDnu9_zyJzO7pvgjhEFTr92vxoCdv4pYGOn79F2YR_bEP6GGnwy2-AJZHLzdhQdTRWtqhxIn8V9NYAVak420fM8-EMrS2dfEJGhhv26_T9Ob2xvfveCjMhu8yhiRCKNGrx4kd7b_jEICWRI28Tri-F8-d7Q-Hh8 Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_626e075834e746638f9ce7a8b2387def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/626e075834e746638f9ce7a8b2387def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 99a154e10393432e8f47c705612c3fcf Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-120185473", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-120185473', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '72b73ea2-395b-41ae-96b0-5158721d65ab'}]}}} Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:54:18.448656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.453462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.465146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-470ad409-1071-4f6a-94b8-f1f52e4cbc59 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:18.466050 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-470ad409-1071-4f6a-94b8-f1f52e4cbc59 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.038624 Oct 17 12:54:18.466666 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 779/1572] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:54:18 2022] POST /compute/v2.1/servers => generated 175 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:54:18.480536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8947dcb6-f7a7-4b26-8873-b9949c9207bf req-6ada2e5d-54be-4cf5-b7fe-24cd8b0c2a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfd732b-cff1-436f-b1d2-730b231b20ca", "name": "network-vif-plugged", "status": "completed", "tag": "d78bd15c-f2c4-45f2-96f4-927fc55d20fc"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:18.514625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8947dcb6-f7a7-4b26-8873-b9949c9207bf req-6ada2e5d-54be-4cf5-b7fe-24cd8b0c2a0c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:18.515167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8947dcb6-f7a7-4b26-8873-b9949c9207bf req-6ada2e5d-54be-4cf5-b7fe-24cd8b0c2a0c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:18.515890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8947dcb6-f7a7-4b26-8873-b9949c9207bf req-6ada2e5d-54be-4cf5-b7fe-24cd8b0c2a0c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:18.535752 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8947dcb6-f7a7-4b26-8873-b9949c9207bf req-6ada2e5d-54be-4cf5-b7fe-24cd8b0c2a0c service nova] Creating event network-vif-plugged:d78bd15c-f2c4-45f2-96f4-927fc55d20fc for instance 4cfd732b-cff1-436f-b1d2-730b231b20ca on n-h2-853316-12 Oct 17 12:54:18.543700 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8947dcb6-f7a7-4b26-8873-b9949c9207bf req-6ada2e5d-54be-4cf5-b7fe-24cd8b0c2a0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071384 Oct 17 12:54:18.544316 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 780/1573] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:18.552330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:18.562034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:18.572387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:18.573579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a090f54-08db-4141-bb4f-6b46cba7269f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1251 microversion: 2.25 time: 0.943959 Oct 17 12:54:18.574146 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 794/1574] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:17 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1251 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:18.586839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:18.586839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:18.606205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:18.606961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:18.608688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:18.610128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c728ae1-213c-4d45-8b0c-0d93dd28d70e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:18.610678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5c728ae1-213c-4d45-8b0c-0d93dd28d70e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: 4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:18.611350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:18.615805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:18.617899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:18.629246 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-5c728ae1-213c-4d45-8b0c-0d93dd28d70e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] HTTP exception thrown: Instance 4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82 could not be found. Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c728ae1-213c-4d45-8b0c-0d93dd28d70e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Request method failure captured: Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82/metadata HTTP/1.1 Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVBc6L1IYp6_7nj2yDnu9_zyJzO7pvgjhEFTr92vxoCdv4pYGOn79F2YR_bEP6GGnwy2-AJZHLzdhQdTRWtqhxIn8V9NYAVak420fM8-EMrS2dfEJGhhv26_T9Ob2xvfveCjMhu8yhiRCKNGrx4kd7b_jEICWRI28Tri-F8-d7Q-Hh8 Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_626e075834e746638f9ce7a8b2387def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/626e075834e746638f9ce7a8b2387def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 99a154e10393432e8f47c705612c3fcf Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82 could not be found. Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'server_id': '4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82'} Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82 could not be found. Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82 could not be found. Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:18.637991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:18.643962 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:18.643962 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:18.643962 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82 could not be found. Oct 17 12:54:18.643962 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.643962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c728ae1-213c-4d45-8b0c-0d93dd28d70e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Returning 404 to user: Instance 4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:18.643962 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5c728ae1-213c-4d45-8b0c-0d93dd28d70e tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82/metadata" status: 404 len: 111 microversion: 2.1 time: 0.050657 Oct 17 12:54:18.643962 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 795/1575] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:54:18 2022] GET /compute/v2.1/servers/4bb70c3f-fe63-41b7-8ea5-2c50f4afdf82/metadata => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:18.857759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32c208ff-6cdd-4b1a-9f89-f3f6566959af tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1984792311", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32c208ff-6cdd-4b1a-9f89-f3f6566959af tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Request method failure captured: Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 499 Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVBc6L1IYp6_7nj2yDnu9_zyJzO7pvgjhEFTr92vxoCdv4pYGOn79F2YR_bEP6GGnwy2-AJZHLzdhQdTRWtqhxIn8V9NYAVak420fM8-EMrS2dfEJGhhv26_T9Ob2xvfveCjMhu8yhiRCKNGrx4kd7b_jEICWRI28Tri-F8-d7Q-Hh8 Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_626e075834e746638f9ce7a8b2387def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/626e075834e746638f9ce7a8b2387def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 99a154e10393432e8f47c705612c3fcf Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1984792311", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1984792311', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '72b73ea2-395b-41ae-96b0-5158721d65ab'}]}}} Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 12:54:18.863726 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.867415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.870906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32c208ff-6cdd-4b1a-9f89-f3f6566959af tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:18.871791 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32c208ff-6cdd-4b1a-9f89-f3f6566959af tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018214 Oct 17 12:54:18.882037 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 796/1576] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:54:18 2022] POST /compute/v2.1/servers => generated 687 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:54:18.947412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-26377e5f-7447-4326-98b3-6e8fa79308b3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1017987264", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-26377e5f-7447-4326-98b3-6e8fa79308b3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Request method failure captured: Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 500 Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVBc6L1IYp6_7nj2yDnu9_zyJzO7pvgjhEFTr92vxoCdv4pYGOn79F2YR_bEP6GGnwy2-AJZHLzdhQdTRWtqhxIn8V9NYAVak420fM8-EMrS2dfEJGhhv26_T9Ob2xvfveCjMhu8yhiRCKNGrx4kd7b_jEICWRI28Tri-F8-d7Q-Hh8 Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_626e075834e746638f9ce7a8b2387def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/626e075834e746638f9ce7a8b2387def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 99a154e10393432e8f47c705612c3fcf Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1017987264", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1017987264', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '72b73ea2-395b-41ae-96b0-5158721d65ab'}]}}} Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 12:54:18.951822 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-26377e5f-7447-4326-98b3-6e8fa79308b3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:18.955246 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-26377e5f-7447-4326-98b3-6e8fa79308b3 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009953 Oct 17 12:54:18.958541 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 797/1577] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:54:18 2022] POST /compute/v2.1/servers => generated 689 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 12:54:18.978356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:18.991280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:18.996053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:19.007878 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-83a8f5ed-db27-45cd-8e76-f369441f95d9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.458710 Oct 17 12:54:19.016714 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 781/1578] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:18 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:19.041326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fcf4f3cd-79f7-45de-ada4-e6a477e2576d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-298448568", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fcf4f3cd-79f7-45de-ada4-e6a477e2576d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Request method failure captured: Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 753 Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVBc6L1IYp6_7nj2yDnu9_zyJzO7pvgjhEFTr92vxoCdv4pYGOn79F2YR_bEP6GGnwy2-AJZHLzdhQdTRWtqhxIn8V9NYAVak420fM8-EMrS2dfEJGhhv26_T9Ob2xvfveCjMhu8yhiRCKNGrx4kd7b_jEICWRI28Tri-F8-d7Q-Hh8 Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_626e075834e746638f9ce7a8b2387def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/626e075834e746638f9ce7a8b2387def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 99a154e10393432e8f47c705612c3fcf Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-298448568", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-298448568', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '72b73ea2-395b-41ae-96b0-5158721d65ab'}]}}} Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:54:19.046329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:54:19.048870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:54:19.052576 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:19.052576 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.057130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fcf4f3cd-79f7-45de-ada4-e6a477e2576d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:19.057130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fcf4f3cd-79f7-45de-ada4-e6a477e2576d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021065 Oct 17 12:54:19.057130 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 798/1579] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:54:19 2022] POST /compute/v2.1/servers => generated 1197 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 17 12:54:19.138218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3137a6e0-a926-45de-bc4f-0017ff3e4cf0 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-908980495", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3137a6e0-a926-45de-bc4f-0017ff3e4cf0 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Request method failure captured: Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 1265 Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVBc6L1IYp6_7nj2yDnu9_zyJzO7pvgjhEFTr92vxoCdv4pYGOn79F2YR_bEP6GGnwy2-AJZHLzdhQdTRWtqhxIn8V9NYAVak420fM8-EMrS2dfEJGhhv26_T9Ob2xvfveCjMhu8yhiRCKNGrx4kd7b_jEICWRI28Tri-F8-d7Q-Hh8 Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_626e075834e746638f9ce7a8b2387def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/626e075834e746638f9ce7a8b2387def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 99a154e10393432e8f47c705612c3fcf Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-908980495", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "72b73ea2-395b-41ae-96b0-5158721d65ab"}]}} Oct 17 12:54:19.143173 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-908980495', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '72b73ea2-395b-41ae-96b0-5158721d65ab'}]}}} Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.146402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:54:19.147728 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:54:19.149933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:54:19.149933 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.152670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3137a6e0-a926-45de-bc4f-0017ff3e4cf0 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:19.153754 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3137a6e0-a926-45de-bc4f-0017ff3e4cf0 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.019603 Oct 17 12:54:19.154860 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 782/1580] 10.222.0.27 () {60 vars in 1148 bytes} [Mon Oct 17 12:54:19 2022] POST /compute/v2.1/servers => generated 2221 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 17 12:54:19.166418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ece2b831-f8ec-47c1-ae4c-97b17b03d2e9 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:19.167860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ece2b831-f8ec-47c1-ae4c-97b17b03d2e9 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: 00fa1f36-8598-4166-b585-7b8e9d6c977c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:19.195132 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ece2b831-f8ec-47c1-ae4c-97b17b03d2e9 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] HTTP exception thrown: Instance 00fa1f36-8598-4166-b585-7b8e9d6c977c could not be found. Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ece2b831-f8ec-47c1-ae4c-97b17b03d2e9 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Request method failure captured: Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/00fa1f36-8598-4166-b585-7b8e9d6c977c/metadata/test2 HTTP/1.1 Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVBc6L1IYp6_7nj2yDnu9_zyJzO7pvgjhEFTr92vxoCdv4pYGOn79F2YR_bEP6GGnwy2-AJZHLzdhQdTRWtqhxIn8V9NYAVak420fM8-EMrS2dfEJGhhv26_T9Ob2xvfveCjMhu8yhiRCKNGrx4kd7b_jEICWRI28Tri-F8-d7Q-Hh8 Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_626e075834e746638f9ce7a8b2387def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/626e075834e746638f9ce7a8b2387def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 99a154e10393432e8f47c705612c3fcf Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 00fa1f36-8598-4166-b585-7b8e9d6c977c could not be found. Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'server_id': '00fa1f36-8598-4166-b585-7b8e9d6c977c', 'id': 'test2'} Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00fa1f36-8598-4166-b585-7b8e9d6c977c could not be found. Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00fa1f36-8598-4166-b585-7b8e9d6c977c could not be found. Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:19.196897 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:19.200797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:19.200797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:19.200797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00fa1f36-8598-4166-b585-7b8e9d6c977c could not be found. Oct 17 12:54:19.200797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:19.201842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ece2b831-f8ec-47c1-ae4c-97b17b03d2e9 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Returning 404 to user: Instance 00fa1f36-8598-4166-b585-7b8e9d6c977c could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:19.210115 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ece2b831-f8ec-47c1-ae4c-97b17b03d2e9 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/00fa1f36-8598-4166-b585-7b8e9d6c977c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.044463 Oct 17 12:54:19.212630 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 799/1581] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 17 12:54:19 2022] GET /compute/v2.1/servers/00fa1f36-8598-4166-b585-7b8e9d6c977c/metadata/test2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:19.235332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:19.236456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:19.244908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:19.252752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:19.254812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:19.259571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:19.260842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:19.265640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:19.268246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:19.269425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:19.271197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:19.271688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:19.272290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:19.272820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:19.273274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:19.273700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:19.363093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:19.524769 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6a1a1431-2b07-4cce-a9c7-23452890563d tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 204 len: 0 microversion: 2.1 time: 0.298846 Oct 17 12:54:19.525868 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 783/1582] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:19 2022] DELETE /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:19.536942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:19.542567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:19.559725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:19.561524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:19.562073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:19.564144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:19.567212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:19.568981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:19.926468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:19.937401 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a69e0b58-0db6-4e7b-8a1e-45cd08ae4640 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1317 microversion: 2.1 time: 0.696199 Oct 17 12:54:19.940103 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 800/1583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:19 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:19.951455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:19.953903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:19.966899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:19.968007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:19.969071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:19.973075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:19.975150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:19.977486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:20.207105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:20.216195 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ebb29de-71ac-4fb8-9a89-7ec38d696ddf tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1305 microversion: 2.1 time: 0.688962 Oct 17 12:54:20.228358 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 784/1584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:19 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1305 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:20.234995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:20.240718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:20.275084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:20.277191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:20.285458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:20.289757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:20.306486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:20.312309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:20.870003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:20.879226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:20.880383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:20.881498 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-03b9e7d0-dfae-43c6-805d-0541005d6c6f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1293 microversion: 2.25 time: 0.650379 Oct 17 12:54:20.887868 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 785/1585] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:20 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1293 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:20.895169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:20.895458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:20.913944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:20.914428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:20.914869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:20.915581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:20.916178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:20.916461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:21.070955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:21.079225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:21.080676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:21.094680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:21.108851 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-993b90ef-f53e-4842-af2b-f043d0f65204 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.218650 Oct 17 12:54:21.113835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 786/1586] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:20 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:21.141824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:21.142480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:21.157453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:21.157947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:21.158413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:21.159654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:21.164109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:21.164618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:21.411114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:21.424652 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f0f9c7b-4227-45dc-9a1b-02a03d5ed970 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1527 microversion: 2.1 time: 1.480571 Oct 17 12:54:21.440194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 801/1587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:19 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1527 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:21.440194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:21.440194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:21.458999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:21.459723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:21.464933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:21.466531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:21.467351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:21.468883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:21.709544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:21.724141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1deeb9fb-b23a-4b87-9cee-372076a5bd64 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1317 microversion: 2.1 time: 0.607740 Oct 17 12:54:21.724833 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 787/1588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:21 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:22.045585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:22.127051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ddc24be0-1eeb-454f-ad62-018a98ee1be2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1305 microversion: 2.1 time: 0.689016 Oct 17 12:54:22.127818 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 802/1589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:21 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1305 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:22.135360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:22.136176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:22.150467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.153305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.154072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.161302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.162009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.162654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.167452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:22.201091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9cd17490-f8dd-40a7-a4c4-07292058f924 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:22.213107 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9cd17490-f8dd-40a7-a4c4-07292058f924 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.353255 Oct 17 12:54:22.214964 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 788/1590] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:54:22.227582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-98e4a96e-e671-4c85-b025-6bbd07d2907e req-7c78c6a1-5e37-4062-b02c-595045efbc25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668320eb-1f68-4fcd-addd-aef8b2271f2a", "tag": "dfb3775c-e68d-4644-94da-eb293b65a58c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:22.248022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-98e4a96e-e671-4c85-b025-6bbd07d2907e req-7c78c6a1-5e37-4062-b02c-595045efbc25 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.248759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-98e4a96e-e671-4c85-b025-6bbd07d2907e req-7c78c6a1-5e37-4062-b02c-595045efbc25 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.249359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-98e4a96e-e671-4c85-b025-6bbd07d2907e req-7c78c6a1-5e37-4062-b02c-595045efbc25 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.270664 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-98e4a96e-e671-4c85-b025-6bbd07d2907e req-7c78c6a1-5e37-4062-b02c-595045efbc25 service nova] Creating event network-changed:dfb3775c-e68d-4644-94da-eb293b65a58c for instance 668320eb-1f68-4fcd-addd-aef8b2271f2a on n-h1-853316-12 Oct 17 12:54:22.285612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-98e4a96e-e671-4c85-b025-6bbd07d2907e req-7c78c6a1-5e37-4062-b02c-595045efbc25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069091 Oct 17 12:54:22.286518 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 789/1591] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:22.291836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:22.294954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:22.305864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.310826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.311512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.312479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.313155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.318795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.356653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:22.412743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:22.423173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:22.424644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:22.436213 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5a5f5b41-7327-4f9d-8b20-822862d84156 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.148436 Oct 17 12:54:22.437252 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 790/1592] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:22 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:22.443585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-986b0c70-5790-41c1-bad0-5b1ca915e5af tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:22.465215 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-986b0c70-5790-41c1-bad0-5b1ca915e5af tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.026601 Oct 17 12:54:22.466125 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 791/1593] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 12:54:22 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:22.470768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:22.471574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:22.478496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.479203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.479812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.480691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.481306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.481913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.788886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:22.800822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:22.813733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:22.820367 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-269c7193-50f8-426d-aba5-a6a31bf2cb7e tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1293 microversion: 2.25 time: 0.690949 Oct 17 12:54:22.830050 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 803/1594] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:22 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1293 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:22.836662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0f2e2802-4e20-4073-8d82-c2725da2eaa8 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:22.846375 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0f2e2802-4e20-4073-8d82-c2725da2eaa8 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013549 Oct 17 12:54:22.847854 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 804/1595] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:22.853694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-587142aa-89f7-469e-9b51-22796d64e8a5 req-d7fe5c27-867a-490d-b852-2b5cf52bf06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdcbc7c-5033-4c97-9d0d-c949a0afe70b", "tag": "8b0cc8df-c676-4f6a-95cc-63c24aa2d7e3"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:22.870361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-587142aa-89f7-469e-9b51-22796d64e8a5 req-d7fe5c27-867a-490d-b852-2b5cf52bf06f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.871108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-587142aa-89f7-469e-9b51-22796d64e8a5 req-d7fe5c27-867a-490d-b852-2b5cf52bf06f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.871619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-587142aa-89f7-469e-9b51-22796d64e8a5 req-d7fe5c27-867a-490d-b852-2b5cf52bf06f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.875794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:22.890895 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-587142aa-89f7-469e-9b51-22796d64e8a5 req-d7fe5c27-867a-490d-b852-2b5cf52bf06f service nova] Creating event network-changed:8b0cc8df-c676-4f6a-95cc-63c24aa2d7e3 for instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b on n-h1-853316-12 Oct 17 12:54:22.898253 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-587142aa-89f7-469e-9b51-22796d64e8a5 req-d7fe5c27-867a-490d-b852-2b5cf52bf06f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048714 Oct 17 12:54:22.899091 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 805/1596] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:22.906405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:22.908788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:22.917507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.918278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.918949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:22.920052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:22.921032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:22.921686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:23.127267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a154e10393432e8f47c705612c3fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626e075834e746638f9ce7a8b2387def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:23.136181 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db7aa2ab-f309-456e-9125-173c76181b94 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 200 len: 1527 microversion: 2.1 time: 0.668833 Oct 17 12:54:23.147114 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 792/1597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:22 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 1527 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:23.154981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67ad17de-2acc-4d89-b0c0-b53db2a8222c tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:23.171526 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67ad17de-2acc-4d89-b0c0-b53db2a8222c tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021130 Oct 17 12:54:23.172901 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 793/1598] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:23.182517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:23.184506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:23.194550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:23.195435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:23.196174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:23.197176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:23.197836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:23.204236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:23.483878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:23.493393 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69eb6d37-2075-42f7-9b9a-b3d213b9e6d6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1305 microversion: 2.1 time: 0.318732 Oct 17 12:54:23.493986 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 794/1599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:23 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1305 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:23.499002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-362e1460-56e6-41b9-9ba0-1c4fe5ae76fd tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:23.554719 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-362e1460-56e6-41b9-9ba0-1c4fe5ae76fd tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.059135 Oct 17 12:54:23.555312 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 795/1600] 10.222.0.27 () {58 vars in 1165 bytes} [Mon Oct 17 12:54:23 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:23.563653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:23.572107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:23.587252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:23.587745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:23.588376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:23.591816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:23.592644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:23.596288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:23.760397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:23.778349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:23.781774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:23.783253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:23.790244 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c78063bf-9272-41b3-bf7e-ea6f557b1d7a tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1467 microversion: 2.1 time: 0.887506 Oct 17 12:54:23.806204 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 806/1601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:22 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1467 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:23.806204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be952f3f-e6bb-40ee-b351-afb45c6e9b2d tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:23.819972 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be952f3f-e6bb-40ee-b351-afb45c6e9b2d tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023584 Oct 17 12:54:23.821965 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 807/1602] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:23.823963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=28 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:23.835560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:23.836174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:23.838528 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4d75f4e-139c-4525-8ef6-ae5b6ba73695 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.260296 Oct 17 12:54:23.850210 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 796/1603] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:23 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:23.850210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a668d275-8de4-4e1c-828a-7ccfbdd33b00 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:23.862925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=14 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:23.866335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:23.870989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:23.871754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:23.883028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:23.883879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:23.888652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:23.927919 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a668d275-8de4-4e1c-828a-7ccfbdd33b00 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.085667 Oct 17 12:54:23.936980 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 797/1604] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 17 12:54:23 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:23.964277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:23.970266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:23.985951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:23.986638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:23.989495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:23.990467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:23.991131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:23.993213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:24.106299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:24.404170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:24.414788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:24.416258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:24.423219 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04dd2cd0-5637-44c4-84f8-b68ab3a85ee3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1293 microversion: 2.25 time: 0.472756 Oct 17 12:54:24.438203 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 798/1605] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:23 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1293 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:24.438203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b4569851-97ae-49ed-a4ad-2e34e0ed465c tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:24.477278 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b4569851-97ae-49ed-a4ad-2e34e0ed465c tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.051407 Oct 17 12:54:24.490732 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 799/1606] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 12:54:24 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:24.492686 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bce253ae-495a-4f21-b2fb-29756cad7290 tempest-ServersOnMultiNodesTest-1565981281 tempest-ServersOnMultiNodesTest-1565981281-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1620 microversion: 2.1 time: 0.669321 Oct 17 12:54:24.494754 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 808/1607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:23 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1620 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:24.501096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-32cad9fb-3ec5-4751-9a13-0e0be68428d0 req-bdbf3f85-e91a-4307-a9d2-d90487faec27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e795d8ed-6984-4792-ba68-003eb9d05fb4", "name": "network-vif-deleted", "tag": "8d49af75-f418-4520-9527-0ce094566c70"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:24.512130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:24.512747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] [instance: e795d8ed-6984-4792-ba68-003eb9d05fb4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:24.524990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:24.525742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:24.526425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:24.526912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-32cad9fb-3ec5-4751-9a13-0e0be68428d0 req-bdbf3f85-e91a-4307-a9d2-d90487faec27 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:24.527496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:24.528092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-32cad9fb-3ec5-4751-9a13-0e0be68428d0 req-bdbf3f85-e91a-4307-a9d2-d90487faec27 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:24.528252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:24.528854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:24.529394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-32cad9fb-3ec5-4751-9a13-0e0be68428d0 req-bdbf3f85-e91a-4307-a9d2-d90487faec27 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:24.560350 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-32cad9fb-3ec5-4751-9a13-0e0be68428d0 req-bdbf3f85-e91a-4307-a9d2-d90487faec27 service nova] Creating event network-vif-deleted:8d49af75-f418-4520-9527-0ce094566c70 for instance e795d8ed-6984-4792-ba68-003eb9d05fb4 on n-h2-853316-12 Oct 17 12:54:24.576363 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-32cad9fb-3ec5-4751-9a13-0e0be68428d0 req-bdbf3f85-e91a-4307-a9d2-d90487faec27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080035 Oct 17 12:54:24.582366 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 809/1608] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:24.593239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-73eb781c-e66b-445d-b73a-ca4d5d663eda tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:24.615284 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-73eb781c-e66b-445d-b73a-ca4d5d663eda tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031063 Oct 17 12:54:24.616194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 810/1609] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:24.629526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:24.631543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:24.650931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:24.652882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:24.655191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:24.656189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:24.656869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:24.660075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:24.802533 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] HTTP exception thrown: Instance e795d8ed-6984-4792-ba68-003eb9d05fb4 could not be found. Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Request method failure captured: Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 HTTP/1.1 Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVBc6L1IYp6_7nj2yDnu9_zyJzO7pvgjhEFTr92vxoCdv4pYGOn79F2YR_bEP6GGnwy2-AJZHLzdhQdTRWtqhxIn8V9NYAVak420fM8-EMrS2dfEJGhhv26_T9Ob2xvfveCjMhu8yhiRCKNGrx4kd7b_jEICWRI28Tri-F8-d7Q-Hh8 Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_626e075834e746638f9ce7a8b2387def", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/626e075834e746638f9ce7a8b2387def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/626e075834e746638f9ce7a8b2387def"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 626e075834e746638f9ce7a8b2387def Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-704121704 Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 99a154e10393432e8f47c705612c3fcf Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-704121704-project Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance e795d8ed-6984-4792-ba68-003eb9d05fb4 could not be found. Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e795d8ed-6984-4792-ba68-003eb9d05fb4'} Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e795d8ed-6984-4792-ba68-003eb9d05fb4 could not be found. Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e795d8ed-6984-4792-ba68-003eb9d05fb4 could not be found. Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:24.804581 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:24.808572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:24.808572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:24.808572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:24.808572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:24.808572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:24.808572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:24.808572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e795d8ed-6984-4792-ba68-003eb9d05fb4 could not be found. Oct 17 12:54:24.808572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:24.810600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] Returning 404 to user: Instance e795d8ed-6984-4792-ba68-003eb9d05fb4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:24.812140 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-abc80f3a-6e16-40e4-b0f0-aa7d92acddb1 tempest-ServerMetadataNegativeTestJSON-704121704 tempest-ServerMetadataNegativeTestJSON-704121704-project] 10.222.0.27 "GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4" status: 404 len: 111 microversion: 2.1 time: 0.320359 Oct 17 12:54:24.814493 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 800/1610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:24 2022] GET /compute/v2.1/servers/e795d8ed-6984-4792-ba68-003eb9d05fb4 => generated 111 bytes in 323 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:24.821388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:24.822199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:24.830021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:24.830733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:24.832237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:24.833170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:24.833958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:24.834716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:24.887736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:25.075035 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9e69f10-912f-4cd8-9231-1c837ef20401 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 204 len: 0 microversion: 2.1 time: 0.258354 Oct 17 12:54:25.076401 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 801/1611] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:24 2022] DELETE /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:25.091238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-baece349-f20b-4859-b033-234e71cabd9b tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:25.170874 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-baece349-f20b-4859-b033-234e71cabd9b tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.090114 Oct 17 12:54:25.171990 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 802/1612] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 17 12:54:25 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:25.183086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:25.186918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:25.201663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:25.202150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:25.202620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:25.203332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:25.204403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:25.204841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:25.322649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:25.334722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:25.340327 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbeedc9f-efb0-4c7c-8cd4-30c069dba84c tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1305 microversion: 2.1 time: 0.717448 Oct 17 12:54:25.358186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:25.358641 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 811/1613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:24 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1305 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:25.358737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:25.369210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d3b69f3-4716-40b8-b0d9-9a0d79e69ad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.189923 Oct 17 12:54:25.370322 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 803/1614] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:25 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:25.370458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:25.371004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:25.379567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ec24b2ef-f4db-4c1e-9bcd-2ec51de5dea8 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:25.391070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:25.391572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:25.392011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:25.392732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:25.393191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:25.394201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:25.397963 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ec24b2ef-f4db-4c1e-9bcd-2ec51de5dea8 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026555 Oct 17 12:54:25.398618 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 804/1615] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:25.411311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8b8aaa2-7d6d-4ffd-96fc-76b189df679e tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:25.458234 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8b8aaa2-7d6d-4ffd-96fc-76b189df679e tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038213 Oct 17 12:54:25.459285 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 805/1616] 10.222.0.27 () {58 vars in 1144 bytes} [Mon Oct 17 12:54:25 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:25.777026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:25.777800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:25.785125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:25.786132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:25.792838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:25.794105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:25.794812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:25.795446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:26.053299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:26.067161 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97384c02-7d7a-464d-a6f2-f8fc25937c6c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1473 microversion: 2.1 time: 0.714320 Oct 17 12:54:26.068002 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 812/1617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:25 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1473 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:26.098987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0cf439f-c91b-46ba-806f-aaf300f13ce8 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.107801 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0cf439f-c91b-46ba-806f-aaf300f13ce8 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017894 Oct 17 12:54:26.112608 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 813/1618] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:26.120324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b076a864-140d-4c27-bcb0-42576d46f338 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.143140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:26.155392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:26.156828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:26.171759 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-27fd2ae1-63d6-4d80-84c6-c53379795cab tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1293 microversion: 2.25 time: 0.703771 Oct 17 12:54:26.172399 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b076a864-140d-4c27-bcb0-42576d46f338 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.055091 Oct 17 12:54:26.173553 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 814/1619] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:26.187270 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 806/1620] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:25 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1293 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:26.189221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c57a13c-de35-43cd-ac17-6b833b3e4ad9 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.211468 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c57a13c-de35-43cd-ac17-6b833b3e4ad9 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.027850 Oct 17 12:54:26.212567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 815/1621] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:26.230351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7085b61-b5f7-409e-ac5d-51a675c5c7aa tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.243940 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7085b61-b5f7-409e-ac5d-51a675c5c7aa tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018982 Oct 17 12:54:26.259487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bce9aa88-3dfc-4d63-8520-ea3d613d459e tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.272008 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 807/1622] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:26.305545 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bce9aa88-3dfc-4d63-8520-ea3d613d459e tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.050728 Oct 17 12:54:26.315376 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 816/1623] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:26.322700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c14ea490-f904-4514-981c-e3cfe96c9bde tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.357380 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c14ea490-f904-4514-981c-e3cfe96c9bde tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038898 Oct 17 12:54:26.378189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 808/1624] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:26.388323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6aecc219-eb40-4a0e-9fed-2a5b797cc018 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.389296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.389928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:26.398829 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6aecc219-eb40-4a0e-9fed-2a5b797cc018 tempest-FlavorsV2TestJSON-669072800 tempest-FlavorsV2TestJSON-669072800-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014486 Oct 17 12:54:26.406975 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 809/1625] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:26.407176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:26.407176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:26.407176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:26.407176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:26.407176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:26.407176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:26.407636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:26.407636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:26.469424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:26.495090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:26.495919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:26.496911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:26.502206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:26.503617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:26.815248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:26.828543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:26.839429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:26.860559 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd8d414c-d2aa-4a02-8674-187aca0e68a1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.459126 Oct 17 12:54:26.861159 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 810/1626] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:27.098069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:27.098856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:27.109527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:27.113597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:27.120623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:27.122482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:27.123464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:27.124511 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7db37a74-0c1b-468c-b37a-29fe8ff4c236 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1305 microversion: 2.1 time: 0.752863 Oct 17 12:54:27.125940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:27.126835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:27.143628 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 817/1627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:26 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1305 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:27.213283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:27.220009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:27.233604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:27.234411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:27.235036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:27.235908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:27.237603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:27.238351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:27.748700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:27.772130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:27.776548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:27.778696 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65d282b9-0ab5-4837-bb59-8c5a6f3c3102 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1293 microversion: 2.25 time: 0.569504 Oct 17 12:54:27.781973 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 818/1628] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:27 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1293 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:27.893800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:27.894579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:27.909901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:27.910477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:27.911702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:27.917209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:27.917866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:27.918650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:27.984267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:28.002223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5dcd6f3-df14-46b1-a989-2829516c115e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1473 microversion: 2.1 time: 0.905385 Oct 17 12:54:28.003946 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 811/1629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:27 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1473 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:28.160279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:28.183255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:28.186200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:28.204390 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab0d1803-5725-4ce4-bb12-fa8a6decbc0d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.316704 Oct 17 12:54:28.209098 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 819/1630] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:27 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:28.226752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:28.227676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:28.236389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.241736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.242462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.244978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.245634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.248693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.363075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78aaa083-ca12-403e-9dfa-cdeb588896bb tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Calling method '.version_select at 0x7fa820c0bca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:28.367497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78aaa083-ca12-403e-9dfa-cdeb588896bb tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.369545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78aaa083-ca12-403e-9dfa-cdeb588896bb tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.370191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78aaa083-ca12-403e-9dfa-cdeb588896bb tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.374433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78aaa083-ca12-403e-9dfa-cdeb588896bb tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.375157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78aaa083-ca12-403e-9dfa-cdeb588896bb tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.377228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78aaa083-ca12-403e-9dfa-cdeb588896bb tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.460677 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-78aaa083-ca12-403e-9dfa-cdeb588896bb tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.443968 Oct 17 12:54:28.465856 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 812/1631] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 17 12:54:28 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:54:28.485144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af4ef7af-7812-4fde-8995-f021bc2a6a28 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Calling method '.version_select at 0x7fa820b5f9d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:28.497191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af4ef7af-7812-4fde-8995-f021bc2a6a28 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.497696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af4ef7af-7812-4fde-8995-f021bc2a6a28 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.501192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af4ef7af-7812-4fde-8995-f021bc2a6a28 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.505563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af4ef7af-7812-4fde-8995-f021bc2a6a28 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.506127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af4ef7af-7812-4fde-8995-f021bc2a6a28 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.506627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af4ef7af-7812-4fde-8995-f021bc2a6a28 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.585897 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af4ef7af-7812-4fde-8995-f021bc2a6a28 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.116024 Oct 17 12:54:28.590637 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 813/1632] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Oct 17 12:54:28 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:28.606667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87d10932-b6b2-4fcd-ae5b-6bd24a438925 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Calling method '.version_select at 0x7fa8212eab80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:28.621470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87d10932-b6b2-4fcd-ae5b-6bd24a438925 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.622475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87d10932-b6b2-4fcd-ae5b-6bd24a438925 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.623097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87d10932-b6b2-4fcd-ae5b-6bd24a438925 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.624275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87d10932-b6b2-4fcd-ae5b-6bd24a438925 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.625144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87d10932-b6b2-4fcd-ae5b-6bd24a438925 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.627827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87d10932-b6b2-4fcd-ae5b-6bd24a438925 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.689482 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-87d10932-b6b2-4fcd-ae5b-6bd24a438925 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.086746 Oct 17 12:54:28.691463 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 814/1633] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Oct 17 12:54:28 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:54:28.705247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da0d4273-5b9b-41ec-a6a4-2665d7e22781 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Calling method '.version_select at 0x7fa820b5fca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:28.709801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da0d4273-5b9b-41ec-a6a4-2665d7e22781 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.714918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da0d4273-5b9b-41ec-a6a4-2665d7e22781 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.715590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da0d4273-5b9b-41ec-a6a4-2665d7e22781 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.716580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da0d4273-5b9b-41ec-a6a4-2665d7e22781 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.717587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da0d4273-5b9b-41ec-a6a4-2665d7e22781 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.718708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da0d4273-5b9b-41ec-a6a4-2665d7e22781 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.770470 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da0d4273-5b9b-41ec-a6a4-2665d7e22781 tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.071054 Oct 17 12:54:28.772053 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 815/1634] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 17 12:54:28 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:28.790865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25a8f316-e2e7-457e-8a0d-f44d275297ce tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Calling method '.version_select at 0x7fa820ce5c10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:28.806082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25a8f316-e2e7-457e-8a0d-f44d275297ce tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.809750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25a8f316-e2e7-457e-8a0d-f44d275297ce tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.810570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25a8f316-e2e7-457e-8a0d-f44d275297ce tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.812468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25a8f316-e2e7-457e-8a0d-f44d275297ce tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.814457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25a8f316-e2e7-457e-8a0d-f44d275297ce tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.816541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25a8f316-e2e7-457e-8a0d-f44d275297ce tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.889740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25a8f316-e2e7-457e-8a0d-f44d275297ce tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.110523 Oct 17 12:54:28.890426 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 816/1635] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 12:54:28 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:28.895718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:28.896242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:28.917352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.917943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.918286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:28.919091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:28.919400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:28.919903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:29.234083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:29.248875 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2294e8b2-0daf-4aaa-9884-82a2eca69117 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1305 microversion: 2.1 time: 1.035223 Oct 17 12:54:29.249788 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 820/1636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:28 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1305 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:29.270226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9480f5b9-b053-4401-975f-bed3441307da tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Calling method '.version_select at 0x7fa8212ad550>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:29.301955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9480f5b9-b053-4401-975f-bed3441307da tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:29.303462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9480f5b9-b053-4401-975f-bed3441307da tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:29.307638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9480f5b9-b053-4401-975f-bed3441307da tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:29.309655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9480f5b9-b053-4401-975f-bed3441307da tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:29.311429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9480f5b9-b053-4401-975f-bed3441307da tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:29.312098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9480f5b9-b053-4401-975f-bed3441307da tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:29.408423 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9480f5b9-b053-4401-975f-bed3441307da tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.156099 Oct 17 12:54:29.418202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 821/1637] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 17 12:54:29 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:29.430849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:29.434229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:29.450588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:29.455372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:29.456054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:29.457491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:29.458079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:29.458794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:29.568963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:29.570048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:29.570800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:29.571424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lazy-loading 'fault' on Instance uuid 4cfd732b-cff1-436f-b1d2-730b231b20ca {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:29.833553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:29.849085 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-570bcbc4-2de9-485a-b085-e247e4614fde tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 200 len: 1307 microversion: 2.1 time: 0.428725 Oct 17 12:54:29.852123 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 822/1638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:29 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:29.863224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4585e05d-b1ee-4a79-b430-1e5761e3abfb req-cb5986c4-999a-4413-b88c-beaa6692511e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfd732b-cff1-436f-b1d2-730b231b20ca", "name": "network-vif-deleted", "tag": "d78bd15c-f2c4-45f2-96f4-927fc55d20fc"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:29.889723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4585e05d-b1ee-4a79-b430-1e5761e3abfb req-cb5986c4-999a-4413-b88c-beaa6692511e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:29.890680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4585e05d-b1ee-4a79-b430-1e5761e3abfb req-cb5986c4-999a-4413-b88c-beaa6692511e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:29.897058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4585e05d-b1ee-4a79-b430-1e5761e3abfb req-cb5986c4-999a-4413-b88c-beaa6692511e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:29.931416 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4585e05d-b1ee-4a79-b430-1e5761e3abfb req-cb5986c4-999a-4413-b88c-beaa6692511e service nova] Creating event network-vif-deleted:d78bd15c-f2c4-45f2-96f4-927fc55d20fc for instance 4cfd732b-cff1-436f-b1d2-730b231b20ca on n-h2-853316-12 Oct 17 12:54:29.959589 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4585e05d-b1ee-4a79-b430-1e5761e3abfb req-cb5986c4-999a-4413-b88c-beaa6692511e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105916 Oct 17 12:54:29.960580 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 823/1639] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:29.971260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:29.979716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:29.998784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:30.012594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:30.018649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:30.019797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:30.020510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:30.021191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:30.273329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:30.303110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:30.308594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:30.313582 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a04455d7-0cbd-477c-a254-27c4ec107ef4 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 1.417341 Oct 17 12:54:30.321576 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 817/1640] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:28 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:30.334826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:30.351611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:30.353686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c114ad4-c104-4568-82b6-80b85b82bfbc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Calling method '.version_select at 0x7fa820bf9790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:30.354676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:30.375481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c114ad4-c104-4568-82b6-80b85b82bfbc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:30.385500 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2bb46d78-af95-42bf-9d19-31c0b121f52e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.421329 Oct 17 12:54:30.387398 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 824/1641] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:29 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:30.394956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c114ad4-c104-4568-82b6-80b85b82bfbc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:30.395757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c114ad4-c104-4568-82b6-80b85b82bfbc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:30.403170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:30.405730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:30.426750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:30.428181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:30.430537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:30.431703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:30.433608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:30.434589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:30.458375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c114ad4-c104-4568-82b6-80b85b82bfbc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:30.460874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c114ad4-c104-4568-82b6-80b85b82bfbc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:30.463466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c114ad4-c104-4568-82b6-80b85b82bfbc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:30.586618 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c114ad4-c104-4568-82b6-80b85b82bfbc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-853316-12" status: 200 len: 603 microversion: 2.1 time: 0.243152 Oct 17 12:54:30.588150 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 818/1642] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 17 12:54:30 2022] GET /compute/v2.1/os-hosts/n-h2-853316-12 => generated 603 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:30.838134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:30.859408 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b61a7cab-679d-4dd4-8130-0ebd1aee6eac tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1305 microversion: 2.1 time: 0.466324 Oct 17 12:54:30.870420 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 825/1643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:30 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1305 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:30.873781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-95a33925-fa9d-41a6-b5c6-9c99b1bcc9fc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Calling method '.version_select at 0x7fa820afd820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:30.891949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95a33925-fa9d-41a6-b5c6-9c99b1bcc9fc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:30.892550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95a33925-fa9d-41a6-b5c6-9c99b1bcc9fc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:30.892883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95a33925-fa9d-41a6-b5c6-9c99b1bcc9fc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:30.936710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95a33925-fa9d-41a6-b5c6-9c99b1bcc9fc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:30.939391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95a33925-fa9d-41a6-b5c6-9c99b1bcc9fc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:30.939921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95a33925-fa9d-41a6-b5c6-9c99b1bcc9fc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.024592 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-95a33925-fa9d-41a6-b5c6-9c99b1bcc9fc tempest-HostsAdminTestJSON-2021150392 tempest-HostsAdminTestJSON-2021150392-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-853316-12" status: 200 len: 735 microversion: 2.1 time: 0.160625 Oct 17 12:54:31.026995 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 826/1644] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 17 12:54:30 2022] GET /compute/v2.1/os-hosts/n-h1-853316-12 => generated 735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:31.046707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:31.047644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 4cfd732b-cff1-436f-b1d2-730b231b20ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:31.064841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:31.072205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.072903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.074447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.094897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.097527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.100804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.149414 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] HTTP exception thrown: Instance 4cfd732b-cff1-436f-b1d2-730b231b20ca could not be found. Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Request method failure captured: Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca HTTP/1.1 Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_TUqYvyKAqyEgY3pwoyPmnLqEIV8EuG7UbdXAao43RYDng0qsbEswAHfrkIrudns39nTN4Ps0A0i-VT_JsAHRgcaILBQTH_hu-G9qJQAWwFLeH8jo3l3EBMJLKYnRiuHB6bbuN6UxHwWtFAtkF913NG48uvXVgfj-wSnh6--JgH9o Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4fdb785bf6b41a68f157d51d763052a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6e4b8603784d4a3ca87cb2b6d1412b89 Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 4cfd732b-cff1-436f-b1d2-730b231b20ca could not be found. Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '4cfd732b-cff1-436f-b1d2-730b231b20ca'} Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cfd732b-cff1-436f-b1d2-730b231b20ca could not be found. Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cfd732b-cff1-436f-b1d2-730b231b20ca could not be found. Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:31.165407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:31.170233 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:31.170233 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:31.170233 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:31.170233 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:31.170233 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:31.170233 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cfd732b-cff1-436f-b1d2-730b231b20ca could not be found. Oct 17 12:54:31.170233 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:31.173257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Returning 404 to user: Instance 4cfd732b-cff1-436f-b1d2-730b231b20ca could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:31.174564 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8db8b24a-b08f-45aa-a316-fe73a0f1bce8 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca" status: 404 len: 111 microversion: 2.1 time: 0.141033 Oct 17 12:54:31.176538 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 827/1645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:31 2022] GET /compute/v2.1/servers/4cfd732b-cff1-436f-b1d2-730b231b20ca => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:31.185085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:31.185677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:31.194561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.195438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.196175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.197126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.197813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.198524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.268438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:31.318220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e19c2ba8-f14d-4386-9dcf-0f13478e3ae9 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Action: 'create', calling method: .version_select at 0x7fa820bf9940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:31.382944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:31.388908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e19c2ba8-f14d-4386-9dcf-0f13478e3ae9 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Getting quotas for project 621945c13ee1466f9d4a2575e8a97697. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:31.401740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e19c2ba8-f14d-4386-9dcf-0f13478e3ae9 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Getting quotas for user 6982fb2c7d914ca7aa7ca0d286343598 and project 621945c13ee1466f9d4a2575e8a97697. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:31.413987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:31.520518 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3ee9fc9-04f4-49c2-b800-f1679cd121e2 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 204 len: 0 microversion: 2.1 time: 0.337599 Oct 17 12:54:31.526445 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 828/1646] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:31 2022] DELETE /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:31.533708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e19c2ba8-f14d-4386-9dcf-0f13478e3ae9 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Getting quotas for project 621945c13ee1466f9d4a2575e8a97697. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:31.537487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:31.538720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:31.546319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.546660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e19c2ba8-f14d-4386-9dcf-0f13478e3ae9 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Getting quotas for user 6982fb2c7d914ca7aa7ca0d286343598 and project 621945c13ee1466f9d4a2575e8a97697. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:31.547638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.548697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.550123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.551306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.552077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.577553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e19c2ba8-f14d-4386-9dcf-0f13478e3ae9 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.987917 Oct 17 12:54:31.581443 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 819/1647] 10.222.0.27 () {62 vars in 1214 bytes} [Mon Oct 17 12:54:30 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:54:31.591533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:31.593943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:31.612845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.614073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.614775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.615678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.617044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.619115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.752035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:31.772258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:31.774482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:31.777134 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-940ad33b-4e4b-42b0-a422-5e876eeb76d9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.246660 Oct 17 12:54:31.778473 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 829/1648] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:31 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:31.785751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:31.786592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:31.793272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.794518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.797806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.798813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:31.799443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:31.801490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:31.843679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:31.854996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:31.857991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:31.866507 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-daccd065-e339-4d7e-8d57-a993ca77da70 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.283287 Oct 17 12:54:31.880844 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 820/1649] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:31 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:31.919607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7daf9115-124e-4a05-af8d-fc9081be0010 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:31.971269 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7daf9115-124e-4a05-af8d-fc9081be0010 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.089190 Oct 17 12:54:31.972133 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 821/1650] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 12:54:31 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:54:31.976746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:31.997790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:32.000235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:32.012902 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2b4edfb-d5c3-4fc7-8623-86033b08a382 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1473 microversion: 2.1 time: 0.233080 Oct 17 12:54:32.032361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:32.033154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:32.033610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:32.036153 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 830/1651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:31 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1473 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:32.038958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:32.039686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:32.041790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0f50eb5-1529-4085-973e-f1abf13a7fbc tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:32.042523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:32.063329 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0f50eb5-1529-4085-973e-f1abf13a7fbc tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/b66908b3-8875-4477-be11-0905838c9c7b" status: 200 len: 235 microversion: 2.64 time: 0.025846 Oct 17 12:54:32.064590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 831/1652] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 17 12:54:32 2022] GET /compute/v2.1/os-server-groups/b66908b3-8875-4477-be11-0905838c9c7b => generated 235 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:54:32.088325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4e1e368-c545-4b49-b3ce-cce3f4822d13 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:32.091310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:32.149357 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a4e1e368-c545-4b49-b3ce-cce3f4822d13 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/b66908b3-8875-4477-be11-0905838c9c7b" status: 204 len: 0 microversion: 2.64 time: 0.076698 Oct 17 12:54:32.157752 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 832/1653] 10.222.0.27 () {60 vars in 1307 bytes} [Mon Oct 17 12:54:32 2022] DELETE /compute/v2.1/os-server-groups/b66908b3-8875-4477-be11-0905838c9c7b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 12:54:32.163945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da44b26c-e97d-45bf-9db4-22cbd08ade49 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:32.171509 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-da44b26c-e97d-45bf-9db4-22cbd08ade49 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] HTTP exception thrown: Instance group b66908b3-8875-4477-be11-0905838c9c7b could not be found. Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da44b26c-e97d-45bf-9db4-22cbd08ade49 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Request method failure captured: Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-server-groups/b66908b3-8875-4477-be11-0905838c9c7b HTTP/1.1 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVCGaAetw-ULTi_9Y2BPZOUJ5SEqHMkcsl4fcpskqnIQgxvL2BOj8gnfb3_u_WPpn2OW6w1d3LWMBjgI503yFOjhwkxo08TyBJ5Kj40u944ylz0Ec3EnqkicVp-sN9LuTf57JSWcpGY3Y1l1rJJ_v9alWpNI6lSHqmtwjRgfl5YfLwY Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.64 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 621945c13ee1466f9d4a2575e8a97697 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerGroup264TestJSON-1180626322 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_621945c13ee1466f9d4a2575e8a97697", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/621945c13ee1466f9d4a2575e8a97697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/621945c13ee1466f9d4a2575e8a97697"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/621945c13ee1466f9d4a2575e8a97697"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerGroup264TestJSON-1180626322 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 621945c13ee1466f9d4a2575e8a97697 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1180626322 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerGroup264TestJSON-1180626322-project Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6982fb2c7d914ca7aa7ca0d286343598 Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerGroup264TestJSON-1180626322-project Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance group b66908b3-8875-4477-be11-0905838c9c7b could not be found. Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b66908b3-8875-4477-be11-0905838c9c7b'} Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b66908b3-8875-4477-be11-0905838c9c7b could not be found. Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b66908b3-8875-4477-be11-0905838c9c7b could not be found. Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:32.181748 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:32.187085 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:32.187085 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:32.187085 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:32.187085 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:32.187085 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b66908b3-8875-4477-be11-0905838c9c7b could not be found. Oct 17 12:54:32.187085 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:32.189337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da44b26c-e97d-45bf-9db4-22cbd08ade49 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] Returning 404 to user: Instance group b66908b3-8875-4477-be11-0905838c9c7b could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:32.191122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da44b26c-e97d-45bf-9db4-22cbd08ade49 tempest-ServerGroup264TestJSON-1180626322 tempest-ServerGroup264TestJSON-1180626322-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/b66908b3-8875-4477-be11-0905838c9c7b" status: 404 len: 117 microversion: 2.64 time: 0.031450 Oct 17 12:54:32.196438 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 833/1654] 10.222.0.27 () {60 vars in 1307 bytes} [Mon Oct 17 12:54:32 2022] DELETE /compute/v2.1/os-server-groups/b66908b3-8875-4477-be11-0905838c9c7b => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:54:32.371323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:32.385974 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f5f4935f-726b-4c2e-83e8-9f1b8b5462c0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1305 microversion: 2.1 time: 0.412711 Oct 17 12:54:32.400348 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 822/1655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:31 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1305 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:32.808620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:32.809394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:32.826710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:32.829006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:32.829586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:32.834110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:32.836184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:32.836773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:32.904106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:32.905166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:32.911746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:32.912573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:32.913254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:32.914490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:32.915341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:32.916005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:33.006484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:33.019844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:33.021815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:33.029461 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5ecd497-2637-42c5-938d-580ab2f4acdf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.130884 Oct 17 12:54:33.030704 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 823/1656] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:32 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:33.044782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:33.046153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:33.061279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:33.062092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:33.062559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:33.063282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:33.063750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:33.064441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:33.378719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:33.389496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:33.391166 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-772c4e2f-b85e-4c07-850f-708b9cb58a5e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1473 microversion: 2.1 time: 0.351239 Oct 17 12:54:33.392097 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 824/1657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:33 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1473 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:33.413848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:33.415625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:33.426245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:33.427072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:33.432236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-877e3848-c8c3-4d99-944f-54704e36792a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.629846 Oct 17 12:54:33.436527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:33.437119 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 834/1658] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:32 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:33.437973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:33.438627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:33.439969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:33.440957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:33.441681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:33.723043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:33.732721 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3a075ad3-dcf1-4367-aab9-73f3b528cda2 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 0.314161 Oct 17 12:54:33.748432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 825/1659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:33 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:34.061545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:34.062425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:34.078918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:34.080546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:34.082512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:34.084314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:34.085051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:34.086316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:34.194207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:34.216495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:34.218334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:34.232919 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f9b8b6f-a6ba-4086-898c-9a771275ff30 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.177695 Oct 17 12:54:34.233512 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 835/1660] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:34 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:34.416254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:34.417610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:34.434924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:34.435714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:34.436399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:34.437367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:34.438190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:34.438851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:34.466418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:34.467334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:34.480607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:34.482471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:34.483414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:34.486178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:34.488262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:34.492026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:34.902786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:34.916659 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d677877f-1127-45d7-a4cf-ec52c969d053 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1473 microversion: 2.1 time: 0.504161 Oct 17 12:54:34.931932 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 826/1661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:34 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1473 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:34.942059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:34.950609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:34.964302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:34.965395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:34.968001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:34.971322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:34.973653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:34.974284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:35.216629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:35.241498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:35.243036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:35.247601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b29ef267-bf97-480d-96fd-b8727c8e0024 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.786381 Oct 17 12:54:35.264083 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 836/1662] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:34 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:35.275457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:35.278127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:35.290402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:35.292175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:35.292885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:35.296083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:35.297459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:35.299328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:35.406336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:35.417275 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6bd42a6b-07b4-408a-ae0f-f991b8962416 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 0.484119 Oct 17 12:54:35.426580 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 827/1663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:34 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:35.700083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:35.710777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:35.716787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:35.744252 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e9462243-5209-4583-8e4a-18ae030ea1ee tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.478473 Oct 17 12:54:35.745678 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 837/1664] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:35 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:35.945583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:35.946267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:35.983251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:35.983783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:35.984242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:35.984993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:35.985456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:35.994977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:36.186145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:36.196197 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e828435-e810-49c4-97e4-bebea4d5ed6d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1431 microversion: 2.1 time: 0.255758 Oct 17 12:54:36.201611 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 828/1665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:35 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1431 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:36.273035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:36.273678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:36.298617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:36.299358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:36.300480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:36.301245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:36.301705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:36.302134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:36.454082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:36.454826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:36.469960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:36.470494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:36.470940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:36.471789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:36.472258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:36.472794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:37.083304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:37.100664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:37.102470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:37.128854 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-909ac81f-408c-4e5a-9f1d-ec60f954d372 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.858824 Oct 17 12:54:37.146199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 838/1666] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:36 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:37.174488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-065ee76c-8cb3-4641-aa59-33b9e456cd7d req-5dc9ceb2-5ebe-4f0f-996e-915c53c8f3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222a4599-cec5-40bf-8491-6396b6760322", "name": "network-vif-deleted", "tag": "0e863af4-158a-4246-b335-b61ce5106bac"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:37.223855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-065ee76c-8cb3-4641-aa59-33b9e456cd7d req-5dc9ceb2-5ebe-4f0f-996e-915c53c8f3d2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:37.224372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-065ee76c-8cb3-4641-aa59-33b9e456cd7d req-5dc9ceb2-5ebe-4f0f-996e-915c53c8f3d2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:37.224851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-065ee76c-8cb3-4641-aa59-33b9e456cd7d req-5dc9ceb2-5ebe-4f0f-996e-915c53c8f3d2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:37.261238 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-065ee76c-8cb3-4641-aa59-33b9e456cd7d req-5dc9ceb2-5ebe-4f0f-996e-915c53c8f3d2 service nova] Creating event network-vif-deleted:0e863af4-158a-4246-b335-b61ce5106bac for instance 222a4599-cec5-40bf-8491-6396b6760322 on n-h1-853316-12 Oct 17 12:54:37.273952 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-065ee76c-8cb3-4641-aa59-33b9e456cd7d req-5dc9ceb2-5ebe-4f0f-996e-915c53c8f3d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136776 Oct 17 12:54:37.275019 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 839/1667] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:37.283434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:37.284283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:37.302089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:37.307734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:37.310627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:37.321671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:37.324487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:37.327142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:37.423506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:37.437882 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a645fbee-9d08-48c5-a1e1-e3f76369f5df tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 0.990314 Oct 17 12:54:37.438546 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 829/1668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:36 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:37.540499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:37.553222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:37.554743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:37.601534 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-12483fd0-5981-48dd-8171-864cf0a6de2a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1560 microversion: 2.91 time: 0.319788 Oct 17 12:54:37.608365 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 840/1669] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:37 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1560 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:37.619735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:37.622575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:37.670772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:37.671837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:37.674539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:37.675774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:37.676847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:37.680458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:37.821264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:37.827074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:37.828029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:37.829805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lazy-loading 'fault' on Instance uuid 222a4599-cec5-40bf-8491-6396b6760322 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:38.083863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Calling method '.version_select at 0x7fa820ce5f70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:38.086062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.086594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.087480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.122441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.127687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.128416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.140908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.141693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.142350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.150955 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf223a3c-e807-42de-893e-131d2b9c4e76 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.711216 Oct 17 12:54:38.152456 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 830/1670] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:54:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:38.227105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:38.240000 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c11b8b84-0207-4bd6-a33b-616770b6a39f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 200 len: 1307 microversion: 2.1 time: 0.627129 Oct 17 12:54:38.257107 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 841/1671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:37 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 1307 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:38.272488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:38.273748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:38.281597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.283820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.284972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.286155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.286730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.287230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.348281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-deaa15c3-f163-4385-a719-d74e8a17bbd4 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] Calling method '.version_select at 0x7fa820ccdd30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:38.350142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-deaa15c3-f163-4385-a719-d74e8a17bbd4 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'a227a738e31c4bfd9a963e6474e39e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e5d679c604f9aa179eb5512bfa340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-deaa15c3-f163-4385-a719-d74e8a17bbd4 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] Request method failure captured: Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hypervisors/n-h2-853316-12/search HTTP/1.1 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCLXW1PUvok3xVavlrdpBM40LC0e68akBpGKLFXgq3-sMnT-7cn33EXcSD2YEGGuX-hbJlzPE9223Oa52lk0mjoj_Pq_FUrcYohxGezIQ_1mPEuYcvGyffR2r5PUSsJBM3rZaUPlcxL60YpqftnR7DQnH5_Ib15kHT3qwZRdoHZ6xo Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 912e5d679c604f9aa179eb5512bfa340 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-290159736 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_912e5d679c604f9aa179eb5512bfa340", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/912e5d679c604f9aa179eb5512bfa340"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/912e5d679c604f9aa179eb5512bfa340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/912e5d679c604f9aa179eb5512bfa340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-290159736 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 912e5d679c604f9aa179eb5512bfa340 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-290159736 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-290159736-project Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a227a738e31c4bfd9a963e6474e39e35 Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-290159736-project Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'n-h2-853316-12'} Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:38.352036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:38.357127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:38.357127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:38.357127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:38.357127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:54:38.357127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:54:38.357127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 12:54:38.357127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:38.358439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-deaa15c3-f163-4385-a719-d74e8a17bbd4 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:38.359471 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-deaa15c3-f163-4385-a719-d74e8a17bbd4 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-853316-12/search" status: 403 len: 117 microversion: 2.1 time: 0.196632 Oct 17 12:54:38.364688 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 831/1672] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 17 12:54:38 2022] GET /compute/v2.1/os-hypervisors/n-h2-853316-12/search => generated 117 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:38.426661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-900523470", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": "none"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:38.525296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:54:38.529536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:54:38.530127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:54:38.530579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:54:38.531003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:54:38.568659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.569195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.571871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.572905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.577459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.578684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.649089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Getting quotas for project 493e79b70a904e0b8556757082b9458f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:38.673316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Getting quotas for user f776019598d34be491112128a5ab0918 and project 493e79b70a904e0b8556757082b9458f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:38.684337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:38.698693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:38.700553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:38.702528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:54:38.704011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8eeb2e51-bbe1-481c-b4d1-30f6b51895cb tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.440468 Oct 17 12:54:38.715282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:54:38.727586 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 842/1673] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:38 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:38.741766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5202db0b-8719-443d-a716-de31408c1eb7 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Calling method '.version_select at 0x7fa8209de0d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:38.745735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5202db0b-8719-443d-a716-de31408c1eb7 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.747357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5202db0b-8719-443d-a716-de31408c1eb7 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.752627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5202db0b-8719-443d-a716-de31408c1eb7 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.768630 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-5202db0b-8719-443d-a716-de31408c1eb7 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5202db0b-8719-443d-a716-de31408c1eb7 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Request method failure captured: Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVCMCttdhhW3m2RR85ea8MUrQV8nPOa0RLlQ-Xt4pQmR2GYRWrpGqCm-nNbKHpVnNg-7jkTwdOKSkedTXlOZldx_qmS_7r6aH5zX4UOQgDs2F8R02ySsqURXXtqeaOFPYWsOf8Z2WwLjnjizKhL5p8J1xEfB_xWobvIJbq5BUDTZOvc Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b01ad806f2ee448984aa140f6fd6e5cc Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1504147167 Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b01ad806f2ee448984aa140f6fd6e5cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b01ad806f2ee448984aa140f6fd6e5cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b01ad806f2ee448984aa140f6fd6e5cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b01ad806f2ee448984aa140f6fd6e5cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1504147167 Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b01ad806f2ee448984aa140f6fd6e5cc Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1504147167 Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 864a18e3f6bb49fa999a888f3fa44827 Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 12:54:38.773872 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:38.779651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5202db0b-8719-443d-a716-de31408c1eb7 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:38.783164 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5202db0b-8719-443d-a716-de31408c1eb7 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.054267 Oct 17 12:54:38.784116 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 843/1674] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 12:54:38 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:38.792764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:38.800232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:38.823910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.825275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.826155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.829280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.830295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.832587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.846127 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e87e7cb-f327-45aa-a631-44a9deb4f438 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.479877 Oct 17 12:54:38.853151 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 832/1675] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 12:54:38.858297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:38.858953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:38.903118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.903624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.904289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:38.905191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:38.906972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:38.910938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.242108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:39.257251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:39.264050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:39.274836 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84e24c31-da40-43ab-b06c-e852e77d5077 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.420152 Oct 17 12:54:39.275487 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 833/1676] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:38 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:39.314877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Calling method '.version_select at 0x7fa820c61dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:39.317496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.317870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.318447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.357168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.357784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.358905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.364703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:39.373303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.373793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.374277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.398373 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d70d2d4-4188-4f80-a9c1-1446146d7a5e tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.089577 Oct 17 12:54:39.407827 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 834/1677] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:54:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:39.416234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3b1a6ffd-53f8-4b12-b70e-c7d46985a0b8 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:39.416850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3b1a6ffd-53f8-4b12-b70e-c7d46985a0b8 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:39.560407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:39.575441 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f9d69cf6-5f6c-4916-89d8-f7d4b7ea2bb3 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 0.785519 Oct 17 12:54:39.576974 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 844/1678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:38 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:39.592077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3b1a6ffd-53f8-4b12-b70e-c7d46985a0b8 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:39.602826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:39.606134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 222a4599-cec5-40bf-8491-6396b6760322] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:39.607004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3b1a6ffd-53f8-4b12-b70e-c7d46985a0b8 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:39.608799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3b1a6ffd-53f8-4b12-b70e-c7d46985a0b8 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:39.610198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3b1a6ffd-53f8-4b12-b70e-c7d46985a0b8 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1277 microversion: 2.54 time: 0.201288 Oct 17 12:54:39.625556 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 835/1679] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:39 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:39.637513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd3b2595-0a76-4586-ada4-a8529da67e78 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] Calling method '.version_select at 0x7fa820c0bca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:39.641369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd3b2595-0a76-4586-ada4-a8529da67e78 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'a227a738e31c4bfd9a963e6474e39e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e5d679c604f9aa179eb5512bfa340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd3b2595-0a76-4586-ada4-a8529da67e78 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] Request method failure captured: Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCLXW1PUvok3xVavlrdpBM40LC0e68akBpGKLFXgq3-sMnT-7cn33EXcSD2YEGGuX-hbJlzPE9223Oa52lk0mjoj_Pq_FUrcYohxGezIQ_1mPEuYcvGyffR2r5PUSsJBM3rZaUPlcxL60YpqftnR7DQnH5_Ib15kHT3qwZRdoHZ6xo Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 912e5d679c604f9aa179eb5512bfa340 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-290159736 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_912e5d679c604f9aa179eb5512bfa340", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/912e5d679c604f9aa179eb5512bfa340"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/912e5d679c604f9aa179eb5512bfa340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/912e5d679c604f9aa179eb5512bfa340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-290159736 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 912e5d679c604f9aa179eb5512bfa340 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-290159736 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-290159736-project Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a227a738e31c4bfd9a963e6474e39e35 Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-290159736-project Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1'} Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:39.645095 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.651126 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:39.651126 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:39.651126 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:39.651126 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:54:39.651126 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:54:39.651126 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 12:54:39.651126 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.657080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd3b2595-0a76-4586-ada4-a8529da67e78 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:39.663177 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd3b2595-0a76-4586-ada4-a8529da67e78 tempest-HypervisorAdminNegativeUnderV252Test-290159736 tempest-HypervisorAdminNegativeUnderV252Test-290159736-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.035761 Oct 17 12:54:39.665009 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 836/1680] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 12:54:39 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:39.673334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.673946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.674946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.675830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.676550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.677091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.682079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b428dd37-a81a-4fc9-8896-d6f83fb758a6 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Calling method '.version_select at 0x7fa820b5f160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:39.684553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b428dd37-a81a-4fc9-8896-d6f83fb758a6 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.688621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b428dd37-a81a-4fc9-8896-d6f83fb758a6 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.694932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b428dd37-a81a-4fc9-8896-d6f83fb758a6 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.702922 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] HTTP exception thrown: Instance 222a4599-cec5-40bf-8491-6396b6760322 could not be found. Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Request method failure captured: Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 HTTP/1.1 Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_TUqYvyKAqyEgY3pwoyPmnLqEIV8EuG7UbdXAao43RYDng0qsbEswAHfrkIrudns39nTN4Ps0A0i-VT_JsAHRgcaILBQTH_hu-G9qJQAWwFLeH8jo3l3EBMJLKYnRiuHB6bbuN6UxHwWtFAtkF913NG48uvXVgfj-wSnh6--JgH9o Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4fdb785bf6b41a68f157d51d763052a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6e4b8603784d4a3ca87cb2b6d1412b89 Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 222a4599-cec5-40bf-8491-6396b6760322 could not be found. Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '222a4599-cec5-40bf-8491-6396b6760322'} Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222a4599-cec5-40bf-8491-6396b6760322 could not be found. Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222a4599-cec5-40bf-8491-6396b6760322 could not be found. Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:39.705190 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.710974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:39.710974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:39.710974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:39.710974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:39.710974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:39.710974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222a4599-cec5-40bf-8491-6396b6760322 could not be found. Oct 17 12:54:39.710974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.710974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Returning 404 to user: Instance 222a4599-cec5-40bf-8491-6396b6760322 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:39.713598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4140d39a-ff7c-4f75-9655-c5db6371396e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322" status: 404 len: 111 microversion: 2.1 time: 0.132843 Oct 17 12:54:39.716355 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 845/1681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:39 2022] GET /compute/v2.1/servers/222a4599-cec5-40bf-8491-6396b6760322 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:39.722182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:39.722863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:39.730284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.731492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.731991 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b428dd37-a81a-4fc9-8896-d6f83fb758a6 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] HTTP exception thrown: No hypervisor matching '707529d7-99e8-42b3-9aef-7edd59fc3e4e' could be found. Oct 17 12:54:39.732194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.733022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.733854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.735146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b428dd37-a81a-4fc9-8896-d6f83fb758a6 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Request method failure captured: Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-hypervisors/707529d7-99e8-42b3-9aef-7edd59fc3e4e/servers HTTP/1.1 Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCMCttdhhW3m2RR85ea8MUrQV8nPOa0RLlQ-Xt4pQmR2GYRWrpGqCm-nNbKHpVnNg-7jkTwdOKSkedTXlOZldx_qmS_7r6aH5zX4UOQgDs2F8R02ySsqURXXtqeaOFPYWsOf8Z2WwLjnjizKhL5p8J1xEfB_xWobvIJbq5BUDTZOvc Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: b01ad806f2ee448984aa140f6fd6e5cc Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1504147167 Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b01ad806f2ee448984aa140f6fd6e5cc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b01ad806f2ee448984aa140f6fd6e5cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b01ad806f2ee448984aa140f6fd6e5cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b01ad806f2ee448984aa140f6fd6e5cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1504147167 Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: b01ad806f2ee448984aa140f6fd6e5cc Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1504147167 Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 864a18e3f6bb49fa999a888f3fa44827 Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: exception: No hypervisor matching '707529d7-99e8-42b3-9aef-7edd59fc3e4e' could be found. Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '707529d7-99e8-42b3-9aef-7edd59fc3e4e'} Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '707529d7-99e8-42b3-9aef-7edd59fc3e4e' could be found. Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '707529d7-99e8-42b3-9aef-7edd59fc3e4e' could be found. Oct 17 12:54:39.735733 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:39.741340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b428dd37-a81a-4fc9-8896-d6f83fb758a6 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] Returning 404 to user: No hypervisor matching '707529d7-99e8-42b3-9aef-7edd59fc3e4e' could be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:39.743828 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b428dd37-a81a-4fc9-8896-d6f83fb758a6 tempest-HypervisorAdminNegativeUnderV252Test-1504147167 tempest-HypervisorAdminNegativeUnderV252Test-1504147167-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/707529d7-99e8-42b3-9aef-7edd59fc3e4e/servers" status: 404 len: 123 microversion: 2.1 time: 0.073436 Oct 17 12:54:39.746759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 837/1682] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 17 12:54:39 2022] GET /compute/v2.1/os-hypervisors/707529d7-99e8-42b3-9aef-7edd59fc3e4e/servers => generated 123 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:39.761381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:39.762238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:39.780611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.781543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.782232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.783166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:39.784050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:39.785972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:39.833628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:40.069073 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-452ed914-7eb1-476c-9f34-11706bffdd51 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 204 len: 0 microversion: 2.1 time: 0.350974 Oct 17 12:54:40.079510 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 846/1683] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:39 2022] DELETE /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:40.092250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:40.093643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:40.111566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:40.113083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:40.113787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:40.114820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:40.115530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:40.116349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:40.141754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:40.160702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:40.166669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:40.174478 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9fe5a310-0590-4157-a0d3-39065dd6db95 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.422598 Oct 17 12:54:40.175800 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 838/1684] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:39 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:40.308530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:40.310270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:40.327162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:40.334433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:40.335247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:40.336204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:40.336874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:40.338968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:40.655771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:40.660154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:40.692791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:40.723608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:40.733624 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-95910c86-5cc3-488e-bc2f-31356dbb3abf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1473 microversion: 2.1 time: 0.645185 Oct 17 12:54:40.735773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:40.737281 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 847/1685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:40 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1473 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:40.754406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:40.754848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:40.762400 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-76c36611-fac0-4b74-adcf-a0e12e8f5ff6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.459220 Oct 17 12:54:40.763002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 839/1686] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:40 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:40.784141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:40.803342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:40.806631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:40.819617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:40.822463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:40.825573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:40.826211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:40.826844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:40.835165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:40.841516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:40.842185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:40.847038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:40.848023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:40.848732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:41.228386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:41.243398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:41.247726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:41.249942 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9a38816-fd59-4829-9359-e75f3b841294 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1329 microversion: 2.54 time: 0.485930 Oct 17 12:54:41.255613 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 840/1687] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:40 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1329 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:41.269308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:41.270447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:41.293025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:41.294093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:41.294805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:41.295798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:41.297311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:41.298128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:41.509869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:41.522657 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b2e3c1b2-48bf-4420-abd2-df0f5188bcef tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 0.779372 Oct 17 12:54:41.546213 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 848/1688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:40 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:41.762789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:41.763439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:41.773747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:41.774246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:41.774650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:41.780860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:41.781401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:41.781855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:42.042764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:42.051740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:42.061047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:42.067400 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80680500-e875-4869-9686-a0a183cfb6ac tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.810137 Oct 17 12:54:42.085964 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 841/1689] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:41 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:42.109845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:42.111125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:42.132225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:42.132741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:42.152303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:42.157828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:42.158419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:42.158901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:42.418835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:42.435346 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-504cf6ac-0e75-4a95-9eb8-cf06e67381cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1473 microversion: 2.1 time: 0.674662 Oct 17 12:54:42.435346 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 849/1690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:41 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1473 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:42.453873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:42.462765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:42.479940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:42.480451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:42.480897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:42.481626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:42.482083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:42.490778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:42.768789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:42.795391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:42.801409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:42.840671 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19c7164f-35e2-4dc0-bf20-c03240c50ead tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.751038 Oct 17 12:54:42.843068 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 842/1691] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:42 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:42.853717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:42.855863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:42.873058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:42.873846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:42.875852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:42.880721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:42.881682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:42.883019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:42.938465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:42.998120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:43.038270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:43.040932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:43.046421 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b59c48e-b99a-464a-9290-ce29e7a8ea20 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1335 microversion: 2.54 time: 0.611412 Oct 17 12:54:43.053459 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 850/1692] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:42 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1335 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:43.111920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:43.113486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:43.124919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:43.125656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:43.127517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:43.129554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:43.132315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:43.133228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:43.860728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:43.879658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:43.890537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:43.896704 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f9b9f0ff-8028-45c9-8fd6-01b73ee1ce77 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.788162 Oct 17 12:54:43.899157 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 851/1693] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:43 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:43.911896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:43.915013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:43.955769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:43.960126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:43.962730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:43.967022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:43.968303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:43.971185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:44.227945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:44.249847 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90e033bb-870b-466b-8789-929fa9958662 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1431 microversion: 2.1 time: 0.338716 Oct 17 12:54:44.254856 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 852/1694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:43 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1431 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:44.270417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:44.271357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:44.278794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:44.286936 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6f66b592-c4ea-4730-a0a3-d10627e7330d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 1.442345 Oct 17 12:54:44.310543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:44.310543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:44.310543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:44.311444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:44.311614 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 843/1695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:42 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:44.317901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-accbd4e3-1770-4c93-839d-eb4a7de5b8c9 req-9c0396a3-2f78-407d-9e82-dfa2ef7493ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668320eb-1f68-4fcd-addd-aef8b2271f2a", "name": "network-vif-plugged", "status": "completed", "tag": "dfb3775c-e68d-4644-94da-eb293b65a58c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:44.319328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:44.319959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:44.329402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-accbd4e3-1770-4c93-839d-eb4a7de5b8c9 req-9c0396a3-2f78-407d-9e82-dfa2ef7493ae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:44.330313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-accbd4e3-1770-4c93-839d-eb4a7de5b8c9 req-9c0396a3-2f78-407d-9e82-dfa2ef7493ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:44.331028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-accbd4e3-1770-4c93-839d-eb4a7de5b8c9 req-9c0396a3-2f78-407d-9e82-dfa2ef7493ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:44.362911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-accbd4e3-1770-4c93-839d-eb4a7de5b8c9 req-9c0396a3-2f78-407d-9e82-dfa2ef7493ae service nova] Creating event network-vif-plugged:dfb3775c-e68d-4644-94da-eb293b65a58c for instance 668320eb-1f68-4fcd-addd-aef8b2271f2a on n-h1-853316-12 Oct 17 12:54:44.375109 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-accbd4e3-1770-4c93-839d-eb4a7de5b8c9 req-9c0396a3-2f78-407d-9e82-dfa2ef7493ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061878 Oct 17 12:54:44.376099 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 844/1696] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:44.398753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:44.399659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:44.414707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:44.415590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:44.420982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:44.422084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:44.422871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:44.423536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:44.595178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:44.616157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:44.617841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:44.628691 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4bb3164c-9c08-48d4-9535-36e4df08332c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.371384 Oct 17 12:54:44.632328 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 853/1697] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:44 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:45.104459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:45.118411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:45.123691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:45.125625 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74917040-c692-44f2-8277-2c9a8dc3842b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1356 microversion: 2.54 time: 0.744813 Oct 17 12:54:45.126835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 845/1698] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:44 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1356 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:45.138470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:45.139560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:45.146969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.148088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.149171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.149898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.151149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.151739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.350980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-87b5a8f3-add6-4d46-a6f8-5d36abbaf6eb req-7337ef90-bf05-4b7b-8224-d463eb241637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d262a90f-1d00-482c-9097-8d9aff357605", "name": "network-vif-deleted", "tag": "9180ba16-60cc-465f-a1a6-eff8a4460d61"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:45.372079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-87b5a8f3-add6-4d46-a6f8-5d36abbaf6eb req-7337ef90-bf05-4b7b-8224-d463eb241637 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.372668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-87b5a8f3-add6-4d46-a6f8-5d36abbaf6eb req-7337ef90-bf05-4b7b-8224-d463eb241637 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.374045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-87b5a8f3-add6-4d46-a6f8-5d36abbaf6eb req-7337ef90-bf05-4b7b-8224-d463eb241637 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.407599 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-87b5a8f3-add6-4d46-a6f8-5d36abbaf6eb req-7337ef90-bf05-4b7b-8224-d463eb241637 service nova] Creating event network-vif-deleted:9180ba16-60cc-465f-a1a6-eff8a4460d61 for instance d262a90f-1d00-482c-9097-8d9aff357605 on n-h1-853316-12 Oct 17 12:54:45.433582 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-87b5a8f3-add6-4d46-a6f8-5d36abbaf6eb req-7337ef90-bf05-4b7b-8224-d463eb241637 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.658003 Oct 17 12:54:45.439062 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 854/1699] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:54:45.450107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1b36289-7b0f-4985-a6ee-e8ba71ce6dd6 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Action: 'create', calling method: .version_select at 0x7fa8209de670>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-931481125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3YWcUQ/RxBXW2wKmhM1nIbttvslYjAVxXQMjcwK7PiCmS2CllAVk8vlWiC6jwfL3aeATZUddeZf6e0qoHJw7MGJ1D4yBdtZJaVgrfKVzRt3necbwxC5ezErknNmtZQYw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:45.493815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d1b36289-7b0f-4985-a6ee-e8ba71ce6dd6 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Getting quotas for project 493e79b70a904e0b8556757082b9458f. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:45.508401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d1b36289-7b0f-4985-a6ee-e8ba71ce6dd6 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Getting quotas for user f776019598d34be491112128a5ab0918 and project 493e79b70a904e0b8556757082b9458f. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:45.559111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1b36289-7b0f-4985-a6ee-e8ba71ce6dd6 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.117670 Oct 17 12:54:45.559732 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 855/1700] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 12:54:45 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 12:54:45.565568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:45.567447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:45.575698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.576356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.576814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.578045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.578493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.579022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.688044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.689957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.693668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.694635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lazy-loading 'fault' on Instance uuid d262a90f-1d00-482c-9097-8d9aff357605 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:45.784753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:45.809676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:45.810591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:45.813543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:45.821332 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a673633e-1785-4433-9144-bb596808b647 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1281 microversion: 2.25 time: 0.693173 Oct 17 12:54:45.842553 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 846/1701] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:45 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1281 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:45.846014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:45.847187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:45.851919 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c8adbe08-42bc-49d1-a5c3-f9bc15592ddd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1307 microversion: 2.1 time: 0.284952 Oct 17 12:54:45.852576 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 856/1702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:45 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:45.872921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-931481125", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:45.885698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:45.887103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.887974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.891170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.896775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.898896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.900438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.901293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.905046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.905046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.908072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:45.908558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:45.910755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:45.992335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:46.134006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:54:46.136701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:54:46.137200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:54:46.137614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:54:46.138027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:54:46.283786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:46.292679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:46.293602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:46.295033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:46.296126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:46.296849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:46.297572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:46.349133 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5179b17b-061b-4656-985e-bae5099feb7a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "POST /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b/action" status: 202 len: 1138 microversion: 2.54 time: 0.484333 Oct 17 12:54:46.350119 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 857/1703] 10.222.0.27 () {62 vars in 1320 bytes} [Mon Oct 17 12:54:45 2022] POST /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b/action => generated 1138 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 12:54:46.364886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:46.366091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:46.374374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:46.377046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:46.380915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:46.384041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:46.386880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:46.388261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:46.561646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:46.575939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:46.578757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:46.590498 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a91d134-bf96-49a5-8d85-4e1a6ef6b6f9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.237173 Oct 17 12:54:46.592577 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 858/1704] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:46 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:46.610480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:46.623617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:46.636872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:46.638866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:46.644904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:46.646861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:46.647959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:46.648706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:46.819205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:46.842022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5336ef4-a6bd-4b67-961c-f4d266e6855e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 1.007616 Oct 17 12:54:46.886184 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 847/1705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:45 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:46.956163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:46.960811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:46.970244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:46.999850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.013585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.014176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.014547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:47.015271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.015719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.016141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:47.025134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.026624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.027837 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d618975a-b365-4a42-822b-6ab638c10f11 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.434039 Oct 17 12:54:47.046646 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 859/1706] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:46 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:47.066523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:47.067028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:47.090395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.091296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.092089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:47.093383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.108584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.108987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:47.275437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.276373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.276828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:47.277313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lazy-loading 'fault' on Instance uuid d262a90f-1d00-482c-9097-8d9aff357605 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:47.388533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.400008 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-22cc05f4-d51f-41e0-ae50-ac14e6ef1a75 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 200 len: 1307 microversion: 2.1 time: 0.354488 Oct 17 12:54:47.414968 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 860/1707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:47 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:47.469374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.486264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.491871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.493508 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-625c4a11-978d-493c-b8f2-f1391b64fc00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1477 microversion: 2.25 time: 0.600307 Oct 17 12:54:47.498542 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 848/1708] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:46 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1477 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:47.623784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:47.624640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:47.638667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.639500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.643098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:47.644771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.645417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.649037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:47.804022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.841595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.846376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:47.861395 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4a044cc-eb2a-422a-8603-63fe073147f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.242702 Oct 17 12:54:47.863816 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 849/1709] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:47 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:54:47.900753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:47.902506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:47.924215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.927391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.928414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:47.929418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:47.930049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:47.932180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:48.163045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:48.164238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:48.178361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:48.179107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:48.179764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:48.181020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:48.181758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:48.182413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:48.359027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:48.373790 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-21c81067-59b0-4d25-a46a-fcd1f86cc0a4 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 0.482538 Oct 17 12:54:48.379079 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 850/1710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:47 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:48.571082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid 668320eb-1f68-4fcd-addd-aef8b2271f2a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:48.614536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:48.620874 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1281950-d5b7-4d0f-ba92-377a0b5dc1e6 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1972 microversion: 2.25 time: 1.099599 Oct 17 12:54:48.622257 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 861/1711] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:47 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1972 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:48.646115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:48.647415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:48.659860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:48.660350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:48.660851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:48.661561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:48.662094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:48.662468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:48.828420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-132786193", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "ab875c4f-87a3-4bf3-a48a-3e1cbefa8c2f"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:48.873649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:48.879958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:48.898921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:48.903666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:48.908044 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbfcecf3-a146-48be-a75b-6e180c802a72 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.267631 Oct 17 12:54:48.925221 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 862/1712] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:48 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:48.946639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:48.948818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: d262a90f-1d00-482c-9097-8d9aff357605] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:48.955377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] validate_networks() for [('ab875c4f-87a3-4bf3-a48a-3e1cbefa8c2f', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:54:48.971085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:48.971581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:48.973395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:48.974192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:48.974909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:48.975176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:49.041964 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] HTTP exception thrown: Instance d262a90f-1d00-482c-9097-8d9aff357605 could not be found. Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Request method failure captured: Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 HTTP/1.1 Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_TUqYvyKAqyEgY3pwoyPmnLqEIV8EuG7UbdXAao43RYDng0qsbEswAHfrkIrudns39nTN4Ps0A0i-VT_JsAHRgcaILBQTH_hu-G9qJQAWwFLeH8jo3l3EBMJLKYnRiuHB6bbuN6UxHwWtFAtkF913NG48uvXVgfj-wSnh6--JgH9o Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4fdb785bf6b41a68f157d51d763052a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6e4b8603784d4a3ca87cb2b6d1412b89 Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d262a90f-1d00-482c-9097-8d9aff357605 could not be found. Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd262a90f-1d00-482c-9097-8d9aff357605'} Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d262a90f-1d00-482c-9097-8d9aff357605 could not be found. Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d262a90f-1d00-482c-9097-8d9aff357605 could not be found. Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:49.054555 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:49.059592 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:49.059592 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:49.059592 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:49.059592 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:49.059592 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:49.059592 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d262a90f-1d00-482c-9097-8d9aff357605 could not be found. Oct 17 12:54:49.059592 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:54:49.062468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Returning 404 to user: Instance d262a90f-1d00-482c-9097-8d9aff357605 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:49.064812 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0e2f715-c189-485c-90d5-d3e6ba2853cd tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605" status: 404 len: 111 microversion: 2.1 time: 0.137546 Oct 17 12:54:49.066318 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 863/1713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:48 2022] GET /compute/v2.1/servers/d262a90f-1d00-482c-9097-8d9aff357605 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:49.072849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:49.074484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:49.084653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:49.085769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:49.086701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:49.088517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:49.089443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:49.090355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:49.383518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid 668320eb-1f68-4fcd-addd-aef8b2271f2a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:49.412589 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90ea9215-6275-4014-bd86-e989f40dc14c tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1972 microversion: 2.25 time: 0.344837 Oct 17 12:54:49.415090 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 864/1714] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:49 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1972 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:49.421590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:49.435371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:49.469793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:49.472607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:49.478717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:49.479627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:49.480218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:49.481854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:49.597172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=16 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:49.692352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:49.703178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:49.708293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:49.726490 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c38047d7-d53d-40ee-88b1-65e1f28537db tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.308725 Oct 17 12:54:49.727475 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 865/1715] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:49 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:49.732244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:49.732987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: b7f172c4-86e8-4996-bbd3-70fbbd71f382] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:49.747148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:49.747958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:49.748680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:49.749617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:49.750322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:49.750961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:49.808633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: b7f172c4-86e8-4996-bbd3-70fbbd71f382] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:50.046308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:54:50.047440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:54:50.048160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:54:50.048935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:54:50.049654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:54:50.055624 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c13f31af-d004-4094-be3c-4d00b17b8a15 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382" status: 204 len: 0 microversion: 2.1 time: 0.326662 Oct 17 12:54:50.058886 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 866/1716] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:49 2022] DELETE /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:50.065243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:50.067100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:50.070703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.071229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.072990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.073739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.075742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.078688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.079178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.080178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.080760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.081949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.083322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.083923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.121170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Getting quotas for project 450b3f93e96f43ba9c4c64f3552f934c. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:50.132813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Getting quotas for user 9a1e4aea1c6c4ca9a9960e814a7ea07c and project 450b3f93e96f43ba9c4c64f3552f934c. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:50.159017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:54:50.168375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:54:50.259607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1146d7a-7e01-45d2-bf97-1c31190fa9e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878954 Oct 17 12:54:50.260731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 851/1717] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:54:50.266783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3bf04a3a-7ace-4331-9be9-6de543190f9a tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:50.272521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf04a3a-7ace-4331-9be9-6de543190f9a tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.273189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf04a3a-7ace-4331-9be9-6de543190f9a tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.273663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf04a3a-7ace-4331-9be9-6de543190f9a tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.274613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf04a3a-7ace-4331-9be9-6de543190f9a tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.275069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf04a3a-7ace-4331-9be9-6de543190f9a tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.275544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf04a3a-7ace-4331-9be9-6de543190f9a tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.324031 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3bf04a3a-7ace-4331-9be9-6de543190f9a tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.061559 Oct 17 12:54:50.333466 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 852/1718] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 17 12:54:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:54:50.606770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3855c8a6-e97b-4225-9fe5-37927015382c tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Action: 'create', calling method: .version_select at 0x7fa820bba9d0>, body: {"keypair": {"name": "tempest-keypair-2130961967", "type": "ssh", "user_id": "3af960f026ae49eb8b36ab7d1ffd14de", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP+D5CyisC6RLNrDgWhAE4oEFM3xbZL3Gpsw7IWspAawn/lVv51qr5G3o0u6Mxuxre/xb8VxRy6PRLBylxrukwTmiMYP1rtgRBFXA20qnXg7tpMmuKcQuPPiBAiMx2Huw=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:50.631281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-3855c8a6-e97b-4225-9fe5-37927015382c tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Getting quotas for project a4f133fb70f94a15830d68f5ec750ad5. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:50.635956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-3855c8a6-e97b-4225-9fe5-37927015382c tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Getting quotas for user e57989db6525413e97bf579b09a5c8db and project a4f133fb70f94a15830d68f5ec750ad5. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:50.679631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:50.680199 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3855c8a6-e97b-4225-9fe5-37927015382c tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.345287 Oct 17 12:54:50.680907 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 853/1719] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 12:54:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 347 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 12:54:50.700163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:50.701178 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f2dea891-c695-4435-a4a0-0ef1d115c967 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 0.640581 Oct 17 12:54:50.704422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:50.707618 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 867/1720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:50 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:50.717258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:50.717755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:50.735944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.740223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.743099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.744368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.744867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.745097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.745301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.746003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.746474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.746695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.746893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.748106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.831649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:50.858889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:50.886470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:50.890816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:50.895388 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b887eb01-afa2-443c-b9e8-53c6c59e365a tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.211661 Oct 17 12:54:50.897766 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 854/1721] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:50 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:50.911125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3a5df46c-ab7c-449f-9dda-e18a9b3af11c req-9543bec8-747b-472a-a305-6c914d558a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdcbc7c-5033-4c97-9d0d-c949a0afe70b", "name": "network-vif-plugged", "status": "completed", "tag": "8b0cc8df-c676-4f6a-95cc-63c24aa2d7e3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:50.937218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a5df46c-ab7c-449f-9dda-e18a9b3af11c req-9543bec8-747b-472a-a305-6c914d558a04 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:50.941337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a5df46c-ab7c-449f-9dda-e18a9b3af11c req-9543bec8-747b-472a-a305-6c914d558a04 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:50.941963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a5df46c-ab7c-449f-9dda-e18a9b3af11c req-9543bec8-747b-472a-a305-6c914d558a04 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:50.974321 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3a5df46c-ab7c-449f-9dda-e18a9b3af11c req-9543bec8-747b-472a-a305-6c914d558a04 service nova] Creating event network-vif-plugged:8b0cc8df-c676-4f6a-95cc-63c24aa2d7e3 for instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b on n-h1-853316-12 Oct 17 12:54:50.983052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3a5df46c-ab7c-449f-9dda-e18a9b3af11c req-9543bec8-747b-472a-a305-6c914d558a04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083488 Oct 17 12:54:50.988424 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 855/1722] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:51.015015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cfd05c61-97ba-4b70-a2b7-f642057fc4ca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:51.016530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cfd05c61-97ba-4b70-a2b7-f642057fc4ca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:51.020846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-990a2464-9942-44f0-b35c-eb2b1a08eacb tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 204 len: 0 microversion: 2.1 time: 0.311342 Oct 17 12:54:51.021775 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 868/1723] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:50 2022] DELETE /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:51.030014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853316-12", "block_migration": "auto"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:51.035199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:51.043013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:51.044071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:51.044986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:51.046370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:51.047131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:51.047775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:51.102948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'flavor' on Instance uuid 668320eb-1f68-4fcd-addd-aef8b2271f2a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:54:51.124839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Going to try to live migrate instance to n-h2-853316-12 {{(pid=127540) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 12:54:51.129455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cfd05c61-97ba-4b70-a2b7-f642057fc4ca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:51.156546 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cfd05c61-97ba-4b70-a2b7-f642057fc4ca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1224 microversion: 2.1 time: 0.160882 Oct 17 12:54:51.170688 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 856/1724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:50 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1224 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:51.184760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-871b4397-3e28-42cd-864b-14185c69ff18 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Action: 'create', calling method: .version_select at 0x7fa820f26f70>, body: {"keypair": {"name": "tempest-keypair-1959439706", "type": "ssh", "user_id": "3af960f026ae49eb8b36ab7d1ffd14de", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfpA/bU/ZhnZMRkTBYdVz9aHvjlj/UWZ9dltvo7vIm6ON7KhofQrbk2NypKI2F9L42tMUlvuyOFDSSyxwR0qe7C4KcJ9aytEfj3i2aQR9u4MmGydxZAJK74kRo1s823rQ=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:51.225198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-871b4397-3e28-42cd-864b-14185c69ff18 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Getting quotas for project a4f133fb70f94a15830d68f5ec750ad5. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:51.231958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-871b4397-3e28-42cd-864b-14185c69ff18 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Getting quotas for user e57989db6525413e97bf579b09a5c8db and project a4f133fb70f94a15830d68f5ec750ad5. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:51.291645 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-871b4397-3e28-42cd-864b-14185c69ff18 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.118393 Oct 17 12:54:51.299267 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 857/1725] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 12:54:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 12:54:51.306178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:51.306858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:51.320131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:51.320627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:51.322966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:51.326424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:51.326927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:51.327357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:51.464320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:51.479043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:51.480705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:51.493987 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd55b020-e9ba-4a52-8b55-aa3f2fa289d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.192878 Oct 17 12:54:51.497846 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 858/1726] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:51 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:51.526099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:51.527074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: b7f172c4-86e8-4996-bbd3-70fbbd71f382] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:51.560681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:51.561089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:51.561529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:51.562272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:51.562724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:51.563229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:51.980223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:51.993209 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62bbfe3d-b5d2-4e21-8901-490170e67032 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382" status: 200 len: 1474 microversion: 2.1 time: 0.492387 Oct 17 12:54:51.996371 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 859/1727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:51 2022] GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382 => generated 1474 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:52.007973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a15c7ef4-e1a3-4501-b176-55a191f97cb0 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Calling method '.version_select at 0x7fa820bba0d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:52.027519 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a15c7ef4-e1a3-4501-b176-55a191f97cb0 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-2130961967?user_id=3af960f026ae49eb8b36ab7d1ffd14de" status: 200 len: 513 microversion: 2.10 time: 0.027553 Oct 17 12:54:52.032860 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 860/1728] 10.222.0.27 () {60 vars in 1340 bytes} [Mon Oct 17 12:54:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2130961967?user_id=3af960f026ae49eb8b36ab7d1ffd14de => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:54:52.039109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:52.040119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:52.049532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:52.051129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:52.052044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:52.053176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:52.054656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:52.055350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:52.486075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:52.498988 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7234bb2-e5b4-4e8f-bad6-dbb97b4e40e9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1293 microversion: 2.1 time: 0.464364 Oct 17 12:54:52.514189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 861/1729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:52 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1293 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:52.536845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:52.545911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:52.562379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:52.562877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:52.563314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:52.564049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:52.564522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:52.565173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:52.702126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:52.725858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:52.736795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:52.742454 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f37d18ea-1c87-4d86-a489-81a00105a852 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.234895 Oct 17 12:54:52.743877 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 862/1730] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:52 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:52.787863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e50c1f9e-a1e6-48ab-a94a-e646cb5adbec tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Action: 'create', calling method: .version_select at 0x7fa820f26a60>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1362662600", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMjrNZBS8aJxF/v1bdL9xohPVaq7EIe3Nzy/ZhvilLosfZ3lQf4mVVoPbnSe3hGZKBVCEQ1uDC5NOxBR+AgjbLGgxTrTLJoOqYUlmizYyk0ee3djKi4FcoE5MSmDJL1Ug=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:52.841342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e50c1f9e-a1e6-48ab-a94a-e646cb5adbec tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Getting quotas for project a4f133fb70f94a15830d68f5ec750ad5. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:54:52.848560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e50c1f9e-a1e6-48ab-a94a-e646cb5adbec tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Getting quotas for user e57989db6525413e97bf579b09a5c8db and project a4f133fb70f94a15830d68f5ec750ad5. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:54:52.895514 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e50c1f9e-a1e6-48ab-a94a-e646cb5adbec tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.141968 Oct 17 12:54:52.906821 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 863/1731] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 12:54:52 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 12:54:52.922988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:52.924197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:52.934870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:52.935793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:52.936864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:52.938849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:52.939972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:52.940823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:53.929934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:53.939564 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6352989d-36fe-4e32-bf3c-f710a7e62baf tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1284 microversion: 2.1 time: 1.031131 Oct 17 12:54:53.952582 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 864/1732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:52 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1284 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:53.960611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:53.963200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:53.975969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:53.983558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:53.984581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:53.985529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:53.986197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:53.986829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:54.334946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:54.345290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:54.347437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:54.387210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5481579-724d-49a9-80f2-1e472cc69924 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.433164 Oct 17 12:54:54.413843 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 865/1733] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:53 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:54.420885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2542ea90-efb3-43d7-b0e6-de151ec07db9 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Calling method '.version_select at 0x7fa820c61670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:54.425976 n-d-853316-12 devstack@n-api.service[127539]: WARNING oslo_db.sqlalchemy.utils [None req-2542ea90-efb3-43d7-b0e6-de151ec07db9 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 12:54:54.435107 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2542ea90-efb3-43d7-b0e6-de151ec07db9 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=3af960f026ae49eb8b36ab7d1ffd14de" status: 200 len: 726 microversion: 2.10 time: 0.018145 Oct 17 12:54:54.444949 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 866/1734] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 17 12:54:54 2022] GET /compute/v2.1/os-keypairs?user_id=3af960f026ae49eb8b36ab7d1ffd14de => generated 726 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:54:54.449553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:54.450723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: b7f172c4-86e8-4996-bbd3-70fbbd71f382] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:54.459894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:54.460523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:54.461179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:54.462357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:54.462887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:54.463439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:55.157481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:55.172735 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d10fa86-bef0-4129-8d2f-b7750822a437 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382" status: 200 len: 1432 microversion: 2.1 time: 0.728502 Oct 17 12:54:55.173435 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 867/1735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:54 2022] GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382 => generated 1432 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:55.188779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:55.191437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:55.208814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:55.209517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:55.210449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:55.212816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:55.213294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:55.219634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:55.435702 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9dfadd83-3b49-474e-9f63-e0c5ef216922 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a/action" status: 202 len: 0 microversion: 2.25 time: 4.412239 Oct 17 12:54:55.436868 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 869/1736] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:54:51 2022] POST /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a/action => generated 0 bytes in 4414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:55.452886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:55.453841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:55.488406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:55.489148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:55.489843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:55.502195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:55.503618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:55.504085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:55.525588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:55.793888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:55.803465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:55.818278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:55.821814 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-84767699-1f2b-4a7b-a26f-18f7bfe1e232 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.383825 Oct 17 12:54:55.842832 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 870/1737] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:55 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:55.849605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1fac07f-22d6-4b31-831c-94a149ace4a5 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Calling method '.version_select at 0x7fa82095f3a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:55.892089 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1fac07f-22d6-4b31-831c-94a149ace4a5 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1362662600" status: 204 len: 0 microversion: 2.10 time: 0.054506 Oct 17 12:54:55.892940 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 871/1738] 10.222.0.27 () {60 vars in 1325 bytes} [Mon Oct 17 12:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1362662600 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:54:55.902093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6e42a7ad-bf78-47ee-9d42-1b7451d7785a req-b4776305-9fbe-4af8-8cdb-861b7407b149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f172c4-86e8-4996-bbd3-70fbbd71f382", "name": "network-vif-deleted", "tag": "af064635-ae9c-4661-b2fa-1d7e93368c37"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:55.930115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6e42a7ad-bf78-47ee-9d42-1b7451d7785a req-b4776305-9fbe-4af8-8cdb-861b7407b149 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:55.930892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6e42a7ad-bf78-47ee-9d42-1b7451d7785a req-b4776305-9fbe-4af8-8cdb-861b7407b149 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:55.931603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6e42a7ad-bf78-47ee-9d42-1b7451d7785a req-b4776305-9fbe-4af8-8cdb-861b7407b149 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:55.955908 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6e42a7ad-bf78-47ee-9d42-1b7451d7785a req-b4776305-9fbe-4af8-8cdb-861b7407b149 service nova] Creating event network-vif-deleted:af064635-ae9c-4661-b2fa-1d7e93368c37 for instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 on n-h2-853316-12 Oct 17 12:54:55.970362 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6e42a7ad-bf78-47ee-9d42-1b7451d7785a req-b4776305-9fbe-4af8-8cdb-861b7407b149 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075293 Oct 17 12:54:55.970902 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 872/1739] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:55.977070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:55.977782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:56.002568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.003465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.004146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.005041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.005665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.006289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.022824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:56.028486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:56.063065 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19dce17c-f06f-4beb-93c6-799059f58e7f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1484 microversion: 2.1 time: 0.887624 Oct 17 12:54:56.063694 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 868/1740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:55 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1484 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:56.095913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:56.096536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:56.114566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.116057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.116505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.118470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.119957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.122591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.284005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:56.290511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:56.300624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:56.303665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:56.305873 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff99ffd0-bd45-4985-92ad-62911e006a42 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1282 microversion: 2.1 time: 0.333210 Oct 17 12:54:56.318187 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d74a443-37b5-4148-b870-f5a2bd7a7a28 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.243020 Oct 17 12:54:56.318836 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 873/1741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:55 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1282 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:56.331142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:56.332131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:56.337132 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 869/1742] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:56 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:56.348057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e3300ec3-d4ca-4723-a487-36ea92a8f972 req-77beeb98-b670-45b4-a655-ea25e033788a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaad0a9a-92c7-4a1c-b7de-a0818785dff5", "name": "network-vif-deleted", "tag": "16e3a732-45d1-4e38-8f45-ed7b0da98a9b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:54:56.350143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.350908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.351610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.352621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.353309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:56.353539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.354609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.367817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e3300ec3-d4ca-4723-a487-36ea92a8f972 req-77beeb98-b670-45b4-a655-ea25e033788a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.368355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e3300ec3-d4ca-4723-a487-36ea92a8f972 req-77beeb98-b670-45b4-a655-ea25e033788a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.368746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e3300ec3-d4ca-4723-a487-36ea92a8f972 req-77beeb98-b670-45b4-a655-ea25e033788a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.397697 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e3300ec3-d4ca-4723-a487-36ea92a8f972 req-77beeb98-b670-45b4-a655-ea25e033788a service nova] Creating event network-vif-deleted:16e3a732-45d1-4e38-8f45-ed7b0da98a9b for instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 on n-h1-853316-12 Oct 17 12:54:56.408499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e3300ec3-d4ca-4723-a487-36ea92a8f972 req-77beeb98-b670-45b4-a655-ea25e033788a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066046 Oct 17 12:54:56.410136 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 870/1743] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:56.426511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f6c39e29-82c9-47a7-ac09-c4d2e4989539 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Calling method '.version_select at 0x7fa820f26160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:56.491798 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f6c39e29-82c9-47a7-ac09-c4d2e4989539 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959439706?user_id=3af960f026ae49eb8b36ab7d1ffd14de" status: 204 len: 0 microversion: 2.10 time: 0.078503 Oct 17 12:54:56.492470 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 871/1744] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959439706?user_id=3af960f026ae49eb8b36ab7d1ffd14de => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:54:56.497354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:56.498065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:56.513993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.514656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.515146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.515947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.516476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.517074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.696513 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5cf1069d-d30c-4b7c-ab51-808e0c73ed05 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.202874 Oct 17 12:54:56.697433 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 872/1745] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 12:54:56 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:54:56.702013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:56.702661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: b7f172c4-86e8-4996-bbd3-70fbbd71f382] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:56.727017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.727522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.727967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.728687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.729146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.729565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.762025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] HTTP exception thrown: Instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 could not be found. Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Request method failure captured: Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382 HTTP/1.1 Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_TUqYvyKAqyEgY3pwoyPmnLqEIV8EuG7UbdXAao43RYDng0qsbEswAHfrkIrudns39nTN4Ps0A0i-VT_JsAHRgcaILBQTH_hu-G9qJQAWwFLeH8jo3l3EBMJLKYnRiuHB6bbuN6UxHwWtFAtkF913NG48uvXVgfj-wSnh6--JgH9o Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4fdb785bf6b41a68f157d51d763052a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6e4b8603784d4a3ca87cb2b6d1412b89 Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 could not be found. Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'b7f172c4-86e8-4996-bbd3-70fbbd71f382'} Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 could not be found. Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 could not be found. Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:56.767839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 could not be found. Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Returning 404 to user: Instance b7f172c4-86e8-4996-bbd3-70fbbd71f382 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:56.774003 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25ac6e8b-48f6-48d7-89c8-ad0d251868cf tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382" status: 404 len: 111 microversion: 2.1 time: 0.071476 Oct 17 12:54:56.782806 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 873/1746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:56 2022] GET /compute/v2.1/servers/b7f172c4-86e8-4996-bbd3-70fbbd71f382 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:56.799610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4db0fceb-e0b9-4ee6-8e86-2b83a7419e01 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] Calling method '.version_select at 0x7fa820f754c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:56.848704 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4db0fceb-e0b9-4ee6-8e86-2b83a7419e01 tempest-KeyPairsV210TestJSON-1302552832 tempest-KeyPairsV210TestJSON-1302552832-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130961967?user_id=3af960f026ae49eb8b36ab7d1ffd14de" status: 204 len: 0 microversion: 2.10 time: 0.060867 Oct 17 12:54:56.850154 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 874/1747] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 12:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130961967?user_id=3af960f026ae49eb8b36ab7d1ffd14de => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:54:56.859386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:56.864850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: aaad0a9a-92c7-4a1c-b7de-a0818785dff5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:56.874941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.875433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.875871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.876578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.877268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.877489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.927521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:56.931216 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] HTTP exception thrown: Instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 could not be found. Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Request method failure captured: Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 HTTP/1.1 Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU_TUqYvyKAqyEgY3pwoyPmnLqEIV8EuG7UbdXAao43RYDng0qsbEswAHfrkIrudns39nTN4Ps0A0i-VT_JsAHRgcaILBQTH_hu-G9qJQAWwFLeH8jo3l3EBMJLKYnRiuHB6bbuN6UxHwWtFAtkF913NG48uvXVgfj-wSnh6--JgH9o Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4fdb785bf6b41a68f157d51d763052a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6e4b8603784d4a3ca87cb2b6d1412b89 Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 could not be found. Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'aaad0a9a-92c7-4a1c-b7de-a0818785dff5'} Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 could not be found. Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 could not be found. Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:54:56.933234 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 could not be found. Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Returning 404 to user: Instance aaad0a9a-92c7-4a1c-b7de-a0818785dff5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8127d26-78bc-495f-8136-2fab90162f42 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5" status: 404 len: 111 microversion: 2.1 time: 0.083543 Oct 17 12:54:56.938390 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 875/1748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:56 2022] GET /compute/v2.1/servers/aaad0a9a-92c7-4a1c-b7de-a0818785dff5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:54:56.942202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:56.950270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:56.950916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:56.951333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:56.954450 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9624efed-474b-4553-84b4-76e47418eb01 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.634250 Oct 17 12:54:56.958376 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 874/1749] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:56 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:56.967978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.968717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.969323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.970246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:56.971584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:56.974794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:56.978403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fb9a6b3f-e1af-4122-9a9a-af4158fe6dd6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:57.069076 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fb9a6b3f-e1af-4122-9a9a-af4158fe6dd6 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/ddd7d891-47fe-455e-a024-f1d9ae7bafb3" status: 204 len: 0 microversion: 2.1 time: 0.108084 Oct 17 12:54:57.071521 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 875/1750] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:54:56 2022] DELETE /compute/v2.1/os-server-groups/ddd7d891-47fe-455e-a024-f1d9ae7bafb3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:57.111133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:57.114272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:57.143382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.144061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.144513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.150895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.151416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.151871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.163819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:57.177272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:57.181183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:57.185037 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8344c99b-8950-4772-80fa-376d2dd6dcf7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.244545 Oct 17 12:54:57.199877 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 876/1751] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:56 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:57.252082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:57.334059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:57.335604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:57.337571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:54:57.345779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.355694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.356286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.357038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.357510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.357945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.467411 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fdfb0c96-64aa-4a8b-894f-a33fa65d683d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 204 len: 0 microversion: 2.1 time: 0.391644 Oct 17 12:54:57.468616 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 876/1752] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:57 2022] DELETE /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:57.478944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:57.483315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:57.499002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.500947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.502067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.504304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.506135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.507449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.637178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:57.651487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:57.655361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:57.667520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a78cebae-b781-4b0f-b25e-daad5f810f90 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.196991 Oct 17 12:54:57.683446 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 877/1753] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:57 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:57.687678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:57.689033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:57.704907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.705749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.706681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.707713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.708396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.710812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.725225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:57.736964 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b404914-226f-4d29-bb45-2148fc7a723a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.405704 Oct 17 12:54:57.737787 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 877/1754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:57 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:54:57.770501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:54:57.951274 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b22698fc-f2e9-417b-9c83-eb894b71339c tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 204 len: 0 microversion: 2.1 time: 0.274198 Oct 17 12:54:57.953457 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 878/1755] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:54:57 2022] DELETE /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:54:57.962451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:57.963193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:57.978976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.979591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.980169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.980914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:57.981371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:57.981978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:57.987874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:57.988852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:58.001066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:58.001989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:58.002645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:58.004123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:58.005813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:58.007037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:58.580630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:58.598928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:58.601975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:58.606439 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9debf3ae-2e24-496b-907a-ba54a8053e74 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.622042 Oct 17 12:54:58.647426 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 879/1756] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:57 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:58.656555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:58.658142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:58.668408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:58.670152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:58.670817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:58.671879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:58.673543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:58.674696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:58.925622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:58.941815 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab27bb52-c2f6-4ce5-b3d7-9c8ba576d788 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 200 len: 1474 microversion: 2.1 time: 0.982707 Oct 17 12:54:58.944559 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 878/1757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:57 2022] GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 1474 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:58.959355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:58.963026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:58.980756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:58.981913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:58.982708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:58.983687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:58.987140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:58.988443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:59.195636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:59.210282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:59.216210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:59.235951 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c3f13b9-2374-42f8-baee-85814bbad8e9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.287073 Oct 17 12:54:59.237445 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 879/1758] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:58 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:59.272681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:59.273690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:59.284012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:59.285673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:59.300595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:59.301902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:59.302713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:59.303397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:59.434524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:59.462902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:59.478859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:59.481187 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08ca4b05-2ef5-44f4-8515-d80676a2a06b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.831092 Oct 17 12:54:59.482155 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 880/1759] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:58 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:54:59.648785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:59.649353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:54:59.663820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:59.667008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:59.669209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:59.672519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:54:59.673302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:54:59.675878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:54:59.928365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:54:59.977304 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e30c123-73f0-40c0-970b-7e4e48bdcca3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.737990 Oct 17 12:54:59.979796 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 880/1760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:59 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:54:59.985567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:54:59.986442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:00.001420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:00.013229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:00.023804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:00.024598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:00.025080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:00.025513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:00.286843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:01.040846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:01.076971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:01.096522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:01.108118 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-099988c2-d5cd-4585-b16a-55ec381290dd tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 1.462729 Oct 17 12:55:01.109018 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 881/1761] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:54:59 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:01.141191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:01.142474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:01.162478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:01.165659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:01.167509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:01.169307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:01.170353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:01.177788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:01.413107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:01.433035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:01.443814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:01.469619 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55c60b00-6399-4471-a1cb-6290a8cb75f6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.343903 Oct 17 12:55:01.471490 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 882/1762] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:01 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:01.477063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:01.477598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:01.480603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:01.491444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:01.491943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:01.492381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:01.493101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:01.493867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:01.493972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:01.660893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:01.670299 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e0b3187-ae98-4be6-9f26-95d90e7e774e tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 200 len: 1474 microversion: 2.1 time: 1.688924 Oct 17 12:55:01.679493 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 881/1763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:54:59 2022] GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 1474 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:01.704782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:01.705429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:01.739286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:01.740329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:01.741060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:01.742038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:01.743569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:01.744292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:02.082827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:02.124038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:02.138002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:02.142560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dfeeb73e-9bd8-4235-905a-e6e1f8806ce7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.666576 Oct 17 12:55:02.160849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 883/1764] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:01 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:02.178658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-52e1d57b-d8c7-4037-8cad-fb8fd6200e8f req-7a93773f-b6db-4845-ad4c-1801e12224e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b7cfee-a8d4-45b1-bc20-fbd5c901fca9", "tag": "5008942b-1b3e-4890-9804-8abe766b5efd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:02.248984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-52e1d57b-d8c7-4037-8cad-fb8fd6200e8f req-7a93773f-b6db-4845-ad4c-1801e12224e3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:02.255533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-52e1d57b-d8c7-4037-8cad-fb8fd6200e8f req-7a93773f-b6db-4845-ad4c-1801e12224e3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:02.258136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-52e1d57b-d8c7-4037-8cad-fb8fd6200e8f req-7a93773f-b6db-4845-ad4c-1801e12224e3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:02.288294 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-52e1d57b-d8c7-4037-8cad-fb8fd6200e8f req-7a93773f-b6db-4845-ad4c-1801e12224e3 service nova] Creating event network-changed:5008942b-1b3e-4890-9804-8abe766b5efd for instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 on n-h2-853316-12 Oct 17 12:55:02.318260 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-52e1d57b-d8c7-4037-8cad-fb8fd6200e8f req-7a93773f-b6db-4845-ad4c-1801e12224e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141823 Oct 17 12:55:02.319403 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 884/1765] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:02.329626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:02.337201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:02.353165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:02.353974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:02.355716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:02.356661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:02.359706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:02.361054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:02.860589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=20 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:03.021754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.053376 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ffa3e3d-9770-4f59-9362-55cfa66e6f70 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 1.372313 Oct 17 12:55:03.057261 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 882/1766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:01 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:03.063681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:03.064538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:03.074570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.075319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.075960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.077198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.077811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.078428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.192930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.206937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.215523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.235683 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a18a3b05-4a75-4445-8286-2cddc99d337a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.172732 Oct 17 12:55:03.252207 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 883/1767] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:03 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:03.266557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:03.267615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:03.275937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.276708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.277470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.289787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.294530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.301498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.476862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.485524 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b77d058f-40c4-41f7-89a3-f5b5ec4d7d9f tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 200 len: 1432 microversion: 2.1 time: 0.224019 Oct 17 12:55:03.498438 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 884/1768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:03 2022] GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 1432 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:03.498438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:03.498438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:03.518818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.519848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.520348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.524999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.525802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.526307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.527336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.530137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.535099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.536827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c5cc7af-e24d-4273-8f7f-fe7411f8c20c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 1.216223 Oct 17 12:55:03.564748 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 885/1769] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:02 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:03.570312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:03.570942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:03.594632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.595410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.596023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.597640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.598901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.600234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.767715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.783457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.797059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.809034 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e31e2ea4-49fd-4e2e-8120-6822c9428fa9 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.241177 Oct 17 12:55:03.810781 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 886/1770] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:03 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:03.821149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-fd9561bb-edd8-4de0-b884-2a98f72d94aa req-aca45012-39b8-4eb1-ba4d-b713b41063d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c0e4db-6bcf-4518-be71-cb588bcf1c91", "name": "network-vif-deleted", "tag": "6fde0fbd-1445-4000-9256-6e3c3be90e06"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:03.859102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:03.870216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fd9561bb-edd8-4de0-b884-2a98f72d94aa req-aca45012-39b8-4eb1-ba4d-b713b41063d5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:03.874886 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b28d82ee-54b2-4b91-a2ee-5aaaf1d898a6 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1484 microversion: 2.1 time: 0.387480 Oct 17 12:55:03.875726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fd9561bb-edd8-4de0-b884-2a98f72d94aa req-aca45012-39b8-4eb1-ba4d-b713b41063d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:03.875887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 885/1771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:03 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1484 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:03.878560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fd9561bb-edd8-4de0-b884-2a98f72d94aa req-aca45012-39b8-4eb1-ba4d-b713b41063d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:03.920304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-fd9561bb-edd8-4de0-b884-2a98f72d94aa req-aca45012-39b8-4eb1-ba4d-b713b41063d5 service nova] Creating event network-vif-deleted:6fde0fbd-1445-4000-9256-6e3c3be90e06 for instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 on n-h2-853316-12 Oct 17 12:55:03.942023 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-fd9561bb-edd8-4de0-b884-2a98f72d94aa req-aca45012-39b8-4eb1-ba4d-b713b41063d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129921 Oct 17 12:55:03.942837 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 887/1772] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:04.090579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:04.092133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:04.116209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:04.120475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:04.122717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:04.125157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:04.127352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:04.133756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:04.594558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:04.612094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1657c651-24a8-4ef2-8d53-6c715effd557 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.525572 Oct 17 12:55:04.613115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 886/1773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:04 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:04.625381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:04.626012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:04.647381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:04.648025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:04.649430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:04.650977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:04.653733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:04.655316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:04.826506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:04.847043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:04.849273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:04.870575 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c1780fda-db40-4aca-8e8a-f98286f8dd4f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.256263 Oct 17 12:55:04.871179 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 887/1774] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:04 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:04.903640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:04.904262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:04.933724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:04.936800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:04.937441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:04.939624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:04.941801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:04.942499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:05.025426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:05.025922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:05.032296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:05.033126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lazy-loading 'fault' on Instance uuid 05c0e4db-6bcf-4518-be71-cb588bcf1c91 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:05.064905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1783681180", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "816bf772-f9f1-45e5-9957-6ada6f09cb0c"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:05.160509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:05.197852 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6454499b-da0f-4d8d-8521-5fa3e3ccc4a9 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 200 len: 1309 microversion: 2.1 time: 0.278424 Oct 17 12:55:05.199443 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 888/1775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:04 2022] GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:05.241656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:05.242515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:05.255329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] validate_networks() for [('816bf772-f9f1-45e5-9957-6ada6f09cb0c', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:55:05.264525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:05.265604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:05.266403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:05.267520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:05.268809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:05.271239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:05.320360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:05.704402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:05.723528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:05.726877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:05.730732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3becab94-ca11-41d0-bcd2-0e17056ab55c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.505765 Oct 17 12:55:05.750358 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 889/1776] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:05 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:05.762020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-394166d0-c4ba-44ce-ac4a-f18d337d390e req-f27bd81e-dc9e-4ded-a3af-ef7c2faa0280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069204c4-71a6-4acd-92cd-c454ac2d1171", "name": "network-vif-deleted", "tag": "044e72ed-f732-475b-96fc-c6377eaa29cd"}, {"name": "network-changed", "server_uuid": "bfdcbc7c-5033-4c97-9d0d-c949a0afe70b", "tag": "8b0cc8df-c676-4f6a-95cc-63c24aa2d7e3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:05.795958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-394166d0-c4ba-44ce-ac4a-f18d337d390e req-f27bd81e-dc9e-4ded-a3af-ef7c2faa0280 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:05.796457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-394166d0-c4ba-44ce-ac4a-f18d337d390e req-f27bd81e-dc9e-4ded-a3af-ef7c2faa0280 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:05.797086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-394166d0-c4ba-44ce-ac4a-f18d337d390e req-f27bd81e-dc9e-4ded-a3af-ef7c2faa0280 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:05.854035 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-394166d0-c4ba-44ce-ac4a-f18d337d390e req-f27bd81e-dc9e-4ded-a3af-ef7c2faa0280 service nova] Creating event network-vif-deleted:044e72ed-f732-475b-96fc-c6377eaa29cd for instance 069204c4-71a6-4acd-92cd-c454ac2d1171 on n-h2-853316-12 Oct 17 12:55:05.857411 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-394166d0-c4ba-44ce-ac4a-f18d337d390e req-f27bd81e-dc9e-4ded-a3af-ef7c2faa0280 service nova] Creating event network-changed:8b0cc8df-c676-4f6a-95cc-63c24aa2d7e3 for instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b on n-h1-853316-12 Oct 17 12:55:05.878655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-394166d0-c4ba-44ce-ac4a-f18d337d390e req-f27bd81e-dc9e-4ded-a3af-ef7c2faa0280 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.119822 Oct 17 12:55:05.882481 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 890/1777] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:05.915969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:05.927966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:05.943505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:05.953169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:05.953909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:05.958032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:05.959024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:05.961647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:06.245139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:06.266573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:06.268761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:06.270610 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd088f45-c1b3-4816-b2de-12694b0984a2 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.383005 Oct 17 12:55:06.304334 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 891/1778] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:05 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:06.317611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:06.325589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:06.346610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:06.348174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:06.350701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:06.355896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:06.356917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:06.357887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:06.929565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:06.951133 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-73f5ed94-c54d-49f2-b839-6025e756fa13 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.644779 Oct 17 12:55:06.954733 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 892/1779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:06 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:06.976691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:06.977393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:06.994334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:55:06.994903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:55:06.996976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:55:06.997533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:55:06.998709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:55:07.007158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.007673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.008112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.012068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.012753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.015378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.023329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.023834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.024284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.025330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.027380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.029685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.079580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Getting quotas for project 36208644b7bf410c8cac37bdd22959df. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:55:07.089184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Getting quotas for user 8c1bddbdf5554e57a2abff13e3cf2341 and project 36208644b7bf410c8cac37bdd22959df. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:55:07.120850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:55:07.126312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:55:07.173219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.191281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.195815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.216762 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-acceb8e1-3625-4bec-a862-494a7e2eb63d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.013074 Oct 17 12:55:07.220586 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 888/1780] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3019 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 12:55:07.230140 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-58d1d51b-0e87-4ac1-8103-1b89a550c405 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.272613 Oct 17 12:55:07.239420 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 893/1781] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:06 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:07.256592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:07.259768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:07.277740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:07.278442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 05c0e4db-6bcf-4518-be71-cb588bcf1c91] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:07.281479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.283838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.286855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.292572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.294091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.296685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.297783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.298326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.299290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.300285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.300805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.301343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.353692 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] HTTP exception thrown: Instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 could not be found. Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Request method failure captured: Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 HTTP/1.1 Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_TUqYvyKAqyEgY3pwoyPmnLqEIV8EuG7UbdXAao43RYDng0qsbEswAHfrkIrudns39nTN4Ps0A0i-VT_JsAHRgcaILBQTH_hu-G9qJQAWwFLeH8jo3l3EBMJLKYnRiuHB6bbuN6UxHwWtFAtkF913NG48uvXVgfj-wSnh6--JgH9o Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4fdb785bf6b41a68f157d51d763052a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6e4b8603784d4a3ca87cb2b6d1412b89 Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 could not be found. Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '05c0e4db-6bcf-4518-be71-cb588bcf1c91'} Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 could not be found. Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 could not be found. Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:07.362528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.370636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:07.370636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:07.370636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:07.370636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:07.370636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:07.370636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 could not be found. Oct 17 12:55:07.370636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.373352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Returning 404 to user: Instance 05c0e4db-6bcf-4518-be71-cb588bcf1c91 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:07.374617 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e04051ac-a268-40c7-b9f7-55d86d885232 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91" status: 404 len: 111 microversion: 2.1 time: 0.151691 Oct 17 12:55:07.379106 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 889/1782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:07 2022] GET /compute/v2.1/servers/05c0e4db-6bcf-4518-be71-cb588bcf1c91 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:07.385232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3235fd7-35bf-4fa5-b2da-3473052c2026 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:07.386467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f3235fd7-35bf-4fa5-b2da-3473052c2026 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:07.454903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3235fd7-35bf-4fa5-b2da-3473052c2026 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.467732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3235fd7-35bf-4fa5-b2da-3473052c2026 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.470594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3235fd7-35bf-4fa5-b2da-3473052c2026 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.473525 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3235fd7-35bf-4fa5-b2da-3473052c2026 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1262 microversion: 2.26 time: 0.092728 Oct 17 12:55:07.486241 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 890/1783] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:07 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1262 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:07.503340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:07.504003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:07.513320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.513963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.514416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.515302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.515760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.516188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.604324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.619118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.621337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:07.623096 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db25300f-d99c-4ebc-8955-45f0b8943515 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.135328 Oct 17 12:55:07.623937 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 891/1784] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:07 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:07.629817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:07.631191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: 069204c4-71a6-4acd-92cd-c454ac2d1171] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:07.664874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.665769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.666746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.667781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.668501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.669738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.694479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] HTTP exception thrown: Instance 069204c4-71a6-4acd-92cd-c454ac2d1171 could not be found. Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Request method failure captured: Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 HTTP/1.1 Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_TUqYvyKAqyEgY3pwoyPmnLqEIV8EuG7UbdXAao43RYDng0qsbEswAHfrkIrudns39nTN4Ps0A0i-VT_JsAHRgcaILBQTH_hu-G9qJQAWwFLeH8jo3l3EBMJLKYnRiuHB6bbuN6UxHwWtFAtkF913NG48uvXVgfj-wSnh6--JgH9o Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4fdb785bf6b41a68f157d51d763052a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6e4b8603784d4a3ca87cb2b6d1412b89 Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 069204c4-71a6-4acd-92cd-c454ac2d1171 could not be found. Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '069204c4-71a6-4acd-92cd-c454ac2d1171'} Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069204c4-71a6-4acd-92cd-c454ac2d1171 could not be found. Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069204c4-71a6-4acd-92cd-c454ac2d1171 could not be found. Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:07.696191 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069204c4-71a6-4acd-92cd-c454ac2d1171 could not be found. Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Returning 404 to user: Instance 069204c4-71a6-4acd-92cd-c454ac2d1171 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91b30be3-c4fb-45c5-a931-5741ef48df01 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171" status: 404 len: 111 microversion: 2.1 time: 0.072826 Oct 17 12:55:07.701295 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 892/1785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:07 2022] GET /compute/v2.1/servers/069204c4-71a6-4acd-92cd-c454ac2d1171 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:07.709470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-64cbbacc-59f7-4c94-9b97-196542608337 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:07.756935 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-64cbbacc-59f7-4c94-9b97-196542608337 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/8d633d19-155c-46b7-9ed4-0198b3f57b6e" status: 204 len: 0 microversion: 2.1 time: 0.053580 Oct 17 12:55:07.758142 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 893/1786] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:55:07 2022] DELETE /compute/v2.1/os-server-groups/8d633d19-155c-46b7-9ed4-0198b3f57b6e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:55:07.769732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:07.770377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:07.782356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.783976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.784740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.786898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:07.787696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:07.788436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:07.868342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:55:07.952757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:08.038956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.051457 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5126aa25-830c-4311-a15f-ecde65ddf6ca tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 204 len: 0 microversion: 2.1 time: 0.288778 Oct 17 12:55:08.052461 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 894/1787] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:55:07 2022] DELETE /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:55:08.060211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.100314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.106761 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e3f5181-b33a-43fa-94a6-e1959a6d8980 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.862448 Oct 17 12:55:08.109345 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 894/1788] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:07 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:08.121605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:08.123387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:08.134968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.135590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.136134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.136960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.137532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.138068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.347637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e62cc727-5f1f-4150-afb5-f07c842e7852 tempest-QuotaClassesAdminTestJSON-782140200 tempest-QuotaClassesAdminTestJSON-782140200-project-admin] Calling method '.version_select at 0x7fa820950040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:08.373968 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e62cc727-5f1f-4150-afb5-f07c842e7852 tempest-QuotaClassesAdminTestJSON-782140200 tempest-QuotaClassesAdminTestJSON-782140200-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.320037 Oct 17 12:55:08.386720 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 895/1789] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 17 12:55:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:08.400625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:08.401375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:08.421923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.422375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.424317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.425651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.426244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.426683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.468562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.483473 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fdc81bd4-c511-4b61-a098-cd63cb411e7c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.372352 Oct 17 12:55:08.484520 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 895/1790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:08 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:08.499539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:08.500598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:08.507981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.508755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.509397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.510509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.511178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.512202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.625097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.637253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.639842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.648094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15525993-d957-4857-9906-0a6a2e5ce69c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.159090 Oct 17 12:55:08.649218 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 896/1791] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:08 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:08.655898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09de62fc-e59e-4755-92d4-ff413c5ce22f tempest-QuotaClassesAdminTestJSON-782140200 tempest-QuotaClassesAdminTestJSON-782140200-project-admin] Action: 'update', calling method: .version_select at 0x7fa820f26d30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:08.762089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.772736 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dee3be09-a805-4127-81a4-385079205743 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1472 microversion: 2.1 time: 0.376014 Oct 17 12:55:08.777899 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 896/1792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:08 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:08.783339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:08.792650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:08.815025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.816434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.817129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.818188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.818906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.819573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.929413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.958244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.960465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:08.962241 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-03d7175e-124f-4bc3-aa78-eef5281673c7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1266 microversion: 2.26 time: 0.182597 Oct 17 12:55:08.963172 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 897/1793] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:08 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:08.969282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:08.970032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:08.976931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.977767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.978487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:08.979447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:08.980131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:08.980814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:09.081856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2,nova_api:UPDATE=6,nova_api:INSERT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:09.104441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:09.119182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:09.121944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:09.123616 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d84afc8c-d70e-4a4b-af86-5c1f3d6e8ee3 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.158709 Oct 17 12:55:09.124948 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 898/1794] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:08 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:09.156587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:09.160785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:09.172935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:09.174053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:09.180472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:09.181776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:09.183954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:09.184942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:09.461453 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09de62fc-e59e-4755-92d4-ff413c5ce22f tempest-QuotaClassesAdminTestJSON-782140200 tempest-QuotaClassesAdminTestJSON-782140200-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.810926 Oct 17 12:55:09.462056 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 897/1795] 10.222.0.27 () {60 vars in 1206 bytes} [Mon Oct 17 12:55:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:09.482356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-73148910-53d8-4517-b444-bf79a0b977dd tempest-QuotaClassesAdminTestJSON-782140200 tempest-QuotaClassesAdminTestJSON-782140200-project-admin] Calling method '.version_select at 0x7fa820d97790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:09.509479 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-73148910-53d8-4517-b444-bf79a0b977dd tempest-QuotaClassesAdminTestJSON-782140200 tempest-QuotaClassesAdminTestJSON-782140200-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.031764 Oct 17 12:55:09.520580 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 898/1796] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 17 12:55:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:09.525732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:09.526378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:09.532842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:09.533389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:09.533875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:09.535952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:09.536416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:09.537072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:09.595635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:09.614745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:09.616408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:09.617771 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ccb2b8a-92f9-4b3d-b0e3-ffc82c5cca33 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.481184 Oct 17 12:55:09.630995 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 899/1797] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:09 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:09.647583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e5c9f964-a3fa-4c7d-bc3a-7c9b7147c01e tempest-QuotaClassesAdminTestJSON-782140200 tempest-QuotaClassesAdminTestJSON-782140200-project-admin] Action: 'update', calling method: .version_select at 0x7fa8209c9d30>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:09.794010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:09.806141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-657221c2-7a91-4878-a2f9-b56605f76d34 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.284010 Oct 17 12:55:09.810503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 899/1798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:09 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:09.836083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:09.837093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:09.870924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:09.874301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:09.874816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:09.878912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:09.879176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:09.879635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:09.927267 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e5c9f964-a3fa-4c7d-bc3a-7c9b7147c01e tempest-QuotaClassesAdminTestJSON-782140200 tempest-QuotaClassesAdminTestJSON-782140200-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.293081 Oct 17 12:55:09.945267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 900/1799] 10.222.0.27 () {60 vars in 1206 bytes} [Mon Oct 17 12:55:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:09.965599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:09.966755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:09.992548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:09.996875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:09.997320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.000654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.004143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.005175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.126605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.149821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.160757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.180798 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6858e04-4118-4331-8391-cf999fef5440 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.368853 Oct 17 12:55:10.181391 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 900/1800] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:09 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:10.216845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:10.218043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:10.242699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.243196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.243629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.244337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.246727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.247177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.429378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.444286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.446767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.451273 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-29c151ff-4f88-46a8-b727-bcf891adb2ce tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1314 microversion: 2.26 time: 0.258059 Oct 17 12:55:10.452058 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 901/1801] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:10 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:10.460055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:10.460559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:10.497961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.498559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.499006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.499740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.500198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.500626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.624867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.640659 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9f09868-4e4b-4d8c-87a4-3f5d47020943 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1472 microversion: 2.1 time: 0.688820 Oct 17 12:55:10.646373 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 901/1802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:09 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1472 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:10.686679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:10.687576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:10.727822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.728789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.729230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.729950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.730500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.730928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.914153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.929644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.940087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:10.942451 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a1af3d8c-e053-41a2-845a-bc127708b1f5 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.486823 Oct 17 12:55:10.947314 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 902/1803] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:10 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:10.960575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:10.961911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:10.974919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.978491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.979248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:10.980690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:10.983886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:10.984637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.229632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.244972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.247557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.249000 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-171cbd11-7009-4669-aea0-3ce782924468 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.583359 Oct 17 12:55:11.250088 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 902/1804] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:10 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:11.256353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-07cd0f1f-02d1-4590-8c8e-6bcd4c5a6d0e req-afe03328-985a-4392-88da-0df49c44b783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2607f9b-b14e-4bad-a241-9cd51a932b94", "name": "network-vif-deleted", "tag": "d90e1352-9e51-4e32-8730-1c0d674883b0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:11.285768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-07cd0f1f-02d1-4590-8c8e-6bcd4c5a6d0e req-afe03328-985a-4392-88da-0df49c44b783 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.286300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-07cd0f1f-02d1-4590-8c8e-6bcd4c5a6d0e req-afe03328-985a-4392-88da-0df49c44b783 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.287626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-07cd0f1f-02d1-4590-8c8e-6bcd4c5a6d0e req-afe03328-985a-4392-88da-0df49c44b783 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.302611 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-07cd0f1f-02d1-4590-8c8e-6bcd4c5a6d0e req-afe03328-985a-4392-88da-0df49c44b783 service nova] Creating event network-vif-deleted:d90e1352-9e51-4e32-8730-1c0d674883b0 for instance e2607f9b-b14e-4bad-a241-9cd51a932b94 on n-h2-853316-12 Oct 17 12:55:11.309367 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-07cd0f1f-02d1-4590-8c8e-6bcd4c5a6d0e req-afe03328-985a-4392-88da-0df49c44b783 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057497 Oct 17 12:55:11.314326 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 903/1805] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:11.323425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:11.324595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:11.335975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.336757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.338653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.339614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.340267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.341065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.381109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.405449 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9bf03e50-8799-49ad-aa37-f72b266b5e65 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.441605 Oct 17 12:55:11.406224 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 903/1806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:10 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:11.438961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d95add87-beb4-48f0-9621-c408563c2faf req-a306383a-ec28-4b45-b9bd-b096cc838482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b7cfee-a8d4-45b1-bc20-fbd5c901fca9", "name": "network-vif-plugged", "status": "completed", "tag": "5008942b-1b3e-4890-9804-8abe766b5efd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:11.459026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.465089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d95add87-beb4-48f0-9621-c408563c2faf req-a306383a-ec28-4b45-b9bd-b096cc838482 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.465574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d95add87-beb4-48f0-9621-c408563c2faf req-a306383a-ec28-4b45-b9bd-b096cc838482 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.466011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d95add87-beb4-48f0-9621-c408563c2faf req-a306383a-ec28-4b45-b9bd-b096cc838482 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.471825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.473936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.480897 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-03aa8062-c174-490a-8c00-ddf4b3a1ea4e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.163126 Oct 17 12:55:11.481846 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 904/1807] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:11 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:11.487282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:11.488014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:11.495062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.495700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.496145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.496957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.497500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.497937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.512581 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d95add87-beb4-48f0-9621-c408563c2faf req-a306383a-ec28-4b45-b9bd-b096cc838482 service nova] Creating event network-vif-plugged:5008942b-1b3e-4890-9804-8abe766b5efd for instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 on n-h2-853316-12 Oct 17 12:55:11.534684 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d95add87-beb4-48f0-9621-c408563c2faf req-a306383a-ec28-4b45-b9bd-b096cc838482 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099117 Oct 17 12:55:11.540063 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 904/1808] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:55:11.625332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.655459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.661146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.665496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a957b70-8d62-4431-ad47-883eae751b67 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1320 microversion: 2.26 time: 0.179293 Oct 17 12:55:11.670611 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 905/1809] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:11 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:11.676539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:11.677663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:11.702004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.702934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.703768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.704812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.714199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.714702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.770306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.770840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.771451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.771749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lazy-loading 'fault' on Instance uuid e2607f9b-b14e-4bad-a241-9cd51a932b94 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:11.850813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:11.874704 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b1e6be3-d9de-4af9-936b-9e5c02d5ca79 tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1307 microversion: 2.1 time: 0.202696 Oct 17 12:55:11.876408 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 905/1810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:11 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:11.976057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:11.976750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:11.980463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=13 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:11.990807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.991311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.995788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:11.996553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:11.997035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:11.997468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.267129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.282084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:12.282905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:12.292570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.292903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.293339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.294146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.296223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.297448 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac90a625-0eb3-4437-a552-3d4b9c5c48c4 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.325806 Oct 17 12:55:12.298009 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 906/1811] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:11 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:12.298542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.299226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.300504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.435725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:12.436827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:12.447051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.447255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.448441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.449384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.450288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.451417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.603499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.617163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.619398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.621265 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f7824c77-d9af-43a9-ae7b-db5972a56419 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.343560 Oct 17 12:55:12.622393 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 906/1812] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:12 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:12.629690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:12.631482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:12.639408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.640675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.641920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.642802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.644057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.644785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.653664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.664585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b12eebb9-4b23-49c2-a883-735c4b741b0c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.236912 Oct 17 12:55:12.665623 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 907/1813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:12 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:12.699945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:12.701098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:12.709648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.710460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.711497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.712494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.713305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.726519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.811784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.824244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.826470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.835882 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-606b3af1-5372-4e2a-8a04-2ad98fd6fb87 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1537 microversion: 2.91 time: 0.211818 Oct 17 12:55:12.836991 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 907/1814] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:12 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:12.899540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:12.900514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:12.907332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.907917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.908485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.910112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.910815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.911451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.949462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:12.950026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:12.950810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:12.951276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lazy-loading 'fault' on Instance uuid e2607f9b-b14e-4bad-a241-9cd51a932b94 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:12.970137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.979636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.981595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:12.982874 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b1462b1-d69a-4092-a07c-ee97cbc107e4 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.290318 Oct 17 12:55:12.983517 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 908/1815] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:12 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:13.009028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e4b8603784d4a3ca87cb2b6d1412b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fdb785bf6b41a68f157d51d763052a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:13.015423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:13.023936 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd1821f2-014f-49ee-8f94-6b2ac5cb544b tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 200 len: 1307 microversion: 2.1 time: 0.128298 Oct 17 12:55:13.025616 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 908/1816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:12 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:13.330298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:13.331370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:13.337930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:13.338694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:13.339223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:13.339985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:13.340680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:13.341364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:13.414261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:13.424350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:13.426925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:13.429933 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9f5ed90c-4baf-4644-9179-0915ea5db49c tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1407 microversion: 2.54 time: 0.102950 Oct 17 12:55:13.431092 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 909/1817] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:13 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:13.653523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:13.654121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:13.661076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:13.661568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:13.662004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:13.663522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:13.664455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:13.665274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:13.689085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:13.689710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:13.697770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:13.698399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:13.698902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:13.709976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:13.711081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:13.711402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:13.930828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:13.943304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20bfd3bf-873a-4b43-903f-35274071d485 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.258135 Oct 17 12:55:13.944168 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 910/1818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:13 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:13.951797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:13.952768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:13.960246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:13.960734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:13.961889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:13.963130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:13.963752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:13.963889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:13.964492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:13.975517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:13.977005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:13.978205 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2320967c-d904-4f94-b163-eaadb7d25713 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.329391 Oct 17 12:55:13.979495 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 909/1819] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:13 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:14.008866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:14.009505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:14.016395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.016889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.017320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:14.019163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.019628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.020053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:14.069843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.078929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.080562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.088194 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fa47dde2-7d11-459b-bfed-d66118a3b2f4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1537 microversion: 2.91 time: 0.142806 Oct 17 12:55:14.089080 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 911/1820] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:13 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:14.093494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:14.094350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] [instance: e2607f9b-b14e-4bad-a241-9cd51a932b94] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:14.101166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.101943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.102412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:14.103209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.103932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.104574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:14.124470 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] HTTP exception thrown: Instance e2607f9b-b14e-4bad-a241-9cd51a932b94 could not be found. Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Request method failure captured: Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 HTTP/1.1 Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU_TUqYvyKAqyEgY3pwoyPmnLqEIV8EuG7UbdXAao43RYDng0qsbEswAHfrkIrudns39nTN4Ps0A0i-VT_JsAHRgcaILBQTH_hu-G9qJQAWwFLeH8jo3l3EBMJLKYnRiuHB6bbuN6UxHwWtFAtkF913NG48uvXVgfj-wSnh6--JgH9o Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4fdb785bf6b41a68f157d51d763052a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4fdb785bf6b41a68f157d51d763052a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: f4fdb785bf6b41a68f157d51d763052a Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2126316396 Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6e4b8603784d4a3ca87cb2b6d1412b89 Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersOnMultiNodesTest-2126316396-project Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e2607f9b-b14e-4bad-a241-9cd51a932b94 could not be found. Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e2607f9b-b14e-4bad-a241-9cd51a932b94'} Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2607f9b-b14e-4bad-a241-9cd51a932b94 could not be found. Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2607f9b-b14e-4bad-a241-9cd51a932b94 could not be found. Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:14.126342 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2607f9b-b14e-4bad-a241-9cd51a932b94 could not be found. Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] Returning 404 to user: Instance e2607f9b-b14e-4bad-a241-9cd51a932b94 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:14.132044 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-77c6919d-5822-4878-90cf-e2977c59b38d tempest-ServersOnMultiNodesTest-2126316396 tempest-ServersOnMultiNodesTest-2126316396-project] 10.222.0.27 "GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94" status: 404 len: 111 microversion: 2.1 time: 0.040448 Oct 17 12:55:14.133310 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 912/1821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:14 2022] GET /compute/v2.1/servers/e2607f9b-b14e-4bad-a241-9cd51a932b94 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:14.257517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.274237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.276551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.277907 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0e444459-3680-4ed5-a5f6-d348a8b10f20 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.272873 Oct 17 12:55:14.279138 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 910/1822] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:14 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:14.465416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:14.468173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:14.484997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.485883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.486938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:14.489574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.490080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.490699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:14.587433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.602565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.604187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:14.605563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4645d854-b2c0-4456-bb0f-ae5273a578ed tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1425 microversion: 2.54 time: 0.146999 Oct 17 12:55:14.614214 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 913/1823] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:14 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1425 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:14.742006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d81cc4df-227e-4efc-aa26-13e24a77534f req-c62e9aa6-b210-44ca-bfe1-9242d044ad70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3f9b5d-f890-4bab-ab06-f817eb89583f", "tag": "bbff9c4d-1224-4974-a6a4-fa9ac3e884c3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:14.754934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d81cc4df-227e-4efc-aa26-13e24a77534f req-c62e9aa6-b210-44ca-bfe1-9242d044ad70 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.755459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d81cc4df-227e-4efc-aa26-13e24a77534f req-c62e9aa6-b210-44ca-bfe1-9242d044ad70 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.756417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d81cc4df-227e-4efc-aa26-13e24a77534f req-c62e9aa6-b210-44ca-bfe1-9242d044ad70 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:14.771602 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d81cc4df-227e-4efc-aa26-13e24a77534f req-c62e9aa6-b210-44ca-bfe1-9242d044ad70 service nova] Creating event network-changed:bbff9c4d-1224-4974-a6a4-fa9ac3e884c3 for instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f on n-h2-853316-12 Oct 17 12:55:14.778105 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d81cc4df-227e-4efc-aa26-13e24a77534f req-c62e9aa6-b210-44ca-bfe1-9242d044ad70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041891 Oct 17 12:55:14.779362 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 911/1824] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:14.974662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:14.975904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:14.986087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.987107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.988532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:14.989397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:14.990103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:14.990794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.072042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3b6db80-38d3-4832-a9f7-c13ca17dbe79 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Calling method '.version_select at 0x7fa820913f70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:15.260858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.271021 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5543aa02-f61b-4f89-bdcf-426c9c587d8b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1324 microversion: 2.1 time: 0.306165 Oct 17 12:55:15.271952 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 912/1825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:14 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1324 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:15.295786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:15.296817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:15.307413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.308226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.308991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.310042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.311021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.311977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.520466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3b6db80-38d3-4832-a9f7-c13ca17dbe79 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 371 microversion: 2.1 time: 0.644286 Oct 17 12:55:15.521368 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 914/1826] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 12:55:14 2022] GET /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 371 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:15.524977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.526841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:15.527719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:15.534067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.534514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.535573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.536182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.536564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.537452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.537761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.537900 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93298285-c994-4150-a146-0ad2a0d7bd9c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.250559 Oct 17 12:55:15.538519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.543418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:15.553411 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 913/1827] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:15 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:15.561201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:15.562507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:15.570681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.571175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.571694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.572525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.573422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.573938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.625218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.635939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.637762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.647003 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c4e673d3-6325-4b23-a435-9dda08dd0426 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1540 microversion: 2.91 time: 0.124412 Oct 17 12:55:15.647793 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 915/1828] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:15 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1540 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:15.655587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f586733d-f1ed-4daa-b3ba-9f1e206f146a tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Action: 'update', calling method: .version_select at 0x7fa8209503a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:15.741444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.751974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.754240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.757265 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-53cb6703-97c6-46d3-b1b3-bdbb9213a27e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.202283 Oct 17 12:55:15.758009 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 914/1829] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:15 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:15.763245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:15.764049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:15.773495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.774379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.774993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.775968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.776537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.776933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.855478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.865979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.867496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:15.868675 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7f4e1f9-d864-4afa-8a2b-b166ff67f389 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1413 microversion: 2.54 time: 0.109305 Oct 17 12:55:15.869242 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 915/1830] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:15 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:15.874107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:15.877472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:15.886420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.886915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.887354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.888044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.888498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.888930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.945248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f586733d-f1ed-4daa-b3ba-9f1e206f146a tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.946104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f586733d-f1ed-4daa-b3ba-9f1e206f146a tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.946748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f586733d-f1ed-4daa-b3ba-9f1e206f146a tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:15.947243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-853316-12". {{(pid=127539) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 12:55:15.947627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f586733d-f1ed-4daa-b3ba-9f1e206f146a tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:15.948083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f586733d-f1ed-4daa-b3ba-9f1e206f146a tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:15.948569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f586733d-f1ed-4daa-b3ba-9f1e206f146a tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.012776 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f586733d-f1ed-4daa-b3ba-9f1e206f146a tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 328 microversion: 2.1 time: 0.363771 Oct 17 12:55:16.013499 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 916/1831] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:55:15 2022] PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 328 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:16.031116 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c07b22cf-3144-4d67-87e7-3d3336b10c98 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5/action" status: 202 len: 0 microversion: 2.91 time: 0.160445 Oct 17 12:55:16.032766 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 916/1832] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:55:15 2022] POST /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:55:16.047484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:16.047990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:16.067020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:16.070830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:16.071861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.074061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:16.074716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:16.075203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.189481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:16.209137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:16.211377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:16.232887 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad8a5de7-b64d-4032-a2c2-a665a9e13d0c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1548 microversion: 2.91 time: 0.189274 Oct 17 12:55:16.233741 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 917/1833] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:16 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:16.298412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:16.299332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:16.311088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:16.311902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:16.312606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.313574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:16.314298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:16.314977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.502449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:16.516131 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1f029b06-dae1-4d54-80ba-250221f29bee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 0.221751 Oct 17 12:55:16.522261 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 918/1834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:16 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:16.541376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:16.542678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:16.550066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:16.550583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:16.551009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.551913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:16.552861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:16.553758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.706504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1627232729", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:16.747421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:16.760554 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9d32035e-18cd-4e86-978a-1eea0375dc86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 0.222062 Oct 17 12:55:16.762931 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 919/1835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:16 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:16.773085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:16.778086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:16.794581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:16.795092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:16.795534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.796477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:16.796937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:16.797358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:16.800691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:55:17.012456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.022548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.024038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.025278 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51daf2ac-67ad-4d1f-b3ac-a75449fd8a20 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.259978 Oct 17 12:55:17.026070 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 920/1836] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:16 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:17.030977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:17.031779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:17.038262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.038965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.039763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.040618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.041410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.041993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.129024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:55:17.129756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:55:17.130612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:55:17.131405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:55:17.132084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:55:17.141368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.141886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.142366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.143102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.144094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.144625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.163908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Getting quotas for project 9d95790536c64ea9a2544b487911c857. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:55:17.170233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Getting quotas for user e994bf2f7f60436f9da8680d19d7d8a8 and project 9d95790536c64ea9a2544b487911c857. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:55:17.185637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.utils [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] cores quota exceeded for 9d95790536c64ea9a2544b487911c857, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127539) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 12:55:17.186546 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Request method failure captured: Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 145 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCxA_SuH2z07vMyqqtWDuVj656Xh9WwxXNkAQY1OSviEAWu-yF6m5ctwftAsIj6wjQSzCF-PVu3Z9Vxrk1PLryOu3lKi4EVBoeUghKnqe88rTibkY4J-nMoXXDO5xtZ91MhrwXSQtLlGOl58DKnuXqF9VQ1IsK2f_ChqkpryIznsiQ Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 9d95790536c64ea9a2544b487911c857 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d95790536c64ea9a2544b487911c857", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d95790536c64ea9a2544b487911c857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d95790536c64ea9a2544b487911c857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d95790536c64ea9a2544b487911c857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 9d95790536c64ea9a2544b487911c857 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-QuotasAdminNegativeTest-961023848-project Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e994bf2f7f60436f9da8680d19d7d8a8 Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-QuotasAdminNegativeTest-961023848-project Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1627232729", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1627232729', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452'}}} Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 12:55:17.218197 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 12:55:17.225483 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.230892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:17.232221 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7c2e70a-edd7-4a0a-81d3-b49f0519863e tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.945164 Oct 17 12:55:17.232825 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 917/1837] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:55:16 2022] POST /compute/v2.1/servers => generated 111 bytes in 947 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:17.240333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db5632bd-5125-45a5-b8b5-586e50b65ae6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-289413493", "metadata": {"": ""}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:17.241571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db5632bd-5125-45a5-b8b5-586e50b65ae6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action HTTP/1.1 Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 106 Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-289413493", "metadata": {"": ""}}} Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '12b7cfee-a8d4-45b1-bc20-fbd5c901fca9', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-289413493', 'metadata': {'': ''}}}} Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'': ''} Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:17.245406 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:55:17.250821 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:17.252125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.256507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db5632bd-5125-45a5-b8b5-586e50b65ae6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:17.256815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.257701 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db5632bd-5125-45a5-b8b5-586e50b65ae6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action" status: 400 len: 170 microversion: 2.1 time: 0.023758 Oct 17 12:55:17.258622 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 918/1838] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 17 12:55:17 2022] POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:55:17.261504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a2ccfd0-f326-4bd3-bcfa-72840633ba0c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.234025 Oct 17 12:55:17.262352 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 921/1839] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:17 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:17.269700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:17.271246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:17.272523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-999438a2-d519-4e55-aea0-ce29628162c1 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Action: 'update', calling method: .version_select at 0x7fa82092a040>, body: {"quota_set": {"cores": 20}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:17.288580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.289302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.289962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.290930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.291497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.292093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.560635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.572718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.576219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.579023 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1fbadb22-a3cc-4efb-b9d8-acac9dd00ea0 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1413 microversion: 2.54 time: 0.319281 Oct 17 12:55:17.591411 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 919/1840] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:17 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1413 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:17.616848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:17.622089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:17.639744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-999438a2-d519-4e55-aea0-ce29628162c1 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.641334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.641796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-999438a2-d519-4e55-aea0-ce29628162c1 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.642557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-999438a2-d519-4e55-aea0-ce29628162c1 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.642904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.644212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.645130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-999438a2-d519-4e55-aea0-ce29628162c1 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.645978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-999438a2-d519-4e55-aea0-ce29628162c1 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.647094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-999438a2-d519-4e55-aea0-ce29628162c1 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.649155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.652488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.653259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.734471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-999438a2-d519-4e55-aea0-ce29628162c1 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 329 microversion: 2.1 time: 0.468379 Oct 17 12:55:17.735267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 922/1841] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:55:17 2022] PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 329 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:17.740730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:17.741352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:17.748641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.749670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.750114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.750894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:17.751355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:17.751826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:17.804270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.818076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.820472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:17.824367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:UPDATE=7,nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:17.828131 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c403d55f-6ff4-43dd-af52-821d4673cfef tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.227160 Oct 17 12:55:17.828722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 920/1842] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:17 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:17.835481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-185708a2-b9e2-4fc4-8dbd-cba9084f206d tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Calling method '.version_select at 0x7fa820c61670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:17.919836 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-185708a2-b9e2-4fc4-8dbd-cba9084f206d tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 371 microversion: 2.1 time: 0.089510 Oct 17 12:55:17.920449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 921/1843] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 12:55:17 2022] GET /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:17.932532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4fdb5ac-4036-4c14-9033-f2c9ebe956f3 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Action: 'update', calling method: .version_select at 0x7fa8252c21f0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:18.007659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.009567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4fdb5ac-4036-4c14-9033-f2c9ebe956f3 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.010051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4fdb5ac-4036-4c14-9033-f2c9ebe956f3 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.010725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4fdb5ac-4036-4c14-9033-f2c9ebe956f3 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.011461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4fdb5ac-4036-4c14-9033-f2c9ebe956f3 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.011915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4fdb5ac-4036-4c14-9033-f2c9ebe956f3 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.012347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4fdb5ac-4036-4c14-9033-f2c9ebe956f3 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.016679 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee963616-3d30-4730-8cf8-921056588e17 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 0.280364 Oct 17 12:55:18.017478 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 923/1844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:17 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:18.046639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:18.047307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:18.054204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.054972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.055402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.056100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.056729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.057313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.099127 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4fdb5ac-4036-4c14-9033-f2c9ebe956f3 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 328 microversion: 2.1 time: 0.170273 Oct 17 12:55:18.100437 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 922/1845] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:55:17 2022] PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 328 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:55:18.105200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:18.106024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:18.112504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.113289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.113940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.115074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.115695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.116475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.281190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.291409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.292909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.294271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a1249278-3b1d-4c81-a6a4-e31d4cf07fb0 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.192557 Oct 17 12:55:18.294931 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 923/1846] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:18 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:18.300676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-474640031", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:18.314956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.335534 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-05872a6e-294d-4dee-8d66-5073ef1af077 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 0.283642 Oct 17 12:55:18.335534 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 924/1847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:18 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:18.335534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:18.335534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:18.349902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.352660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.353126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.354545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.355196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.355663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.381326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:55:18.666987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.683406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:55:18.683836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:55:18.684398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:55:18.685220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:55:18.685794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.685958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:55:18.691590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.695308 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11cae9f8-8a08-4434-8021-1c84344afd19 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.366713 Oct 17 12:55:18.697935 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 925/1848] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:18 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:18.699681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.700277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.700841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.701728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.702157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.702875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.707021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c683d23-3c89-4ac5-8299-3a07c83384b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1492901131", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c683d23-3c89-4ac5-8299-3a07c83384b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action HTTP/1.1 Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 619 Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1492901131", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '12b7cfee-a8d4-45b1-bc20-fbd5c901fca9', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1492901131', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:55:18.718673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 12:55:18.723720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.728941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Getting quotas for project 9d95790536c64ea9a2544b487911c857. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:55:18.730227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c683d23-3c89-4ac5-8299-3a07c83384b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:18.731732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c683d23-3c89-4ac5-8299-3a07c83384b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action" status: 400 len: 938 microversion: 2.1 time: 0.032049 Oct 17 12:55:18.732712 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 926/1849] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 17 12:55:18 2022] POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action => generated 938 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:55:18.734292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Getting quotas for user e994bf2f7f60436f9da8680d19d7d8a8 and project 9d95790536c64ea9a2544b487911c857. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:55:18.742322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:18.743979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:18.759619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.utils [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] instances quota exceeded for 9d95790536c64ea9a2544b487911c857, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127539) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 12:55:18.760523 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 12:55:18.761521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.762401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Request method failure captured: Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 144 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCxA_SuH2z07vMyqqtWDuVj656Xh9WwxXNkAQY1OSviEAWu-yF6m5ctwftAsIj6wjQSzCF-PVu3Z9Vxrk1PLryOu3lKi4EVBoeUghKnqe88rTibkY4J-nMoXXDO5xtZ91MhrwXSQtLlGOl58DKnuXqF9VQ1IsK2f_ChqkpryIznsiQ Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 9d95790536c64ea9a2544b487911c857 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d95790536c64ea9a2544b487911c857", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d95790536c64ea9a2544b487911c857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d95790536c64ea9a2544b487911c857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d95790536c64ea9a2544b487911c857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 9d95790536c64ea9a2544b487911c857 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-QuotasAdminNegativeTest-961023848-project Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e994bf2f7f60436f9da8680d19d7d8a8 Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-QuotasAdminNegativeTest-961023848-project Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-474640031", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-474640031', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452'}}} Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 12:55:18.762777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6102ee0b-228b-4b04-880f-efc4114ff700 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.468880 Oct 17 12:55:18.770121 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 924/1850] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:55:18 2022] POST /compute/v2.1/servers => generated 119 bytes in 470 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:18.776909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:18.777124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.778085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.778280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:18.779066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.779851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.786223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.786734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.787193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.787956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:18.788417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:18.788906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:18.967572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.975885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.985944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.986258 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-26d82a9f-f9d8-4245-a282-734a24256cb4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 0.217009 Oct 17 12:55:18.987083 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 925/1851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:18 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:18.994062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:18.995572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6cfdbd22-33e8-484c-a224-b8e622a12acd tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1398 microversion: 2.54 time: 0.261253 Oct 17 12:55:18.996016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-36992278-3458-488d-9bb0-d35b4f4edb52 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Action: 'update', calling method: .version_select at 0x7fa820f26670>, body: {"quota_set": {"instances": 10}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:19.012850 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 927/1852] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:18 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1398 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:19.026875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:19.027488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:19.044420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.046865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.047537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.048504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.048987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.049440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.115552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36992278-3458-488d-9bb0-d35b4f4edb52 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.116845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36992278-3458-488d-9bb0-d35b4f4edb52 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.117238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36992278-3458-488d-9bb0-d35b4f4edb52 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.118420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36992278-3458-488d-9bb0-d35b4f4edb52 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.118920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36992278-3458-488d-9bb0-d35b4f4edb52 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.119441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36992278-3458-488d-9bb0-d35b4f4edb52 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.202127 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-36992278-3458-488d-9bb0-d35b4f4edb52 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 329 microversion: 2.1 time: 0.212732 Oct 17 12:55:19.211573 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 926/1853] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:55:18 2022] PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 329 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:19.211573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:19.211573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:19.220409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:19.224437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.225055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.225770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.226674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.227242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.227763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.232667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:19.235705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:19.244279 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d219cfc7-eda1-430d-923d-94187c7f3651 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.221252 Oct 17 12:55:19.245585 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 928/1854] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:19 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:19.251156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-434103de-4563-4d1c-8bef-18199e996df7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '.version_select at 0x7fa82092ac10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:19.289855 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-434103de-4563-4d1c-8bef-18199e996df7 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-931481125" status: 204 len: 0 microversion: 2.54 time: 0.042656 Oct 17 12:55:19.291308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 929/1855] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 12:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-931481125 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:19.297259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2483d072-7952-4cca-87b9-8d8cfe011226 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Calling method '.version_select at 0x7fa82092b040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:19.427764 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2483d072-7952-4cca-87b9-8d8cfe011226 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 371 microversion: 2.1 time: 0.134910 Oct 17 12:55:19.431463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 930/1856] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 12:55:19 2022] GET /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:19.442935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:19.444513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:19.463871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.465796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.467356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.469061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.469987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.471167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.495591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:19.500372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:55:19.509435 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a04fb8f1-1712-4339-991c-c4b47cb7bceb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 0.304981 Oct 17 12:55:19.510476 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 927/1857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:19 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:19.520267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:19.521343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:19.528897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.529540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.530509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.531167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.531793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.534581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.694558 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16ec7722-368e-435c-8533-fe78a36446b1 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 204 len: 0 microversion: 2.54 time: 0.261205 Oct 17 12:55:19.695846 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 931/1858] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:55:19 2022] DELETE /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:19.701962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d86b90b3-c51b-4dc8-b8e1-d9f24855f6f4 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Action: 'update', calling method: .version_select at 0x7fa820913280>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:19.822245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:19.833577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:19.833863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d86b90b3-c51b-4dc8-b8e1-d9f24855f6f4 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.835968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:19.837859 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6f2f1ea3-d942-48b6-b3d5-e4d816e80cfe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.326154 Oct 17 12:55:19.838480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d86b90b3-c51b-4dc8-b8e1-d9f24855f6f4 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.850327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d86b90b3-c51b-4dc8-b8e1-d9f24855f6f4 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.850327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d86b90b3-c51b-4dc8-b8e1-d9f24855f6f4 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.850327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d86b90b3-c51b-4dc8-b8e1-d9f24855f6f4 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.850327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d86b90b3-c51b-4dc8-b8e1-d9f24855f6f4 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.851265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 928/1859] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:19 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:19.857610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3db9924-7066-419f-a4be-5948275c57c6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3db9924-7066-419f-a4be-5948275c57c6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action HTTP/1.1 Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 285 Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '12b7cfee-a8d4-45b1-bc20-fbd5c901fca9', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:19.863407 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 12:55:19.868265 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:19.870926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3db9924-7066-419f-a4be-5948275c57c6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:19.872245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b3db9924-7066-419f-a4be-5948275c57c6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action" status: 400 len: 619 microversion: 2.1 time: 0.023469 Oct 17 12:55:19.876645 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 929/1860] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 17 12:55:19 2022] POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:55:19.884219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:19.885077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:19.894952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.895713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.896354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.897357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.897504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:19.898152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.899051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.928462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:19.944490 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d86b90b3-c51b-4dc8-b8e1-d9f24855f6f4 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 325 microversion: 2.1 time: 0.246595 Oct 17 12:55:19.945485 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 932/1861] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:55:19 2022] PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 325 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:19.969224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:19.973282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:19.990076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.990918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.991752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:19.995274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:19.996965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:19.997139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.017521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.029610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.031128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.032355 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-732e111c-a08c-4197-b69c-41fda3e4aa42 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1404 microversion: 2.54 time: 0.154366 Oct 17 12:55:20.037668 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 930/1862] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:19 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:20.044275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:20.045102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:20.076031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.076547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.076990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.077961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.086238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.086849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.373807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.395708 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-022ab78d-6a4d-4a55-98fe-c629cbc833ee tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 0.346929 Oct 17 12:55:20.396866 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 931/1863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:20 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:20.407713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-101173183", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:20.438256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.467269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.473535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.474859 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-edbeffd7-be20-4c06-be90-505ef14453d9 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.523548 Oct 17 12:55:20.475439 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 933/1864] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:19 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:20.496029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:20.504419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:20.507781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:55:20.513318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.514117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.514941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.515992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.516611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.517491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.687940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.709970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.713581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:20.721065 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b76744b-b5d3-410f-b276-b12369c7daa8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.235672 Oct 17 12:55:20.722305 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 934/1865] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:20 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:20.728562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:20.729148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:20.736771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.737891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.738432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.739445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.739907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.740336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.745981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:20.877864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:55:20.878436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:55:20.879039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:55:20.879638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:55:20.880788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:55:20.892970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.894198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.895302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.896278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.897250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.898089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.923677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Getting quotas for project 9d95790536c64ea9a2544b487911c857. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:55:20.932716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Getting quotas for user e994bf2f7f60436f9da8680d19d7d8a8 and project 9d95790536c64ea9a2544b487911c857. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:55:20.953949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.utils [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] ram quota exceeded for 9d95790536c64ea9a2544b487911c857, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127539) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 12:55:20.955810 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Request method failure captured: Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 144 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCxA_SuH2z07vMyqqtWDuVj656Xh9WwxXNkAQY1OSviEAWu-yF6m5ctwftAsIj6wjQSzCF-PVu3Z9Vxrk1PLryOu3lKi4EVBoeUghKnqe88rTibkY4J-nMoXXDO5xtZ91MhrwXSQtLlGOl58DKnuXqF9VQ1IsK2f_ChqkpryIznsiQ Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 9d95790536c64ea9a2544b487911c857 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d95790536c64ea9a2544b487911c857", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d95790536c64ea9a2544b487911c857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d95790536c64ea9a2544b487911c857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d95790536c64ea9a2544b487911c857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 9d95790536c64ea9a2544b487911c857 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-QuotasAdminNegativeTest-961023848-project Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e994bf2f7f60436f9da8680d19d7d8a8 Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-QuotasAdminNegativeTest-961023848-project Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-101173183", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-101173183', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452'}}} Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 12:55:20.959515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e57854e3-4146-4b0b-b109-6b546a092373 tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.562813 Oct 17 12:55:20.968080 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 932/1866] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:55:20 2022] POST /compute/v2.1/servers => generated 110 bytes in 568 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:20.975654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:20.975654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:20.981013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.981548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.982222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:20.983420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:20.984168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:20.984779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.158814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:21.171866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:21.174550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:21.176494 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-806be63f-4d30-4b35-8fc4-59c696568266 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.209277 Oct 17 12:55:21.177869 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 933/1867] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:20 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:21.195877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ccad44f-c892-4854-9ca4-17d696787a06 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Action: 'update', calling method: .version_select at 0x7fa820a61e50>, body: {"quota_set": {"ram": 51200}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:21.285557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ccad44f-c892-4854-9ca4-17d696787a06 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:21.287103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ccad44f-c892-4854-9ca4-17d696787a06 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:21.287978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ccad44f-c892-4854-9ca4-17d696787a06 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.289348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ccad44f-c892-4854-9ca4-17d696787a06 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:21.290101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ccad44f-c892-4854-9ca4-17d696787a06 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:21.291111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ccad44f-c892-4854-9ca4-17d696787a06 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.415377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ccad44f-c892-4854-9ca4-17d696787a06 tempest-QuotasAdminNegativeTest-430774430 tempest-QuotasAdminNegativeTest-430774430-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 200 len: 329 microversion: 2.1 time: 0.235693 Oct 17 12:55:21.419428 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 934/1868] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:55:21 2022] PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 329 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:21.426278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:21.427078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:21.438479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:21.441432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:21.442419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:21.443296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.444410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:21.445149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:21.446028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.451297 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32639b21-25a4-4e06-8397-ead10f0cb046 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 0.727720 Oct 17 12:55:21.457445 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 935/1869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:20 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:21.462417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca3a5521-5125-48d3-a351-b9b61e1d0ecb tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Action: 'update', calling method: .version_select at 0x7fa82096a3a0>, body: {"quota_set": {"ram": 0}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:21.484801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca3a5521-5125-48d3-a351-b9b61e1d0ecb tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e994bf2f7f60436f9da8680d19d7d8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d95790536c64ea9a2544b487911c857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca3a5521-5125-48d3-a351-b9b61e1d0ecb tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Request method failure captured: Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 HTTP/1.1 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 25 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVCxA_SuH2z07vMyqqtWDuVj656Xh9WwxXNkAQY1OSviEAWu-yF6m5ctwftAsIj6wjQSzCF-PVu3Z9Vxrk1PLryOu3lKi4EVBoeUghKnqe88rTibkY4J-nMoXXDO5xtZ91MhrwXSQtLlGOl58DKnuXqF9VQ1IsK2f_ChqkpryIznsiQ Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 9d95790536c64ea9a2544b487911c857 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d95790536c64ea9a2544b487911c857", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d95790536c64ea9a2544b487911c857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d95790536c64ea9a2544b487911c857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d95790536c64ea9a2544b487911c857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 9d95790536c64ea9a2544b487911c857 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-961023848 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-QuotasAdminNegativeTest-961023848-project Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e994bf2f7f60436f9da8680d19d7d8a8 Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-QuotasAdminNegativeTest-961023848-project Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: {"quota_set": {"ram": 0}} Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9d95790536c64ea9a2544b487911c857', 'body': {'quota_set': {'ram': 0}}} Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 12:55:21.507336 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 12:55:21.512804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:21.515168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca3a5521-5125-48d3-a351-b9b61e1d0ecb tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:21.516199 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca3a5521-5125-48d3-a351-b9b61e1d0ecb tempest-QuotasAdminNegativeTest-961023848 tempest-QuotasAdminNegativeTest-961023848-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857" status: 403 len: 116 microversion: 2.1 time: 0.057724 Oct 17 12:55:21.517285 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 936/1870] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:55:21 2022] PUT /compute/v2.1/os-quota-sets/9d95790536c64ea9a2544b487911c857 => generated 116 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:21.527630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1962976442"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:21.536310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:21.543446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:21.543944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:21.544454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.545183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:21.545640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:21.546065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.633478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:21.644563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:21.652091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:21.663370 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5945352-8a5e-4ccd-b692-57ff9d11e501 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1404 microversion: 2.54 time: 0.241978 Oct 17 12:55:21.665200 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 935/1871] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:21 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1404 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:21.674126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:21.674967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:21.684450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:21.685055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:21.689837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.696866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:21.698294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:21.700579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:21.977485 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da63c69d-6bef-4c42-8b29-327d7de17b6e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action" status: 202 len: 0 microversion: 2.1 time: 0.457878 Oct 17 12:55:21.988991 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 937/1872] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:55:21 2022] POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 12:55:22.005877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:22.007527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:22.027200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.027771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.028447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.029828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.031062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.032365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.079481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.114383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.121905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.126493 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-779df59f-d445-46f1-8b48-48edeb1bbfb6 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.456763 Oct 17 12:55:22.127409 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 936/1873] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:21 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:22.152451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-901100878"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:22.155364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:22.165640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.166348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.170100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.170989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.171554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.172079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.241200 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Cannot 'createImage' instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 while it is in task_state image_snapshot_pending Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action HTTP/1.1 Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 84 Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-901100878"}} Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'createImage' instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 while it is in task_state image_snapshot_pending Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '12b7cfee-a8d4-45b1-bc20-fbd5c901fca9', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-901100878'}}} Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 12:55:22.244392 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 while it is in task_state image_snapshot_pending Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 while it is in task_state image_snapshot_pending Oct 17 12:55:22.250836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:22.253915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 409 to user: Cannot 'createImage' instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 while it is in task_state image_snapshot_pending {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:22.256001 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c916f44e-e6f2-4563-b5b1-b07546480524 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action" status: 409 len: 167 microversion: 2.1 time: 0.125737 Oct 17 12:55:22.257076 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 937/1874] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:55:22 2022] POST /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9/action => generated 167 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:55:22.262339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:22.263088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:22.271930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.272157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.274684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.274959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.276558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.276714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.277186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.291891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.295288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.307543 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0dfb3ccc-d6a8-4bde-a83b-b3cd4d5887bc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.315524 Oct 17 12:55:22.308453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 938/1875] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:21 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:22.319985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe0e2c49-890b-40a7-94b1-5cba9714f00d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '.version_select at 0x7fa8209639d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:22.604172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.618770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.631756 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe0e2c49-890b-40a7-94b1-5cba9714f00d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/images/a68ffe24-e8a0-4875-9a48-933ad9a3f585" status: 204 len: 0 microversion: 2.1 time: 0.322152 Oct 17 12:55:22.632924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.633283 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 939/1876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:22 2022] DELETE /compute/v2.1/images/a68ffe24-e8a0-4875-9a48-933ad9a3f585 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:55:22.636583 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-672335dd-5d29-44df-b35e-af8fb1e4dc07 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.378110 Oct 17 12:55:22.640354 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 938/1877] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:22 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:22.653365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:22.653365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:22.661815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.661815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.661815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.664029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.664029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.664537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.697665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:22.698539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:22.728532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.730876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.731497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.733880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:22.734536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:22.735046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:22.973482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:22.994229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.008799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.013522 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e806c34d-2864-47a7-a319-d0427c8aad9d tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1404 microversion: 2.54 time: 0.323235 Oct 17 12:55:23.014110 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 939/1878] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:22 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1404 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:23.175688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:23.181191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:23.198768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:23.219779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:23.221390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:23.224252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:23.230788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:23.231517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:23.232147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:23.587250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.596121 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-192497b4-5cb9-47d2-b8cc-aca5677e4cab tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1541 microversion: 2.1 time: 0.957799 Oct 17 12:55:23.602501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 940/1879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:22 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1541 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:23.615258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:23.616047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:23.627921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:23.631476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:23.632536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:23.634889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:23.635475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:23.639518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:23.672875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.707345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.718572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.724893 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ec4c264b-30df-43eb-9f1d-4b5e05548b81 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.569240 Oct 17 12:55:23.738190 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 940/1880] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:23 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:23.738190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-eda8cc7e-ddad-4a0a-a8a3-d483f8f9c5fd req-f0afe3aa-65d9-4b7c-a851-76f59686a4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3f9b5d-f890-4bab-ab06-f817eb89583f", "name": "network-vif-plugged", "status": "completed", "tag": "bbff9c4d-1224-4974-a6a4-fa9ac3e884c3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:23.776361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eda8cc7e-ddad-4a0a-a8a3-d483f8f9c5fd req-f0afe3aa-65d9-4b7c-a851-76f59686a4e6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:23.777410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eda8cc7e-ddad-4a0a-a8a3-d483f8f9c5fd req-f0afe3aa-65d9-4b7c-a851-76f59686a4e6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:23.778297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eda8cc7e-ddad-4a0a-a8a3-d483f8f9c5fd req-f0afe3aa-65d9-4b7c-a851-76f59686a4e6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:23.779444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.794704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.796409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:23.799011 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-eda8cc7e-ddad-4a0a-a8a3-d483f8f9c5fd req-f0afe3aa-65d9-4b7c-a851-76f59686a4e6 service nova] Creating event network-vif-plugged:bbff9c4d-1224-4974-a6a4-fa9ac3e884c3 for instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f on n-h2-853316-12 Oct 17 12:55:23.806556 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-eda8cc7e-ddad-4a0a-a8a3-d483f8f9c5fd req-f0afe3aa-65d9-4b7c-a851-76f59686a4e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078638 Oct 17 12:55:23.807576 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 941/1881] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:23.808592 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c4988056-2f0f-4e12-be57-db179c829eac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.204874 Oct 17 12:55:23.812261 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 941/1882] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:23 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:23.843206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:23.844091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:23.855100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:23.856293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:23.856989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:23.858138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:23.858677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:23.859657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:24.047856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:24.048481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:24.069389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:24.069895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:24.070367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:24.071087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:24.071541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:24.071962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:24.167144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:24.170856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:24.171512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:24.172128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lazy-loading 'fault' on Instance uuid e152d308-5c9c-487b-aafc-e59d5583416b {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:24.287081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:24.301864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:24.303754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:24.308422 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d0e1dc5-2686-4019-b318-672d77207c45 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1409 microversion: 2.54 time: 0.264745 Oct 17 12:55:24.311830 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 942/1883] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:24 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1409 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:24.341014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:24.364110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:24.371108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:24.377198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e61c747-152c-4bda-a1a3-b2de035b8e35 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.566274 Oct 17 12:55:24.394437 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 942/1884] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:23 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:24.497717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d454f0d0-3502-4b00-bb53-06a4c757fe22 req-a4efb5e2-4a69-4797-b59e-a3f5a162417a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668320eb-1f68-4fcd-addd-aef8b2271f2a", "name": "network-vif-unplugged", "status": "completed", "tag": "dfb3775c-e68d-4644-94da-eb293b65a58c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:24.510777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d454f0d0-3502-4b00-bb53-06a4c757fe22 req-a4efb5e2-4a69-4797-b59e-a3f5a162417a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:24.511532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d454f0d0-3502-4b00-bb53-06a4c757fe22 req-a4efb5e2-4a69-4797-b59e-a3f5a162417a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:24.512963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d454f0d0-3502-4b00-bb53-06a4c757fe22 req-a4efb5e2-4a69-4797-b59e-a3f5a162417a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:24.531539 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d454f0d0-3502-4b00-bb53-06a4c757fe22 req-a4efb5e2-4a69-4797-b59e-a3f5a162417a service nova] Creating event network-vif-unplugged:dfb3775c-e68d-4644-94da-eb293b65a58c for instance 668320eb-1f68-4fcd-addd-aef8b2271f2a on n-h1-853316-12 Oct 17 12:55:24.539490 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d454f0d0-3502-4b00-bb53-06a4c757fe22 req-a4efb5e2-4a69-4797-b59e-a3f5a162417a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045780 Oct 17 12:55:24.540951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 943/1885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:24.625128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:24.625879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:24.659249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:24.660036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:24.660648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:24.661249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:24.661730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:24.662149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:24.760833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:24.762128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:24.777163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:24.777937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:24.778613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:24.779517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:24.780139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:24.780744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:25.093061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.107176 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d099bcf0-7243-4f5c-899f-01b1577eea39 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1539 microversion: 2.1 time: 0.485739 Oct 17 12:55:25.122520 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 943/1886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:24 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1539 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:25.141047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:25.142009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:25.151849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:25.152660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:25.153314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:25.154414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:25.155451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:25.156176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:25.237992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.248540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.257315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.261984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.273813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca09f93d-553c-44f3-b1fb-0e4bf154271b tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.515725 Oct 17 12:55:25.274853 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 944/1887] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:24 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:25.311416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.316828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.326047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a0694a3-4370-4776-af4e-b04f4ee0c28c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.202137 Oct 17 12:55:25.340155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:25.341039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:25.348322 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 944/1888] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:25 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:25.354534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:25.355293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:25.358704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:25.359481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:25.359955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:25.360383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:25.412181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:25.412959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:25.425559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:25.427812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:25.428268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:25.431932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:25.432415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:25.434663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:25.456794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:25.459942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:25.460594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:25.461223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lazy-loading 'fault' on Instance uuid e152d308-5c9c-487b-aafc-e59d5583416b {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:25.723272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.730501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.735971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.740257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.745388 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-819087a5-35c4-4462-bbfd-09070adbb5f9 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.335565 Oct 17 12:55:25.746033 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 945/1889] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:25 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:25.749964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.756626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f776019598d34be491112128a5ab0918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493e79b70a904e0b8556757082b9458f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:25.758247 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3aacac3d-0187-4735-81c0-5e82d8ad6d47 tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 200 len: 1409 microversion: 2.54 time: 0.422898 Oct 17 12:55:25.762267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 945/1890] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:25 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 1409 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:26.155294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:26.156331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:26.176983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:26.179810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:26.180356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:26.181088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:26.182023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:26.187071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:26.309538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:26.310438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:26.330088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:26.334244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:26.335120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:26.338816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:26.340562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:26.343006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:26.604186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:26.614613 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-28dd0c0e-bfbe-4302-b08e-1b09893643f2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1539 microversion: 2.1 time: 0.468118 Oct 17 12:55:26.621072 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 946/1891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:26 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1539 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:26.634924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:26.635572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:26.692133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:26.692401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:26.696046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:26.699515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:26.703449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:26.704071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:26.930334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:26.944707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:26.955614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:26.958544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:26.975107 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7640d6c0-ef1e-4efa-8034-0e9fbcecd442 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.348336 Oct 17 12:55:26.975653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:26.984439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:26.993368 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b72e5dc-21ce-4170-ab7e-59cba58ac858 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1362 microversion: 2.26 time: 0.689706 Oct 17 12:55:26.999407 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 947/1892] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:26 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:27.000934 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 946/1893] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:26 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1362 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:27.029360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-20be7744-e82e-4b89-80f0-784e4482e37a req-358a40a5-a61f-42e4-aadd-eec05348c4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668320eb-1f68-4fcd-addd-aef8b2271f2a", "tag": "dfb3775c-e68d-4644-94da-eb293b65a58c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:27.034312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:27.036116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:27.047712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20be7744-e82e-4b89-80f0-784e4482e37a req-358a40a5-a61f-42e4-aadd-eec05348c4d5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:27.048699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20be7744-e82e-4b89-80f0-784e4482e37a req-358a40a5-a61f-42e4-aadd-eec05348c4d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:27.049325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20be7744-e82e-4b89-80f0-784e4482e37a req-358a40a5-a61f-42e4-aadd-eec05348c4d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:27.061056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:27.062297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:27.064319 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-20be7744-e82e-4b89-80f0-784e4482e37a req-358a40a5-a61f-42e4-aadd-eec05348c4d5 service nova] Creating event network-changed:dfb3775c-e68d-4644-94da-eb293b65a58c for instance 668320eb-1f68-4fcd-addd-aef8b2271f2a on n-h1-853316-12 Oct 17 12:55:27.072273 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-20be7744-e82e-4b89-80f0-784e4482e37a req-358a40a5-a61f-42e4-aadd-eec05348c4d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071401 Oct 17 12:55:27.073654 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 948/1894] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:27.075342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:27.080052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:27.081817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:27.083699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:27.085433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:27.094141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] [instance: e152d308-5c9c-487b-aafc-e59d5583416b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:27.113685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:27.116622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:27.119397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:27.122318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:27.124301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:27.125626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:27.181411 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] HTTP exception thrown: Instance e152d308-5c9c-487b-aafc-e59d5583416b could not be found. Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Request method failure captured: Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b HTTP/1.1 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCNtMh9uGS2JPhKY_AfgLHmT4OTkX6mVhAyTf-E_SEjkOfEEXTKFyePaMSQstHKTxkxeedZ3i1s-5SMvPS6Wd0oBnQPGyjzf5StqAC0700Q9V-64e0_pAAvKPCyHgBoXqrNPDFbeZZ_i1ZG896fH42KMkIf-6fv9741x7IoxGVUZl4 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.54 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 493e79b70a904e0b8556757082b9458f Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerShowV254Test-2101646196 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_493e79b70a904e0b8556757082b9458f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/493e79b70a904e0b8556757082b9458f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/493e79b70a904e0b8556757082b9458f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/493e79b70a904e0b8556757082b9458f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerShowV254Test-2101646196 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 493e79b70a904e0b8556757082b9458f Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerShowV254Test-2101646196 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerShowV254Test-2101646196-project Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: f776019598d34be491112128a5ab0918 Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerShowV254Test-2101646196-project Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance e152d308-5c9c-487b-aafc-e59d5583416b could not be found. Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e152d308-5c9c-487b-aafc-e59d5583416b'} Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e152d308-5c9c-487b-aafc-e59d5583416b could not be found. Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e152d308-5c9c-487b-aafc-e59d5583416b could not be found. Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:27.185426 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:27.194212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:27.194212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:27.194212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:27.194212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:27.194212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:27.194212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e152d308-5c9c-487b-aafc-e59d5583416b could not be found. Oct 17 12:55:27.194212 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:55:27.211256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] Returning 404 to user: Instance e152d308-5c9c-487b-aafc-e59d5583416b could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:27.214099 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ed6281da-6580-43a7-a970-e69af503181b tempest-ServerShowV254Test-2101646196 tempest-ServerShowV254Test-2101646196-project] 10.222.0.27 "GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b" status: 404 len: 111 microversion: 2.54 time: 0.138776 Oct 17 12:55:27.217281 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 949/1895] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:27 2022] GET /compute/v2.1/servers/e152d308-5c9c-487b-aafc-e59d5583416b => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:55:27.650695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:27.651508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:27.678400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:27.680030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:27.682692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:27.686490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:27.687289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:27.689331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:27.762497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:27.832217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:27.846175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:27.859456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:27.863770 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c226787-7e18-4f71-9bd3-de90c028eb2c tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.860538 Oct 17 12:55:27.864672 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 947/1896] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:27 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:28.011945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:28.011945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:28.031022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:28.031302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:28.031842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:28.038947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:28.039453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:28.045327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:28.316970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:28.339292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:28.344585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:28.356191 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c081c10-6b19-4248-ba1d-494820879086 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.352778 Oct 17 12:55:28.357274 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 948/1897] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:28 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:28.399092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:28.402567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:28.431395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:28.432379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:28.433754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:28.436782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:28.439568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:28.442591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:28.622625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:28.644062 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-999e9890-4f56-4923-a029-bf1850167708 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1521 microversion: 2.1 time: 1.001144 Oct 17 12:55:28.677198 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 950/1898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:27 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1521 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:28.730270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:28.730735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:28.747970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:28.748818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:28.758066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:28.759714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:28.760540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:28.761287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:28.806613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:55:29.046031 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f49d12b9-1188-4453-85be-1be540fb54fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 204 len: 0 microversion: 2.1 time: 0.349177 Oct 17 12:55:29.055027 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 951/1899] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:55:28 2022] DELETE /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:55:29.071681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:29.072533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:29.095094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:29.096196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:29.096718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:29.098210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:29.103083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:29.104285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:29.452752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:29.479299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:29.484255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:29.493847 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-42ee9200-30fa-4df9-aad0-cc9cd56fe611 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.436038 Oct 17 12:55:29.505719 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 952/1900] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:29 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:29.524466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:29.525516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:29.542689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:29.543500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:29.543940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:29.544862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:29.545491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:29.546094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:29.635953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:29.656961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:29.658785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:29.660800 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-430a4dfb-d17f-40b1-9557-3f5ce28f6827 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1546 microversion: 2.26 time: 1.301345 Oct 17 12:55:29.661565 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 949/1901] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:28 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1546 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:29.790967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:29.813844 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10fb146a-6e29-4399-8d40-c6f98e748b47 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1527 microversion: 2.1 time: 0.306406 Oct 17 12:55:29.827018 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 953/1902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:29 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1527 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:29.840858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:29.841887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:29.852762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:29.853443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:29.854133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:29.855092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:29.855922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:29.856563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:29.873916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:29.933855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1701642715", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "23df3658-5c85-448c-bade-196efd7fa577"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:29.944518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=40 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:30.006996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] validate_networks() for [('23df3658-5c85-448c-bade-196efd7fa577', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:55:30.049345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:30.061457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:30.068683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:30.082364 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-491c9457-3f6c-444f-b828-3eeba33758e2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.253691 Oct 17 12:55:30.087519 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 954/1903] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:29 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:30.098567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa820a66c10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:30.130296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.132173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.133432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.135267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:30.151507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.152361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.155039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.156987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.157690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.158947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.226009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.230109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.231423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.270231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.272017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.272626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.342864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:30.382063 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6a836171-3fc7-4e11-87e6-80381987aec0 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-581018157" status: 201 len: 0 microversion: 2.26 time: 0.292296 Oct 17 12:55:30.385344 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 955/1904] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 17 12:55:30 2022] PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-581018157 => generated 0 bytes in 297 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 12:55:30.402802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ae962d9d-9bc0-4779-a962-aba0920ac882 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa820a61700>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:30.426337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae962d9d-9bc0-4779-a962-aba0920ac882 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.428828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae962d9d-9bc0-4779-a962-aba0920ac882 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.430586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae962d9d-9bc0-4779-a962-aba0920ac882 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.460067 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ae962d9d-9bc0-4779-a962-aba0920ac882 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-581018157" status: 204 len: 0 microversion: 2.26 time: 0.068542 Oct 17 12:55:30.461312 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 956/1905] 10.222.0.27 () {60 vars in 1358 bytes} [Mon Oct 17 12:55:30 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-581018157 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:30.484190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa820a61ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:30.504699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.507725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.510107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.513552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:30.528866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.531874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.533265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.535414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.538064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.539584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.579415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.579415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.579415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.603518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:30.641342 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2225945b-1372-46be-a383-9b98fe82bc84 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 204 len: 0 microversion: 2.26 time: 0.169079 Oct 17 12:55:30.643917 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 957/1906] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 17 12:55:30 2022] DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:30.658704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:30.660987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:30.679267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.681309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.683184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:30.686687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:30.687450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:30.689904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:31.312523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:31.401572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=84,nova_cell0:UPDATE=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:31.889223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:55:31.889734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:55:31.889943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:55:31.890401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:55:31.890819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:55:31.909459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:31.910473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:31.911197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:31.912198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:31.913200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:31.914219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:31.992080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Getting quotas for project c1fcd669f19740e18e617f3a1a76f1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:55:32.007469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Getting quotas for user e5661f5ab2c545dc9f1d0edb738e1ea7 and project c1fcd669f19740e18e617f3a1a76f1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:55:32.082861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:55:32.109821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:55:32.341798 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dba4437b-4589-4fdc-9e6b-7e8c253ded4a tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.678630 Oct 17 12:55:32.342627 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 950/1907] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:55:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:55:32.382282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-142c94ad-c940-44f3-b52c-a4eac050c7d7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa820ab6790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:32.406283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:32.416725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:32.418291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-142c94ad-c940-44f3-b52c-a4eac050c7d7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:32.420332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-142c94ad-c940-44f3-b52c-a4eac050c7d7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:32.421369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-142c94ad-c940-44f3-b52c-a4eac050c7d7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:32.435461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:32.449715 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b453c22a-4201-41b8-b408-ea1e0e8bf015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 1.803994 Oct 17 12:55:32.470705 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 958/1908] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:30 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:32.484973 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-142c94ad-c940-44f3-b52c-a4eac050c7d7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 200 len: 12 microversion: 2.26 time: 0.129105 Oct 17 12:55:32.485844 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 951/1909] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:55:32 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 12 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:32.498074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:32.498947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:32.506698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:32.507190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:32.507855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:32.508755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:32.509389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:32.510064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:32.512389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:32.520876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:32.568962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:32.571172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:32.572689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:32.574739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:32.576294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:32.577875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:32.879138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:32.895766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:32.897235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:32.918347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9cd0779-3cd7-4a7c-9987-1153a0bfee6d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.421479 Oct 17 12:55:32.926213 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 952/1910] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:32 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:33.247868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2079406956", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": "none"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:33.466381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:55:33.467608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:55:33.468280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:55:33.470261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:55:33.472931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:55:33.529170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:33.529676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:33.530117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:33.538468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:33.539284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:33.554869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:33.669725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Getting quotas for project 00c00cd9a5cc40b6a489aa36de099324. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:55:33.688115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Getting quotas for user be94fc8bfabc4f84bd2abafa7bd79f82 and project 00c00cd9a5cc40b6a489aa36de099324. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:55:33.691131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:33.734244 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9e461ce-92e8-4a60-baad-50fcdfb0bcb5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1527 microversion: 2.1 time: 1.236594 Oct 17 12:55:33.752585 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 959/1911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:32 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1527 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:33.764837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3feaa5b7-57a6-42cc-b9d0-cc65175db97c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:33.767704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3feaa5b7-57a6-42cc-b9d0-cc65175db97c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:33.781936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:55:33.789863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:55:34.021338 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a39b66a3-7640-48dd-aba9-09d002a78cf6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.093877 Oct 17 12:55:34.036831 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 953/1912] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 12:55:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 12:55:34.067538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa82093f940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:34.108699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.111159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.111998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.113246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:34.143091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.147922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.149409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.150393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.157522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.158353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.219894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:34.262504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.263284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.263918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.329476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.329991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.332258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.462505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:34.657020 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ef81b9d-5012-4b23-a2e2-33c2dfee6088 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-170606864" status: 201 len: 0 microversion: 2.26 time: 0.617828 Oct 17 12:55:34.657685 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 954/1913] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 17 12:55:34 2022] PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-170606864 => generated 0 bytes in 620 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 12:55:34.682012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d32274ad-a57a-4743-8c15-120f862a2273 req-1d592d19-7e5a-47d2-82b9-fa171b75edf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b7cfee-a8d4-45b1-bc20-fbd5c901fca9", "name": "network-vif-plugged", "status": "completed", "tag": "5008942b-1b3e-4890-9804-8abe766b5efd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:34.725984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d32274ad-a57a-4743-8c15-120f862a2273 req-1d592d19-7e5a-47d2-82b9-fa171b75edf9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.728705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d32274ad-a57a-4743-8c15-120f862a2273 req-1d592d19-7e5a-47d2-82b9-fa171b75edf9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.731279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d32274ad-a57a-4743-8c15-120f862a2273 req-1d592d19-7e5a-47d2-82b9-fa171b75edf9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.767663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3feaa5b7-57a6-42cc-b9d0-cc65175db97c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:34.768742 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d32274ad-a57a-4743-8c15-120f862a2273 req-1d592d19-7e5a-47d2-82b9-fa171b75edf9 service nova] Creating event network-vif-plugged:5008942b-1b3e-4890-9804-8abe766b5efd for instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 on n-h2-853316-12 Oct 17 12:55:34.776206 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3feaa5b7-57a6-42cc-b9d0-cc65175db97c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1224 microversion: 2.1 time: 1.020249 Oct 17 12:55:34.783378 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d32274ad-a57a-4743-8c15-120f862a2273 req-1d592d19-7e5a-47d2-82b9-fa171b75edf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112402 Oct 17 12:55:34.785644 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 955/1914] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:34.803408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:34.803729 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 960/1915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:33 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1224 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:34.806581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:34.822197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.823210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.824858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.825791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.826745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.827469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.834587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:34.835207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:34.860893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.861494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.861835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:34.863174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:34.863960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:34.864412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.150861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:35.163117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:35.164546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:35.168458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:35.172004 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-89a9c966-cb36-4a20-8bd8-4514f08894a5 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.384957 Oct 17 12:55:35.174450 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 956/1916] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:34 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:35.183683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:35.187460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4ceaba63-167f-43f7-b6fb-83a21a274b48 req-06bd6ec4-0c3e-4864-9ba9-54b71a75d515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b7cfee-a8d4-45b1-bc20-fbd5c901fca9", "name": "network-vif-deleted", "tag": "5008942b-1b3e-4890-9804-8abe766b5efd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:35.189438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:35.207504 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-78225872-ea47-43d0-9e4b-ab602fe9fd53 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.392705 Oct 17 12:55:35.212785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ceaba63-167f-43f7-b6fb-83a21a274b48 req-06bd6ec4-0c3e-4864-9ba9-54b71a75d515 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.213202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ceaba63-167f-43f7-b6fb-83a21a274b48 req-06bd6ec4-0c3e-4864-9ba9-54b71a75d515 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.216656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ceaba63-167f-43f7-b6fb-83a21a274b48 req-06bd6ec4-0c3e-4864-9ba9-54b71a75d515 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.222529 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 961/1917] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:34 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:35.251863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1a2387b-410f-43dc-a7e1-601541026c9b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:35.255978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a1a2387b-410f-43dc-a7e1-601541026c9b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:35.257432 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4ceaba63-167f-43f7-b6fb-83a21a274b48 req-06bd6ec4-0c3e-4864-9ba9-54b71a75d515 service nova] Creating event network-vif-deleted:5008942b-1b3e-4890-9804-8abe766b5efd for instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 on n-h2-853316-12 Oct 17 12:55:35.291307 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4ceaba63-167f-43f7-b6fb-83a21a274b48 req-06bd6ec4-0c3e-4864-9ba9-54b71a75d515 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111106 Oct 17 12:55:35.297430 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 957/1918] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:35.304442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b5f5120a-c2e1-4d79-9918-6ded5a0c6559 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa82092b310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:35.310878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:35.319255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5f5120a-c2e1-4d79-9918-6ded5a0c6559 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.320042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5f5120a-c2e1-4d79-9918-6ded5a0c6559 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.320670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5f5120a-c2e1-4d79-9918-6ded5a0c6559 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.334866 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b5f5120a-c2e1-4d79-9918-6ded5a0c6559 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 200 len: 35 microversion: 2.26 time: 0.035360 Oct 17 12:55:35.336281 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 958/1919] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:55:35 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 35 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:35.343319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:35.344423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:35.354941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.355972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.356871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.358147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.358936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.359540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.420513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.421284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.421931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.422653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lazy-loading 'fault' on Instance uuid 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:35.480482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:35.505375 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-449521ca-9e32-4c3a-bfad-9368179413ad tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 200 len: 1314 microversion: 2.1 time: 0.167252 Oct 17 12:55:35.508724 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 959/1920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:35 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:35.524241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa82094a040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:35.546993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.547954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.551686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.553991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:35.569982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.572532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.586343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.588908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.594225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.598455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.667687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.681969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.684160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.765497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:35.815534 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0c61373-c387-4e2b-b31a-4385923293c3 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-170606864" status: 204 len: 0 microversion: 2.26 time: 0.303971 Oct 17 12:55:35.821282 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 960/1921] 10.222.0.27 () {60 vars in 1361 bytes} [Mon Oct 17 12:55:35 2022] DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-170606864 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:35.834522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:35.835162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:35.851233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.851577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.852028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:35.855852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:35.856819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:35.861250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.013396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:36.028965 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e29bac3d-b6d7-4ee9-9663-65c5c95520fa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1284 microversion: 2.1 time: 0.205696 Oct 17 12:55:36.029742 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 961/1922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:35 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:36.041821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0c8c523-0dac-4af6-82b6-ef09611f843d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa82093ff70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:36.061850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0c8c523-0dac-4af6-82b6-ef09611f843d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.071238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0c8c523-0dac-4af6-82b6-ef09611f843d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.072046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0c8c523-0dac-4af6-82b6-ef09611f843d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.075380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1a2387b-410f-43dc-a7e1-601541026c9b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:36.089799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1a2387b-410f-43dc-a7e1-601541026c9b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:36.093952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1a2387b-410f-43dc-a7e1-601541026c9b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:36.104674 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a1a2387b-410f-43dc-a7e1-601541026c9b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1278 microversion: 2.57 time: 0.880669 Oct 17 12:55:36.110607 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0c8c523-0dac-4af6-82b6-ef09611f843d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 200 len: 12 microversion: 2.26 time: 0.078538 Oct 17 12:55:36.113917 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 962/1923] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:55:36 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 12 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:36.118604 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 962/1924] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:35 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1278 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:36.131595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa82094a310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:36.146570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.150341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.151023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.155044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:36.172291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.172824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.173313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.174032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.177015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.177485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.204821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:36.208733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:36.242822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.247559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.248316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.249297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.250852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.253302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.270851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.272255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.274709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.286813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:36.326148 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f9ef44b5-2e5d-4985-8e70-e6e0ab6e490a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 204 len: 0 microversion: 2.26 time: 0.198816 Oct 17 12:55:36.330029 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 963/1925] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 17 12:55:36 2022] DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:36.357566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:36.361795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:36.389993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.391975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.395496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.397088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.397567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.402155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.689860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:36.719384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:36.721214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:36.743188 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2c6c9de-b5b5-4beb-b026-840cdbdfbd71 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.411721 Oct 17 12:55:36.744572 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 964/1926] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:36 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:36.778359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa82094a940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:36.817752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.818944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.819624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.830003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:36.839614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.840505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.841198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.842267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.844216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.845529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:36.960513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:36.968136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:36.970674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:37.047207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:37.048593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:37.049368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:37.197339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:37.275466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20f45f82-a490-4253-9ed8-1b810f5d33fc tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-1985124959" status: 201 len: 0 microversion: 2.26 time: 0.529223 Oct 17 12:55:37.283944 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 965/1927] 10.222.0.27 () {62 vars in 1380 bytes} [Mon Oct 17 12:55:36 2022] PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-1985124959 => generated 0 bytes in 538 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 17 12:55:37.291337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:37.302095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:37.311198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:37.311873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:37.312351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:37.315910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:37.319385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:37.320238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:37.371818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 HTTP/1.1 Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '12b7cfee-a8d4-45b1-bc20-fbd5c901fca9'} Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:37.376435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:37.383827 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:37.383827 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:37.383827 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:37.383827 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:37.383827 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:37.383827 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:37.383827 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:55:37.383827 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:37.388473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:37.390428 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6da5b390-b41c-44ae-896f-cc9cb7113dd2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 404 len: 111 microversion: 2.1 time: 0.104874 Oct 17 12:55:37.392623 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 966/1928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:37 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:37.413139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-12684029-984b-4d34-97eb-9f7a1c457036 req-b23886a3-ce68-4304-ad93-63b739c864f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b7cfee-a8d4-45b1-bc20-fbd5c901fca9", "name": "network-vif-unplugged", "status": "completed", "tag": "5008942b-1b3e-4890-9804-8abe766b5efd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:37.486279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-12684029-984b-4d34-97eb-9f7a1c457036 req-b23886a3-ce68-4304-ad93-63b739c864f1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:37.491870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-12684029-984b-4d34-97eb-9f7a1c457036 req-b23886a3-ce68-4304-ad93-63b739c864f1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:37.492406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-12684029-984b-4d34-97eb-9f7a1c457036 req-b23886a3-ce68-4304-ad93-63b739c864f1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:37.540577 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-12684029-984b-4d34-97eb-9f7a1c457036 req-b23886a3-ce68-4304-ad93-63b739c864f1 service nova] Creating event network-vif-unplugged:5008942b-1b3e-4890-9804-8abe766b5efd for instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 on n-h2-853316-12 Oct 17 12:55:37.563169 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-12684029-984b-4d34-97eb-9f7a1c457036 req-b23886a3-ce68-4304-ad93-63b739c864f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161246 Oct 17 12:55:37.565181 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 967/1929] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:37.591188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:37.591951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:37.623296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:37.623805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:37.624250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:37.624983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:37.625457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:37.633478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:37.735995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:37.751050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:37.752728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:37.757545 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-20440aac-d944-4475-9914-82b21b674668 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 1.561079 Oct 17 12:55:37.778682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 963/1930] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:36 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:37.801142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:37.802606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:37.827159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:37.828148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:37.832286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:37.836710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:37.837651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:37.841552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.038009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:38.048267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:38.049773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:38.051075 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34e23f39-6140-47ee-a772-4fa1dfc7558b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1330 microversion: 2.57 time: 0.270409 Oct 17 12:55:38.067405 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 964/1931] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:37 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1330 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:38.082835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa8252e5040>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:38.094996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.096361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.099038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.100235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:38.104599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:38.107444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.111607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.112364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.116603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.117843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.119138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.120928 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9219d01d-7013-48d4-a61c-c629d479d047 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1282 microversion: 2.1 time: 0.550480 Oct 17 12:55:38.122380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 968/1932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:37 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1282 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:38.138841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2b4e0c55-6e58-4b98-bca6-40d98c45633a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'create', calling method: .version_select at 0x7fa820914940>, body: {"keypair": {"name": "tempest-keypair-625318655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyoESUl4azEIr8ECQQPwFqMDdNh0GQIZqiw3Tu2RF72Dx2jjzG7USnwqShwj4IlVIWs3nMwYfMrXQ49eSnVFtn7GSKMhRD4bTAqApQytDeIWX7JXBu6VdgYZi5ldYCgkA=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:38.156637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.157652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.158637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.169418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:38.172583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2b4e0c55-6e58-4b98-bca6-40d98c45633a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Getting quotas for project 450b3f93e96f43ba9c4c64f3552f934c. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:55:38.172769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.173927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.174758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.179118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2b4e0c55-6e58-4b98-bca6-40d98c45633a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Getting quotas for user 9a1e4aea1c6c4ca9a9960e814a7ea07c and project 450b3f93e96f43ba9c4c64f3552f934c. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:55:38.212214 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2b4e0c55-6e58-4b98-bca6-40d98c45633a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088049 Oct 17 12:55:38.220745 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 969/1933] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:55:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:38.227738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:38.228671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:38.237553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.238556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.239239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.240169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.241056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:38.241353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.241968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.251312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:38.270862 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b1f12b63-ee34-4f47-bce4-983f0d315ba7 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-881318008" status: 201 len: 0 microversion: 2.26 time: 0.200608 Oct 17 12:55:38.273819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 965/1934] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 17 12:55:38 2022] PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-881318008 => generated 0 bytes in 209 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 12:55:38.290436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa8252bfd30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:38.313334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.314366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.317410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.319480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:38.328881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.329842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.330609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.333491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.334241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.334934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.367177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.367935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.368539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.404152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:38.432390 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c846eada-828a-4b2a-9066-2edc79c59fdf tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 204 len: 0 microversion: 2.26 time: 0.154902 Oct 17 12:55:38.433754 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 966/1935] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 17 12:55:38 2022] DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 12:55:38.445990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb894047-0591-4bb7-a8a0-3c0ebf7e919c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa820fb1ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:38.458268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb894047-0591-4bb7-a8a0-3c0ebf7e919c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.459261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb894047-0591-4bb7-a8a0-3c0ebf7e919c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.459763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb894047-0591-4bb7-a8a0-3c0ebf7e919c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.470264 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb894047-0591-4bb7-a8a0-3c0ebf7e919c tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 200 len: 12 microversion: 2.26 time: 0.030706 Oct 17 12:55:38.472173 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 967/1936] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:55:38 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 12 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:38.484398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa825284c10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:38.497072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.497870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.498627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.499426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:38.509064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.509958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.510740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.511611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.512223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.512860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.562386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.562936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.564705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.578201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:38.604103 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ba59bc2-5dc6-4ee3-bfeb-02474d2d199a tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 204 len: 0 microversion: 2.26 time: 0.125489 Oct 17 12:55:38.605024 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 968/1937] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 17 12:55:38 2022] DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:38.606866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:38.633247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa820fb1ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:38.636429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:38.639114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:38.648313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.649091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.649712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.650392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:38.651640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2809a50-825e-43a2-b7b5-1c2b53dfd97a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.429692 Oct 17 12:55:38.655811 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 970/1938] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:38 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:38.678701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.679293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.679808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.680594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.681255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.681759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.715710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.717209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.717875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.729621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.730235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.730639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.764766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:38.785122 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48334d10-da96-4d50-aff5-2c03411db110 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-716967488" status: 201 len: 0 microversion: 2.26 time: 0.172023 Oct 17 12:55:38.786202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:38.786375 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 969/1939] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 17 12:55:38 2022] PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-716967488 => generated 0 bytes in 174 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 12:55:38.791635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:38.798758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa820d54c10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:38.807118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.807118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.807118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.807118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.808549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.808549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.811996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.812856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.813836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.814389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:38.826933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.826933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.826933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.826933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.826933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.826933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.861635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.862833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.863311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.875466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.876090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.876563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.913834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:38.933062 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-38c18f99-cbc4-43c3-9b3a-20ced5692040 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-1598296805" status: 201 len: 0 microversion: 2.26 time: 0.140356 Oct 17 12:55:38.941948 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 970/1940] 10.222.0.27 () {62 vars in 1380 bytes} [Mon Oct 17 12:55:38 2022] PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags/tempest-tag-1598296805 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 17 12:55:38.959160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Action: 'update_all', calling method: .version_select at 0x7fa825284670>, body: {"tags": ["tempest-tag-148276915", "tempest-tag-1500340030"]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:38.978811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.979971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.980703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.981801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:38.990922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.991901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.992795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:38.994462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:38.995045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:38.995614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.037722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.038615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.039281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.070072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:39.096205 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-df629d35-204f-4d04-895d-47c4497bd639 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 200 len: 61 microversion: 2.26 time: 0.152624 Oct 17 12:55:39.097936 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 971/1941] 10.222.0.27 () {62 vars in 1312 bytes} [Mon Oct 17 12:55:38 2022] PUT /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 61 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:39.109405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:39.119260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.120250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Searching by: {'deleted': False, 'project_id': '2035f4fadc8741738c4d0bf67e555717'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:55:39.130609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.132429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.133380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.134450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.135426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.136167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.174927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:55:39.205657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.225736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.227867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.229283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4022d87b-251b-4abc-a948-a9336ffd9a08 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.448198 Oct 17 12:55:39.229882 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 971/1942] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:38 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:39.245942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:39.246705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:39.257797 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f8370b1-cc2a-40ce-a6e0-380d504feae7 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.157103 Oct 17 12:55:39.261800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.266278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.266278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.266278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.268765 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 972/1943] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 12:55:39 2022] GET /compute/v2.1/servers => generated 344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:39.268966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.269245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.274024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25554d4f-c255-48e9-93da-2a28dab3e13d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa825284f70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:39.281956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:39.309375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25554d4f-c255-48e9-93da-2a28dab3e13d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.309882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25554d4f-c255-48e9-93da-2a28dab3e13d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.317896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25554d4f-c255-48e9-93da-2a28dab3e13d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.370513 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25554d4f-c255-48e9-93da-2a28dab3e13d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 200 len: 61 microversion: 2.26 time: 0.087093 Oct 17 12:55:39.371725 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 973/1944] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 12:55:39 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 61 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:39.385133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:39.386054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:39.399148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.399895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.401785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.405464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.406362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.407492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.511111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.539954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.544465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.548318 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b346b22-c45d-4c14-ab9f-089571eba34c tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1348 microversion: 2.57 time: 0.314537 Oct 17 12:55:39.550563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 972/1945] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:39 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1348 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:39.588860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:39.596194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.598617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Searching by: {'deleted': False, 'project_id': '2035f4fadc8741738c4d0bf67e555717'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 12:55:39.609991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.610573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.611101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.611876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.612955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.613425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.664348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 12:55:39.684390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.697870 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3955e0db-43f1-4176-9369-d6d6c825755f tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.324928 Oct 17 12:55:39.712269 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 974/1946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:39 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:39.712269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '.version_select at 0x7fa8252c2dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:39.733385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.740166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.740700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.741419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:39.746470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:39.752896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.753385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.753547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.753986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.754374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.754959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.755923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.762654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.763395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.783342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:39.792791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.793433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.793954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.836650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lazy-loading 'flavor' on Instance uuid 7a3f9b5d-f890-4bab-ab06-f817eb89583f {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:39.859071 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e994537f-358a-4038-a5c8-6fbe2b7150fb tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags" status: 204 len: 0 microversion: 2.26 time: 0.155900 Oct 17 12:55:39.860984 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 975/1947] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 17 12:55:39 2022] DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f/tags => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:39.869864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:39.870975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:39.879855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.880750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.881696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.882744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:39.883731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:39.885721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:39.984030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.001544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.005067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.013392 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f22f5fad-ad5c-47c1-be70-f5a0f6520cf1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.149728 Oct 17 12:55:40.015708 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 976/1948] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:39 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:40.023124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:40.025193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:40.038734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.040872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.041744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.042991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.043769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.044399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.098795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:55:40.257161 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-00cba24e-2be2-49b9-ba20-28ab07cfd45d tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 204 len: 0 microversion: 2.26 time: 0.238785 Oct 17 12:55:40.258321 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 977/1949] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:55:40 2022] DELETE /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:55:40.269692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:40.269692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:40.277433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.278044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.279323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.280264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.281795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.282507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.340748 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a6a4a61-29a8-4802-aa8a-4aecde4d237e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.766035 Oct 17 12:55:40.341559 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 973/1950] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 12:55:39 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:40.361465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:40.363193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:40.378398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.379766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.380486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.381486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.386110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.387116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.543356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.556336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.559036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.560184 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d2328ea-c607-4384-a22e-8fe600a0e4b3 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.300629 Oct 17 12:55:40.561017 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 978/1951] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:40 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:40.590219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c803c3c-3a00-43e0-9036-13866a3d656f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:40.600714 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c803c3c-3a00-43e0-9036-13866a3d656f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022833 Oct 17 12:55:40.601486 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 979/1952] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 12:55:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:40.607082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:40.607962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:40.624559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.625894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.626620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.627605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.629322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.630320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.725358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.735752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.738365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.739753 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7900c54f-bf9b-4a89-95b7-bddb3b715e11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1336 microversion: 2.57 time: 0.136903 Oct 17 12:55:40.746099 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 980/1953] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:40 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1336 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:40.751068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:40.751696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:40.763509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.763902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.764357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.765098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:40.765588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:40.766261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:40.987023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:40.999262 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35f91f4d-3cec-48b9-a2e1-772bc54a3832 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.252001 Oct 17 12:55:41.010200 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 981/1954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:40 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:41.010200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:41.010200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:41.021000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.023754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.025263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.025775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.026648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.027203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.029435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.033340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.036055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.037955 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9131db23-a05f-46f7-9c99-899990efb65e tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1552 microversion: 2.26 time: 0.695288 Oct 17 12:55:41.039949 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 974/1955] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:40 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1552 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:41.052829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:41.053964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:41.072774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.073287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.073735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.074492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.074954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.075383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.094080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:55:41.238835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.239443 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-03aaf5af-aaac-43b6-bf58-cbcf90e4382b tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 204 len: 0 microversion: 2.1 time: 0.237695 Oct 17 12:55:41.243164 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 982/1956] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:55:41 2022] DELETE /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:55:41.249752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:41.250505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:41.251636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.253783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.269537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.270037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.270547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.271281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.271742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.272189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.273522 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-852dd86e-2d50-46d5-b574-c0a9a0051f34 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.225908 Oct 17 12:55:41.290639 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 975/1957] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:41 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:41.594357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:41.595256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:41.626098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.627019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.627695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.629974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.630797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.631487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.637884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.646497 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-81152cc1-2427-4122-a22f-fa4297fd6aa8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1608 microversion: 2.1 time: 0.401821 Oct 17 12:55:41.654965 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 983/1958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:41 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1608 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:41.767761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:41.768251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:41.780191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.780427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.781893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.788315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:41.788315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:41.788315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:41.965048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.977113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.980460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:41.981843 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7970b4bc-05d5-4de1-b434-df4966807ab0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1336 microversion: 2.57 time: 0.218646 Oct 17 12:55:41.994749 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 984/1959] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:41 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1336 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:42.008480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-183099592", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:42.088677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] validate_networks() for [('ab875c4f-87a3-4bf3-a48a-3e1cbefa8c2f', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:55:42.094833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:42.109476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:42.116994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:42.118527 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6178dc40-44cc-4fca-aa1e-971db8d8aa31 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.529047 Oct 17 12:55:42.120717 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 976/1960] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:41 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:42.138745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:42.139476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:42.148482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.151324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.152056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:42.153272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.155179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.155720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:42.584445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:42.597757 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2a6434e5-a6e4-41e4-bccf-0dc3a3b74664 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.475154 Oct 17 12:55:42.599158 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 977/1961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:42 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:42.621768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:42.622549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:42.634530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.636551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.638129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:42.639412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.639931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:55:42.640360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:55:42.640837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:55:42.641248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:55:42.641660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:55:42.642853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.645332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:42.652856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.653632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.654456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:42.655574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.656221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.657079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:42.679404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Getting quotas for project 450b3f93e96f43ba9c4c64f3552f934c. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:55:42.686466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Getting quotas for user 9a1e4aea1c6c4ca9a9960e814a7ea07c and project 450b3f93e96f43ba9c4c64f3552f934c. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:55:42.716709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:55:42.719431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:55:42.795232 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-959da3e9-3bee-4352-8ea7-28be0996150c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.799123 Oct 17 12:55:42.804323 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 985/1962] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:55:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:55:42.809585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3f67fed3-569f-4d80-a573-fdffdd4b867c req-06c4cc5c-17f9-410a-a7f9-5c31cb063b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5172ea-5f53-483b-b469-8fb6a9ea5a6b", "tag": "10322626-559a-4ee7-8e62-ad809bff351b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:42.826086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3f67fed3-569f-4d80-a573-fdffdd4b867c req-06c4cc5c-17f9-410a-a7f9-5c31cb063b68 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.826963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3f67fed3-569f-4d80-a573-fdffdd4b867c req-06c4cc5c-17f9-410a-a7f9-5c31cb063b68 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.827644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3f67fed3-569f-4d80-a573-fdffdd4b867c req-06c4cc5c-17f9-410a-a7f9-5c31cb063b68 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:42.839150 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3f67fed3-569f-4d80-a573-fdffdd4b867c req-06c4cc5c-17f9-410a-a7f9-5c31cb063b68 service nova] Creating event network-changed:10322626-559a-4ee7-8e62-ad809bff351b for instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b on n-h2-853316-12 Oct 17 12:55:42.845833 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3f67fed3-569f-4d80-a573-fdffdd4b867c req-06c4cc5c-17f9-410a-a7f9-5c31cb063b68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039517 Oct 17 12:55:42.854348 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 986/1963] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:42.860658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:42.861553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:42.868941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.869871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.870605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:42.871560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:42.872266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:42.873204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:43.030566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.045880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.047571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.056567 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04ce29db-2924-41be-81df-9fc28acec1fd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.200615 Oct 17 12:55:43.057285 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 987/1964] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:42 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:43.075278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:43.076186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:43.085023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:43.085701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:43.086252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:43.088257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:43.088821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:43.089485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:43.235745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.253550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.255308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.256557 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e910021-6eb4-4dce-851f-aeac392c46fa tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1552 microversion: 2.26 time: 0.656442 Oct 17 12:55:43.257131 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 978/1965] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:42 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1552 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:43.265306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ce31e78-ea61-4d9a-9434-4777358da731 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:43.270955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ce31e78-ea61-4d9a-9434-4777358da731 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:43.495013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ce31e78-ea61-4d9a-9434-4777358da731 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.504513 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ce31e78-ea61-4d9a-9434-4777358da731 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1224 microversion: 2.1 time: 0.244770 Oct 17 12:55:43.516212 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 979/1966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:43 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1224 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:43.542417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:43.543268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:43.554628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:43.555361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:43.556003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:43.557416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:43.558055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:43.558778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:43.647897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.678442 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-caae6dc9-1c44-44d3-a8ed-a1c94addd51f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1608 microversion: 2.1 time: 0.620181 Oct 17 12:55:43.680255 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 988/1967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:43 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1608 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:43.712485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:43.713479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:43.730822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:43.733833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:43.734553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:43.736457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:43.739393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:43.740192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:43.766250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.781981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.789551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:43.799133 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4cd9246c-3e5e-46d5-bf7f-40cd23995608 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1357 microversion: 2.57 time: 0.267418 Oct 17 12:55:43.804760 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 980/1968] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:43 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1357 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:43.818252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:43.843251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:43.855190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:43.856407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:43.857112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:43.858020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:43.859233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:43.859870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.173987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.187218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.193515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.195467 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ed2850c-accd-40bf-9fe7-9de39b18ea00 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1487 microversion: 2.25 time: 0.513888 Oct 17 12:55:44.208006 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 989/1969] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:43 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1487 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:44.223446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:44.226540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:44.234001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.234907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.235614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.236560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.237278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.237933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.332350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:44.358333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:55:44.359110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:55:44.359780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:55:44.360370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:55:44.360961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:55:44.381789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.396586 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0469a49-171b-42df-b4c3-af931ae6fc6b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.590387 Oct 17 12:55:44.398252 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 981/1970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:43 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:44.406955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:44.408079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:44.416598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.417456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.418333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.419306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.420213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.420881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.452378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:44.461205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.461917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.462751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.464000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.465002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.465989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.540503 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7adbf721-8f4c-4f9a-b7d6-1f569ae7358f tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "POST /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821/action" status: 202 len: 1138 microversion: 2.57 time: 0.321124 Oct 17 12:55:44.541956 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 990/1971] 10.222.0.27 () {62 vars in 1320 bytes} [Mon Oct 17 12:55:44 2022] POST /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821/action => generated 1138 bytes in 333 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 12:55:44.547230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:44.548101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:44.555154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.556284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.558568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.559797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.560493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.561149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.653484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.667034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.671924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.693791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.699447 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe6dd13c-1e5c-4bf0-98ef-13c39ec3ba47 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1533 microversion: 2.91 time: 0.299807 Oct 17 12:55:44.714679 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 982/1972] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:44 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1533 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:44.714916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.714916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c1bddbdf5554e57a2abff13e3cf2341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36208644b7bf410c8cac37bdd22959df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.714916 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf40317c-a2a1-40b5-8947-61703fece120 tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 200 len: 1510 microversion: 2.26 time: 0.170236 Oct 17 12:55:44.715819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 991/1973] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:44 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:44.727290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:44.728296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:44.744115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:44.744801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:44.745900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.748322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.748887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.750838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.751752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.754088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.777177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.777706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.779553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.780329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.780795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.781234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.905738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.922874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.927959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.934369 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dc47c386-c82f-4922-97a8-0dafc3cf845e tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.215510 Oct 17 12:55:44.935927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:44.936492 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 992/1974] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:44 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:44.944551 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6558bf40-dcc4-4926-8f97-1c16025ae6fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1284 microversion: 2.1 time: 0.221956 Oct 17 12:55:44.968377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:44.973004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:44.974259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 983/1975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:44 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:44.986907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:44.991333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.992235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.993558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:44.995392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:44.997669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:44.998453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:44.999709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:45.015309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:45.015809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:45.017368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:45.018408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:45.019463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:45.020190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:45.113996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lazy-loading 'services' on Instance uuid 4989d7ea-4d14-4eff-9da0-417d549e10f5 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:45.136148 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0abd4bb3-a707-4ef2-8300-da131d5b55f2 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1940 microversion: 2.91 time: 0.160672 Oct 17 12:55:45.137902 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 984/1976] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:44 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1940 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:45.163362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-84cee9a9-38c9-475b-ad1e-a62c5f634cd2 req-93eb0b42-d778-4648-8cd6-a0f6c5e8fa3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3f9b5d-f890-4bab-ab06-f817eb89583f", "name": "network-vif-deleted", "tag": "bbff9c4d-1224-4974-a6a4-fa9ac3e884c3"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:45.179717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-84cee9a9-38c9-475b-ad1e-a62c5f634cd2 req-93eb0b42-d778-4648-8cd6-a0f6c5e8fa3b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:45.180208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-84cee9a9-38c9-475b-ad1e-a62c5f634cd2 req-93eb0b42-d778-4648-8cd6-a0f6c5e8fa3b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:45.189372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-84cee9a9-38c9-475b-ad1e-a62c5f634cd2 req-93eb0b42-d778-4648-8cd6-a0f6c5e8fa3b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:45.236973 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-84cee9a9-38c9-475b-ad1e-a62c5f634cd2 req-93eb0b42-d778-4648-8cd6-a0f6c5e8fa3b service nova] Creating event network-vif-deleted:bbff9c4d-1224-4974-a6a4-fa9ac3e884c3 for instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f on n-h2-853316-12 Oct 17 12:55:45.243640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-84cee9a9-38c9-475b-ad1e-a62c5f634cd2 req-93eb0b42-d778-4648-8cd6-a0f6c5e8fa3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103766 Oct 17 12:55:45.244920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 985/1977] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:45.254130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:45.255125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:45.269973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:45.271208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:45.272142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:45.274517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:45.277784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:45.278495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:45.374429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lazy-loading 'flavor' on Instance uuid 4989d7ea-4d14-4eff-9da0-417d549e10f5 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:45.511304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:45.839734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40fdf79b-7ca4-461a-b8ef-cd506619bad0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "POST /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5/action" status: 202 len: 0 microversion: 2.91 time: 0.592251 Oct 17 12:55:45.840674 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 986/1978] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:55:45 2022] POST /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:55:45.870863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:45.876574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:45.893811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:45.894910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:45.895595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:45.896516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:45.897174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:45.897804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:46.142697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:46.165062 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-697a752f-d3dc-4405-8408-a1a8924aa059 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1608 microversion: 2.1 time: 1.212377 Oct 17 12:55:46.166115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 993/1979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:44 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1608 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:46.175935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:46.180632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:46.192128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:46.193174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:46.193937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:46.194949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:46.195648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:46.196309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:46.651137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:46.663427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:46.664959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:46.666053 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-daad0d5d-bb83-48df-8bad-e4efb06fb87d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1477 microversion: 2.25 time: 0.824045 Oct 17 12:55:46.675062 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 987/1980] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:45 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1477 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:46.680199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:46.688537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] [instance: 7a3f9b5d-f890-4bab-ab06-f817eb89583f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:46.706586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:46.707440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:46.707569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:46.708191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:46.708666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:46.709074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:46.726663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:46.743809 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-433f6c6f-9730-4da0-8f94-0df3a51f777d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.576387 Oct 17 12:55:46.747521 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 994/1981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:46 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:46.757845 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] HTTP exception thrown: Instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f could not be found. Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Request method failure captured: Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f HTTP/1.1 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVCnGyuilwvNIWlkSDTMtzC35aBSjpXopAI6IBkMh46Os46N5cXtAu1SkrFZ_d5KAhHEDM39Z_rUovuzUpyu39tEprWK7w9LIHqP80Q5QDbvhWZazGpPQ3LJm5noOBT7e_B-iSDqrdCxGJ40U3WKN0XgPEZX2-hW3emZEv0Ihqk2AcI Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.26 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 36208644b7bf410c8cac37bdd22959df Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerTagsTestJSON-1200448439 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36208644b7bf410c8cac37bdd22959df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36208644b7bf410c8cac37bdd22959df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36208644b7bf410c8cac37bdd22959df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36208644b7bf410c8cac37bdd22959df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerTagsTestJSON-1200448439 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 36208644b7bf410c8cac37bdd22959df Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerTagsTestJSON-1200448439 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerTagsTestJSON-1200448439-project Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 8c1bddbdf5554e57a2abff13e3cf2341 Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerTagsTestJSON-1200448439-project Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f could not be found. Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7a3f9b5d-f890-4bab-ab06-f817eb89583f'} Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f could not be found. Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f could not be found. Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:46.761395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f could not be found. Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] Returning 404 to user: Instance 7a3f9b5d-f890-4bab-ab06-f817eb89583f could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:46.776115 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e7ee561-833a-4f53-9dfd-d57cb18e28fd tempest-ServerTagsTestJSON-1200448439 tempest-ServerTagsTestJSON-1200448439-project] 10.222.0.27 "GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f" status: 404 len: 111 microversion: 2.26 time: 0.086474 Oct 17 12:55:46.784725 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 988/1982] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:46 2022] GET /compute/v2.1/servers/7a3f9b5d-f890-4bab-ab06-f817eb89583f => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:55:46.801425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:46.802055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:46.812330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:46.817072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:46.829367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:46.829867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:46.830332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:46.831577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:46.832041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:46.832572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:46.835377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:46.842656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:46.847524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:46.848821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:46.849568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:46.850321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.017928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:47.027815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:47.041856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:47.043585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3dfb369b-21a0-4838-b96e-9b672dffd910 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.257672 Oct 17 12:55:47.044649 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 989/1983] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:46 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:47.051287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:47.057110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:47.075277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:47.080074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:47.080639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.086654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:47.087254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:47.087799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.234371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:47.249166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:47.252611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:47.265516 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c11b8b15-2494-4b9a-9c2b-ef89e70b9a68 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.516470 Oct 17 12:55:47.279541 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 995/1984] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:46 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:47.281148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fba79b5-f3ca-4560-bff8-4d85f1993399 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '.version_select at 0x7fa82529a9d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:47.291208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fba79b5-f3ca-4560-bff8-4d85f1993399 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:47.294450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fba79b5-f3ca-4560-bff8-4d85f1993399 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:47.295205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fba79b5-f3ca-4560-bff8-4d85f1993399 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.328075 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7fba79b5-f3ca-4560-bff8-4d85f1993399 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.050794 Oct 17 12:55:47.330290 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 996/1985] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 17 12:55:47 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:47.342653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:47.343764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:47.360943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:47.369292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:47.369894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.370977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:47.371543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:47.372072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.380510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:47.392234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-828800c1-64a8-4650-a7d9-8452e80bdb50 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1282 microversion: 2.1 time: 0.346171 Oct 17 12:55:47.392815 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 990/1986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:47 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1282 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:47.410701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-82b91c82-4c92-4c23-94b1-9ac38c232117 req-44909e27-92dd-411c-b203-2401be81c67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdcbc7c-5033-4c97-9d0d-c949a0afe70b", "name": "network-vif-deleted", "tag": "8b0cc8df-c676-4f6a-95cc-63c24aa2d7e3"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:47.454126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-82b91c82-4c92-4c23-94b1-9ac38c232117 req-44909e27-92dd-411c-b203-2401be81c67c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:47.454623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-82b91c82-4c92-4c23-94b1-9ac38c232117 req-44909e27-92dd-411c-b203-2401be81c67c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:47.455063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-82b91c82-4c92-4c23-94b1-9ac38c232117 req-44909e27-92dd-411c-b203-2401be81c67c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.490807 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-82b91c82-4c92-4c23-94b1-9ac38c232117 req-44909e27-92dd-411c-b203-2401be81c67c service nova] Creating event network-vif-deleted:8b0cc8df-c676-4f6a-95cc-63c24aa2d7e3 for instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b on n-h1-853316-12 Oct 17 12:55:47.545996 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-82b91c82-4c92-4c23-94b1-9ac38c232117 req-44909e27-92dd-411c-b203-2401be81c67c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151912 Oct 17 12:55:47.554626 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 991/1987] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:47.581822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:47.584898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:47.600943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:47.605351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:47.606091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:47.609783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.610869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:47.611582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:47.616835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:47.927038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] Lazy-loading 'services' on Instance uuid 668320eb-1f68-4fcd-addd-aef8b2271f2a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:47.969335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11f868b1-82d8-4abd-9e3b-1824ba869ff0 tempest-LiveAutoBlockMigrationV225Test-527223671 tempest-LiveAutoBlockMigrationV225Test-527223671-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1972 microversion: 2.25 time: 0.413124 Oct 17 12:55:47.975298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:47.984964 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-994d07d0-1ab5-41ce-8c48-dcf2c7a48915 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1252 microversion: 2.1 time: 0.653477 Oct 17 12:55:47.990190 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 997/1988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:47 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1252 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:48.000356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:48.000994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:48.017826 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 992/1989] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:47 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1972 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:48.021230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:48.021740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:48.022275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:48.023000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:48.025256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:48.025701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:48.041541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:48.042702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:48.059515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:48.060295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:48.060914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:48.061830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:48.064882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:48.066217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:48.136247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:55:48.352503 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d362715-c3ad-4df9-81d9-4f683da88564 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 204 len: 0 microversion: 2.25 time: 0.316053 Oct 17 12:55:48.358719 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 993/1990] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:55:48 2022] DELETE /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 12:55:48.368063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:48.369155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:48.376871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:48.378706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:48.379634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:48.384802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:48.385355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:48.385811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:48.930699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:48.949166 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52d01ba6-9725-43e5-a339-44f02bf7c9da tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.956860 Oct 17 12:55:48.950539 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 998/1991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:47 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:48.965440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:48.966483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:48.980292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:48.981171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:48.981882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:48.986087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:48.990974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:48.997441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:49.128656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.137828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.140233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.141674 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50a69059-3232-4fae-b716-a6bcf4c6a2ec tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.781639 Oct 17 12:55:49.142993 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 994/1992] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:48 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:49.148977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:49.149894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:49.156265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:49.157063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:49.157756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:49.158711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:49.159497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:49.160146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:49.304822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.315784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.317530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.334289 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ee8d1b5-4fac-4e8a-8e43-fa14205c3ae3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.382343 Oct 17 12:55:49.346232 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 999/1993] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:48 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:49.346232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:49.346232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:49.360987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:49.361489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:49.361957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:49.363266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:49.363726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:49.364158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:49.425731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.435233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.440111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.445223 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-022334cd-2baa-495e-9205-b44308216681 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1483 microversion: 2.25 time: 0.300321 Oct 17 12:55:49.453336 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 995/1994] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:49 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1483 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:49.463672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:49.465638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:49.481023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:49.481532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:49.482132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:49.482881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:49.483341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:49.483774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:49.598249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.608644 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9290b739-1cdb-4af9-be85-09e33c255fb0 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1252 microversion: 2.1 time: 0.153883 Oct 17 12:55:49.613474 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 996/1995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:49 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1252 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:49.935597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:49.949941 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a8b9d725-806a-4b39-bdbf-d8a57b356536 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.613504 Oct 17 12:55:49.971551 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1000/1996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:49 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:49.977832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:49.978421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:49.980422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:49.994532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:49.995390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:49.999689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:50.001474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:50.002223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:50.003000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:50.168848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:50.169469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:50.178397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:50.178898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:50.179350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:50.180077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:50.180534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:50.180960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:50.374674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:50.382450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:50.389245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:50.391277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:50.394951 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-40b6d6a7-609d-413f-baa3-bac185b6fb9d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.229960 Oct 17 12:55:50.398479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4e0b146-a6c1-4009-9fe1-bd391efeae55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.424554 Oct 17 12:55:50.398921 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1001/1997] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:50 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:50.402066 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 997/1998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:49 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:50.411507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:50.412138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:50.431817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:50.432453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:50.432901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:50.433720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:50.434402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:50.435006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:50.487494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:50.488306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:50.504912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:50.506323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:50.506851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:50.508701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:50.509274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:50.509762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:50.980015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:50.998845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:51.005838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:51.007145 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eaef1bea-9c98-40df-a1dd-6f87b60258ee tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1483 microversion: 2.25 time: 0.526587 Oct 17 12:55:51.007735 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 998/1999] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:50 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1483 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:51.025875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:51.027573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:51.053961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.054780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.055416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.056328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.061382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.062024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.119508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:51.135971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:51.138422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:51.150280 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c0b6ea01-56d7-47eb-afe8-9582d2a04f65 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.749948 Oct 17 12:55:51.168460 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1002/2000] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:50 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:51.180065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:51.181098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:51.195710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:51.198049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.198718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.199533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.200683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.201697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.203486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.240537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:51.258366 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00f86da2-568a-4fbc-93e7-849daef099e8 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1252 microversion: 2.1 time: 0.245148 Oct 17 12:55:51.263797 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 999/2001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:51 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1252 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:51.279707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f3013db2-12f5-4113-8911-5fdbe9146549 req-3ce36447-bf7b-4325-bc13-78e95540a220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5172ea-5f53-483b-b469-8fb6a9ea5a6b", "name": "network-vif-plugged", "status": "completed", "tag": "10322626-559a-4ee7-8e62-ad809bff351b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:51.306352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f3013db2-12f5-4113-8911-5fdbe9146549 req-3ce36447-bf7b-4325-bc13-78e95540a220 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.307151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f3013db2-12f5-4113-8911-5fdbe9146549 req-3ce36447-bf7b-4325-bc13-78e95540a220 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.307869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f3013db2-12f5-4113-8911-5fdbe9146549 req-3ce36447-bf7b-4325-bc13-78e95540a220 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.328490 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f3013db2-12f5-4113-8911-5fdbe9146549 req-3ce36447-bf7b-4325-bc13-78e95540a220 service nova] Creating event network-vif-plugged:10322626-559a-4ee7-8e62-ad809bff351b for instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b on n-h2-853316-12 Oct 17 12:55:51.344547 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f3013db2-12f5-4113-8911-5fdbe9146549 req-3ce36447-bf7b-4325-bc13-78e95540a220 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075595 Oct 17 12:55:51.348350 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1000/2002] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:51.426810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:51.428255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:51.435020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.435733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.436374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.437260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.438104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.438723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.787204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:51.797402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f4fa394b-0757-43e8-8692-da00859ab8c7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.627383 Oct 17 12:55:51.817309 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1003/2003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:51 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:51.824708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:51.825714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:51.834402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.835149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.835903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.837889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:51.838571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:51.839164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:51.864632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:51.878797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88cca604-3126-4ed2-84b8-f0d8a8b6b9d7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.456821 Oct 17 12:55:51.879681 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1001/2004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:51 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:52.037989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:52.038683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:52.050756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.054033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.054654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.055477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.055957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.056392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.065312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:52.179570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.191823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.196995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.198270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ef572ca-2a68-422b-8e88-cb9e24796c1a tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.377488 Oct 17 12:55:52.209607 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1004/2005] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:51 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:52.218715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-30356f64-f08e-4307-8f0f-5bd5a5f5841d req-8e8dffb3-b1d8-4198-90fe-9b42df27c871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668320eb-1f68-4fcd-addd-aef8b2271f2a", "name": "network-vif-deleted", "tag": "dfb3775c-e68d-4644-94da-eb293b65a58c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:52.245741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30356f64-f08e-4307-8f0f-5bd5a5f5841d req-8e8dffb3-b1d8-4198-90fe-9b42df27c871 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.246241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30356f64-f08e-4307-8f0f-5bd5a5f5841d req-8e8dffb3-b1d8-4198-90fe-9b42df27c871 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.246678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30356f64-f08e-4307-8f0f-5bd5a5f5841d req-8e8dffb3-b1d8-4198-90fe-9b42df27c871 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.292681 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-30356f64-f08e-4307-8f0f-5bd5a5f5841d req-8e8dffb3-b1d8-4198-90fe-9b42df27c871 service nova] Creating event network-vif-deleted:dfb3775c-e68d-4644-94da-eb293b65a58c for instance 668320eb-1f68-4fcd-addd-aef8b2271f2a on n-h2-853316-12 Oct 17 12:55:52.312568 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-30356f64-f08e-4307-8f0f-5bd5a5f5841d req-8e8dffb3-b1d8-4198-90fe-9b42df27c871 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101487 Oct 17 12:55:52.313186 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1005/2006] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:52.320111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:52.326374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:52.344633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.345442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.348323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.349206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.350757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.356005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.530968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.547576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:52.548024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.556092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.558770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.568093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.568808 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6a6fc031-4d93-4567-a2d3-1501930e35c7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.253520 Oct 17 12:55:52.569654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.570914 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8be0c18b-fb22-4864-9e86-07c0573863a6 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1441 microversion: 2.25 time: 0.539600 Oct 17 12:55:52.576475 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1002/2007] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:52 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1441 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:52.589213 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1006/2008] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:52 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:52.593400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:52.594237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:52.604037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.604826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.608432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.609464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.610126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.610782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.733300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:52.751259 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d06103d1-551f-4203-bc6d-e2933bfd3af9 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1252 microversion: 2.1 time: 0.161942 Oct 17 12:55:52.751849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1003/2009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:52 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1252 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:52.832476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:52.834521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:52.851705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:52.859036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:52.866903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.870101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.871868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.872867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.878650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.880281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.904648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:52.905957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:52.914949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.915452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.915896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:52.916621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:52.917084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:52.917514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.326300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:53.340414 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-177c250e-c3fa-45a5-a58c-a9d0733f409f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.515342 Oct 17 12:55:53.354189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1007/2010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:52 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:53.354189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:53.354189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:53.370590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:53.371087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:53.371527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.379109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:53.380165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:53.381053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.500672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=20 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:53.573928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:53.591898 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc4db6d2-7625-4b54-a8e5-f55982632118 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1324 microversion: 2.1 time: 0.687543 Oct 17 12:55:53.593777 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1004/2011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:52 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:53.610364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:53.616371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:53.631160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:53.631787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:53.632322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.633269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:53.634432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:53.635438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.768942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:53.786585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:53.788062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:53.789280 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab33cbae-03cd-4656-81b0-48251233780d tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.446672 Oct 17 12:55:53.796825 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1008/2012] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:53 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:53.815087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:53.824600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:53.835600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:53.846068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:53.849287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:53.854963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:53.855729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:53.856362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.857263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:53.857916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:53.858546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.859651 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab2086bc-da6f-47a2-b135-ac258abd173f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.263299 Oct 17 12:55:53.866864 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1005/2013] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:53 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:55:53.871852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:53.872589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:53.886194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:53.886858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:53.891528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.892898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:53.893568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:53.894808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:53.992566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:54.009006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:54.012680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:54.015876 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-37513b73-9029-4e4c-92f5-4a0dcaad06ef tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1266 microversion: 2.25 time: 0.217243 Oct 17 12:55:54.018429 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1009/2014] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:53 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:54.127345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:54.139883 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-71db5613-78d6-4db4-8aa9-819eb0554775 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1252 microversion: 2.1 time: 0.271803 Oct 17 12:55:54.143885 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1006/2015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:53 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1252 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:54.350688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f5b64a2b-f6b2-46b8-8359-1a3b95d81cef req-e760967b-4b0a-4c20-94e3-8ce7924b9788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d1a825-3c09-415b-ad04-ee11d8d0ccd5", "tag": "86862125-98f4-4524-b929-b877a16c6e68"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:54.365923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:54.366948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:54.368637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f5b64a2b-f6b2-46b8-8359-1a3b95d81cef req-e760967b-4b0a-4c20-94e3-8ce7924b9788 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.370823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f5b64a2b-f6b2-46b8-8359-1a3b95d81cef req-e760967b-4b0a-4c20-94e3-8ce7924b9788 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.371375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f5b64a2b-f6b2-46b8-8359-1a3b95d81cef req-e760967b-4b0a-4c20-94e3-8ce7924b9788 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:54.377517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.379142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.379772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:54.381530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.387465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.388167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:54.405153 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f5b64a2b-f6b2-46b8-8359-1a3b95d81cef req-e760967b-4b0a-4c20-94e3-8ce7924b9788 service nova] Creating event network-changed:86862125-98f4-4524-b929-b877a16c6e68 for instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 on n-h1-853316-12 Oct 17 12:55:54.416993 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f5b64a2b-f6b2-46b8-8359-1a3b95d81cef req-e760967b-4b0a-4c20-94e3-8ce7924b9788 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070187 Oct 17 12:55:54.418155 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1010/2016] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:54.622105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:54.623181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:54.642880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.649839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.650683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:54.651144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:54.652121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.652858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.653525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:54.669794 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e8a042a-9cb2-4084-8b4c-5e45acbe447c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.307087 Oct 17 12:55:54.682743 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1007/2017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:54 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:54.827475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:54.828084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:54.835972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.836471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.836913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:54.837630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.838085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.838539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:54.896775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:54.908624 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4d2bd27e-6f4b-48d8-a543-2e5dc749e17e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1520 microversion: 2.1 time: 0.292290 Oct 17 12:55:54.910994 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1011/2018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:54 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:54.916606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:54.917508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:54.925693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.926628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.927399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:54.928376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:54.929077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:54.929740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:55.053550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.064108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.072010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.079197 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1690a492-e95a-4647-b265-957211c7bb8d tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.166263 Oct 17 12:55:55.080545 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1012/2019] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:54 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:55.086632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-487eeee2-ca03-44aa-9a6a-72dfc5760a4d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'create', calling method: .version_select at 0x7fa8252e51f0>, body: {"pool": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:55.202988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.243474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.245597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.247101 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-36f5d562-afcb-449e-9ba8-84ac503cbda2 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.423495 Oct 17 12:55:55.248290 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1008/2020] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:54 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:55.255847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:55.257940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:55.273665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:55.274468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:55.275416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:55.276604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:55.277240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:55.277836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:55.499015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.513485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.515745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.519322 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2545e29c-069c-4688-a51f-12138c69af76 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1266 microversion: 2.25 time: 0.269446 Oct 17 12:55:55.520611 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1009/2021] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:55 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:55.526047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:55.526906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:55.532996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:55.533715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:55.536905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:55.538424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:55.539057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:55.539659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:55.719769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:55.728592 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d668fcb-f133-425b-8fac-94eeae244936 tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1252 microversion: 2.1 time: 0.206572 Oct 17 12:55:55.729170 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1010/2022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:55 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1252 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:55.736404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:55.738054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:55.747403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:55.748297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:55.749003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:55.749965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:55.750810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:55.752149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:56.440752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:56.457469 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-209c8b6f-4a8d-4d51-98f8-f54c0198a9fb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.725884 Oct 17 12:55:56.474897 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1011/2023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:55 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:56.493050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:56.493902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:56.506632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:56.509777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:56.510542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:56.511524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:56.515789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:56.516534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:56.784496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:56.813109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:56.818480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:56.827621 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-856ae958-633c-40c5-81ac-e55ddec079dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.351343 Oct 17 12:55:56.828846 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1012/2024] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:56 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:56.864321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:56.864944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:56.877039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:56.877544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:56.878143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:56.879142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:56.879604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:56.880268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.015957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:57.028667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:57.040834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:57.042139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1417e7dd-c8b5-45d5-8788-7029a806a7f3 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.188941 Oct 17 12:55:57.043160 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1013/2025] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:56 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:57.048597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:57.049199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:57.056700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.057822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.058543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.059476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.060140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.060775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.154134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:57.167919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:57.177143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:57.178438 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-309889ba-9aaf-4b21-bb5f-c37c5cf84cf2 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1266 microversion: 2.25 time: 0.134210 Oct 17 12:55:57.189046 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1014/2026] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:57 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:57.199473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:57.200273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:57.218749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.219334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.220512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.221362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.222719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.223442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.280095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.280588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.282600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.283440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lazy-loading 'fault' on Instance uuid bfdcbc7c-5033-4c97-9d0d-c949a0afe70b {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:55:57.362711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564a2e749d644c5f8906c175cd34d6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2035f4fadc8741738c4d0bf67e555717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:57.381631 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e40fe6d4-f977-4f32-b1f3-114f9060317e tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 200 len: 1257 microversion: 2.1 time: 0.189805 Oct 17 12:55:57.385000 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1015/2027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:57 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 1257 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:57.490602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:57.491252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:57.510310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.511044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.514044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.516329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.517182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.517791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.843297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:57.856606 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45d359f1-f446-4970-94d1-d7a36279cd94 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.375380 Oct 17 12:55:57.862700 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1016/2028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:57 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:55:57.885103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:57.890258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:57.902148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.902711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.906602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:57.907355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:57.908011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:57.908648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:58.060015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.075295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.076778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.094625 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9ec4921-6496-43ef-a1a3-f19aaa2a74ab tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.230568 Oct 17 12:55:58.098728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1017/2029] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:57 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:58.106114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:58.129704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:58.148137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:58.149424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:58.149972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:58.153007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:58.153627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:58.154198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:58.208886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:55:58.306399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.317111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.318758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.323092 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e95aa86f-bc2c-4a8a-8d96-e124b084dfe4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.223226 Oct 17 12:55:58.328170 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1018/2030] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:58 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:58.337913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:58.339601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:58.355874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:58.356890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:58.359624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:58.360782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:58.363927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:58.364695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:58.535314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.550201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.561910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:58.563575 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31cf9dc4-9a6a-4a82-b443-4b7793de4810 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1266 microversion: 2.25 time: 0.234012 Oct 17 12:55:58.565860 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1019/2031] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:58 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:58.586153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:58.590139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] [instance: bfdcbc7c-5033-4c97-9d0d-c949a0afe70b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:58.607053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:58.609398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:58.609845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:58.610609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:58.614910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:58.617874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:58.674852 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] HTTP exception thrown: Instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b could not be found. Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Request method failure captured: Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b HTTP/1.1 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVBHfXeG2rvsySz05Ak9jlikPaF_YWAwE_vwj9rmbCkAiR2jhXy2_QY93uabY0ngTToI0YkzQOTpYuebsbxeWSzkecMUVICTYYKRspvlvhXAOrwd6F669iW65rAeufqGYanc7ONJq7MVd3btbpis3QMNcKwX9dlp2AJ0OqEDZ550gRA Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 2035f4fadc8741738c4d0bf67e555717 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestBootFromVolume-381663663 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2035f4fadc8741738c4d0bf67e555717", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2035f4fadc8741738c4d0bf67e555717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2035f4fadc8741738c4d0bf67e555717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2035f4fadc8741738c4d0bf67e555717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestBootFromVolume-381663663 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 2035f4fadc8741738c4d0bf67e555717 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestBootFromVolume-381663663 Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestBootFromVolume-381663663-project Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 564a2e749d644c5f8906c175cd34d6cd Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestBootFromVolume-381663663-project Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b could not be found. Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'bfdcbc7c-5033-4c97-9d0d-c949a0afe70b'} Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b could not be found. Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b could not be found. Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:55:58.679039 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b could not be found. Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Returning 404 to user: Instance bfdcbc7c-5033-4c97-9d0d-c949a0afe70b could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b090046-8c0f-411c-964b-8ec5f241fc6d tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b" status: 404 len: 111 microversion: 2.1 time: 0.109657 Oct 17 12:55:58.683669 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1020/2032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:58 2022] GET /compute/v2.1/servers/bfdcbc7c-5033-4c97-9d0d-c949a0afe70b => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:55:58.702148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-044aae07-a8a5-49a1-be2b-f209d295a26f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] Calling method '.version_select at 0x7fa8209030d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:58.733615 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-044aae07-a8a5-49a1-be2b-f209d295a26f tempest-ServersTestBootFromVolume-381663663 tempest-ServersTestBootFromVolume-381663663-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823391073" status: 202 len: 0 microversion: 2.1 time: 0.046669 Oct 17 12:55:58.734871 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1021/2033] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 12:55:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823391073 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:55:58.890231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:58.891009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:58.919345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:58.924530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:58.928214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:58.931193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:58.933264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:58.934017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:59.382043 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-487eeee2-ca03-44aa-9a6a-72dfc5760a4d tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.299417 Oct 17 12:55:59.398074 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1013/2034] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:55:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:55:59.407655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:59.408514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:59.421780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:59.422794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:59.424466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:59.426586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:59.429438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:59.430375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:59.482565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.497863 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5714982f-0179-47cc-8941-23acbdc40a3b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.618100 Oct 17 12:55:59.514271 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1022/2035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:55:58 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:55:59.533227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:59.533855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:59.561549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:59.562140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:59.562622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:59.563373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:59.563832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:59.564264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:59.672557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.713065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.728893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.741074 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-94a7de58-336d-4185-b9fe-52ab2b62c91e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.340386 Oct 17 12:55:59.748404 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1014/2036] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:59 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:59.761873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:55:59.762851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:55:59.778690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:59.779461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:59.780100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:59.781009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:55:59.781661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:55:59.782283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:55:59.792570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.802738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.813500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.817004 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ffeccd1-2ded-4cbb-b35b-bf71b0181bdc tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.308510 Oct 17 12:55:59.849508 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1023/2037] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:59 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:55:59.855229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-575114618", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "23df3658-5c85-448c-bade-196efd7fa577"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:55:59.959490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.974590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] validate_networks() for [('23df3658-5c85-448c-bade-196efd7fa577', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:55:59.976671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.978685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:55:59.980075 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-81427787-d809-4256-8b7b-79dab2637992 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1266 microversion: 2.25 time: 0.230438 Oct 17 12:56:00.003878 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1015/2038] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:55:59 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:00.536510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:00.537978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:00.581427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:00.582412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:00.583091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:00.591332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:00.593634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:00.593634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.008564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:56:01.009153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:56:01.009529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:56:01.010018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:56:01.010478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:56:01.029496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:01.032024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:01.032394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.033209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:01.035117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:01.037937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.087411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Getting quotas for project c1fcd669f19740e18e617f3a1a76f1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:56:01.103779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Getting quotas for user e5661f5ab2c545dc9f1d0edb738e1ea7 and project c1fcd669f19740e18e617f3a1a76f1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:56:01.137923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:56:01.147167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:56:01.193313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.205045 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4b46a50-b2d2-4ccb-b40f-25a8d49180e5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.673756 Oct 17 12:56:01.206416 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1016/2039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:00 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:01.219448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:01.222017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:01.242079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:01.246621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:01.247421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.249208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:01.251584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:01.254726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.293092 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-409eff4d-9dd5-4077-8f93-c03b3f59ed94 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440232 Oct 17 12:56:01.303135 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1024/2040] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:56:01.304875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:01.305516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:01.325110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:01.325651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:01.327265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.328047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:01.328533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:01.328958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.459342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.489965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.495097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.519166 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19695f7c-e2b7-4d28-abcc-70d408df8664 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.307633 Oct 17 12:56:01.523432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1017/2041] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:01 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:01.529159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:01.531528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:01.568057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:01.571156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:01.572847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.574639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:01.577185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:01.577934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:01.678893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.692309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.695214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.696829 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-447416ef-ae1f-456b-bfc7-441cec056205 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.399790 Oct 17 12:56:01.699944 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1025/2042] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:01 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:01.712169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a787ef1a-1f51-440f-b895-d74441a67631 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:01.714084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a787ef1a-1f51-440f-b895-d74441a67631 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:01.739873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:01.751726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.763402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.764965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.766856 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5f2bb23e-82e6-4c9f-98ee-215207478015 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1266 microversion: 2.25 time: 0.242127 Oct 17 12:56:01.774250 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1018/2043] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:01 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:01.871368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a787ef1a-1f51-440f-b895-d74441a67631 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:01.882310 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a787ef1a-1f51-440f-b895-d74441a67631 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1223 microversion: 2.1 time: 0.177836 Oct 17 12:56:01.893090 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1026/2044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:01 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1223 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:02.271830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:02.274902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:02.295139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:02.305324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:02.305785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:02.306574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:02.307034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:02.307527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:02.552838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:02.553610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:02.573599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:02.574714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:02.575396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:02.578452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:02.579240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:02.583771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:02.621025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:02.633659 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee222a40-e3f7-4841-b18c-7e497e6368bb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.397717 Oct 17 12:56:02.641411 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1019/2045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:02 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:02.729671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:02.730607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:02.759526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:02.760765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:02.762046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:02.765892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:02.766984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:02.771001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:02.925905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:02.941357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:02.947389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:02.950365 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7bd751d0-f985-459d-8f4b-c9641e798deb tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.224737 Oct 17 12:56:02.952201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:02.953604 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1020/2046] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:02 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:02.966351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:02.967635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:02.970550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:02.972229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:02.985703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:02.986848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:02.989356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:02.990392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:02.991075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:02.991634 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-129bb297-146c-49ac-a8fc-65b79db242f1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.444173 Oct 17 12:56:02.993439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:02.994065 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1027/2047] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:02 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:03.006671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:03.007724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:03.022898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:03.024282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:03.027228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:03.028253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:03.030000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:03.030535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:03.108288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:03.136025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:03.138126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:03.140221 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f25448b-dbc6-4091-b66f-79afb3be4259 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 200 len: 1266 microversion: 2.25 time: 0.183264 Oct 17 12:56:03.140713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:03.141649 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1021/2048] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:02 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:03.169205 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19631bed-fae7-44d1-a8d8-eaad6a6749c6 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1275 microversion: 2.1 time: 0.173144 Oct 17 12:56:03.178768 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1028/2049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:02 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:03.666286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:03.667605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:03.679936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:03.685307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:03.686573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:03.687571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:03.688215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:03.692096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:03.998550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:04.001358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:04.028163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:04.036027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:04.039043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:04.050365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:04.051200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:04.051762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:04.411175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:04.425373 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a1289e46-4f69-488d-8593-6e2131c02a86 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 0.763547 Oct 17 12:56:04.426713 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1022/2050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:03 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:04.439116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:04.440078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:04.453453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:04.466533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:04.476345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:04.478649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:04.480318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:04.481122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:04.482354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:04.483780 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ccf20821-8adb-4a7f-8dc4-bcd362370486 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.489724 Oct 17 12:56:04.485395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:04.488728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:04.490679 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1029/2051] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:03 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:04.507569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:04.511668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 668320eb-1f68-4fcd-addd-aef8b2271f2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:04.557737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:04.558659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:04.559376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:04.560610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:04.561213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:04.562569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:04.622511 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] HTTP exception thrown: Instance 668320eb-1f68-4fcd-addd-aef8b2271f2a could not be found. Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Request method failure captured: Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a HTTP/1.1 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8-365YWxAB2DszvlpHxZuRsleHB_hTUFuCrugNj906C6F2MLYFruDPljl6Fw5ee8oFm-snrC9KvSwXbD9oXQyWFuS3-Oj5kl44aJEIaFAHL1N1VCVFaMz3x6SxRmGIahnR6wy0mR74ds2VUQtzniWB0dnlqjdRXEMwL2vFYzQaw0k Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c964bbec50ba4a2480831a33d6a935c7 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c964bbec50ba4a2480831a33d6a935c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c964bbec50ba4a2480831a33d6a935c7 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-LiveAutoBlockMigrationV225Test-479537449-project Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 8dfeceb58cdd47b8b82d905614ba3d5b Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-479537449-project Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 668320eb-1f68-4fcd-addd-aef8b2271f2a could not be found. Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '668320eb-1f68-4fcd-addd-aef8b2271f2a'} Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668320eb-1f68-4fcd-addd-aef8b2271f2a could not be found. Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668320eb-1f68-4fcd-addd-aef8b2271f2a could not be found. Oct 17 12:56:04.631474 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668320eb-1f68-4fcd-addd-aef8b2271f2a could not be found. Oct 17 12:56:04.636596 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:04.637944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Returning 404 to user: Instance 668320eb-1f68-4fcd-addd-aef8b2271f2a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:56:04.641951 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90cc9f25-3fb0-44f1-aa51-63fccaf45047 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a" status: 404 len: 111 microversion: 2.25 time: 0.149858 Oct 17 12:56:04.642834 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1030/2052] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:04 2022] GET /compute/v2.1/servers/668320eb-1f68-4fcd-addd-aef8b2271f2a => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:56:04.682248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:04.684295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:04.705059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:04.705567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:04.706087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:04.706917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:04.707384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:04.707808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:04.753412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:04.797955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:04.801106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:04.837215 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6675227f-fbba-4c52-bfad-941dd0f47764 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.408090 Oct 17 12:56:04.840885 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1023/2053] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:04 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:04.998547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:05.012271 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0079233c-9e02-4d1e-9c73-f324e0896402 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1281 microversion: 2.1 time: 0.367952 Oct 17 12:56:05.014470 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1031/2054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:04 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1281 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:05.462333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:05.462958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:05.478304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:05.479279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:05.479966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:05.480982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:05.482640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:05.483893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:05.531526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:05.532411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:05.553537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:05.555950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:05.556792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:05.560049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:05.560879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:05.562619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:05.996425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:06.027512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:06.040192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:06.041753 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ecee2f0f-0ae1-4718-813d-6811a39e7416 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.515111 Oct 17 12:56:06.060228 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1032/2055] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:05 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:06.091514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-09b6376c-9334-4ad4-8cf0-794a4bf5a1c8 req-ddc0bf24-93ee-4558-aa01-83dcaea25f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d1a825-3c09-415b-ad04-ee11d8d0ccd5", "name": "network-vif-plugged", "status": "completed", "tag": "86862125-98f4-4524-b929-b877a16c6e68"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:06.156320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-09b6376c-9334-4ad4-8cf0-794a4bf5a1c8 req-ddc0bf24-93ee-4558-aa01-83dcaea25f4f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:06.156829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-09b6376c-9334-4ad4-8cf0-794a4bf5a1c8 req-ddc0bf24-93ee-4558-aa01-83dcaea25f4f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:06.157270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-09b6376c-9334-4ad4-8cf0-794a4bf5a1c8 req-ddc0bf24-93ee-4558-aa01-83dcaea25f4f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:06.248216 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-09b6376c-9334-4ad4-8cf0-794a4bf5a1c8 req-ddc0bf24-93ee-4558-aa01-83dcaea25f4f service nova] Creating event network-vif-plugged:86862125-98f4-4524-b929-b877a16c6e68 for instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 on n-h1-853316-12 Oct 17 12:56:06.264455 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-09b6376c-9334-4ad4-8cf0-794a4bf5a1c8 req-ddc0bf24-93ee-4558-aa01-83dcaea25f4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201983 Oct 17 12:56:06.266768 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1033/2056] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:06.282495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:06.283456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:06.298441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:06.299277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:06.300733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:06.301730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:06.303044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:06.303740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:06.908736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:06.953135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:06.975269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:06.975972 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-367d8f25-f3b3-423d-9e15-7fe6b5a40c8c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 1.516116 Oct 17 12:56:06.981401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:06.995542 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1024/2057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:05 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:07.016874 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2c357f6-4eca-4938-9bf9-f27b12e72dcd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.748614 Oct 17 12:56:07.017460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1034/2058] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:06 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:07.024698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:07.025390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:07.077117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:07.077617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:07.078059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:07.093961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:07.095957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:07.096414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:07.107462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:07.107462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:07.142044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:07.143034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:07.145597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:07.146701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:07.148822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:07.149812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:07.235917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:07.582802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:07.594542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:07.612969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:07.625464 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4c9b029d-8c9c-4c5d-b8a5-04b10b8ac6f5 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.521111 Oct 17 12:56:07.629053 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1035/2059] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:07 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:08.025352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:08.030352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:08.053566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:08.054061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:08.054537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:08.055256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:08.055703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:08.056130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:08.677256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:08.704045 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b379b3f-8cae-43f2-93eb-44e7c75a256c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 1.698315 Oct 17 12:56:08.705336 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1025/2060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:06 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:08.719575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:08.720504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:08.753025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:08.753556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:08.756429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:08.775796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:08.779145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:08.779805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:09.011102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:09.024363 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cdec5fd3-acde-4b06-b4eb-7563a4cb8988 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1324 microversion: 2.1 time: 1.007309 Oct 17 12:56:09.082980 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1036/2061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:08 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1324 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:56:09.105889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:09.107030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:09.116556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:09.117778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:09.120198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:09.130079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:09.131133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:09.132450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:09.415819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:09.428127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:09.433029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:09.443322 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-00158b11-1662-4567-9776-a6027352e0d0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.731191 Oct 17 12:56:09.444680 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1026/2062] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:08 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:09.562507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:09.573363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:09.579117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:09.599249 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7a68e1b-9074-4f68-9dee-ca6d1c5d298b tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.497033 Oct 17 12:56:09.608762 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1037/2063] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:09 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:09.732697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:09.734210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:09.743425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:09.754822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:09.755484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:09.756406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:09.771562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:09.772451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:10.094247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:10.094815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:10.111812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:10.119145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:10.125589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:10.126623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:10.134900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:10.135435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:10.718897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:10.733267 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-67aabf60-586d-4736-a208-7e207c28cae5 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1521 microversion: 2.1 time: 0.643807 Oct 17 12:56:10.755447 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1038/2064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:10 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1521 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:10.793364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:10.795313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:10.814908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:10.816000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:10.816756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:10.818080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:10.818961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:10.850926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:10.979658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:10.993928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:10.997669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:10.999187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:11.016108 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-882a137c-b371-4709-a55a-1ea80b6e8bbb tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.255465 Oct 17 12:56:11.017068 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1039/2065] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:10 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:11.022752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:11.030287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:11.047229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:11.048288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:11.048917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:11.050404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:11.051051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:11.051920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:11.090589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:11.107151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:11.126521 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a637e961-030e-4514-b56f-0cc33035b5bf tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 1.396976 Oct 17 12:56:11.128558 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1027/2066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:09 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:11.173201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:11.175595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:11.196761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:11.197606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:11.202576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:11.203420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:11.203969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:11.204416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:11.216468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:11.225674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:11.242837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:11.244411 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97bd3e73-a6de-41ac-b507-dc808d485012 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1366 microversion: 2.57 time: 0.226150 Oct 17 12:56:11.245194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1040/2067] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:11 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:11.255733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c7913e17-9257-4e15-8034-c538632fd754 req-645e47de-fda2-4dad-82d0-69892447eb58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4896fa-c2a7-4984-8d35-67f609edf0bb", "tag": "7a448a17-903a-4e85-a762-940065d276a2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:11.295816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c7913e17-9257-4e15-8034-c538632fd754 req-645e47de-fda2-4dad-82d0-69892447eb58 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:11.299014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c7913e17-9257-4e15-8034-c538632fd754 req-645e47de-fda2-4dad-82d0-69892447eb58 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:11.299487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c7913e17-9257-4e15-8034-c538632fd754 req-645e47de-fda2-4dad-82d0-69892447eb58 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:11.329281 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c7913e17-9257-4e15-8034-c538632fd754 req-645e47de-fda2-4dad-82d0-69892447eb58 service nova] Creating event network-changed:7a448a17-903a-4e85-a762-940065d276a2 for instance ae4896fa-c2a7-4984-8d35-67f609edf0bb on n-h1-853316-12 Oct 17 12:56:11.335932 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c7913e17-9257-4e15-8034-c538632fd754 req-645e47de-fda2-4dad-82d0-69892447eb58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089229 Oct 17 12:56:11.336549 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1041/2068] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:11.584074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:11.596038 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee8db27b-9869-488c-b92f-f1a1594ea9ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1521 microversion: 2.1 time: 0.465981 Oct 17 12:56:11.599481 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1028/2069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:11 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:11.626222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-774809962"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:11.630395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:11.648001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:11.648903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:11.649596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:11.650609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:11.651318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:11.653237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:11.876621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:12.053577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:12.054217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:12.060991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:12.061763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:12.062567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:12.063541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:12.064340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:12.065775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:12.322528 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-545173e9-1c28-4422-b7a5-80c6ccc1544f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5/action" status: 202 len: 0 microversion: 2.1 time: 0.701528 Oct 17 12:56:12.326653 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1042/2070] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:56:11 2022] POST /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 12:56:12.339416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:12.340974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:12.360485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:12.363816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:12.364514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:12.365475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:12.368297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:12.368995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:12.535357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:12.557003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:12.562761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:12.586682 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a11c127b-46eb-42a7-9d1d-6f65395be521 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.535680 Oct 17 12:56:12.588814 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1029/2071] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:12 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:12.602505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:12.611777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:12.634379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:12.634889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:12.640861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:12.641946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:12.644389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:12.645121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:12.854464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:12.867856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:12.875481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:12.884257 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-114e6a54-e1d7-4a15-b891-e30ca52a66d4 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1372 microversion: 2.57 time: 0.294078 Oct 17 12:56:12.908860 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1030/2072] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:12 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1372 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:12.943752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f76f6f3-6753-42cf-9a84-76fa936dd78c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '.version_select at 0x7fa82529aaf0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:13.271251 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f76f6f3-6753-42cf-9a84-76fa936dd78c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/images/ffa24802-74d8-4b90-b8b2-2c13a0830d90" status: 204 len: 0 microversion: 2.1 time: 0.350230 Oct 17 12:56:13.277358 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1031/2073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:12 2022] DELETE /compute/v2.1/images/ffa24802-74d8-4b90-b8b2-2c13a0830d90 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:56:13.293947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7e1fc0f7-1d2c-41bd-a723-cb9ff9c9e0e8 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '.version_select at 0x7fa82529af70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:13.365064 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-7e1fc0f7-1d2c-41bd-a723-cb9ff9c9e0e8 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Image not found. Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7e1fc0f7-1d2c-41bd-a723-cb9ff9c9e0e8 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/images/ffa24802-74d8-4b90-b8b2-2c13a0830d90 HTTP/1.1 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'ffa24802-74d8-4b90-b8b2-2c13a0830d90'} Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ffa24802-74d8-4b90-b8b2-2c13a0830d90 Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 12:56:13.369269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ffa24802-74d8-4b90-b8b2-2c13a0830d90 could not be found. Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:13.377004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7e1fc0f7-1d2c-41bd-a723-cb9ff9c9e0e8 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:56:13.384865 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7e1fc0f7-1d2c-41bd-a723-cb9ff9c9e0e8 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/images/ffa24802-74d8-4b90-b8b2-2c13a0830d90" status: 404 len: 62 microversion: 2.1 time: 0.093269 Oct 17 12:56:13.384865 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1032/2074] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:56:13 2022] GET /compute/v2.1/images/ffa24802-74d8-4b90-b8b2-2c13a0830d90 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:56:13.402415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:13.403531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:13.420228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:13.437648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:13.438208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:13.441918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:13.443270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:13.443737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:13.444183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:13.450484 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-67f8d7d2-fa2d-4823-9cce-39b1a5f12de3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 1.122147 Oct 17 12:56:13.452214 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1043/2075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:12 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:13.616172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:13.617135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:13.633776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:13.637444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:13.638020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:13.639034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:13.639765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:13.642037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:13.801212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:13.825694 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2380ac18-ebba-4d07-8e02-d5e70ef37617 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1533 microversion: 2.1 time: 0.437810 Oct 17 12:56:13.850897 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1033/2076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:13 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1533 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:13.880026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:13.913599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:13.915706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:13.926959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:13.928519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:13.934193 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff5cfb03-ad80-4839-8bde-06aad86eb02f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1560 microversion: 2.91 time: 0.322481 Oct 17 12:56:13.940158 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1044/2077] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:13 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:13.954891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:13.955454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:13.956619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:13.966439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:13.966982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:13.967426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:14.205330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:14.227297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:14.230138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:14.232922 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f324d9a9-6361-4711-b85d-854fb2eec489 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1372 microversion: 2.57 time: 0.311664 Oct 17 12:56:14.238436 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1034/2078] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:13 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:14.490713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:14.491879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:14.499625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:14.500506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:14.501331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:14.502625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:14.503851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:14.504603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:14.838438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:14.851235 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af0a60f0-aa3a-40c4-aa10-4b0d31b11073 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 0.365941 Oct 17 12:56:14.854295 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1045/2079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:14 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:14.863300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:14.863929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:14.874664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:14.875159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:14.875626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:14.883789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:14.884507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:14.885150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:14.973507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:14.974294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:14.992789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:14.996015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:14.997958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:14.999654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:15.000798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:15.002550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:15.194910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:15.206497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:15.209697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:15.223277 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f856a3ca-abe7-4fde-8cd2-b6e22e89a5d2 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1560 microversion: 2.91 time: 0.255390 Oct 17 12:56:15.239941 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1046/2080] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:14 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1560 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:15.273308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:15.275708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:15.297367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:15.300825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:15.302110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:15.306078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:15.306881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:15.309307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:15.399031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:15.407010 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3454215e-d384-43f4-bd53-2e11f23555dd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1533 microversion: 2.1 time: 0.548131 Oct 17 12:56:15.410265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1035/2081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:14 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1533 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:15.529584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:15.543621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:15.545002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:15.578958 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00f6f3bd-de35-4dde-b038-a636b4f33101 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1372 microversion: 2.57 time: 0.280845 Oct 17 12:56:15.579658 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1047/2082] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:15 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1372 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:15.879118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:15.879637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:15.894042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:15.896789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:15.897377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:15.898141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:15.903299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:15.904349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:16.264783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:16.266508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:16.288070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:16.291821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:16.292490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:16.296590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:16.298819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:16.299482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:16.501140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:16.519661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:16.521773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:16.548581 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-acaaaa38-20c4-495d-a74b-21c8c0e2d665 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.285511 Oct 17 12:56:16.553255 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1048/2083] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:16 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:16.565809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:16.569329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:16.586269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:16.587224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:16.587879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:16.590281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:16.592055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:16.593790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:16.690120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:16.716078 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a5462853-4213-415d-91d6-b19eebd7d783 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 0.828791 Oct 17 12:56:16.733491 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1036/2084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:15 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:16.746045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:16.750150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:16.767242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:16.767982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:16.769182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:16.777057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:16.777888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:16.778888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:17.069567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:17.081932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:17.083488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:17.087663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:17.096079 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e32ca22b-28c4-403d-a10b-ec958722cccc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1539 microversion: 2.1 time: 0.540293 Oct 17 12:56:17.096652 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1049/2085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:16 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1539 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:17.126025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e40869aa-6ff3-41c4-8525-21e3d3b47a11 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1357 microversion: 2.57 time: 0.380681 Oct 17 12:56:17.126025 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1037/2086] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:16 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1357 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:17.204332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:17.204840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:17.219450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:17.219947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:17.220741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:17.221682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:17.222337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:17.222921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:17.289052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:56:17.583991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:17.584889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:17.603622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:17.607053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:17.607715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:17.611509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:17.616972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:17.622623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:17.665213 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fad7b887-f5d6-47bd-81c9-fc32221945f0 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 204 len: 0 microversion: 2.57 time: 0.462740 Oct 17 12:56:17.668262 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1050/2087] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:56:17 2022] DELETE /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:56:17.697804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:17.698552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:17.715514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:17.716329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:17.717529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:17.718533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:17.727199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:17.727955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:17.989520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:18.012027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:18.016375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:18.042245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0db95779-7545-4586-9c4b-65e883d5148a tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.462872 Oct 17 12:56:18.050732 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1038/2088] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:17 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:18.062039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:18.068960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:18.104312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:18.112991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:18.115667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:18.123271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:18.128160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:18.128751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:18.138051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:18.152189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:18.155402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:18.165740 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c008791c-e077-4f4c-b4a7-fb996a0636c6 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1363 microversion: 2.57 time: 0.488915 Oct 17 12:56:18.191918 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1051/2089] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:17 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:18.208741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:18.210838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:18.236351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:18.243315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:18.244341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:18.249779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:18.250548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:18.251177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:18.343060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:56:18.509626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:18.626342 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87d9a209-bf54-4207-aa2f-048ae1de5403 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 204 len: 0 microversion: 2.25 time: 0.430739 Oct 17 12:56:18.629038 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1052/2090] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:56:18 2022] DELETE /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:56:18.648039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:18.649922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:18.672423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:18.679070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:18.680614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:18.681646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:18.683129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:18.685755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:18.863510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:18.872557 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a080470f-8b02-4a63-b17a-f2497f2d0cb9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 0.820340 Oct 17 12:56:18.888543 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1039/2091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:18 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:18.913989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:18.914650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:18.936145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:18.936649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:18.937090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:18.937813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:18.938306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:18.938736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:19.341355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.352663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3295839-efc8-4290-9fe4-ee377c9e7990 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1539 microversion: 2.1 time: 0.720521 Oct 17 12:56:19.354573 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1053/2092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:18 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1539 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:19.366131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:19.378663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.395829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:19.400471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.402248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.413276 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ff54830-79c3-4b00-9cbd-e21276caa36a tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1733 microversion: 2.25 time: 0.524100 Oct 17 12:56:19.415762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:19.418781 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1040/2093] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:18 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1733 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:19.420738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:19.424800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:19.425578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:19.427991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:19.430898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:19.433089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:19.443316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:19.474975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:19.482349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:19.483272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:19.492838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:19.499647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:19.501626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:19.727439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.739743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.741649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be94fc8bfabc4f84bd2abafa7bd79f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c00cd9a5cc40b6a489aa36de099324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.743234 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7e250dc4-96cd-4255-a589-bff031365cff tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 200 len: 1363 microversion: 2.57 time: 0.323273 Oct 17 12:56:19.755261 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1041/2094] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:19 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:19.772062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.781992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.782835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-90cedc8a-5d80-4e33-a038-221153b31510 req-55119a63-2507-47b7-9730-caeefe9c93a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d1a825-3c09-415b-ad04-ee11d8d0ccd5", "name": "network-vif-plugged", "status": "completed", "tag": "86862125-98f4-4524-b929-b877a16c6e68"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:19.788062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:19.801914 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c31360b-8818-44e4-adcf-803eba3edee9 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.442430 Oct 17 12:56:19.802974 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1054/2095] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:19 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:19.813732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-90cedc8a-5d80-4e33-a038-221153b31510 req-55119a63-2507-47b7-9730-caeefe9c93a8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:19.814664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-90cedc8a-5d80-4e33-a038-221153b31510 req-55119a63-2507-47b7-9730-caeefe9c93a8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:19.815628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-90cedc8a-5d80-4e33-a038-221153b31510 req-55119a63-2507-47b7-9730-caeefe9c93a8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:19.873689 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-90cedc8a-5d80-4e33-a038-221153b31510 req-55119a63-2507-47b7-9730-caeefe9c93a8 service nova] Creating event network-vif-plugged:86862125-98f4-4524-b929-b877a16c6e68 for instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 on n-h1-853316-12 Oct 17 12:56:19.890954 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-90cedc8a-5d80-4e33-a038-221153b31510 req-55119a63-2507-47b7-9730-caeefe9c93a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133924 Oct 17 12:56:19.900567 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1042/2096] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:19.903210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:19.904045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:19.918071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:19.944159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:19.950035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:19.951951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:19.960392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:19.960871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:20.382725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:20.383606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:20.408093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:20.417151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:20.423020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:20.426260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:20.432537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:20.438853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:20.832222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:20.841516 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f6ad937c-37e2-4fd7-a1c4-f430557b61e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1539 microversion: 2.1 time: 0.464223 Oct 17 12:56:20.852981 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1043/2097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:20 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1539 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:20.860479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:20.868993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:20.889653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:20.894099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:20.894970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:20.897096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:20.899108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:20.899885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:20.939448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:21.456939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:21.472814 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1d8adef-edec-4c38-9c75-84aa175f9c55 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 1.573533 Oct 17 12:56:21.475934 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1055/2098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:19 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:21.491880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:21.494613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] [instance: 8cea1af1-452e-4670-bd1c-29bc3cdf2821] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:21.542138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:21.547691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:21.550959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:21.552048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:21.554078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:21.562746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:21.611737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] HTTP exception thrown: Instance 8cea1af1-452e-4670-bd1c-29bc3cdf2821 could not be found. Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Request method failure captured: Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 HTTP/1.1 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVDDqmZDp4Clv0916SanXw-0ulG-qEWuO3wCo2HwtbtBRDNYd9VVQX_Jt0vFjUntt4NNd8RCnbhEybtpzuezc08n5eAne-MCMR0RC7cTUGlcRrqLL8Zb-EcYdcyvdRe7r6VPzcTsiZMbVB5zcyPNZt7Yv8GapHm71HoOhPUiM8xqeuA Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.57 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 00c00cd9a5cc40b6a489aa36de099324 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerShowV257Test-521391547 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_00c00cd9a5cc40b6a489aa36de099324", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00c00cd9a5cc40b6a489aa36de099324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/00c00cd9a5cc40b6a489aa36de099324"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00c00cd9a5cc40b6a489aa36de099324"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerShowV257Test-521391547 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 00c00cd9a5cc40b6a489aa36de099324 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerShowV257Test-521391547 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerShowV257Test-521391547-project Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: be94fc8bfabc4f84bd2abafa7bd79f82 Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerShowV257Test-521391547-project Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 8cea1af1-452e-4670-bd1c-29bc3cdf2821 could not be found. Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '8cea1af1-452e-4670-bd1c-29bc3cdf2821'} Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cea1af1-452e-4670-bd1c-29bc3cdf2821 could not be found. Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cea1af1-452e-4670-bd1c-29bc3cdf2821 could not be found. Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:21.619350 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:21.624230 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:21.624230 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:21.624230 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:21.624230 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:56:21.624230 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:56:21.624230 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cea1af1-452e-4670-bd1c-29bc3cdf2821 could not be found. Oct 17 12:56:21.624230 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:21.641116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] Returning 404 to user: Instance 8cea1af1-452e-4670-bd1c-29bc3cdf2821 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:56:21.645222 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-013c5240-5d19-4fc6-bf42-8ed04bfdf555 tempest-ServerShowV257Test-521391547 tempest-ServerShowV257Test-521391547-project] 10.222.0.27 "GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821" status: 404 len: 111 microversion: 2.57 time: 0.164174 Oct 17 12:56:21.646137 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1056/2099] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:21 2022] GET /compute/v2.1/servers/8cea1af1-452e-4670-bd1c-29bc3cdf2821 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:56:21.668861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:21.678093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:21.691758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:21.701837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:21.702406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:21.702859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:21.703608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:21.710573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:21.711619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:21.718245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:21.736828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:21.750126 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dffd5ec1-95c0-4dcc-a80f-81f4d983f118 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1733 microversion: 2.25 time: 0.895544 Oct 17 12:56:21.754611 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1044/2100] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:20 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1733 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:21.882258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:21.884330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:21.890005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=93 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:21.913657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:21.919282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:21.920628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:21.926420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:21.927709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:21.930140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:22.121852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:22.149552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:22.151092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:22.181282 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8fb09b70-8703-42a2-a4c1-bf92867e8911 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.530323 Oct 17 12:56:22.196493 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1057/2101] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:21 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:22.500998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:22.502357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:22.522841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:22.523347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:22.532978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:22.543631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:22.547592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:22.548201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:22.602475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:22.614705 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b32c642-3361-4e8e-b1f0-cb2eb5e06a30 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 0.743757 Oct 17 12:56:22.631218 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1045/2102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:21 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:22.741021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-780e2f7b-af76-40f4-b42d-e142ab2e6d4f req-5c4f8274-ccb0-41ab-9a99-d7a085c1148e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a076fb2-b905-428e-8d88-e396a91a80c1", "name": "network-vif-deleted", "tag": "271b29d9-801d-45ee-9eb8-0cc803f60d9a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:22.755035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-780e2f7b-af76-40f4-b42d-e142ab2e6d4f req-5c4f8274-ccb0-41ab-9a99-d7a085c1148e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:22.755844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-780e2f7b-af76-40f4-b42d-e142ab2e6d4f req-5c4f8274-ccb0-41ab-9a99-d7a085c1148e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:22.756641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-780e2f7b-af76-40f4-b42d-e142ab2e6d4f req-5c4f8274-ccb0-41ab-9a99-d7a085c1148e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:22.777863 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-780e2f7b-af76-40f4-b42d-e142ab2e6d4f req-5c4f8274-ccb0-41ab-9a99-d7a085c1148e service nova] Creating event network-vif-deleted:271b29d9-801d-45ee-9eb8-0cc803f60d9a for instance 5a076fb2-b905-428e-8d88-e396a91a80c1 on n-h1-853316-12 Oct 17 12:56:22.785899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-780e2f7b-af76-40f4-b42d-e142ab2e6d4f req-5c4f8274-ccb0-41ab-9a99-d7a085c1148e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047046 Oct 17 12:56:22.792372 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1046/2103] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:22.806420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:22.808362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:22.822758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:22.823604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:22.824368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:22.825456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:22.826339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:22.827546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:23.001645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:23.021528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:23.024650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:23.046677 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f821939e-d65e-4470-bb95-fae0a48702ff tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 200 len: 1370 microversion: 2.25 time: 0.249559 Oct 17 12:56:23.048874 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1047/2104] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:22 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:23.228656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:23.229684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:23.239161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:23.242283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:23.242919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:23.243820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:23.247302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:23.247940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:23.404600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:23.424992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:23.428900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:23.462635 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e64be2c-789b-40fa-b8c9-a07fa4ecc943 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.238103 Oct 17 12:56:23.468156 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1048/2105] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:23 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:23.525460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-dd4303b7-6e4f-48c8-b942-ff1b7c1e9803 req-4dd2752f-f998-444b-8e4b-dc07422d751d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4896fa-c2a7-4984-8d35-67f609edf0bb", "name": "network-vif-plugged", "status": "completed", "tag": "7a448a17-903a-4e85-a762-940065d276a2"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:23.545284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd4303b7-6e4f-48c8-b942-ff1b7c1e9803 req-4dd2752f-f998-444b-8e4b-dc07422d751d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:23.548514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd4303b7-6e4f-48c8-b942-ff1b7c1e9803 req-4dd2752f-f998-444b-8e4b-dc07422d751d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:23.548978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd4303b7-6e4f-48c8-b942-ff1b7c1e9803 req-4dd2752f-f998-444b-8e4b-dc07422d751d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:23.577039 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-dd4303b7-6e4f-48c8-b942-ff1b7c1e9803 req-4dd2752f-f998-444b-8e4b-dc07422d751d service nova] Creating event network-vif-plugged:7a448a17-903a-4e85-a762-940065d276a2 for instance ae4896fa-c2a7-4984-8d35-67f609edf0bb on n-h1-853316-12 Oct 17 12:56:23.587982 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-dd4303b7-6e4f-48c8-b942-ff1b7c1e9803 req-4dd2752f-f998-444b-8e4b-dc07422d751d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066498 Oct 17 12:56:23.593129 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1049/2106] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:56:23.649239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:23.650036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:23.666076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:23.666600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:23.667042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:23.667775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:23.668218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:23.668642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:23.903920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:23.921577 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-231c8494-6dd3-45ca-816c-d7b8a5d8334b tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 1.424489 Oct 17 12:56:23.928359 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1058/2107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:22 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:56:24.079168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:24.079782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: 5a076fb2-b905-428e-8d88-e396a91a80c1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:24.106525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:24.107120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:24.107572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:24.114049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:24.114616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:24.115064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:24.261549 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] HTTP exception thrown: Instance 5a076fb2-b905-428e-8d88-e396a91a80c1 could not be found. Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Request method failure captured: Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 HTTP/1.1 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTU8-365YWxAB2DszvlpHxZuRsleHB_hTUFuCrugNj906C6F2MLYFruDPljl6Fw5ee8oFm-snrC9KvSwXbD9oXQyWFuS3-Oj5kl44aJEIaFAHL1N1VCVFaMz3x6SxRmGIahnR6wy0mR74ds2VUQtzniWB0dnlqjdRXEMwL2vFYzQaw0k Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c964bbec50ba4a2480831a33d6a935c7 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c964bbec50ba4a2480831a33d6a935c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c964bbec50ba4a2480831a33d6a935c7 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-LiveAutoBlockMigrationV225Test-479537449-project Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 8dfeceb58cdd47b8b82d905614ba3d5b Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-479537449-project Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 5a076fb2-b905-428e-8d88-e396a91a80c1 could not be found. Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5a076fb2-b905-428e-8d88-e396a91a80c1'} Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a076fb2-b905-428e-8d88-e396a91a80c1 could not be found. Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a076fb2-b905-428e-8d88-e396a91a80c1 could not be found. Oct 17 12:56:24.266772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a076fb2-b905-428e-8d88-e396a91a80c1 could not be found. Oct 17 12:56:24.272755 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:24.281226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Returning 404 to user: Instance 5a076fb2-b905-428e-8d88-e396a91a80c1 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:56:24.282541 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7ec1c953-1ae4-44b8-aed8-9d5ac708de66 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1" status: 404 len: 111 microversion: 2.25 time: 0.207922 Oct 17 12:56:24.289394 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1059/2108] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:24 2022] GET /compute/v2.1/servers/5a076fb2-b905-428e-8d88-e396a91a80c1 => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 12:56:24.307514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9511be8-db6d-469f-9d47-78b2676ba862 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '.version_select at 0x7fa8209c9670>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:24.361082 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9511be8-db6d-469f-9d47-78b2676ba862 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838025958" status: 204 len: 0 microversion: 2.25 time: 0.069013 Oct 17 12:56:24.365332 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1060/2109] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 12:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838025958 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:56:24.461657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:24.472613 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7646705-b87e-4727-b30e-cf0a3cb2cd8f tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 0.828602 Oct 17 12:56:24.490191 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1050/2110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:23 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:24.495810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:24.496758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:24.501753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:24.513144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:24.514669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:24.516703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:24.519927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:24.524014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:24.528602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:24.951694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:24.952800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:24.969350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:24.976498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:24.977351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:24.978708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:24.981569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:24.982908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:24.984323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:24.985038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:25.003269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:25.030491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4b11b36-94eb-4db7-813e-2f789387ce31 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.538763 Oct 17 12:56:25.061906 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1061/2111] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:24 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:25.450486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:25.461508 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-982478ac-e508-4cdd-a17d-3aaeabedc6e2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1323 microversion: 2.1 time: 0.513565 Oct 17 12:56:25.478290 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1051/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:24 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:25.507146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:25.507806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:25.523078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:25.535404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:25.537191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:25.538852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:25.539867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:25.541065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:26.067482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:26.068405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:26.085374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:26.096699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:26.097634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:26.099384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:26.108814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:26.109748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:26.195261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:26.214075 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9fa8f297-0239-4370-87d3-445bded6ebd9 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 0.709684 Oct 17 12:56:26.219487 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1062/2113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:25 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:26.310005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:26.341950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:26.344127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:26.366627 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.304003 Oct 17 12:56:26.368419 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1052/2114] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:26 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:26.494393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:26.495403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:26.510357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:26.526219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:26.527704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:26.530292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:26.530946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:26.532786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:26.870081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:26.871240 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd871a0b-7142-4023-a9e2-f22fcba22ca3 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001525 Oct 17 12:56:26.871584 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1053/2115] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 17 12:56:26 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 12:56:27.246802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:27.247415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:27.256641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:27.257485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:27.264893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:27.266453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:27.267170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:27.267884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:27.345614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:27.363445 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a768ebe5-9023-4d43-b3c5-d28cf348bdd3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 200 len: 1518 microversion: 2.1 time: 0.874329 Oct 17 12:56:27.372925 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1063/2116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:26 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 1518 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:27.410007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.221"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:27.421752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:27.452892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:27.453947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:27.458503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:27.460354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:27.462835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:27.463480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:27.560469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:56:27.577707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquired lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:56:27.885998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:27.904713 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-94f6a993-1efc-4735-a983-75b2c2bc30fd tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 0.661837 Oct 17 12:56:27.905689 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1054/2117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:27 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:27.922321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:27.923221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:27.934485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:27.935521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:27.938426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:27.943180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:27.944150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:27.944802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:28.046483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:28.057698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:28.059812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:28.070872 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e38ce093-cf1e-44ec-937c-8998e2c12327 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.161977 Oct 17 12:56:28.096425 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1055/2118] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:27 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:28.104997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:28.106275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:28.115723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:28.116449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:28.117172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:28.118137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:28.118864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:28.120125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:28.195111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:56:28.416825 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70c82cc1-206f-4c5f-9b71-3398ae1cb31f tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 204 len: 0 microversion: 2.25 time: 0.318206 Oct 17 12:56:28.417434 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1056/2119] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:56:28 2022] DELETE /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:56:28.429997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:28.432812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:28.458663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:28.459449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:28.460350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:28.461430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:28.462072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:28.462737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:28.726966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:28.742082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:28.744123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:28.745640 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0dad17c7-a1b2-4de9-9e41-375a670c65fe tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1549 microversion: 2.25 time: 0.323264 Oct 17 12:56:28.747682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1057/2120] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:28 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1549 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:28.937401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:28.940879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:28.963487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:28.969108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:28.970990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:28.973951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:28.974726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:28.981342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:31.359712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:31.413342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Building network info cache for instance {{(pid=127540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 12:56:31.433432 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-071b5c65-1a0d-49e4-87de-68e5d4206c92 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 2.502822 Oct 17 12:56:31.436281 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1058/2121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:28 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:31.464269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:31.472459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:31.511166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:31.512049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:31.518300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:31.519385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:31.522546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:31.525369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:32.171301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:32.232560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:32.263276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:32.307654 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43faee4c-c91b-4128-b7f1-43362bbba2d8 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.869673 Oct 17 12:56:32.319859 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1059/2122] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:31 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:32.355560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:32.360461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:32.400777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:32.401581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:32.414508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:32.419376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:32.420276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:32.421033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:33.301719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Updating instance_info_cache with network_info: [{"id": "10322626-559a-4ee7-8e62-ad809bff351b", "address": "fa:16:3e:ad:2c:ad", "network": {"id": "23df3658-5c85-448c-bade-196efd7fa577", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-990311509-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1fcd669f19740e18e617f3a1a76f1b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap10322626-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 12:56:33.351032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Releasing lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:56:33.356790 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b201450a-76b1-4b11-8f61-e769ea8f4fc3 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action" status: 202 len: 0 microversion: 2.1 time: 5.957820 Oct 17 12:56:33.363825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1064/2123] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:56:27 2022] POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action => generated 0 bytes in 5968 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 17 12:56:33.380786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-93d47ae7-2f4f-45cc-a522-4927f4596483 req-3cf5b4a6-c028-4746-96f4-b0002b1ce074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5172ea-5f53-483b-b469-8fb6a9ea5a6b", "tag": "10322626-559a-4ee7-8e62-ad809bff351b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:33.402886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-93d47ae7-2f4f-45cc-a522-4927f4596483 req-3cf5b4a6-c028-4746-96f4-b0002b1ce074 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:33.404330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-93d47ae7-2f4f-45cc-a522-4927f4596483 req-3cf5b4a6-c028-4746-96f4-b0002b1ce074 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:33.405482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-93d47ae7-2f4f-45cc-a522-4927f4596483 req-3cf5b4a6-c028-4746-96f4-b0002b1ce074 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:33.490563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-93d47ae7-2f4f-45cc-a522-4927f4596483 req-3cf5b4a6-c028-4746-96f4-b0002b1ce074 service nova] Creating event network-changed:10322626-559a-4ee7-8e62-ad809bff351b for instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b on n-h2-853316-12 Oct 17 12:56:33.512909 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-93d47ae7-2f4f-45cc-a522-4927f4596483 req-3cf5b4a6-c028-4746-96f4-b0002b1ce074 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143127 Oct 17 12:56:33.516685 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1065/2124] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:33.564013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:33.571726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:33.606290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:33.610096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:33.612419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:33.619525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:33.621630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:33.627874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:34.323885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:34.342457 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cb8de129-ec40-407d-af03-aa1386407cb3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 0.811428 Oct 17 12:56:34.347294 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1066/2125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:33 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:34.363211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:34.364155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:34.380929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:34.383841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:34.386749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:34.390178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:34.391381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:34.393985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:34.621071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:34.638863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:34.643037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:34.657195 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc8cbc58-835e-4cf0-9b02-d5466c16ccbf tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.306389 Oct 17 12:56:34.661963 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1067/2126] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:34 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:34.708608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.221"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:34.723491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:34.775093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:34.781612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:34.782469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:34.783803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:34.784636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:34.785377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:34.900311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "refresh_cache-ae4896fa-c2a7-4984-8d35-67f609edf0bb" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:56:34.900813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquired lock "refresh_cache-ae4896fa-c2a7-4984-8d35-67f609edf0bb" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:56:35.225867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:35.261231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:35.263200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:35.264634 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1549 microversion: 2.25 time: 2.941760 Oct 17 12:56:35.265707 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1060/2127] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:32 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1549 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:35.267710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:35.271476 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002212 Oct 17 12:56:35.279338 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1061/2128] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 17 12:56:35 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 12:56:35.281383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:35.282764 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002280 Oct 17 12:56:35.283956 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1062/2129] 10.222.0.27 () {54 vars in 1035 bytes} [Mon Oct 17 12:56:35 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 17 12:56:35.299379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:35.300641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.007994 Oct 17 12:56:35.319976 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1063/2130] 10.222.0.27 () {54 vars in 1041 bytes} [Mon Oct 17 12:56:35 2022] GET /compute/v2.1/ => generated 388 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:35.321432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:35.322695 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1e86fa2-ef8e-4a40-b585-8fa7d080e29b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001586 Oct 17 12:56:35.334078 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1064/2131] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 17 12:56:35 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 12:56:35.373180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:35.376305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:35.390867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:35.391664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:35.392296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:35.393537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:35.396475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:35.398956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:37.032389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:37.032389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:37.032389 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c0e2567a-444b-4692-9477-c0cb5cd55556 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 1.653079 Oct 17 12:56:37.032389 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1065/2132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:35 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:37.064303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:37.069711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:37.101510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:37.119857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:37.120525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:37.128965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:37.129755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:37.130303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:37.712473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:37.727670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:37.729187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:37.774118 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-682ded38-1095-41a8-9f24-3b33491e6730 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.745798 Oct 17 12:56:37.774781 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1066/2133] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:37 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:37.795144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:37.795776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:37.860564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:37.871615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:37.872258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:37.873045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:37.873528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:37.873967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:37.991181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:37.993121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:37.996547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:37.999802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lazy-loading 'fault' on Instance uuid c19e54d2-638f-4ff0-b1ca-556fd7322174 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:56:38.167548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:38.177455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:38.178953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:38.180139 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb90d711-0a18-41c0-9ca3-37f5a86e237b tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 200 len: 1352 microversion: 2.25 time: 0.404410 Oct 17 12:56:38.180705 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1067/2134] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:37 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 1352 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:38.207432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b7045113-5f37-4006-b3c3-f24c016713b2 req-320ae24a-3f11-49c7-8048-de4ffb5785c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19e54d2-638f-4ff0-b1ca-556fd7322174", "name": "network-vif-deleted", "tag": "5508e157-467a-4880-9215-51dfaa80fe19"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:38.235395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b7045113-5f37-4006-b3c3-f24c016713b2 req-320ae24a-3f11-49c7-8048-de4ffb5785c8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:38.235884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b7045113-5f37-4006-b3c3-f24c016713b2 req-320ae24a-3f11-49c7-8048-de4ffb5785c8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:38.236387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b7045113-5f37-4006-b3c3-f24c016713b2 req-320ae24a-3f11-49c7-8048-de4ffb5785c8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:38.286145 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b7045113-5f37-4006-b3c3-f24c016713b2 req-320ae24a-3f11-49c7-8048-de4ffb5785c8 service nova] Creating event network-vif-deleted:5508e157-467a-4880-9215-51dfaa80fe19 for instance c19e54d2-638f-4ff0-b1ca-556fd7322174 on n-h1-853316-12 Oct 17 12:56:38.305568 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b7045113-5f37-4006-b3c3-f24c016713b2 req-320ae24a-3f11-49c7-8048-de4ffb5785c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123612 Oct 17 12:56:38.306206 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1068/2135] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:38.323865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:38.324591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:38.356043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:38.356824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:38.357621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:38.358581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:38.359213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:38.359961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:38.677364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:38.691425 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b5a48b7-38eb-44ae-b54a-fa2911f3161b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 0.381567 Oct 17 12:56:38.699306 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1069/2136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:38 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:38.805681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:38.806332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:38.817605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:38.820223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:38.821238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:38.827489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:38.828866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:38.830992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:39.071367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:39.080734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:39.088330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:39.106624 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb0da4b2-e97c-41e3-b495-63dcdb36f87b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.304812 Oct 17 12:56:39.107986 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1070/2137] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:38 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:39.219818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:39.222862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: c19e54d2-638f-4ff0-b1ca-556fd7322174] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:39.234003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:39.238127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:39.239601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:39.241446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:39.244376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:39.245802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:39.316102 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] HTTP exception thrown: Instance c19e54d2-638f-4ff0-b1ca-556fd7322174 could not be found. Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Request method failure captured: Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 HTTP/1.1 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8-365YWxAB2DszvlpHxZuRsleHB_hTUFuCrugNj906C6F2MLYFruDPljl6Fw5ee8oFm-snrC9KvSwXbD9oXQyWFuS3-Oj5kl44aJEIaFAHL1N1VCVFaMz3x6SxRmGIahnR6wy0mR74ds2VUQtzniWB0dnlqjdRXEMwL2vFYzQaw0k Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c964bbec50ba4a2480831a33d6a935c7 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c964bbec50ba4a2480831a33d6a935c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c964bbec50ba4a2480831a33d6a935c7 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-LiveAutoBlockMigrationV225Test-479537449-project Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 8dfeceb58cdd47b8b82d905614ba3d5b Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-479537449-project Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance c19e54d2-638f-4ff0-b1ca-556fd7322174 could not be found. Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c19e54d2-638f-4ff0-b1ca-556fd7322174'} Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19e54d2-638f-4ff0-b1ca-556fd7322174 could not be found. Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19e54d2-638f-4ff0-b1ca-556fd7322174 could not be found. Oct 17 12:56:39.323950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19e54d2-638f-4ff0-b1ca-556fd7322174 could not be found. Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:39.330862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Returning 404 to user: Instance c19e54d2-638f-4ff0-b1ca-556fd7322174 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:56:39.334906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-896bfca2-a0ba-423e-bec9-fe3945c0a993 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174" status: 404 len: 111 microversion: 2.25 time: 0.127697 Oct 17 12:56:39.336681 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1071/2138] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:39 2022] GET /compute/v2.1/servers/c19e54d2-638f-4ff0-b1ca-556fd7322174 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 12:56:39.346110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:39.352313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:39.364092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:39.371166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:39.371839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:39.372583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:39.373042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:39.373652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:39.434485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:56:39.728031 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4d09d686-5139-4db6-ac06-b23a9152a9dc tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 204 len: 0 microversion: 2.25 time: 0.382191 Oct 17 12:56:39.736599 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1072/2139] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:56:39 2022] DELETE /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 12:56:39.765168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:39.769966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:39.785694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:39.786772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:39.787873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:39.789270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:39.791114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:39.792441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:40.393199 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.network.neutron [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] re-assign floating IP 172.25.6.221 from instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b Oct 17 12:56:40.563061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Building network info cache for instance {{(pid=127540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 12:56:40.754914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:40.764635 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82c82ab8-2b7d-4a5b-8af5-18600b9881e2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 1.026142 Oct 17 12:56:40.770245 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1073/2140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:39 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:40.777842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:40.782951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:40.797355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:40.801071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:40.801818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:40.802847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:40.804528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:40.809560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:41.619983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:41.632330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:41.641661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dfeceb58cdd47b8b82d905614ba3d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c964bbec50ba4a2480831a33d6a935c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:41.642986 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd91abb0-3802-4d16-ac52-3eb5b6011035 tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 200 len: 1563 microversion: 2.25 time: 0.871390 Oct 17 12:56:41.643561 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1074/2141] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:40 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 1563 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:41.688515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:41.689290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:41.736989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:41.742649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:41.759142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:41.759924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:41.760409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:41.761200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:42.203697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:42.219825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:42.225385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:42.241255 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-22fdb679-c0e5-4fa1-a845-4aea49f75087 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.569531 Oct 17 12:56:42.241715 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1075/2142] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:41 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:42.257708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e1b60881-3103-41b9-b5d4-dd9f52dcb9f6 req-18d6650b-9fb3-4e36-86c3-c58870ce8a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5172ea-5f53-483b-b469-8fb6a9ea5a6b", "tag": "10322626-559a-4ee7-8e62-ad809bff351b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:42.277096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e1b60881-3103-41b9-b5d4-dd9f52dcb9f6 req-18d6650b-9fb3-4e36-86c3-c58870ce8a6c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:42.280398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e1b60881-3103-41b9-b5d4-dd9f52dcb9f6 req-18d6650b-9fb3-4e36-86c3-c58870ce8a6c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:42.280871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e1b60881-3103-41b9-b5d4-dd9f52dcb9f6 req-18d6650b-9fb3-4e36-86c3-c58870ce8a6c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:42.305713 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e1b60881-3103-41b9-b5d4-dd9f52dcb9f6 req-18d6650b-9fb3-4e36-86c3-c58870ce8a6c service nova] Creating event network-changed:10322626-559a-4ee7-8e62-ad809bff351b for instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b on n-h2-853316-12 Oct 17 12:56:42.315032 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e1b60881-3103-41b9-b5d4-dd9f52dcb9f6 req-18d6650b-9fb3-4e36-86c3-c58870ce8a6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068214 Oct 17 12:56:42.316081 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1076/2143] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:42.342552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:42.344479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:42.353231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:42.353933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:42.355033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:42.355929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:42.356934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:42.357547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:42.505215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Updating instance_info_cache with network_info: [{"id": "10322626-559a-4ee7-8e62-ad809bff351b", "address": "fa:16:3e:ad:2c:ad", "network": {"id": "23df3658-5c85-448c-bade-196efd7fa577", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-990311509-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1fcd669f19740e18e617f3a1a76f1b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap10322626-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 12:56:42.521269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Building network info cache for instance {{(pid=127540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 12:56:44.237370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Updating instance_info_cache with network_info: [{"id": "7a448a17-903a-4e85-a762-940065d276a2", "address": "fa:16:3e:72:98:be", "network": {"id": "23df3658-5c85-448c-bade-196efd7fa577", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-990311509-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1fcd669f19740e18e617f3a1a76f1b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7a448a17-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 12:56:44.271895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Releasing lock "refresh_cache-ae4896fa-c2a7-4984-8d35-67f609edf0bb" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:56:44.274390 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cff62f60-a92b-45eb-99bd-a4612b30f8b7 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb/action" status: 202 len: 0 microversion: 2.1 time: 9.610830 Oct 17 12:56:44.294377 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1068/2144] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:56:34 2022] POST /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb/action => generated 0 bytes in 9629 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 12:56:44.422494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:44.432668 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c57af9a9-7054-42a6-8c7b-06f7a041ca31 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1534 microversion: 2.1 time: 2.112426 Oct 17 12:56:44.440633 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1077/2145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:42 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1534 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:44.467655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:44.468734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] [instance: ea792d36-025e-4920-94b6-edd2f314fe14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:44.487490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:44.489668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:44.490523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:44.492259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:44.494491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:44.496181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:44.540611 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] HTTP exception thrown: Instance ea792d36-025e-4920-94b6-edd2f314fe14 could not be found. Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Request method failure captured: Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 HTTP/1.1 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTU8-365YWxAB2DszvlpHxZuRsleHB_hTUFuCrugNj906C6F2MLYFruDPljl6Fw5ee8oFm-snrC9KvSwXbD9oXQyWFuS3-Oj5kl44aJEIaFAHL1N1VCVFaMz3x6SxRmGIahnR6wy0mR74ds2VUQtzniWB0dnlqjdRXEMwL2vFYzQaw0k Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c964bbec50ba4a2480831a33d6a935c7 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c964bbec50ba4a2480831a33d6a935c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c964bbec50ba4a2480831a33d6a935c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c964bbec50ba4a2480831a33d6a935c7 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-479537449 Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-LiveAutoBlockMigrationV225Test-479537449-project Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 8dfeceb58cdd47b8b82d905614ba3d5b Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-479537449-project Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance ea792d36-025e-4920-94b6-edd2f314fe14 could not be found. Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'ea792d36-025e-4920-94b6-edd2f314fe14'} Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea792d36-025e-4920-94b6-edd2f314fe14 could not be found. Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea792d36-025e-4920-94b6-edd2f314fe14 could not be found. Oct 17 12:56:44.542517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea792d36-025e-4920-94b6-edd2f314fe14 could not be found. Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] Returning 404 to user: Instance ea792d36-025e-4920-94b6-edd2f314fe14 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e61b29a-f2c6-4fdb-9570-921722b5281d tempest-LiveAutoBlockMigrationV225Test-479537449 tempest-LiveAutoBlockMigrationV225Test-479537449-project] 10.222.0.27 "GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14" status: 404 len: 111 microversion: 2.25 time: 0.091692 Oct 17 12:56:44.551164 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1078/2146] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:44 2022] GET /compute/v2.1/servers/ea792d36-025e-4920-94b6-edd2f314fe14 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:56:44.565706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-150fc5a5-4e8b-49f8-96dc-42380dee46be req-ba600b6a-dd6a-48a3-9d16-a53066dcdbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea792d36-025e-4920-94b6-edd2f314fe14", "name": "network-vif-deleted", "tag": "38ada92b-863e-4ecb-a957-96d170033bfb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:44.590853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-150fc5a5-4e8b-49f8-96dc-42380dee46be req-ba600b6a-dd6a-48a3-9d16-a53066dcdbc5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:44.591482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-150fc5a5-4e8b-49f8-96dc-42380dee46be req-ba600b6a-dd6a-48a3-9d16-a53066dcdbc5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:44.598582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-150fc5a5-4e8b-49f8-96dc-42380dee46be req-ba600b6a-dd6a-48a3-9d16-a53066dcdbc5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:44.623947 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-150fc5a5-4e8b-49f8-96dc-42380dee46be req-ba600b6a-dd6a-48a3-9d16-a53066dcdbc5 service nova] Creating event network-vif-deleted:38ada92b-863e-4ecb-a957-96d170033bfb for instance ea792d36-025e-4920-94b6-edd2f314fe14 on n-h1-853316-12 Oct 17 12:56:44.636452 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-150fc5a5-4e8b-49f8-96dc-42380dee46be req-ba600b6a-dd6a-48a3-9d16-a53066dcdbc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081883 Oct 17 12:56:44.639113 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1079/2147] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:44.651862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:44.653785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:44.668753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:44.672883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:44.674006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:44.675064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:44.675642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:44.677807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:44.772728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=18 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:44.808101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cbf1aab-6e60-4a12-81c0-098e1f69d127 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Action: 'create', calling method: .version_select at 0x7fa820907820>, body: {"keypair": {"name": "tempest-keypair-780795782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETEGJWeyf9uu023DWhNSMgbCP7wao3vhUIxCXtAD2vhSXMHmczyJEVQP2WYw3G/mWM3smwUxULn5KerK7doqdInkUbmBkzdpuUTvMChjWvsDRlmfpDlH+SmC7N2+UQhDg=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:44.853473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:44.872553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:44.874424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:44.891655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-381255c2-0d9e-45a7-80d1-15a8ac36886f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.242322 Oct 17 12:56:44.893805 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1080/2148] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:44 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:44.903747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-9cbf1aab-6e60-4a12-81c0-098e1f69d127 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Getting quotas for project 8f3503d17d744d78a6c72ecab706e9b0. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:56:44.915298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.221"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:44.923676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-9cbf1aab-6e60-4a12-81c0-098e1f69d127 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Getting quotas for user 7616e4a36c64457dbadf38f33731ccc5 and project 8f3503d17d744d78a6c72ecab706e9b0. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:56:45.018837 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9cbf1aab-6e60-4a12-81c0-098e1f69d127 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.723859 Oct 17 12:56:45.019734 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1069/2149] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:56:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:45.057592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e7836d45-1b82-41e8-82b7-f728921e33f6 req-c01071ec-900e-4ebc-98d1-f7ba4aa9c20e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4896fa-c2a7-4984-8d35-67f609edf0bb", "tag": "7a448a17-903a-4e85-a762-940065d276a2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:45.094007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7836d45-1b82-41e8-82b7-f728921e33f6 req-c01071ec-900e-4ebc-98d1-f7ba4aa9c20e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:45.102691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7836d45-1b82-41e8-82b7-f728921e33f6 req-c01071ec-900e-4ebc-98d1-f7ba4aa9c20e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:45.104520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7836d45-1b82-41e8-82b7-f728921e33f6 req-c01071ec-900e-4ebc-98d1-f7ba4aa9c20e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:45.142066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:45.150300 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e7836d45-1b82-41e8-82b7-f728921e33f6 req-c01071ec-900e-4ebc-98d1-f7ba4aa9c20e service nova] Creating event network-changed:7a448a17-903a-4e85-a762-940065d276a2 for instance ae4896fa-c2a7-4984-8d35-67f609edf0bb on n-h1-853316-12 Oct 17 12:56:45.166814 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e7836d45-1b82-41e8-82b7-f728921e33f6 req-c01071ec-900e-4ebc-98d1-f7ba4aa9c20e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124378 Oct 17 12:56:45.170942 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1070/2150] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:45.471768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:45.472727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:45.480266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:45.493697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:45.495075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:45.498448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:45.499910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:45.508094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:45.761660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:45.771491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:45.773364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:45.781187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:45.786607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:45.788694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:45.790048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:46.019367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:46.034181 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b6e4f3d-5986-40e4-8abb-ace79df83450 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1521 microversion: 2.1 time: 0.562496 Oct 17 12:56:46.038860 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1071/2151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:45 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1521 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:56:46.049216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:46.050467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:46.067028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:46.067867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:46.068554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:46.069849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:46.070583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:46.073213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:46.736237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:46.756760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:46.762991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:46.800684 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f1aa449-0ee9-4763-b188-d140f29139dd tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.756544 Oct 17 12:56:46.801651 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1072/2152] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:46 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:46.839244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:46.852024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:46.883883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:46.884381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:46.892639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:46.893956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:46.895258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:46.895943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:46.994087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:56:47.352743 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c3f4d4e-81f9-4c1b-b7c1-f5e5c279d54d tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 204 len: 0 microversion: 2.1 time: 0.535846 Oct 17 12:56:47.353814 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1073/2153] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:56:46 2022] DELETE /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:56:47.403438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1cfac226-da37-42c1-a4bb-3ab04f52298b req-c80afe25-399b-4fd8-b665-8f558bc8333f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d1a825-3c09-415b-ad04-ee11d8d0ccd5", "name": "network-vif-unplugged", "status": "completed", "tag": "86862125-98f4-4524-b929-b877a16c6e68"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:47.473116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1cfac226-da37-42c1-a4bb-3ab04f52298b req-c80afe25-399b-4fd8-b665-8f558bc8333f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:47.485071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1cfac226-da37-42c1-a4bb-3ab04f52298b req-c80afe25-399b-4fd8-b665-8f558bc8333f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:47.491903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1cfac226-da37-42c1-a4bb-3ab04f52298b req-c80afe25-399b-4fd8-b665-8f558bc8333f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:47.514259 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] HTTP exception thrown: Floating IP 172.25.6.221 is not associated with instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b. Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Request method failure captured: Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action HTTP/1.1 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 49 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVDARaP-htK_AXmFXu6604oCx5TetBMHeRp6LFjgVnmvOgxbBate9wjq8kDGRFUupxH8PbF0V3qQ2mYJK7XPxBbr70kI5f4djTINi5j_omczO_gWCwH_knQ6kkswvFyiqWZaHJUO8IHJp3d_Dg0QkZ7MdaKgEyhvUnBFUO6Mxys1DYM Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c1fcd669f19740e18e617f3a1a76f1b1 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fcd669f19740e18e617f3a1a76f1b1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c1fcd669f19740e18e617f3a1a76f1b1 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FloatingIPsAssociationTestJSON-384425266-project Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e5661f5ab2c545dc9f1d0edb738e1ea7 Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-384425266-project Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: {"removeFloatingIp": {"address": "172.25.6.221"}} Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: exception: Floating IP 172.25.6.221 is not associated with instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b. Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'de5172ea-5f53-483b-b469-8fb6a9ea5a6b', 'body': {'removeFloatingIp': {'address': '172.25.6.221'}}} Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.221 is not associated with instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b. Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.221 is not associated with instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b. Oct 17 12:56:47.516229 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:56:47.535226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Returning 409 to user: Floating IP 172.25.6.221 is not associated with instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:56:47.535226 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d7feaba-a54b-4037-abcc-3de473c9e329 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action" status: 409 len: 146 microversion: 2.1 time: 2.623176 Oct 17 12:56:47.535226 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1081/2154] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:56:44 2022] POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action => generated 146 bytes in 2624 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:56:47.535226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:47.535226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:47.555243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:47.555848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:47.558578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:47.559391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:47.559928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:47.560438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:47.568769 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1cfac226-da37-42c1-a4bb-3ab04f52298b req-c80afe25-399b-4fd8-b665-8f558bc8333f service nova] Creating event network-vif-unplugged:86862125-98f4-4524-b929-b877a16c6e68 for instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 on n-h1-853316-12 Oct 17 12:56:47.584876 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1cfac226-da37-42c1-a4bb-3ab04f52298b req-c80afe25-399b-4fd8-b665-8f558bc8333f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.210155 Oct 17 12:56:47.586462 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1074/2155] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:47.621097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.221"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:47.936404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:47.952247 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aeb5f367-ddef-4fc9-a99d-3a977363e576 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1527 microversion: 2.1 time: 0.431669 Oct 17 12:56:47.952739 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1082/2156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:47 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1527 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:47.989515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:47.991463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:48.016352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:48.018033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:48.020548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:48.021592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:48.023849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:48.025667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:48.301294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:48.305589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:48.308645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:48.309138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:48.309579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:48.311983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:48.316780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:48.319669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:48.323274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:48.325889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:48.342943 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-01ec945c-0214-47f4-b5f3-a085bab155e7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1555 microversion: 2.91 time: 0.371944 Oct 17 12:56:48.381069 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1083/2157] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:47 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1555 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:48.984794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:48.996297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:49.004825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:49.053903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:49.058600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:49.059370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:49.060451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:49.061122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:49.061764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:49.099934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "refresh_cache-ae4896fa-c2a7-4984-8d35-67f609edf0bb" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:56:49.100436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquired lock "refresh_cache-ae4896fa-c2a7-4984-8d35-67f609edf0bb" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:56:49.122016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:49.594594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:49.614010 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-66baea98-c854-4d87-ac06-5fdfa4f28dff tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1527 microversion: 2.1 time: 0.636704 Oct 17 12:56:49.616555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1084/2158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:48 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1527 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:49.625868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:49.628183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:49.638502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:49.640600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:49.641343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:49.644169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:49.645449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:49.646239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:49.895953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:49.913934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:49.915769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:49.927749 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f75921d9-2c2e-4209-9498-27e210b58519 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1537 microversion: 2.91 time: 0.308195 Oct 17 12:56:49.932008 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1085/2159] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:49 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:50.640384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:50.641639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:50.654656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:50.655167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:50.655610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:50.656333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:50.656791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:50.657218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:51.639317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Building network info cache for instance {{(pid=127540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 12:56:51.928653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:51.936671 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-182be08e-820f-4056-98eb-2766655e9bc7 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1527 microversion: 2.1 time: 1.300600 Oct 17 12:56:51.937262 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1086/2160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:50 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1527 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:51.954097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:51.955147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:51.972125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:51.972625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:51.973266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:51.974743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:51.975378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:51.976013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:52.154712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:52.163524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:52.170435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:52.184203 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9218a7a-654e-4f79-ba02-57706b5ee010 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1540 microversion: 2.91 time: 0.245880 Oct 17 12:56:52.185459 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1087/2161] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:51 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1540 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:52.197946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2e14777f-43be-4cc0-bb95-245a45e5624d req-4b10c95d-e28b-4ef1-90f6-00e13aab8bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4896fa-c2a7-4984-8d35-67f609edf0bb", "tag": "7a448a17-903a-4e85-a762-940065d276a2"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:52.222940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2e14777f-43be-4cc0-bb95-245a45e5624d req-4b10c95d-e28b-4ef1-90f6-00e13aab8bab service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:52.223720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2e14777f-43be-4cc0-bb95-245a45e5624d req-4b10c95d-e28b-4ef1-90f6-00e13aab8bab service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:52.224366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2e14777f-43be-4cc0-bb95-245a45e5624d req-4b10c95d-e28b-4ef1-90f6-00e13aab8bab service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:52.244039 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2e14777f-43be-4cc0-bb95-245a45e5624d req-4b10c95d-e28b-4ef1-90f6-00e13aab8bab service nova] Creating event network-changed:7a448a17-903a-4e85-a762-940065d276a2 for instance ae4896fa-c2a7-4984-8d35-67f609edf0bb on n-h1-853316-12 Oct 17 12:56:52.256731 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2e14777f-43be-4cc0-bb95-245a45e5624d req-4b10c95d-e28b-4ef1-90f6-00e13aab8bab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067009 Oct 17 12:56:52.257886 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1088/2162] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:52.271138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:52.274004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:52.292957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:52.293786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:52.294485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:52.296336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:52.301174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:52.301850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:52.392573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-853316-12". {{(pid=127539) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 12:56:52.536368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac2825a2-2469-46a7-b74f-0ab870ba5978 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5/action" status: 202 len: 0 microversion: 2.91 time: 0.276897 Oct 17 12:56:52.537540 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1089/2163] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 12:56:52 2022] POST /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:56:52.555289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-97c4a34c-1619-4d26-a375-79b8355e34af req-b85488e6-435b-4bf4-b06c-7dbe5925160f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d1a825-3c09-415b-ad04-ee11d8d0ccd5", "name": "network-vif-deleted", "tag": "86862125-98f4-4524-b929-b877a16c6e68"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:52.606071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-97c4a34c-1619-4d26-a375-79b8355e34af req-b85488e6-435b-4bf4-b06c-7dbe5925160f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:52.606860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-97c4a34c-1619-4d26-a375-79b8355e34af req-b85488e6-435b-4bf4-b06c-7dbe5925160f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:52.608392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-97c4a34c-1619-4d26-a375-79b8355e34af req-b85488e6-435b-4bf4-b06c-7dbe5925160f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:52.640205 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-97c4a34c-1619-4d26-a375-79b8355e34af req-b85488e6-435b-4bf4-b06c-7dbe5925160f service nova] Creating event network-vif-deleted:86862125-98f4-4524-b929-b877a16c6e68 for instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 on n-h1-853316-12 Oct 17 12:56:52.680275 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-97c4a34c-1619-4d26-a375-79b8355e34af req-b85488e6-435b-4bf4-b06c-7dbe5925160f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141327 Oct 17 12:56:52.683706 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1090/2164] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:56:52.703508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:52.704741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:52.735541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:52.738569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:52.739356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:52.740384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:52.740854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:52.741282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:52.995297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:53.020125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:53.022109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:53.040339 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7cdd1b6b-08d3-48ea-a6f8-6e42aeb435ac tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1488 microversion: 2.91 time: 0.353518 Oct 17 12:56:53.040882 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1091/2165] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:52 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1488 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:53.062827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:53.066252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:53.098648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:53.099238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:53.112709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:53.116867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:53.118464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:53.119159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:53.249471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:53.254835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:53.255294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:53.259041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lazy-loading 'fault' on Instance uuid 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:56:53.435677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:53.478272 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe973f84-567b-4dc3-b8c0-8161ca9d0f83 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1314 microversion: 2.1 time: 0.435545 Oct 17 12:56:53.480339 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1092/2166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:53 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:54.075457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:54.076880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:54.089309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:54.091328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:54.092922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:54.096614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:54.097416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:54.100268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:54.301530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:54.326086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:54.327734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:54.347390 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-406ed802-d219-4415-b7d7-8bfac52b0c36 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1488 microversion: 2.91 time: 0.276893 Oct 17 12:56:54.348416 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1093/2167] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:54 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1488 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:54.507076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:54.507701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:54.535752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:54.536263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:54.536712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:54.537442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:54.537953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:54.538400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:54.697749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:54.698271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:54.698725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:54.699189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lazy-loading 'fault' on Instance uuid 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:56:54.958398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:56:55.068537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Updating instance_info_cache with network_info: [{"id": "7a448a17-903a-4e85-a762-940065d276a2", "address": "fa:16:3e:72:98:be", "network": {"id": "23df3658-5c85-448c-bade-196efd7fa577", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-990311509-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1fcd669f19740e18e617f3a1a76f1b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7a448a17-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 12:56:55.086709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Releasing lock "refresh_cache-ae4896fa-c2a7-4984-8d35-67f609edf0bb" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:56:55.087858 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3e0dfee-3697-4bd3-986f-316a83f58bc9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb/action" status: 202 len: 0 microversion: 2.1 time: 7.499501 Oct 17 12:56:55.094844 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1075/2168] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:56:47 2022] POST /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb/action => generated 0 bytes in 7507 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 12:56:55.103730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:55.111457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:55.122525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:55.123662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:55.125734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:55.127454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:55.128196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:55.129845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:55.137039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:55.146364 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3abf7b29-6907-4fe1-8245-946981de2ab6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 200 len: 1314 microversion: 2.1 time: 0.643193 Oct 17 12:56:55.174797 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1094/2169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:54 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:56:55.190214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:56:55.363760 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ace57023-9c7a-474d-b2d8-e7a78e1b7cfa tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 204 len: 0 microversion: 2.1 time: 0.263350 Oct 17 12:56:55.364996 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1076/2170] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:56:55 2022] DELETE /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:56:55.376425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.221"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:55.379447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:55.394076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:55.395418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:55.420868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:55.421376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:55.421834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:55.428214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:55.428544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:55.428995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:55.429708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:55.431843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:55.432634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:55.433692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:55.448593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:55.449777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:55.529162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:56:55.529573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquired lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:56:55.658208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:55.673905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:55.675681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:55.692655 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db918f9a-0edd-42bd-8f28-74c43c9f15dc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.310394 Oct 17 12:56:55.696562 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1077/2171] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:55 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:56:55.711613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-803577690", "imageRef": "90e852a5-ddcc-49c7-95eb-97317717973c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "04406c05-b7a4-4a24-8232-e36014263959"}], "security_groups": [{"name": "tempest-securitygroup--1165999040"}], "key_name": "tempest-keypair-780795782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:55.893997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] validate_networks() for [('04406c05-b7a4-4a24-8232-e36014263959', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:56:56.578051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:56:56.578731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:56:56.579365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:56:56.579806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:56:56.580230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:56:56.597230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:56.597749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:56.598228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:56.599228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:56.600393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:56.600893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:56.632554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Getting quotas for project 8f3503d17d744d78a6c72ecab706e9b0. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:56:56.639774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Getting quotas for user 7616e4a36c64457dbadf38f33731ccc5 and project 8f3503d17d744d78a6c72ecab706e9b0. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:56:56.661977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:56:56.665474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90e852a5-ddcc-49c7-95eb-97317717973c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:56:56.757369 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a0bc0dfc-3ee4-44a1-b6d8-be098fe1a3a6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.058869 Oct 17 12:56:56.764523 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1078/2172] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:56:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:56:56.769589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:56.770233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:56.777593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:56.778098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:56.778571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:56.779336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:56.779794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:56.780429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:56.797242 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 HTTP/1.1 Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '10d1a825-3c09-415b-ad04-ee11d8d0ccd5'} Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:56.800543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:56:56.805662 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:56.805662 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:56:56.805662 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:56:56.805662 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:56:56.805662 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:56:56.805662 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:56:56.805662 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:56:56.805662 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:56:56.812935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:56:56.815031 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-06c70af9-e6a2-4272-b1ba-8267f3dd8d05 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 404 len: 111 microversion: 2.1 time: 0.047588 Oct 17 12:56:56.816037 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1079/2173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:56 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:56:56.831067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:56.831067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:56.845780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:56.846992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:56.847668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:56.848794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:56.849572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:56.850387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:56.943591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:56.954787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:56.956418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:56.962981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65e79eb1-7edf-485d-af3f-9dc1a074003e tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.145643 Oct 17 12:56:56.979512 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1080/2174] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:56 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:56.994195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-366e5cc9-b3ff-4fb2-b5e8-824c5ecf3ddf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:56.994830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-366e5cc9-b3ff-4fb2-b5e8-824c5ecf3ddf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:57.094001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-366e5cc9-b3ff-4fb2-b5e8-824c5ecf3ddf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:57.112503 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-366e5cc9-b3ff-4fb2-b5e8-824c5ecf3ddf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1244 microversion: 2.1 time: 0.131283 Oct 17 12:56:57.115841 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1081/2175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:56 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1244 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:56:57.149400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2013565621", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:56:57.296413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] validate_networks() for [('ab875c4f-87a3-4bf3-a48a-3e1cbefa8c2f', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:56:59.149130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:56:59.150587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:56:59.151281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:56:59.152850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:56:59.153442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:56:59.182790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:59.187927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:59.192026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:59.195898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:59.197107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:59.197656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:59.282859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Getting quotas for project 450b3f93e96f43ba9c4c64f3552f934c. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:56:59.327120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Getting quotas for user 9a1e4aea1c6c4ca9a9960e814a7ea07c and project 450b3f93e96f43ba9c4c64f3552f934c. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:56:59.374835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:56:59.388542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:56:59.599441 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e7918ca-4aa7-4e9f-9f6b-0fde63043598 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.455198 Oct 17 12:56:59.615066 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1082/2176] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:56:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:56:59.651203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:59.653106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:59.669703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:59.670657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:59.673562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:59.676219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:59.677163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:59.677928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:59.906532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:59.918554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:59.921485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:56:59.932109 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-027d15da-3e14-42a9-82c5-9a35a8011999 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.315623 Oct 17 12:56:59.933755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1083/2177] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:56:59 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:56:59.940266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:56:59.942321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:56:59.949432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:59.950305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:59.951005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:56:59.953530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:56:59.954413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:56:59.955103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:00.118175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:00.150640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90948008-85ac-489c-aa7e-9d55731f22ca tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1302 microversion: 2.1 time: 0.198566 Oct 17 12:57:00.150640 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1084/2178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:56:59 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1302 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:00.170826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5744d0a5-7d74-45a5-809a-99d92c891452 req-90d12a9b-620c-4d28-9ca8-2e19f285aebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4896fa-c2a7-4984-8d35-67f609edf0bb", "name": "network-vif-deleted", "tag": "7a448a17-903a-4e85-a762-940065d276a2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:00.203253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5744d0a5-7d74-45a5-809a-99d92c891452 req-90d12a9b-620c-4d28-9ca8-2e19f285aebe service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:00.203253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5744d0a5-7d74-45a5-809a-99d92c891452 req-90d12a9b-620c-4d28-9ca8-2e19f285aebe service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:00.203253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5744d0a5-7d74-45a5-809a-99d92c891452 req-90d12a9b-620c-4d28-9ca8-2e19f285aebe service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:00.237542 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5744d0a5-7d74-45a5-809a-99d92c891452 req-90d12a9b-620c-4d28-9ca8-2e19f285aebe service nova] Creating event network-vif-deleted:7a448a17-903a-4e85-a762-940065d276a2 for instance ae4896fa-c2a7-4984-8d35-67f609edf0bb on n-h1-853316-12 Oct 17 12:57:00.249332 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5744d0a5-7d74-45a5-809a-99d92c891452 req-90d12a9b-620c-4d28-9ca8-2e19f285aebe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091424 Oct 17 12:57:00.249998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1085/2179] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:00.262110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3b4bd52-da52-4093-a669-68719d8723e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:00.262850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3b4bd52-da52-4093-a669-68719d8723e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:00.302597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:00.424344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3b4bd52-da52-4093-a669-68719d8723e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:00.447657 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3b4bd52-da52-4093-a669-68719d8723e4 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1225 microversion: 2.1 time: 0.190424 Oct 17 12:57:00.448430 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1086/2180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:00 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1225 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:00.964348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:00.965587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:00.983042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:00.983700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:00.984207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:00.985808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:00.986694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:00.987244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:01.129875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:01.154543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:01.160971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:01.193837 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-122cf610-91c5-4199-8bfc-cb8334122834 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.233423 Oct 17 12:57:01.214729 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1087/2181] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:00 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:57:01.234113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:01.236319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:01.273089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:01.275491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:01.276471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:01.277476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:01.282428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:01.291096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:01.402330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:01.468593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Building network info cache for instance {{(pid=127539) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 12:57:01.471298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:01.493393 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ed12bbd-6f2d-45ff-bcef-933e72b926e7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1302 microversion: 2.1 time: 0.273846 Oct 17 12:57:01.494870 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1088/2182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:01 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1302 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:01.509040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:01.512045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:01.527882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:01.529777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:01.550805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:01.551705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:01.553170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:01.554406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:01.747731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:01.765056 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3fe85be5-a0db-490b-88cb-cc31c29e1b2a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1277 microversion: 2.1 time: 0.268863 Oct 17 12:57:01.765902 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1089/2183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:01 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1277 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:01.779192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a34d66f2-bb7d-4740-b9b3-ffc84c1c0fbb req-8dea3001-7e70-4c76-9686-99d5187a32e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5172ea-5f53-483b-b469-8fb6a9ea5a6b", "tag": "10322626-559a-4ee7-8e62-ad809bff351b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:01.802769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a34d66f2-bb7d-4740-b9b3-ffc84c1c0fbb req-8dea3001-7e70-4c76-9686-99d5187a32e7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:01.803559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a34d66f2-bb7d-4740-b9b3-ffc84c1c0fbb req-8dea3001-7e70-4c76-9686-99d5187a32e7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:01.804135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a34d66f2-bb7d-4740-b9b3-ffc84c1c0fbb req-8dea3001-7e70-4c76-9686-99d5187a32e7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:01.820744 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a34d66f2-bb7d-4740-b9b3-ffc84c1c0fbb req-8dea3001-7e70-4c76-9686-99d5187a32e7 service nova] Creating event network-changed:10322626-559a-4ee7-8e62-ad809bff351b for instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b on n-h2-853316-12 Oct 17 12:57:01.826759 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a34d66f2-bb7d-4740-b9b3-ffc84c1c0fbb req-8dea3001-7e70-4c76-9686-99d5187a32e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057525 Oct 17 12:57:01.827543 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1090/2184] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:02.234124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:02.235249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:02.263300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:02.268000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:02.270985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:02.273127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:02.275955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:02.277058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:02.604617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:02.639408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:02.647687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:02.670312 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab7774a6-7a35-41de-8918-1c0b9d654e2b tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.442964 Oct 17 12:57:02.676097 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1091/2185] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:02 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:57:02.689091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:02.689724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:02.708582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:02.712250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:02.712902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:02.715441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:02.716118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:02.719397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:02.931254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:02.943675 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e12eb62-5e95-41c6-8a7a-b14746ef9051 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1302 microversion: 2.1 time: 0.266355 Oct 17 12:57:02.945147 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1092/2186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:02 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1302 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:02.963061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:02.968075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:02.989070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:02.989856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:02.990574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:02.991517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:02.992189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:02.993005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:03.184800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:03.200949 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-baf442cb-1f0b-4131-bd03-265b862a4520 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1283 microversion: 2.1 time: 0.241418 Oct 17 12:57:03.202234 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1093/2187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:02 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1283 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:03.703232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:03.704850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:03.727035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:03.732747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:03.733537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:03.734554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:03.735793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:03.737116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:03.965162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:03.974937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:03.979808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:03.991842 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-74f2288f-ba45-484a-98c6-e2da3397bf00 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.292459 Oct 17 12:57:03.992757 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1094/2188] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:03 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:57:04.014072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:04.015107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:04.032216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:04.032935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:04.033686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:04.043475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:04.043475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:04.043475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:04.413709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:04.425560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18e02d52-e830-4960-8cbd-4ba8ec834a1b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1302 microversion: 2.1 time: 0.431425 Oct 17 12:57:04.438423 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1095/2189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:03 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1302 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:04.446995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:04.447810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:04.480409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:04.480974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:04.481535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:04.491188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:04.491908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:04.492509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:04.912474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:04.926541 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d861c0e9-7526-435e-9029-328cf0c01573 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1283 microversion: 2.1 time: 0.490024 Oct 17 12:57:04.946928 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1096/2190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:04 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1283 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:05.025648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:05.026643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:05.034104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:05.034666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:05.035127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:05.035877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:05.036355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:05.045622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:05.150413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Updating instance_info_cache with network_info: [{"id": "10322626-559a-4ee7-8e62-ad809bff351b", "address": "fa:16:3e:ad:2c:ad", "network": {"id": "23df3658-5c85-448c-bade-196efd7fa577", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-990311509-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1fcd669f19740e18e617f3a1a76f1b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap10322626-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127539) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 12:57:05.169261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Releasing lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:57:05.170499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa5bab9c-27f4-4850-9a9a-2bdb98c4a160 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action" status: 202 len: 0 microversion: 2.1 time: 9.799129 Oct 17 12:57:05.171367 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1095/2191] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:56:55 2022] POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action => generated 0 bytes in 9801 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 17 12:57:05.181661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9ec5b82-8fa5-4391-a651-9dff55728ae9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '.version_select at 0x7fa8252e58b0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:05.386010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:05.400152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:05.420268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:05.421171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=39 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:05.435391 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bbcf8d27-c819-4641-a4b4-997eb7e913a5 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.413916 Oct 17 12:57:05.458567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1097/2192] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:05 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:05.470075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:05.488257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:05.504752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:05.505253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:05.505695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:05.506445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:05.512035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:05.514741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:06.163736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:06.173183 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-613ec298-be77-4e8f-a390-e4a6ecdb646d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.713346 Oct 17 12:57:06.180474 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1098/2193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:05 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:06.185481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:06.198959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:06.230562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:06.231379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:06.232266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:06.233273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:06.234925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:06.236300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:06.579706 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9ec5b82-8fa5-4391-a651-9dff55728ae9 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/b020d4dd-d62d-47b5-9689-ddacd940d634" status: 200 len: 185 microversion: 2.1 time: 1.402632 Oct 17 12:57:06.581322 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1096/2194] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 12:57:05 2022] GET /compute/v2.1/os-floating-ips/b020d4dd-d62d-47b5-9689-ddacd940d634 => generated 185 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:57:06.601823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:06.602777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:06.627422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:06.638315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:06.639079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:06.641428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:06.642192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:06.644471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:06.875187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:06.894008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:06.898513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:06.913610 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25c81392-e76a-496c-9b8b-b31d25154262 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.330279 Oct 17 12:57:06.918181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:06.924318 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1097/2195] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:06 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:06.930413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.221"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:06.939514 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc6179a1-5f7f-4363-aae7-b74fd0c3cf5e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1325 microversion: 2.1 time: 0.757436 Oct 17 12:57:06.942028 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1099/2196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:06 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1325 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:07.201319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:07.202393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:07.222505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:07.226773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:07.233817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:07.239690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:07.242450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:07.243970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:07.324768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:07.332203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:07.332870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:07.333502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:07.334393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:07.341008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:07.341697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:08.177111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 12:57:08.179724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquired lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 12:57:09.015746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:09.028040 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d2ef2f7-dc81-4836-8193-5591c3782d08 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 1.831378 Oct 17 12:57:09.043682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1100/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:07 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:09.055505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:09.056971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:09.064994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:09.065973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:09.066921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:09.067884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:09.068541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:09.069178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:09.242434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:09.474574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:09.518575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:09.521974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:09.545831 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3ef7ebb-60ec-4860-b1fd-c18140c8c339 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.499298 Oct 17 12:57:09.549951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1101/2198] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:09 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:09.584470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:09.594678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:09.620628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:09.621515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:09.622104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:09.641336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:09.647722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:09.648131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:10.326639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:10.342323 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d9ecc31-e01e-4afe-813e-f1b9314e1c4c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1325 microversion: 2.1 time: 0.783628 Oct 17 12:57:10.344032 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1102/2199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:09 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1325 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:10.348875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:10.349488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:10.367929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:10.375109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:10.375933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:10.376846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:10.377478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:10.378088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:10.429038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=16 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:10.947680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:10.981003 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-895f3bfa-7d58-4973-92a2-fe302e703a92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.635430 Oct 17 12:57:10.983778 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1103/2200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:10 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:11.004638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:11.005393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:11.023897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:11.027980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:11.028502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:11.029311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:11.029786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:11.030243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:11.300697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:11.333085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:11.334728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:11.381764 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-128c1c8f-3653-4708-acb3-a7d499446758 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.394436 Oct 17 12:57:11.382488 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1104/2201] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:10 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:11.434475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8cd5ec1b-6ec5-49e2-ba99-99c11292c09f req-9f3b6ee9-9f0c-404c-83f7-74efa7a34f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dff0a31-d0a4-4203-9280-48996deaa841", "tag": "0d24b606-1b0b-4095-be00-86b3411aa958"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:11.529688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8cd5ec1b-6ec5-49e2-ba99-99c11292c09f req-9f3b6ee9-9f0c-404c-83f7-74efa7a34f8e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:11.534486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8cd5ec1b-6ec5-49e2-ba99-99c11292c09f req-9f3b6ee9-9f0c-404c-83f7-74efa7a34f8e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:11.538848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8cd5ec1b-6ec5-49e2-ba99-99c11292c09f req-9f3b6ee9-9f0c-404c-83f7-74efa7a34f8e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:11.611685 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8cd5ec1b-6ec5-49e2-ba99-99c11292c09f req-9f3b6ee9-9f0c-404c-83f7-74efa7a34f8e service nova] Creating event network-changed:0d24b606-1b0b-4095-be00-86b3411aa958 for instance 2dff0a31-d0a4-4203-9280-48996deaa841 on n-h2-853316-12 Oct 17 12:57:11.640553 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8cd5ec1b-6ec5-49e2-ba99-99c11292c09f req-9f3b6ee9-9f0c-404c-83f7-74efa7a34f8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217445 Oct 17 12:57:11.641725 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1105/2202] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:11.699974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:11.711771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:11.748494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:11.751226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:11.755745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:11.760442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:11.762108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:11.764472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:11.841354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:12.401726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Building network info cache for instance {{(pid=127539) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 12:57:12.590916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:12.602814 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9778ddea-baf3-49fb-9bbd-8a7a25f93969 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1325 microversion: 2.1 time: 0.948929 Oct 17 12:57:12.623696 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1106/2203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:11 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1325 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:12.636978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-cc241712-a688-4426-b629-10ccb753cfd1 req-74339db9-9c54-40b9-b742-90519677ca8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29679db4-ed8a-427d-89ce-0657f17156e9", "tag": "93574143-8cce-4588-a0a6-7657b09b1f61"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:12.657458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cc241712-a688-4426-b629-10ccb753cfd1 req-74339db9-9c54-40b9-b742-90519677ca8c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:12.663750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cc241712-a688-4426-b629-10ccb753cfd1 req-74339db9-9c54-40b9-b742-90519677ca8c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:12.664474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cc241712-a688-4426-b629-10ccb753cfd1 req-74339db9-9c54-40b9-b742-90519677ca8c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:12.695243 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-cc241712-a688-4426-b629-10ccb753cfd1 req-74339db9-9c54-40b9-b742-90519677ca8c service nova] Creating event network-changed:93574143-8cce-4588-a0a6-7657b09b1f61 for instance 29679db4-ed8a-427d-89ce-0657f17156e9 on n-h1-853316-12 Oct 17 12:57:12.708081 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-cc241712-a688-4426-b629-10ccb753cfd1 req-74339db9-9c54-40b9-b742-90519677ca8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082752 Oct 17 12:57:12.713822 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1107/2204] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:12.734998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:12.743229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:12.751744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:12.758127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:12.758849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:12.760260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:12.760897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:12.761708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:13.793331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:13.814048 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1360aa5a-77a6-4f7b-904f-45cb0dae8f24 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 1.075024 Oct 17 12:57:13.817940 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1108/2205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:12 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:13.842034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:13.843093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:13.856416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:13.857511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:13.861397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:13.864251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:13.865762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:13.868068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.074998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:14.131475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:14.148584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:14.179598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e334114f-649b-479f-9c17-6720526e4eb6 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.360578 Oct 17 12:57:14.181090 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1109/2206] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:13 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:14.207891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:14.208775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:14.216615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.217558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.220615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.221614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.222310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.223299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.490787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Updating instance_info_cache with network_info: [{"id": "10322626-559a-4ee7-8e62-ad809bff351b", "address": "fa:16:3e:ad:2c:ad", "network": {"id": "23df3658-5c85-448c-bade-196efd7fa577", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-990311509-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c1fcd669f19740e18e617f3a1a76f1b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap10322626-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127539) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 12:57:14.509372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Releasing lock "refresh_cache-de5172ea-5f53-483b-b469-8fb6a9ea5a6b" {{(pid=127539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 12:57:14.511191 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-59ec5597-00d0-4d5b-9fee-d8135c04c7b5 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action" status: 202 len: 0 microversion: 2.1 time: 7.584956 Oct 17 12:57:14.514676 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1098/2207] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:57:06 2022] POST /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b/action => generated 0 bytes in 7590 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 12:57:14.526329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-1cd45c4e-8bac-478b-9904-a5791087a057 req-e00b833b-8e0e-4871-915e-e93cd74ffda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5172ea-5f53-483b-b469-8fb6a9ea5a6b", "tag": "10322626-559a-4ee7-8e62-ad809bff351b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:14.553799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1cd45c4e-8bac-478b-9904-a5791087a057 req-e00b833b-8e0e-4871-915e-e93cd74ffda5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.554629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1cd45c4e-8bac-478b-9904-a5791087a057 req-e00b833b-8e0e-4871-915e-e93cd74ffda5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.559050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1cd45c4e-8bac-478b-9904-a5791087a057 req-e00b833b-8e0e-4871-915e-e93cd74ffda5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.586215 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-1cd45c4e-8bac-478b-9904-a5791087a057 req-e00b833b-8e0e-4871-915e-e93cd74ffda5 service nova] Creating event network-changed:10322626-559a-4ee7-8e62-ad809bff351b for instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b on n-h2-853316-12 Oct 17 12:57:14.601990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-1cd45c4e-8bac-478b-9904-a5791087a057 req-e00b833b-8e0e-4871-915e-e93cd74ffda5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083825 Oct 17 12:57:14.602714 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1099/2208] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:14.618007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:14.618895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:14.635399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.635867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.636533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.637445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.638265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.656397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.708124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:14.715584 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] HTTP exception thrown: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Request method failure captured: Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb HTTP/1.1 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVDARaP-htK_AXmFXu6604oCx5TetBMHeRp6LFjgVnmvOgxbBate9wjq8kDGRFUupxH8PbF0V3qQ2mYJK7XPxBbr70kI5f4djTINi5j_omczO_gWCwH_knQ6kkswvFyiqWZaHJUO8IHJp3d_Dg0QkZ7MdaKgEyhvUnBFUO6Mxys1DYM Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c1fcd669f19740e18e617f3a1a76f1b1 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fcd669f19740e18e617f3a1a76f1b1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c1fcd669f19740e18e617f3a1a76f1b1 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FloatingIPsAssociationTestJSON-384425266-project Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e5661f5ab2c545dc9f1d0edb738e1ea7 Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-384425266-project Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'ae4896fa-c2a7-4984-8d35-67f609edf0bb'} Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:14.720430 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Returning 404 to user: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:14.723521 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1151fb67-536f-449c-9e83-f8976e47a4d2 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 404 len: 111 microversion: 2.1 time: 0.117923 Oct 17 12:57:14.729141 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1100/2209] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:57:14 2022] DELETE /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:57:14.749711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:14.758794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:14.759777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: ae4896fa-c2a7-4984-8d35-67f609edf0bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:14.766601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7912a4bf-08ae-4f66-9f4c-7175c1845fca tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1325 microversion: 2.1 time: 0.583650 Oct 17 12:57:14.783105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.786770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.787478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.790679 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1110/2210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:14 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1325 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:14.791230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.791932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.794796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.842399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:14.843604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:14.853046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.857841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.858493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.858717 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] HTTP exception thrown: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.860401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:14.861042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:14.862202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Request method failure captured: Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb HTTP/1.1 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVDARaP-htK_AXmFXu6604oCx5TetBMHeRp6LFjgVnmvOgxbBate9wjq8kDGRFUupxH8PbF0V3qQ2mYJK7XPxBbr70kI5f4djTINi5j_omczO_gWCwH_knQ6kkswvFyiqWZaHJUO8IHJp3d_Dg0QkZ7MdaKgEyhvUnBFUO6Mxys1DYM Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c1fcd669f19740e18e617f3a1a76f1b1 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fcd669f19740e18e617f3a1a76f1b1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c1fcd669f19740e18e617f3a1a76f1b1 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FloatingIPsAssociationTestJSON-384425266-project Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e5661f5ab2c545dc9f1d0edb738e1ea7 Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-384425266-project Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'ae4896fa-c2a7-4984-8d35-67f609edf0bb'} Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.874600 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:14.878462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.878462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:14.878462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:14.878462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:14.878462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:14.878462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:14.878462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. Oct 17 12:57:14.878462 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:14.886793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Returning 404 to user: Instance ae4896fa-c2a7-4984-8d35-67f609edf0bb could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:14.888729 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8856f7b0-4b75-4e3c-bb47-38f3cefe8d0c tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb" status: 404 len: 111 microversion: 2.1 time: 0.158548 Oct 17 12:57:14.889685 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1101/2211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:14 2022] GET /compute/v2.1/servers/ae4896fa-c2a7-4984-8d35-67f609edf0bb => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:57:14.898414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d60a75f-2aee-42d7-a26a-f8f704056579 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '.version_select at 0x7fa8252e5280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:16.120139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:16.139273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a58ca47-6d31-43b3-862b-54c9b55f599a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 1.300949 Oct 17 12:57:16.170047 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1111/2212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:14 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:16.192607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:16.195592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:16.214469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:16.217573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:16.218745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:16.221652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:16.222391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:16.224305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:16.523541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:16.541950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:16.556031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:16.575967 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-98a24c27-4022-4673-9b4e-6be3650b1dc4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.403924 Oct 17 12:57:16.600402 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1112/2213] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:16 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:16.605737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:16.611829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:16.637833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:16.651402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:16.654389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:16.656945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:16.662999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:16.663858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:17.851304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:17.869730 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-79e82a2a-c8dc-4fa5-ab11-fcf01bed52d2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1325 microversion: 2.1 time: 1.267683 Oct 17 12:57:17.871050 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1113/2214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:16 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1325 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:17.878597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:17.879542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:17.892649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:17.893155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:17.893593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:17.894421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:17.918745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:17.920574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:18.739587 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d60a75f-2aee-42d7-a26a-f8f704056579 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/b020d4dd-d62d-47b5-9689-ddacd940d634" status: 202 len: 0 microversion: 2.1 time: 3.845112 Oct 17 12:57:18.741087 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1102/2215] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:57:14 2022] DELETE /compute/v2.1/os-floating-ips/b020d4dd-d62d-47b5-9689-ddacd940d634 => generated 0 bytes in 3847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:57:18.747325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:18.748128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:18.765253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:18.765787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:18.768775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:18.769772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:18.770320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:18.772757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:18.785395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:18.794664 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9e82f8fd-4fe5-4088-8d98-cc5e5e348aa5 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.922189 Oct 17 12:57:18.798380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1114/2216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:17 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:18.810917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:18.811538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:18.829930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:18.830747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:18.832000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:18.832928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:18.833510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:18.834068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:18.868414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:57:18.939295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:18.957340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:18.958922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:18.974360 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cbba2aa9-6d17-4687-bb55-323b65ceef17 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.231925 Oct 17 12:57:18.974977 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1103/2217] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:18 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:18.989341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:18.990190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:19.003931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:19.005925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:19.007215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:19.009099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:19.009583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:19.010025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:19.115170 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e6eccc42-7e17-477a-bbda-4680f4e98aa1 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 204 len: 0 microversion: 2.1 time: 0.315288 Oct 17 12:57:19.121870 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1115/2218] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:57:18 2022] DELETE /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:57:19.141918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:19.144246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:19.155604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:19.157355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:19.158362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:19.159882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:19.160810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:19.161847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:19.387447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:19.398858 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-18a770ef-bc4f-4984-bbe2-b702f1d9a3ef tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1325 microversion: 2.1 time: 0.420074 Oct 17 12:57:19.399955 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1104/2219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:18 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:19.828126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:19.830303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:19.844747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:19.845454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:19.847187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:19.848548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:19.849289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:19.850716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:19.943507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:19.956884 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e50ffb49-bdd8-4fb2-961e-3f8cb0ffff37 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1526 microversion: 2.1 time: 0.828945 Oct 17 12:57:19.960886 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1116/2220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:19 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1526 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:20.011790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:20.013317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:20.028387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:20.029182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:20.030621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:20.033310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:20.033974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:20.035430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:20.268018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:20.290515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:20.297777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:20.321281 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec9f059c-4f98-44c8-9d81-77f63c3c3953 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.314028 Oct 17 12:57:20.324218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:20.324893 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1117/2221] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:20 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:20.338188 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e6efd51-60a8-48ec-ab83-b72e467a428f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.513725 Oct 17 12:57:20.340521 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1105/2222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:19 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:57:20.426070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:20.428983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:20.464171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:20.470443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:20.472561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:20.475336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:20.476222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:20.492053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:20.786068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:20.840825 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-970cdb39-581d-4c73-95a0-b4ee2b01b53b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1325 microversion: 2.1 time: 0.418474 Oct 17 12:57:20.842721 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1118/2223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:20 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1325 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:20.997543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:20.998195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:21.018832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-de889bb5-4fd0-4b3a-a52c-878406ee9b9a req-94b9ca56-2f5e-4dd5-aaf0-448412ba1a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29679db4-ed8a-427d-89ce-0657f17156e9", "name": "network-vif-plugged", "status": "completed", "tag": "93574143-8cce-4588-a0a6-7657b09b1f61"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:21.025776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.026566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.027102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.034708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.035279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.035723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.052151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-de889bb5-4fd0-4b3a-a52c-878406ee9b9a req-94b9ca56-2f5e-4dd5-aaf0-448412ba1a69 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.054822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-de889bb5-4fd0-4b3a-a52c-878406ee9b9a req-94b9ca56-2f5e-4dd5-aaf0-448412ba1a69 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.059153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-de889bb5-4fd0-4b3a-a52c-878406ee9b9a req-94b9ca56-2f5e-4dd5-aaf0-448412ba1a69 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.103459 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-de889bb5-4fd0-4b3a-a52c-878406ee9b9a req-94b9ca56-2f5e-4dd5-aaf0-448412ba1a69 service nova] Creating event network-vif-plugged:93574143-8cce-4588-a0a6-7657b09b1f61 for instance 29679db4-ed8a-427d-89ce-0657f17156e9 on n-h1-853316-12 Oct 17 12:57:21.119176 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-de889bb5-4fd0-4b3a-a52c-878406ee9b9a req-94b9ca56-2f5e-4dd5-aaf0-448412ba1a69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105363 Oct 17 12:57:21.124109 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1119/2224] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:57:21.360578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:21.361885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:21.376166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.379958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.381205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.385338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.386810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.391494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.596058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:21.607819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:21.608371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:21.610801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:21.617865 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6d9e50b-f58a-4fd9-b031-223ea53afb14 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.262896 Oct 17 12:57:21.619094 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1120/2225] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:21 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:21.624373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:21.625523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:21.653151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.654000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.654749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.655833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.656865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.657989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.664075 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c627a779-d29e-4bab-a4e8-0d6d5e979c71 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1526 microversion: 2.1 time: 0.682767 Oct 17 12:57:21.668497 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1106/2226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:20 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1526 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:21.873153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:21.873780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:21.885809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.889164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.889791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.892535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:21.893206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:21.896559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:21.915754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:21.930951 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c5c3521e-65c0-4543-a7f5-4dd8b107b7b7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.310493 Oct 17 12:57:21.933820 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1121/2227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:21 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:22.308410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:22.348099 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dc6d3c2a-c329-4509-a7ba-06e0fa2736ce tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1325 microversion: 2.1 time: 0.479182 Oct 17 12:57:22.360899 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1107/2228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:21 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1325 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:22.434080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6039ae51-d570-45de-90ab-5c2f15d847c4 req-f3d33954-bfc6-44c3-a8b4-d4e508581546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5172ea-5f53-483b-b469-8fb6a9ea5a6b", "name": "network-vif-deleted", "tag": "10322626-559a-4ee7-8e62-ad809bff351b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:22.458648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6039ae51-d570-45de-90ab-5c2f15d847c4 req-f3d33954-bfc6-44c3-a8b4-d4e508581546 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:22.459409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6039ae51-d570-45de-90ab-5c2f15d847c4 req-f3d33954-bfc6-44c3-a8b4-d4e508581546 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:22.460008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6039ae51-d570-45de-90ab-5c2f15d847c4 req-f3d33954-bfc6-44c3-a8b4-d4e508581546 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:22.495852 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6039ae51-d570-45de-90ab-5c2f15d847c4 req-f3d33954-bfc6-44c3-a8b4-d4e508581546 service nova] Creating event network-vif-deleted:10322626-559a-4ee7-8e62-ad809bff351b for instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b on n-h2-853316-12 Oct 17 12:57:22.515348 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6039ae51-d570-45de-90ab-5c2f15d847c4 req-f3d33954-bfc6-44c3-a8b4-d4e508581546 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082597 Oct 17 12:57:22.517524 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1122/2229] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:22.659907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:22.660700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:22.691755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:22.692106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:22.692803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:22.697979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:22.701079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:22.707322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:22.709160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:22.712339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:22.712492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:22.713954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:22.721005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:22.721605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:22.731500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:22.732067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:22.732592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:22.860392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:22.910092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:22.938121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:22.946471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:22.948857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:22.949698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:22.950938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:22.951834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lazy-loading 'fault' on Instance uuid de5172ea-5f53-483b-b469-8fb6a9ea5a6b {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:57:22.985152 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e8ade49-b719-4add-8c3f-cb8f1ba7b580 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.332021 Oct 17 12:57:22.988143 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1108/2230] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:22 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:22.996317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:22.997171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:23.007996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:23.008740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:23.009326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:23.010200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:23.010825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:23.011402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:23.115592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5661f5ab2c545dc9f1d0edb738e1ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fcd669f19740e18e617f3a1a76f1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:23.131573 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5932eaa4-e367-4f07-9c3d-e4eebf200924 tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 200 len: 1314 microversion: 2.1 time: 0.446019 Oct 17 12:57:23.148949 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1123/2231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:22 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:57:23.334492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:23.350738 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db7fdbf4-c593-4ed6-82be-c2878cd0f5a3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.360870 Oct 17 12:57:23.351521 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1109/2232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:22 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:23.381354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:23.382070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:23.395293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:23.395293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:23.395551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:23.397838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:23.397838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:23.397838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:23.799004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:23.816640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e97a8c0e-3714-4f30-9a09-963ccf319470 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1521 microversion: 2.1 time: 0.441619 Oct 17 12:57:23.817852 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1124/2233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:23 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:23.851888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:23.852551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:23.863341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:23.864579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:23.865106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:23.867662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:23.868963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:23.870636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:23.918920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:57:24.018488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:24.019281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:24.041051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:24.042121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:24.042605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:24.045701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:24.046505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:24.046974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:24.085124 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3aa3aa82-70eb-4759-ad98-6e6b0cf2c514 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 204 len: 0 microversion: 2.1 time: 0.239208 Oct 17 12:57:24.086471 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1110/2234] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:57:23 2022] DELETE /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:57:24.096582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:24.097568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:24.107514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:24.108167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:24.108609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:24.109472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:24.110250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:24.111055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:24.200463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:24.217754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:24.225947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:24.239488 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85367cad-ebe6-4b33-a756-9b989717c4ca tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.227579 Oct 17 12:57:24.256298 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1125/2235] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:24 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:24.271090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:24.271691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] [instance: de5172ea-5f53-483b-b469-8fb6a9ea5a6b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:24.286601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:24.287132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:24.287601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:24.288286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:24.288902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:24.289268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:24.322468 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] HTTP exception thrown: Instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b could not be found. Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Request method failure captured: Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b HTTP/1.1 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVDARaP-htK_AXmFXu6604oCx5TetBMHeRp6LFjgVnmvOgxbBate9wjq8kDGRFUupxH8PbF0V3qQ2mYJK7XPxBbr70kI5f4djTINi5j_omczO_gWCwH_knQ6kkswvFyiqWZaHJUO8IHJp3d_Dg0QkZ7MdaKgEyhvUnBFUO6Mxys1DYM Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c1fcd669f19740e18e617f3a1a76f1b1 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c1fcd669f19740e18e617f3a1a76f1b1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c1fcd669f19740e18e617f3a1a76f1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c1fcd669f19740e18e617f3a1a76f1b1 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-384425266 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FloatingIPsAssociationTestJSON-384425266-project Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e5661f5ab2c545dc9f1d0edb738e1ea7 Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-384425266-project Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b could not be found. Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'de5172ea-5f53-483b-b469-8fb6a9ea5a6b'} Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b could not be found. Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b could not be found. Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:24.324327 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b could not be found. Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] Returning 404 to user: Instance de5172ea-5f53-483b-b469-8fb6a9ea5a6b could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:24.329137 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-14d3e0d6-598f-420d-a5ad-49493fbaa09e tempest-FloatingIPsAssociationTestJSON-384425266 tempest-FloatingIPsAssociationTestJSON-384425266-project] 10.222.0.27 "GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b" status: 404 len: 111 microversion: 2.1 time: 0.067564 Oct 17 12:57:24.333350 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1126/2236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:24 2022] GET /compute/v2.1/servers/de5172ea-5f53-483b-b469-8fb6a9ea5a6b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:57:24.351980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:24.364204 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35a9acf7-b729-4a4c-9240-5c95d9bb9eeb tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1527 microversion: 2.1 time: 0.273165 Oct 17 12:57:24.389452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:24.390969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:24.395053 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1111/2237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:24 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1527 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:57:24.399221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:24.399877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:24.400468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:24.401328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:24.401925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:24.402520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:24.864029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:24.874217 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3990025c-1f70-4516-a076-b631ef1ba343 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.493331 Oct 17 12:57:24.876030 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1127/2238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:24 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:25.270792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:25.271726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:25.291493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:25.291994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:25.295975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:25.297522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:25.298000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:25.311516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:25.402681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:25.406464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:25.459883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:25.467071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:25.468541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:25.470036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:25.470683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:25.471289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:25.512743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:25.532989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:25.542288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:25.568103 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02d7038e-a301-4651-b762-6ffed9a470cc tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.302823 Oct 17 12:57:25.568714 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1112/2239] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:25 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:25.902582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:25.903586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:25.913774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:25.914464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:25.915180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:25.916652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:25.917322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:25.917894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:26.073993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:26.083017 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aada9a31-682c-4056-81ae-ff1d764914b2 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1527 microversion: 2.1 time: 0.688697 Oct 17 12:57:26.087454 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1128/2240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:25 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1527 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:26.267980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:26.277198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0080c589-dea6-4b19-9f0c-1a1873d9bb5e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.380609 Oct 17 12:57:26.293774 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1113/2241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:25 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:57:26.598821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:26.600178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:26.611635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:26.615548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:26.616042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:26.618541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:26.619024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:26.619517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:26.787352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:26.796015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:26.797820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:26.813701 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dfbaeb16-6e60-49a7-825f-f98a1f1489f7 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.220474 Oct 17 12:57:26.848053 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1129/2242] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:26 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:27.109733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:27.110580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:27.118257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:27.118716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:27.119152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:27.119859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:27.120311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:27.120732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:27.301204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:27.301824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:27.309801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:27.314762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:27.315512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:27.316722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:27.319809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:27.320464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:27.479305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:27.489808 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52adface-3af9-4380-b81b-175e7fc1d51c tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1527 microversion: 2.1 time: 0.384378 Oct 17 12:57:27.490761 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1114/2243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:27 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1527 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:27.706150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a1d51f23-9f92-499d-bd0c-76bb0c7dfd6b req-695659ac-5ee1-411a-95d1-d72ea80c013e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29679db4-ed8a-427d-89ce-0657f17156e9", "name": "network-vif-deleted", "tag": "93574143-8cce-4588-a0a6-7657b09b1f61"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:27.725351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a1d51f23-9f92-499d-bd0c-76bb0c7dfd6b req-695659ac-5ee1-411a-95d1-d72ea80c013e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:27.726127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a1d51f23-9f92-499d-bd0c-76bb0c7dfd6b req-695659ac-5ee1-411a-95d1-d72ea80c013e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:27.726802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a1d51f23-9f92-499d-bd0c-76bb0c7dfd6b req-695659ac-5ee1-411a-95d1-d72ea80c013e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:27.752755 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a1d51f23-9f92-499d-bd0c-76bb0c7dfd6b req-695659ac-5ee1-411a-95d1-d72ea80c013e service nova] Creating event network-vif-deleted:93574143-8cce-4588-a0a6-7657b09b1f61 for instance 29679db4-ed8a-427d-89ce-0657f17156e9 on n-h1-853316-12 Oct 17 12:57:27.764584 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a1d51f23-9f92-499d-bd0c-76bb0c7dfd6b req-695659ac-5ee1-411a-95d1-d72ea80c013e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062278 Oct 17 12:57:27.767138 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1115/2244] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:27.860898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:27.861703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:27.875884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:27.882432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:27.884653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:27.888666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:27.892862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:27.894284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:27.895627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:27.908268 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-748c02c3-4494-4182-8e5b-7a2b0c1cdcb3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.610832 Oct 17 12:57:27.912772 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1130/2245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:27 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:28.080432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:28.092590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:28.102994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:28.113596 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-750a5719-41ac-494b-b7b5-a608b3755604 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.260228 Oct 17 12:57:28.116986 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1116/2246] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:27 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:57:28.517355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:28.518112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:28.536069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:28.553650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:28.555362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:28.558694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:28.559185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:28.564209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:28.759426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:28.784253 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2722e3ef-55b8-4a8d-a78c-79cdd47324b3 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1485 microversion: 2.1 time: 0.271567 Oct 17 12:57:28.788929 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1131/2247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:28 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1485 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:28.937561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:28.938401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:28.951657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:28.953638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:28.956840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:28.958853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:28.962312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:28.963969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:29.148716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:29.149491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:29.180722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:29.186022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:29.200480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:29.203934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:29.205246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:29.208936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:29.574379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:29.591842 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0215ec89-847b-456b-ae75-a471db030158 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.658195 Oct 17 12:57:29.595667 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1117/2248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:28 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:29.618664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:29.638869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:29.649802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:29.663854 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec1778fb-736c-4dc4-9713-6879b9923de0 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.519683 Oct 17 12:57:29.671008 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1132/2249] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:29 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:57:29.817671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:29.818675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:29.845189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:29.848717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:29.850703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:29.853232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:29.854138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:29.856244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:29.867661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:29.961844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:29.964170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:29.965515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:29.966872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lazy-loading 'fault' on Instance uuid 29679db4-ed8a-427d-89ce-0657f17156e9 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:57:30.107588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e4aea1c6c4ca9a9960e814a7ea07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450b3f93e96f43ba9c4c64f3552f934c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:30.121305 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f9ed61c5-807f-478c-976e-56678f12a034 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 200 len: 1315 microversion: 2.1 time: 0.307767 Oct 17 12:57:30.122596 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1118/2250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:29 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:30.621099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:30.622799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:30.638186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:30.649399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:30.650725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:30.653455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:30.654853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:30.655620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:30.704748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:30.706308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:30.723450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:30.728649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:30.730417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:30.732469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:30.733747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:30.734736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:30.850114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:30.865322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:30.867833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:30.878301 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-63e483cb-73d5-4b42-b068-eb49de86648c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.175399 Oct 17 12:57:30.901734 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1119/2251] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:30 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:31.148405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:31.149141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 29679db4-ed8a-427d-89ce-0657f17156e9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:31.169022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:31.169830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:31.170487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:31.172056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:31.172660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:31.173532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:31.232345 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Instance 29679db4-ed8a-427d-89ce-0657f17156e9 could not be found. Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 HTTP/1.1 Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 29679db4-ed8a-427d-89ce-0657f17156e9 could not be found. Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '29679db4-ed8a-427d-89ce-0657f17156e9'} Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29679db4-ed8a-427d-89ce-0657f17156e9 could not be found. Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29679db4-ed8a-427d-89ce-0657f17156e9 could not be found. Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.235616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.239461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.239461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.239461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:31.239461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:31.239461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:31.239461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:31.239461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29679db4-ed8a-427d-89ce-0657f17156e9 could not be found. Oct 17 12:57:31.239461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.243729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Instance 29679db4-ed8a-427d-89ce-0657f17156e9 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:31.246327 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-610fc555-1008-46fd-88de-8b2453ac092e tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9" status: 404 len: 111 microversion: 2.1 time: 0.102692 Oct 17 12:57:31.253864 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1120/2252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:31 2022] GET /compute/v2.1/servers/29679db4-ed8a-427d-89ce-0657f17156e9 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:57:31.267777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:31.273710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8b5d057-7c76-4568-b723-e01ea3836fb6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '.version_select at 0x7fa8252e59d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:31.282403 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45e8b3b9-e993-469e-abf5-6750ee1a418e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.666487 Oct 17 12:57:31.287007 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1133/2253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:30 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:31.323700 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-f8b5d057-7c76-4568-b723-e01ea3836fb6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Image not found. Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8b5d057-7c76-4568-b723-e01ea3836fb6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/images/ffa24802-74d8-4b90-b8b2-2c13a0830d90 HTTP/1.1 Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'ffa24802-74d8-4b90-b8b2-2c13a0830d90'} Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ffa24802-74d8-4b90-b8b2-2c13a0830d90 to delete Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ffa24802-74d8-4b90-b8b2-2c13a0830d90 could not be found. Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.326328 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 12:57:31.331040 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.334856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8b5d057-7c76-4568-b723-e01ea3836fb6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:31.336576 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8b5d057-7c76-4568-b723-e01ea3836fb6 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/images/ffa24802-74d8-4b90-b8b2-2c13a0830d90" status: 404 len: 62 microversion: 2.1 time: 0.078348 Oct 17 12:57:31.338397 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1121/2254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:31 2022] DELETE /compute/v2.1/images/ffa24802-74d8-4b90-b8b2-2c13a0830d90 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:57:31.349868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:31.350882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:31.362709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:31.363709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:31.364640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:31.366053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:31.367265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:31.368171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:31.426151 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 HTTP/1.1 Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '10d1a825-3c09-415b-ad04-ee11d8d0ccd5'} Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:31.428431 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.431830 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.436421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:31.442927 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-691b3e7c-e7c3-40aa-95fd-a8afcb45bfed tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 404 len: 111 microversion: 2.1 time: 0.099730 Oct 17 12:57:31.450879 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1134/2255] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:57:31 2022] DELETE /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:57:31.454850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:31.455596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 10d1a825-3c09-415b-ad04-ee11d8d0ccd5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:31.475786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:31.476408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:31.476946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:31.478063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:31.478638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:31.479224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:31.563932 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 HTTP/1.1 Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '10d1a825-3c09-415b-ad04-ee11d8d0ccd5'} Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.573039 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:31.576303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Instance 10d1a825-3c09-415b-ad04-ee11d8d0ccd5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:31.586608 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db3db742-e6ec-4d62-b47c-8f3af965cf0a tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5" status: 404 len: 111 microversion: 2.1 time: 0.125854 Oct 17 12:57:31.587338 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1122/2256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:31 2022] GET /compute/v2.1/servers/10d1a825-3c09-415b-ad04-ee11d8d0ccd5 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:57:31.599298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-541c9c1a-8172-4557-bf39-17ee17244375 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '.version_select at 0x7fa820b13dc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:31.672968 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-541c9c1a-8172-4557-bf39-17ee17244375 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625318655" status: 202 len: 0 microversion: 2.1 time: 0.073130 Oct 17 12:57:31.673638 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1135/2257] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 12:57:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625318655 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:57:31.943723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:31.948354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:31.959580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:31.960588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:31.961327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:31.962755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:31.963476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:31.964291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:32.149710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:32.166187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:32.176375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:32.190571 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7057e43e-6763-4658-97f8-7bb24156de9c tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.260467 Oct 17 12:57:32.192369 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1123/2258] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:31 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:32.313980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:32.315357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:32.338262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:32.341702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:32.345973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:32.347586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:32.349578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:32.351826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:32.933272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:32.951033 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7bd2f820-3dab-4237-849f-06a60e6121f9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.643617 Oct 17 12:57:32.976034 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1136/2259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:32 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:33.223185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:33.224515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:33.239226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:33.240004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:33.242640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:33.244944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:33.247008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:33.248239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:33.582189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:33.595247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:33.603016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:33.615989 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0d6936fb-45fd-44b1-9158-173f3bf41a0f tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1546 microversion: 2.91 time: 0.399578 Oct 17 12:57:33.616594 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1124/2260] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:33 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1546 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:33.820686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3f81078f-5fb4-41d5-8d6f-86d07e07bee5 req-0a64d35a-2766-4ca6-9d3d-10ed0a12f794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dff0a31-d0a4-4203-9280-48996deaa841", "name": "network-vif-plugged", "status": "completed", "tag": "0d24b606-1b0b-4095-be00-86b3411aa958"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:33.838338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3f81078f-5fb4-41d5-8d6f-86d07e07bee5 req-0a64d35a-2766-4ca6-9d3d-10ed0a12f794 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:33.839444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3f81078f-5fb4-41d5-8d6f-86d07e07bee5 req-0a64d35a-2766-4ca6-9d3d-10ed0a12f794 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:33.840319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3f81078f-5fb4-41d5-8d6f-86d07e07bee5 req-0a64d35a-2766-4ca6-9d3d-10ed0a12f794 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:33.863745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3f81078f-5fb4-41d5-8d6f-86d07e07bee5 req-0a64d35a-2766-4ca6-9d3d-10ed0a12f794 service nova] Creating event network-vif-plugged:0d24b606-1b0b-4095-be00-86b3411aa958 for instance 2dff0a31-d0a4-4203-9280-48996deaa841 on n-h2-853316-12 Oct 17 12:57:33.876746 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3f81078f-5fb4-41d5-8d6f-86d07e07bee5 req-0a64d35a-2766-4ca6-9d3d-10ed0a12f794 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061697 Oct 17 12:57:33.881480 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1137/2261] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:33.982613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:33.983354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:33.997815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:33.999709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:34.006309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:34.007428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:34.008161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:34.008778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:34.420285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:34.431125 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d3a27f87-d730-49c1-a1fa-baac86877a74 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 0.452358 Oct 17 12:57:34.453375 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1125/2262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:33 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:34.657765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:34.658510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:34.668817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:34.669325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:34.673531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:34.674390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:34.674886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:34.675324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:34.727996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ef64b20-59e7-4a9b-a658-ad2ea6b9c6fc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '.version_select at 0x7fa825284160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:34.801088 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-5ef64b20-59e7-4a9b-a658-ad2ea6b9c6fc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Image not found. Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ef64b20-59e7-4a9b-a658-ad2ea6b9c6fc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/images/a68ffe24-e8a0-4875-9a48-933ad9a3f585 HTTP/1.1 Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a68ffe24-e8a0-4875-9a48-933ad9a3f585'} Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a68ffe24-e8a0-4875-9a48-933ad9a3f585 to delete Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a68ffe24-e8a0-4875-9a48-933ad9a3f585 could not be found. Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:34.810301 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 12:57:34.814422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.817747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ef64b20-59e7-4a9b-a658-ad2ea6b9c6fc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:34.819634 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5ef64b20-59e7-4a9b-a658-ad2ea6b9c6fc tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/images/a68ffe24-e8a0-4875-9a48-933ad9a3f585" status: 404 len: 62 microversion: 2.1 time: 0.094647 Oct 17 12:57:34.831018 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1126/2263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:34 2022] DELETE /compute/v2.1/images/a68ffe24-e8a0-4875-9a48-933ad9a3f585 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 12:57:34.842014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:34.849138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:34.879479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:34.881823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:34.886752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:34.890562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:34.891227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:34.892079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:34.932159 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 HTTP/1.1 Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '12b7cfee-a8d4-45b1-bc20-fbd5c901fca9'} Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:34.938913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:34.942394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:34.945232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:34.946966 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31aaa73e-591f-42b3-b1be-15137692db15 tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 404 len: 111 microversion: 2.1 time: 0.114153 Oct 17 12:57:34.950376 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1127/2264] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:57:34 2022] DELETE /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:57:34.968302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:34.969952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] [instance: 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:34.980088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:34.987410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:34.987975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:34.991267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:34.993058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:34.996185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:34.997733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:35.000675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:35.007911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:35.031706 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] HTTP exception thrown: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Request method failure captured: Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 HTTP/1.1 Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVCXRwiYlgcWU3kX1xJkkZmEShTLyuh8VA2NjiWSX2QCjMin5laPDoDZ4Q39fXVRO16gCIb5mPOTQSZJ00M8ZjSozZhIj0Ek0bHCCyfJNiiEP-AygzEcCvbrYMBQ4qvKsudnZl85alXbdS455TviHKbSOirn1DuewyCqTE4l2WK_wP4 Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_450b3f93e96f43ba9c4c64f3552f934c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/450b3f93e96f43ba9c4c64f3552f934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 450b3f93e96f43ba9c4c64f3552f934c Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-109554671 Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9a1e4aea1c6c4ca9a9960e814a7ea07c Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-109554671-project Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '12b7cfee-a8d4-45b1-bc20-fbd5c901fca9'} Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:35.043104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:35.047657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:35.047657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:35.047657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:35.047657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:35.047657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:35.047657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:35.047657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. Oct 17 12:57:35.047657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:35.052081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] Returning 404 to user: Instance 12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:35.056333 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d0d594f-1350-4ff1-8168-948e68ffd803 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1533 microversion: 2.91 time: 0.404042 Oct 17 12:57:35.057226 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c1a0c17f-5e61-447f-9427-1be20126ec7b tempest-ImagesOneServerNegativeTestJSON-109554671 tempest-ImagesOneServerNegativeTestJSON-109554671-project] 10.222.0.27 "GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9" status: 404 len: 111 microversion: 2.1 time: 0.102461 Oct 17 12:57:35.060643 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1128/2265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:34 2022] GET /compute/v2.1/servers/12b7cfee-a8d4-45b1-bc20-fbd5c901fca9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:57:35.064808 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1138/2266] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:34 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1533 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:57:35.097065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:35.097947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:35.106982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:35.107702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:35.108314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:35.109372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:35.110311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:35.111202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:35.460553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:35.461887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:35.476079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:35.484099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:35.487574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:35.489520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:35.496414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:35.498547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:35.841619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] Lazy-loading 'services' on Instance uuid 4989d7ea-4d14-4eff-9da0-417d549e10f5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:57:35.930000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:35.938627 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-519ee582-d5e4-4e18-b442-e79ad9dc1168 tempest-UnshelveToHostMultiNodesTest-918600395 tempest-UnshelveToHostMultiNodesTest-918600395-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1940 microversion: 2.91 time: 0.842312 Oct 17 12:57:35.956241 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1129/2267] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:35 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1940 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:36.000663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:36.002310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:36.032505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:36.036481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:36.036657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:36.038721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:36.038847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:36.039209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:36.143447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:57:36.373679 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-537cd9a1-ee51-4c49-acbd-67c7629ea020 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 204 len: 0 microversion: 2.91 time: 0.378097 Oct 17 12:57:36.375874 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1130/2268] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 12:57:35 2022] DELETE /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 12:57:36.393182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:36.399519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:36.411257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:36.411748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:36.412184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:36.413334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:36.413334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:36.413735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:36.549037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:36.567464 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce83372c-439f-4233-ab32-3ac3db7b58bf tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1370 microversion: 2.1 time: 1.111382 Oct 17 12:57:36.584755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1139/2269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:35 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1370 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:36.677667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:36.695508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:36.696994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:36.716795 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7e947c56-7688-4e26-bd56-ba5389bfe773 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.330154 Oct 17 12:57:36.719729 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1131/2270] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:36 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:37.599539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:37.600181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:37.632229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:37.632745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:37.633203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:37.659932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:37.663707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:37.665833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:37.750371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:37.752110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:37.762491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:37.763437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:37.764879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:37.767579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:37.770128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:37.772546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:38.072117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:38.087785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:38.092073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:38.105423 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f275b59c-40d8-4c52-9ee9-99da5de2bba4 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1539 microversion: 2.91 time: 0.360398 Oct 17 12:57:38.109086 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1132/2271] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:37 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1539 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:38.174506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:38.186135 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e069a35a-7a4a-42f7-8f8b-25a7a8c3467b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1557 microversion: 2.1 time: 0.594006 Oct 17 12:57:38.190619 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1140/2272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:37 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1557 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:38.219337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:38.221402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:38.228194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:38.228875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:38.229461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:38.231147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:38.232732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:38.237306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:38.477338 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-937b588c-f447-429e-9bba-920b046e1350 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.261757 Oct 17 12:57:38.478007 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1133/2273] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 12:57:38 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-interface => generated 285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:57:39.139157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:39.140301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:39.160535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:39.163630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:39.164086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:39.177678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:39.184530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:39.185073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:39.359588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:39.360290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:39.363245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:39.363954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lazy-loading 'fault' on Instance uuid 4989d7ea-4d14-4eff-9da0-417d549e10f5 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:57:39.472761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:39.525779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:39.528269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3b6b183dbf44cd684c5030b272bff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ecd4f9330143ddb5817579fab9b163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:39.574701 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff29a059-a267-406e-ae10-a1cf5d872ea1 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 200 len: 1544 microversion: 2.91 time: 0.435943 Oct 17 12:57:39.579005 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1141/2274] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:39 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 1544 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:57:40.606930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:40.607543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] [instance: 4989d7ea-4d14-4eff-9da0-417d549e10f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:40.625874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:40.626421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:40.626870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:40.634982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:40.639033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:40.639713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:40.719387 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] HTTP exception thrown: Instance 4989d7ea-4d14-4eff-9da0-417d549e10f5 could not be found. Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Request method failure captured: Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 HTTP/1.1 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVBe5G19-t0jlAWNN-yV_4yimUzeIa9MvJU8BlYo8eIQFU1XZ6JdgOPA-68S2mXN-zprpALgX4OijVc-qXJDymucJMZKIxLpMzPveGGpixJSAmUwzw7EqqLeKjRhu1xIlhlTT1gGUrxZO0ZxDXXqBXNDwzPsdlfHIRPMz19cRJDmkuw Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.91 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 91ecd4f9330143ddb5817579fab9b163 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1731234004 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91ecd4f9330143ddb5817579fab9b163", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91ecd4f9330143ddb5817579fab9b163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91ecd4f9330143ddb5817579fab9b163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91ecd4f9330143ddb5817579fab9b163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1731234004 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 91ecd4f9330143ddb5817579fab9b163 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1731234004 Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-UnshelveToHostMultiNodesTest-1731234004-project Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a3b6b183dbf44cd684c5030b272bff4f Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1731234004-project Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 4989d7ea-4d14-4eff-9da0-417d549e10f5 could not be found. Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '4989d7ea-4d14-4eff-9da0-417d549e10f5'} Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4989d7ea-4d14-4eff-9da0-417d549e10f5 could not be found. Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4989d7ea-4d14-4eff-9da0-417d549e10f5 could not be found. Oct 17 12:57:40.721073 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4989d7ea-4d14-4eff-9da0-417d549e10f5 could not be found. Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] Returning 404 to user: Instance 4989d7ea-4d14-4eff-9da0-417d549e10f5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:57:40.724696 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-40395089-ea76-4cac-ac0e-30d0553d7076 tempest-UnshelveToHostMultiNodesTest-1731234004 tempest-UnshelveToHostMultiNodesTest-1731234004-project] 10.222.0.27 "GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5" status: 404 len: 111 microversion: 2.91 time: 0.120175 Oct 17 12:57:40.729362 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1134/2275] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:57:40 2022] GET /compute/v2.1/servers/4989d7ea-4d14-4eff-9da0-417d549e10f5 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 12:57:44.351244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-497d4361-3090-47fe-b008-b380d8419b36 req-5f4d7793-cd79-421b-bf79-22d058f4c068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dff0a31-d0a4-4203-9280-48996deaa841", "tag": "0d24b606-1b0b-4095-be00-86b3411aa958"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:44.370245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-497d4361-3090-47fe-b008-b380d8419b36 req-5f4d7793-cd79-421b-bf79-22d058f4c068 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:44.370652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-497d4361-3090-47fe-b008-b380d8419b36 req-5f4d7793-cd79-421b-bf79-22d058f4c068 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:44.371094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-497d4361-3090-47fe-b008-b380d8419b36 req-5f4d7793-cd79-421b-bf79-22d058f4c068 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:44.391647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-497d4361-3090-47fe-b008-b380d8419b36 req-5f4d7793-cd79-421b-bf79-22d058f4c068 service nova] Creating event network-changed:0d24b606-1b0b-4095-be00-86b3411aa958 for instance 2dff0a31-d0a4-4203-9280-48996deaa841 on n-h2-853316-12 Oct 17 12:57:44.410593 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-497d4361-3090-47fe-b008-b380d8419b36 req-5f4d7793-cd79-421b-bf79-22d058f4c068 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072292 Oct 17 12:57:44.412914 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1142/2276] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:57:50.493399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1925298516", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:50.640956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:57:50.668129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:52.335669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:57:52.336278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:57:52.336550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:57:52.336955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:57:52.337370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:57:52.362120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:52.362818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:52.363440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:52.364343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:52.365058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:52.365651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:52.414902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Getting quotas for project babd3113b96b41bd90cbc7d38b3cac5f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:57:52.432529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Getting quotas for user 39929884c9ad40f88466f6755622ce73 and project babd3113b96b41bd90cbc7d38b3cac5f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:57:52.448779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:57:52.451634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:57:52.526496 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69578249-bd5e-4b1a-88c3-5b596509065e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.439738 Oct 17 12:57:52.542295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3dc995c-4a38-41ac-a53b-ef8299f5e2c9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:52.543626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3dc995c-4a38-41ac-a53b-ef8299f5e2c9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:52.546819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1135/2277] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:57:52.852675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3dc995c-4a38-41ac-a53b-ef8299f5e2c9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:52.864150 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3dc995c-4a38-41ac-a53b-ef8299f5e2c9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1214 microversion: 2.1 time: 0.328320 Oct 17 12:57:52.874914 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1143/2278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:52 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1214 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:53.897825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:53.900200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:53.915415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:53.916023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:53.916472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:53.917201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:53.924840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:53.925403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:54.047671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:54.061625 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35c8ecb9-a50b-4761-9d0b-06d0f2934464 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1210 microversion: 2.1 time: 0.173666 Oct 17 12:57:54.079927 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1136/2279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:53 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:54.522676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:54.762455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1779062512", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "76738b67-1f67-4450-8954-529dd7a99e80"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:57:54.800270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:57:54.912515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] validate_networks() for [('76738b67-1f67-4450-8954-529dd7a99e80', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:57:55.092767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:55.093405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:55.106651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:55.107408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:55.108561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:55.109527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:55.110199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:55.112933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:55.403605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:55.417749 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71463c90-ef0b-4cba-962e-e95b0e96172b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1272 microversion: 2.1 time: 0.330893 Oct 17 12:57:55.435460 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1137/2280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:55 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:56.449375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:56.450319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:56.465464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:56.465972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:56.468733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:56.473054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:56.473537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:56.473984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:56.766935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:56.782847 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-547d020a-061e-46d7-91fa-76457b192e89 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1272 microversion: 2.1 time: 0.333987 Oct 17 12:57:56.784507 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1138/2281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:56 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:57.811337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:57.812803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:57.854706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:57.855929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:57.862000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:57.865082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:57.865933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:57.869249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:58.384395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:57:58.384850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:57:58.385295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:57:58.385711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:57:58.386129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:57:58.405146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:58.406041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:58.409815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:58.411737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:58.412471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:58.414811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:58.465800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:57:58.479609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for user 638e5facdbe64d26bf3c4b5c12a33da7 and project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:57:58.514615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:58.528904 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3fd9b5ba-9a4f-4fd4-b872-7c35c6a0c5d9 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1272 microversion: 2.1 time: 0.724684 Oct 17 12:57:58.530104 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1139/2282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:57 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1272 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:57:58.544732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:57:58.548315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:57:58.671525 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00648989-8cfb-41a4-a624-9529e06fc369 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.155827 Oct 17 12:57:58.684015 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1144/2283] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:57:58.685264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bcc504ca-b20c-4db4-93f8-aaee8d3b53ca tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:58.686720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bcc504ca-b20c-4db4-93f8-aaee8d3b53ca tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:59.059873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bcc504ca-b20c-4db4-93f8-aaee8d3b53ca tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:57:59.071025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bcc504ca-b20c-4db4-93f8-aaee8d3b53ca tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1208 microversion: 2.1 time: 0.389298 Oct 17 12:57:59.094522 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1140/2284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:58 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1208 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:57:59.557264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:57:59.558070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:57:59.580717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:59.588335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:59.593657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:57:59.594670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:57:59.597034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:57:59.597623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:00.117517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:00.124435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:00.134025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:00.135155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:00.137528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:00.138499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:00.141664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:00.142328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:00.336770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:00.351483 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-94665ba2-4c73-46b5-9fab-9a619c2b7b1f tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 0.797901 Oct 17 12:58:00.353725 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1145/2285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:57:59 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:00.481953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:00.506607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-49559f5a-bdc9-4fa9-b366-ba7d381c8650 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1204 microversion: 2.1 time: 0.382212 Oct 17 12:58:00.508525 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1141/2286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:00 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1204 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:01.381811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:01.383641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:01.398272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:01.403379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:01.406232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:01.408355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:01.412356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:01.414108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:01.536065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:01.536676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:01.553002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:01.553511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:01.553947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:01.554700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:01.555151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:01.555575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:01.994629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:02.013449 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-02fda477-f038-46b8-9301-55a0fc3d434d tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 0.634695 Oct 17 12:58:02.014882 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1146/2287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:01 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:02.258889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:02.275453 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a05ede41-40e7-4bfb-badb-fc87dcb00688 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1266 microversion: 2.1 time: 0.742974 Oct 17 12:58:02.284075 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1142/2288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:01 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1266 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:02.368828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7fe89ac7-178b-4dd1-afce-978148eeb775 req-68ac16af-242f-4436-a39c-aeb054b8def0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6af7074-5d9d-4ccb-a888-c8624da0b069", "tag": "c3c1bc7d-a473-4a3c-a60a-7a96779481d1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:02.382124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1348359849", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "5ab5fe2b-3424-46bb-bd5e-c78cc4ccf633"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:02.388860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7fe89ac7-178b-4dd1-afce-978148eeb775 req-68ac16af-242f-4436-a39c-aeb054b8def0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:02.389813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7fe89ac7-178b-4dd1-afce-978148eeb775 req-68ac16af-242f-4436-a39c-aeb054b8def0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:02.390452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7fe89ac7-178b-4dd1-afce-978148eeb775 req-68ac16af-242f-4436-a39c-aeb054b8def0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:02.399777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:02.421270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7fe89ac7-178b-4dd1-afce-978148eeb775 req-68ac16af-242f-4436-a39c-aeb054b8def0 service nova] Creating event network-changed:c3c1bc7d-a473-4a3c-a60a-7a96779481d1 for instance a6af7074-5d9d-4ccb-a888-c8624da0b069 on n-h1-853316-12 Oct 17 12:58:02.437739 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7fe89ac7-178b-4dd1-afce-978148eeb775 req-68ac16af-242f-4436-a39c-aeb054b8def0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070966 Oct 17 12:58:02.440395 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1143/2289] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:02.516621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] validate_networks() for [('5ab5fe2b-3424-46bb-bd5e-c78cc4ccf633', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:58:03.042754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:03.044074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:03.055761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:03.058850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:03.061309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:03.062983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:03.066808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:03.067521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:04.012240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:58:04.012728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:58:04.013203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:58:04.014150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:58:04.014617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:58:04.024731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:04.025220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:04.025954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:04.027331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:04.028754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:04.029569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:04.072081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for project 6c6509294f164045968c57ff20d25d18. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:04.091234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for user bd6001af2bfe4fe881afcaaf6cca9962 and project 6c6509294f164045968c57ff20d25d18. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:04.128241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:58:04.130965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:58:04.221085 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2b42b512-f66f-4f57-82b6-c7bec2d163e1 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.201630 Oct 17 12:58:04.222099 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1147/2290] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:58:04.244704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:04.247375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:04.263084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:04.263735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:04.264439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:04.265589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:04.266216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:04.276893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:04.588724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:04.607090 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2aa2b21a-efda-4a3a-ab3f-eac2e2e0c9b2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.383026 Oct 17 12:58:04.624726 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1148/2291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:04 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:04.631752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2bb9810-e829-4eae-bb58-20d2ff89c16f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:04.632458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2bb9810-e829-4eae-bb58-20d2ff89c16f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:04.771565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2bb9810-e829-4eae-bb58-20d2ff89c16f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:04.781787 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2bb9810-e829-4eae-bb58-20d2ff89c16f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1211 microversion: 2.1 time: 0.155482 Oct 17 12:58:04.782948 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1149/2292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:04 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:05.250449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:05.272723 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e074cd2d-4e2c-4f92-82c8-bfa5c46ceeef tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 2.232272 Oct 17 12:58:05.288970 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1144/2293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:03 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:05.649643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:05.650960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:05.664953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:05.665689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:05.666346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:05.667247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:05.667962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:05.668526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:05.806276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:05.806903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:05.826504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:05.830572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:05.832061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:05.841623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:05.843869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:05.844400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:06.129677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:06.155738 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43ff6be5-2cca-494e-a51d-8bd94526cdef tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1215 microversion: 2.1 time: 0.352984 Oct 17 12:58:06.156016 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1145/2294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:05 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1215 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:06.286785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:06.301315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:06.302091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:06.306363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:06.309832 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e3f2b25-8609-425b-8cac-c559aac724ef tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.662506 Oct 17 12:58:06.311488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:06.312389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:06.313071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:06.314759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:06.316475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:06.317140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:06.332540 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1150/2295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:05 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:07.186917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:07.187563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:07.203133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:07.203642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:07.206885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:07.207867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:07.210361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:07.212777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:07.363087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:07.375228 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3bdfc85-199c-4bc2-8fee-ef536b6aa681 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1269 microversion: 2.1 time: 0.192277 Oct 17 12:58:07.376008 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1151/2296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:07 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:07.381123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:07.388167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:07.395650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:07.404400 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-105b37ab-a26f-49ed-a346-bddb9eb93007 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 1.108111 Oct 17 12:58:07.408197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:07.408696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:07.409139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:07.409848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:07.410331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:07.410754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:07.418770 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1146/2297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:06 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:07.656846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:07.664734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-54c511f2-07b4-4ab6-9f98-e8e4d5d595cb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.287289 Oct 17 12:58:07.665908 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1152/2298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:07 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:08.400899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:08.401516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:08.412999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:08.413700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:08.414328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:08.415202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:08.415811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:08.416392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:08.428242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:08.429005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:08.441226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:08.441825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:08.450889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:08.451893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:08.452481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:08.452991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:08.691260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:08.715722 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-106cdaa5-7fda-4c71-874c-478eb2e1e92e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1269 microversion: 2.1 time: 0.319077 Oct 17 12:58:08.716310 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1147/2299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:08 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1269 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:08.724207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:08.733706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:08.750204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:08.754419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:08.755026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:08.756436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:08.757295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:08.757945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:08.915859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:08.929917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81d1e3ad-ca34-4c21-ac79-34a4b2c38524 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 0.505571 Oct 17 12:58:08.931350 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1153/2300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:08 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:09.067654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:09.408123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:09.420894 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3b3b25cd-062d-43b9-ad56-8b4285133b74 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.700268 Oct 17 12:58:09.423131 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1148/2301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:08 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:09.746036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:09.746967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:09.748265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5ec51d3f-b517-42d7-a0f0-36d1f4839d73 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Action: 'create', calling method: .version_select at 0x7fa8212a8790>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1333310369", "policies": ["affinity"]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:09.761462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:09.762775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:09.766151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:09.767285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:09.768135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:09.768756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:09.816887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5ec51d3f-b517-42d7-a0f0-36d1f4839d73 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:09.825938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5ec51d3f-b517-42d7-a0f0-36d1f4839d73 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:09.902731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5ec51d3f-b517-42d7-a0f0-36d1f4839d73 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:09.911196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5ec51d3f-b517-42d7-a0f0-36d1f4839d73 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:09.928977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5ec51d3f-b517-42d7-a0f0-36d1f4839d73 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.410361 Oct 17 12:58:09.930606 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1154/2302] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 17 12:58:09 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:09.955702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9c5997b-d944-461c-b29c-414ba6aedead tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Action: 'create', calling method: .version_select at 0x7fa8212a8700>, body: {"server_group": {"name": "tempest-server-group-824360948", "policies": ["affinity"]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:09.996066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b9c5997b-d944-461c-b29c-414ba6aedead tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:10.008867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b9c5997b-d944-461c-b29c-414ba6aedead tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:10.056664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:10.080170 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-73512de7-63d1-472b-a334-4641a89b5468 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1269 microversion: 2.1 time: 0.337593 Oct 17 12:58:10.083112 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1149/2303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:09 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1269 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:10.105839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:10.106540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:10.143029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:10.144539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:10.147121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:10.148164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:10.153353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:10.155484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b9c5997b-d944-461c-b29c-414ba6aedead tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:10.157085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:10.163749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b9c5997b-d944-461c-b29c-414ba6aedead tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:10.177663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:10.239628 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9c5997b-d944-461c-b29c-414ba6aedead tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.298134 Oct 17 12:58:10.250750 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1155/2304] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 17 12:58:09 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:10.275831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-80ddb186-92d0-495d-95db-446cec831710 req-4df78554-5088-42f8-bca1-b31316da03b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93643651-ffe6-4925-ac21-a34be3ab4749", "tag": "2300358d-c0d9-4e82-a174-84c57b25bef4"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:10.302078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-80ddb186-92d0-495d-95db-446cec831710 req-4df78554-5088-42f8-bca1-b31316da03b6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:10.302594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-80ddb186-92d0-495d-95db-446cec831710 req-4df78554-5088-42f8-bca1-b31316da03b6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:10.303096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-80ddb186-92d0-495d-95db-446cec831710 req-4df78554-5088-42f8-bca1-b31316da03b6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:10.335081 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-80ddb186-92d0-495d-95db-446cec831710 req-4df78554-5088-42f8-bca1-b31316da03b6 service nova] Creating event network-changed:2300358d-c0d9-4e82-a174-84c57b25bef4 for instance 93643651-ffe6-4925-ac21-a34be3ab4749 on n-h2-853316-12 Oct 17 12:58:10.341926 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-80ddb186-92d0-495d-95db-446cec831710 req-4df78554-5088-42f8-bca1-b31316da03b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085080 Oct 17 12:58:10.343158 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1156/2305] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:10.357499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb0ac57f-ba9e-4ad4-b8e2-c481c41d47d4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Action: 'create', calling method: .version_select at 0x7fa8209e99d0>, body: {"server_group": {"name": "tempest-server-group-824360948", "policies": ["affinity"]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:10.440922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-eb0ac57f-ba9e-4ad4-b8e2-c481c41d47d4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:10.454399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-eb0ac57f-ba9e-4ad4-b8e2-c481c41d47d4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:10.585477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-eb0ac57f-ba9e-4ad4-b8e2-c481c41d47d4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:10.598649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-eb0ac57f-ba9e-4ad4-b8e2-c481c41d47d4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:10.626849 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eb0ac57f-ba9e-4ad4-b8e2-c481c41d47d4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.282162 Oct 17 12:58:10.627801 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1157/2306] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 17 12:58:10 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:10.636307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:10.637104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:10.651650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:10.658327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:10.658859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:10.664674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:10.665476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:10.672697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:11.418109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:11.431857 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ebbd67cd-be39-437c-8433-4f1034dddbb9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.802730 Oct 17 12:58:11.432939 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1158/2307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:10 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:11.453925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99b229b7-7a13-4a8d-989e-79ccd3c09779 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:11.507427 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-99b229b7-7a13-4a8d-989e-79ccd3c09779 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/caccb6f6-3986-4a46-9e27-b818b792b35e" status: 204 len: 0 microversion: 2.1 time: 0.068343 Oct 17 12:58:11.508839 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1159/2308] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:11 2022] DELETE /compute/v2.1/os-server-groups/caccb6f6-3986-4a46-9e27-b818b792b35e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:58:11.517470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:11.518596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:11.535376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:11.538540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:11.540718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:11.541931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:11.545913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:11.547173 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f38d7f1c-9e85-4777-914f-88a520445e83 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 1.460418 Oct 17 12:58:11.547776 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1150/2309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:10 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:11.548444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:11.550067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:11.586219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84621fec-9ba6-41ee-b047-349f7f01acfc tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:11.640916 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84621fec-9ba6-41ee-b047-349f7f01acfc tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.079639 Oct 17 12:58:11.647817 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1151/2310] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:58:11 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:11.668464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-05b24fb2-9a47-4234-b5e2-534f4c48755e tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:11.758150 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-05b24fb2-9a47-4234-b5e2-534f4c48755e tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/e369c12f-b8d8-49ca-9ed7-e514047f06cc" status: 204 len: 0 microversion: 2.1 time: 0.101497 Oct 17 12:58:11.759472 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1152/2311] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:11 2022] DELETE /compute/v2.1/os-server-groups/e369c12f-b8d8-49ca-9ed7-e514047f06cc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:58:11.769840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da7048b8-12d9-4227-aadf-015c448d3ff9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:11.802326 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da7048b8-12d9-4227-aadf-015c448d3ff9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034412 Oct 17 12:58:11.805558 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1153/2312] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:58:11 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:58:11.819316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b0b7cda6-6e36-4fce-8676-ccaa87f3b670 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Action: 'create', calling method: .version_select at 0x7fa825229d30>, body: {"server_group": {"name": "tempest-server-group-1413183328", "policies": ["affinity"]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:11.879554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b0b7cda6-6e36-4fce-8676-ccaa87f3b670 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:11.901998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b0b7cda6-6e36-4fce-8676-ccaa87f3b670 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:12.052652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b0b7cda6-6e36-4fce-8676-ccaa87f3b670 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:12.053394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:12.066523 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f5304f6f-4333-4917-8619-fbb7c6667612 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1311 microversion: 2.1 time: 0.556053 Oct 17 12:58:12.072607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b0b7cda6-6e36-4fce-8676-ccaa87f3b670 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:12.073486 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1160/2313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:11 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1311 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:12.108776 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b0b7cda6-6e36-4fce-8676-ccaa87f3b670 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.294466 Oct 17 12:58:12.114951 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1154/2314] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 17 12:58:11 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:58:12.126127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-045fea90-4243-4902-b876-ac7e9a5abbb4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:12.184891 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-045fea90-4243-4902-b876-ac7e9a5abbb4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/8bb80ab7-1246-4fe4-975c-1efe27b47cca" status: 204 len: 0 microversion: 2.1 time: 0.063101 Oct 17 12:58:12.190860 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1161/2315] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:12 2022] DELETE /compute/v2.1/os-server-groups/8bb80ab7-1246-4fe4-975c-1efe27b47cca => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:58:12.195167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-36902b58-b429-4a7f-8bab-b8639d435335 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:12.225437 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-36902b58-b429-4a7f-8bab-b8639d435335 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031178 Oct 17 12:58:12.241918 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1155/2316] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:58:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:58:12.248204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1172612a-261a-4c29-b7ef-81f3b56a7474 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Action: 'create', calling method: .version_select at 0x7fa8209d0430>, body: {"server_group": {"name": "tempest-server-group-1766092281", "policies": ["anti-affinity"]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:12.291627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1172612a-261a-4c29-b7ef-81f3b56a7474 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:12.306245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1172612a-261a-4c29-b7ef-81f3b56a7474 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:12.405957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1172612a-261a-4c29-b7ef-81f3b56a7474 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:12.422068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1172612a-261a-4c29-b7ef-81f3b56a7474 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_groups'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:12.447901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1172612a-261a-4c29-b7ef-81f3b56a7474 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.204476 Oct 17 12:58:12.449651 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1162/2317] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 17 12:58:12 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:12.461979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-797e6e60-d42f-43de-b390-02b9b2643777 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:12.469234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:12.470447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:12.489028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:12.489568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:12.490248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:12.491316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:12.491967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:12.492555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:12.533392 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-797e6e60-d42f-43de-b390-02b9b2643777 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/29ae8d48-a8a9-43c7-a66e-02074a1353ce" status: 204 len: 0 microversion: 2.1 time: 0.073653 Oct 17 12:58:12.534664 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1156/2318] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:12 2022] DELETE /compute/v2.1/os-server-groups/29ae8d48-a8a9-43c7-a66e-02074a1353ce => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:58:12.547206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7a66569e-dd4a-4dca-805c-ba31edd752e1 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:12.573499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7a66569e-dd4a-4dca-805c-ba31edd752e1 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034467 Oct 17 12:58:12.574229 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1157/2319] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:58:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:12.589952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:12.590982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:12.603210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:12.603802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:12.610231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:12.611293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:12.611981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:12.612608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:12.999414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:13.007653 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-638fa901-6ab0-44a5-a701-ddf97ba36b9f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.546049 Oct 17 12:58:13.023770 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1163/2320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:12 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:13.031653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-493267080", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "f598f5e6-b22b-485d-8086-83be50a30f70"}]}, "os:scheduler_hints": {"group": "962bed96-822e-451e-8e56-769f0760c77a"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:13.115083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] validate_networks() for [('f598f5e6-b22b-485d-8086-83be50a30f70', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:58:14.049299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:14.192438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:14.208906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d423e6aa-ea00-4751-b03c-7e284eb14800 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 1.633652 Oct 17 12:58:14.238401 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1158/2321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:12 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:14.246445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:14.252648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:14.269454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:14.270480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:14.271252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:14.272656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:14.273399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:14.274754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:14.675852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:58:14.676619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:58:14.677669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:58:14.678721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:58:14.679726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:58:14.709888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=49 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:14.712501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:14.713569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:14.714265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:14.715365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:14.721271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:14.722102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:14.781720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:14.788072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:14.813975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:58:14.829152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:58:14.855444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:14.875542 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-45fd171a-9e25-414c-949f-73a8088c8ff7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1311 microversion: 2.1 time: 0.629269 Oct 17 12:58:14.885823 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1159/2322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:14 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1311 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:14.898255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a7390da6-d541-409e-9740-9d1022bf6193 req-f32f4e36-f147-4484-a15c-232441e0eaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6af7074-5d9d-4ccb-a888-c8624da0b069", "name": "network-vif-plugged", "status": "completed", "tag": "c3c1bc7d-a473-4a3c-a60a-7a96779481d1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:14.904021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:14.912227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a7390da6-d541-409e-9740-9d1022bf6193 req-f32f4e36-f147-4484-a15c-232441e0eaa8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:14.913471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a7390da6-d541-409e-9740-9d1022bf6193 req-f32f4e36-f147-4484-a15c-232441e0eaa8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:14.914898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a7390da6-d541-409e-9740-9d1022bf6193 req-f32f4e36-f147-4484-a15c-232441e0eaa8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:14.926716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127540) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 17 12:58:14.944212 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a7390da6-d541-409e-9740-9d1022bf6193 req-f32f4e36-f147-4484-a15c-232441e0eaa8 service nova] Creating event network-vif-plugged:c3c1bc7d-a473-4a3c-a60a-7a96779481d1 for instance a6af7074-5d9d-4ccb-a888-c8624da0b069 on n-h1-853316-12 Oct 17 12:58:14.955611 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a7390da6-d541-409e-9740-9d1022bf6193 req-f32f4e36-f147-4484-a15c-232441e0eaa8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067915 Oct 17 12:58:14.956976 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1160/2323] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:14.970674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "140d6d88-fddc-4894-ad61-b189ef869571"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:14.974989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:14.976937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_group_members'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:15.011714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_group_members'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:15.016897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:15.017757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:15.018854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:15.019870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:15.020572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:15.021984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:15.081299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:15.159970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_group_members'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:15.170052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Getting quotas for user 9c28ffd1511043d7be0c0cefa16413e9 and project b7caded0f2864eac9eb14f8b3744d927. Resources: {'server_group_members'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:15.233963 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-caae8ef0-4b07-43ba-9784-d77352b73cee tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.208721 Oct 17 12:58:15.249109 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1164/2324] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:58:15.251298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:15.253736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:15.267230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:15.267914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:15.268715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:15.269594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:15.270300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:15.271899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:15.745437 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2475960-6b6d-4d6f-9be8-b75f7631313f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "POST /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768757 Oct 17 12:58:15.749930 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1161/2325] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 12:58:14 2022] POST /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments => generated 194 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:15.777609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:15.778286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:15.811285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:15.811792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:15.812237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:15.817186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:15.822507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:15.823455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:16.347169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:16.364419 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fa808831-196b-4488-9cce-7f2397f22c9a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 1.118680 Oct 17 12:58:16.384409 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1165/2326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:15 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:16.402842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dba8cada-a175-426f-8982-c5f764c7b014 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:16.405117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dba8cada-a175-426f-8982-c5f764c7b014 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:16.581146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dba8cada-a175-426f-8982-c5f764c7b014 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:16.597613 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dba8cada-a175-426f-8982-c5f764c7b014 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1212 microversion: 2.1 time: 0.211998 Oct 17 12:58:16.598852 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1166/2327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:16 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1212 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:16.603782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:16.614121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:16.630787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:16.635885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:16.638099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:16.639089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:16.640756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:16.642800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:16.740598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:16.757358 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72c24c84-bbbd-445b-8751-ecc8423f5b6b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 0.998185 Oct 17 12:58:16.758059 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1162/2328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:15 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:16.768585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-52ec7cee-1083-42d5-9c72-7b91687fece2 req-8e77ee21-9321-408e-99cc-798b7582e6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093eddd4-bc84-4fc5-b692-1a986ddcf78a", "tag": "5a53af6b-06ae-4124-abe0-490e5199838b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:16.803868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-52ec7cee-1083-42d5-9c72-7b91687fece2 req-8e77ee21-9321-408e-99cc-798b7582e6d4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:16.807341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-52ec7cee-1083-42d5-9c72-7b91687fece2 req-8e77ee21-9321-408e-99cc-798b7582e6d4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:16.809019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-52ec7cee-1083-42d5-9c72-7b91687fece2 req-8e77ee21-9321-408e-99cc-798b7582e6d4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:16.845514 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-52ec7cee-1083-42d5-9c72-7b91687fece2 req-8e77ee21-9321-408e-99cc-798b7582e6d4 service nova] Creating event network-changed:5a53af6b-06ae-4124-abe0-490e5199838b for instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a on n-h1-853316-12 Oct 17 12:58:16.862973 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-52ec7cee-1083-42d5-9c72-7b91687fece2 req-8e77ee21-9321-408e-99cc-798b7582e6d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099391 Oct 17 12:58:16.863611 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1163/2329] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:17.303397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:17.315733 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d49697ca-2790-4a56-a83b-b62e8034291d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1311 microversion: 2.1 time: 0.714838 Oct 17 12:58:17.317306 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1167/2330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:16 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1311 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:17.344194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-28aba570-59fc-4795-953e-e8a48a0e8644 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Action: 'create', calling method: .version_select at 0x7fa8252293a0>, body: {"keypair": {"name": "tempest-keypair-544563165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3LAj3eeNFmxJJmkAqmRH5G3HF1dIxHRy2DkxISh94dE7AX/if4I0mLNMv42lJRcnqSvfXSp7oXvGOGoEvoXUNfXMJ8C7UVdiDbHv3PIwwPp978EUbsA0cIdHD1BtbQ7A=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:17.392040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:17.393622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:17.414074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:17.426333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-28aba570-59fc-4795-953e-e8a48a0e8644 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Getting quotas for project 8ed76e939ebc4a828650e77d8695c708. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:17.432653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:17.433197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:17.436251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:17.442829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-28aba570-59fc-4795-953e-e8a48a0e8644 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Getting quotas for user ca1b49177f8441328c36765b43a918fc and project 8ed76e939ebc4a828650e77d8695c708. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:17.448399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:17.449673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:17.547720 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-28aba570-59fc-4795-953e-e8a48a0e8644 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.209664 Oct 17 12:58:17.550825 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1164/2331] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 12:58:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 215 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 12:58:17.623792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:17.624811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:17.639479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:17.641336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:17.642407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:17.643489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:17.646328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:17.649405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:17.795430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:17.807402 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07914825-3253-4a78-9b9c-3f7230cd80e2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.420302 Oct 17 12:58:17.808213 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1168/2332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:17 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:17.830925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:17.831554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:17.869030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:17.869605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:17.870106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:17.871020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:17.871492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:17.871991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:17.887344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:17.906822 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-661c0515-2a60-464a-a79e-b519b3a2dd46 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1272 microversion: 2.1 time: 0.285857 Oct 17 12:58:17.910528 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1165/2333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:17 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:18.249754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:18.262563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d62ffb3-bf43-47a8-87db-9aa26d482af8 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1314 microversion: 2.1 time: 0.449289 Oct 17 12:58:18.280536 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1169/2334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:17 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:18.348573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:18.349426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:18.379246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:18.379879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:18.381884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:18.383898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:18.388700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:18.389174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:18.839471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:18.840605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:18.855441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:18.857136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:18.857768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:18.859771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:18.860242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:18.861993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:19.007689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:19.018604 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd99cda0-6a85-4215-ae15-7283784786c3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1311 microversion: 2.1 time: 0.677095 Oct 17 12:58:19.038417 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1166/2335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:18 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1311 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:19.043836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:19.052142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:19.064949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:19.066057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:19.066730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:19.067673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:19.068337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:19.068972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:19.221736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:19.229576 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-611b5dff-efa9-4139-9506-484bddc62a88 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1270 microversion: 2.1 time: 0.189671 Oct 17 12:58:19.237118 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1167/2336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:19 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:19.287094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:19.287712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:19.303792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:19.304304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:19.304749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:19.305633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:19.306099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:19.306573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:19.542625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:19.556954 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-70e97c12-d70d-41a1-ad98-1a7dc7a4384a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.718636 Oct 17 12:58:19.567893 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1170/2337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:18 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:19.970748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-fe74f225-6053-4298-bf3b-a808e6ff2f1c req-91376d89-39b5-412d-851c-8e3eb25f3cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93643651-ffe6-4925-ac21-a34be3ab4749", "name": "network-vif-plugged", "status": "completed", "tag": "2300358d-c0d9-4e82-a174-84c57b25bef4"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:19.999143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fe74f225-6053-4298-bf3b-a808e6ff2f1c req-91376d89-39b5-412d-851c-8e3eb25f3cf9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:19.999666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fe74f225-6053-4298-bf3b-a808e6ff2f1c req-91376d89-39b5-412d-851c-8e3eb25f3cf9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.000450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fe74f225-6053-4298-bf3b-a808e6ff2f1c req-91376d89-39b5-412d-851c-8e3eb25f3cf9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:20.012561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:20.048935 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-fe74f225-6053-4298-bf3b-a808e6ff2f1c req-91376d89-39b5-412d-851c-8e3eb25f3cf9 service nova] Creating event network-vif-plugged:2300358d-c0d9-4e82-a174-84c57b25bef4 for instance 93643651-ffe6-4925-ac21-a34be3ab4749 on n-h2-853316-12 Oct 17 12:58:20.062948 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-fe74f225-6053-4298-bf3b-a808e6ff2f1c req-91376d89-39b5-412d-851c-8e3eb25f3cf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097361 Oct 17 12:58:20.066351 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1171/2338] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:20.068439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:20.101829 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48ded48d-491f-4877-acef-c5bc48186331 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1463 microversion: 2.1 time: 0.818550 Oct 17 12:58:20.103246 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1168/2339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:19 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1463 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:20.115745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:20.116487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:20.132636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:20.132898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.136444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:20.137272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:20.139779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.140489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:20.585024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f001419b-3f3a-4b13-a416-fbfbbee76a66 tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Calling method '.version_select at 0x7fa825147c10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:20.603635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f001419b-3f3a-4b13-a416-fbfbbee76a66 tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:20.604391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f001419b-3f3a-4b13-a416-fbfbbee76a66 tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.604821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f001419b-3f3a-4b13-a416-fbfbbee76a66 tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:20.645417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f001419b-3f3a-4b13-a416-fbfbbee76a66 tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:20.646380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f001419b-3f3a-4b13-a416-fbfbbee76a66 tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.647100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f001419b-3f3a-4b13-a416-fbfbbee76a66 tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:20.683823 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f001419b-3f3a-4b13-a416-fbfbbee76a66 tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/babd3113b96b41bd90cbc7d38b3cac5f?start=2022-10-16T12%3A58%3A20.122754&end=2022-10-18T12%3A58%3A20.122754" status: 200 len: 695 microversion: 2.1 time: 0.557248 Oct 17 12:58:20.687451 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1169/2340] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 17 12:58:20 2022] GET /compute/v2.1/os-simple-tenant-usage/babd3113b96b41bd90cbc7d38b3cac5f?start=2022-10-16T12%3A58%3A20.122754&end=2022-10-18T12%3A58%3A20.122754 => generated 695 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:58:20.692260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:20.693074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:20.714356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:20.715115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.715747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:20.717490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:20.727840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.728627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:20.953495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:20.961553 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68b555d5-484d-488c-9091-44883413269c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1311 microversion: 2.1 time: 0.892879 Oct 17 12:58:20.962146 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1172/2341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:20 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1311 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:20.968058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:20.968861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:20.975082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:20.976345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.977275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:20.978229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:20.978826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:20.979403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:21.427070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:21.451974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:21.483335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0a6b870-dfcb-4f9b-b203-80e2280bf997 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1308 microversion: 2.1 time: 0.515752 Oct 17 12:58:21.488542 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1173/2342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:20 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1308 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:21.498611 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f4df7bf-b87c-449d-8ac3-8d63d9caa14a tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1312 microversion: 2.1 time: 0.808030 Oct 17 12:58:21.499711 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1170/2343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:20 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1312 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:21.511619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-79a312bb-aa20-47fb-87d5-afaeeef3c99a tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '.version_select at 0x7fa820d0f0d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:21.527157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79a312bb-aa20-47fb-87d5-afaeeef3c99a tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:21.527640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79a312bb-aa20-47fb-87d5-afaeeef3c99a tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:21.528249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79a312bb-aa20-47fb-87d5-afaeeef3c99a tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:21.569484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79a312bb-aa20-47fb-87d5-afaeeef3c99a tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:21.570235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79a312bb-aa20-47fb-87d5-afaeeef3c99a tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:21.570823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79a312bb-aa20-47fb-87d5-afaeeef3c99a tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:21.613521 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-79a312bb-aa20-47fb-87d5-afaeeef3c99a tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/babd3113b96b41bd90cbc7d38b3cac5f?start=2022-10-16T12%3A58%3A20.122754&end=2022-10-18T12%3A58%3A20.122754" status: 200 len: 695 microversion: 2.1 time: 0.123608 Oct 17 12:58:21.614301 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1174/2344] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 17 12:58:21 2022] GET /compute/v2.1/os-simple-tenant-usage/babd3113b96b41bd90cbc7d38b3cac5f?start=2022-10-16T12%3A58%3A20.122754&end=2022-10-18T12%3A58%3A20.122754 => generated 695 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:21.633512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-64541434-920f-4a6e-ae1e-38abcb9fbf2c tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Calling method '.version_select at 0x7fa825165b80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:21.644981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64541434-920f-4a6e-ae1e-38abcb9fbf2c tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:21.647451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64541434-920f-4a6e-ae1e-38abcb9fbf2c tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:21.648377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64541434-920f-4a6e-ae1e-38abcb9fbf2c tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:21.694584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64541434-920f-4a6e-ae1e-38abcb9fbf2c tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:21.697335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64541434-920f-4a6e-ae1e-38abcb9fbf2c tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:21.698742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64541434-920f-4a6e-ae1e-38abcb9fbf2c tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:21.943238 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-64541434-920f-4a6e-ae1e-38abcb9fbf2c tempest-TenantUsagesTestJSON-1298040530 tempest-TenantUsagesTestJSON-1298040530-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T12%3A58%3A20.122754&end=2022-10-18T12%3A58%3A20.122754&detailed=1" status: 200 len: 27184 microversion: 2.1 time: 0.314296 Oct 17 12:58:21.967995 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1171/2345] 10.222.0.27 () {58 vars in 1335 bytes} [Mon Oct 17 12:58:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T12%3A58%3A20.122754&end=2022-10-18T12%3A58%3A20.122754&detailed=1 => generated 27184 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 12:58:22.005202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:22.007764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:22.009044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:22.010094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:22.023187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:22.030902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.036066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.037102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.041173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.041952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.046478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.048167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.048808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.049930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.052692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.053332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.053877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.124688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:58:22.244824 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e2568ffc-e3e5-450d-bc37-0c1ead9f459c tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 204 len: 0 microversion: 2.1 time: 0.245113 Oct 17 12:58:22.245736 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1172/2346] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:58:21 2022] DELETE /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:58:22.256977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:22.257687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:22.265905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.266443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.266880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.267810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.268286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.268688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.588945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:22.594587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:22.597825 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-06c741cf-0cd1-4cdf-a268-6ee15994ec63 tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1469 microversion: 2.1 time: 0.347146 Oct 17 12:58:22.614023 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ffa686d-9e81-463f-8d32-64b3ef0285e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1311 microversion: 2.1 time: 0.631494 Oct 17 12:58:22.618061 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1173/2347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:22 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1469 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:22.620025 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1175/2348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:21 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1311 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:22.626444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9c458c32-c2af-416b-bdd4-543084ed6f21 req-deb60f17-2f7b-4191-8b33-0cf8adb70c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ed9aab-b664-467a-bb6b-fdc75b01ee14", "tag": "ee3c24f4-3686-4a11-91bb-dbb99f5a6896"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:22.639167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:22.640605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:22.655092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.656921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.659022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.663162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.663934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.665188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.677496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9c458c32-c2af-416b-bdd4-543084ed6f21 req-deb60f17-2f7b-4191-8b33-0cf8adb70c5e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.678880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9c458c32-c2af-416b-bdd4-543084ed6f21 req-deb60f17-2f7b-4191-8b33-0cf8adb70c5e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.679497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9c458c32-c2af-416b-bdd4-543084ed6f21 req-deb60f17-2f7b-4191-8b33-0cf8adb70c5e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.693450 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9c458c32-c2af-416b-bdd4-543084ed6f21 req-deb60f17-2f7b-4191-8b33-0cf8adb70c5e service nova] Creating event network-changed:ee3c24f4-3686-4a11-91bb-dbb99f5a6896 for instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 on n-h2-853316-12 Oct 17 12:58:22.700325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9c458c32-c2af-416b-bdd4-543084ed6f21 req-deb60f17-2f7b-4191-8b33-0cf8adb70c5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078376 Oct 17 12:58:22.701745 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1174/2349] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:22.712783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:22.714413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:22.729255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.734232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.734884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.735813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:22.736277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:22.736754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:22.988608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:23.003408 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aaf70713-2af1-4e33-b8ee-7e09e2fe2dc9 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1312 microversion: 2.1 time: 0.295506 Oct 17 12:58:23.019217 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1175/2350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:22 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:23.111517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-51b1b48a-45e9-42da-81e3-59cd4653c350 req-12ce853e-23dd-4106-8763-1bb3a6012d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093eddd4-bc84-4fc5-b692-1a986ddcf78a", "name": "network-vif-plugged", "status": "completed", "tag": "5a53af6b-06ae-4124-abe0-490e5199838b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:23.133278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-51b1b48a-45e9-42da-81e3-59cd4653c350 req-12ce853e-23dd-4106-8763-1bb3a6012d3f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:23.142127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-51b1b48a-45e9-42da-81e3-59cd4653c350 req-12ce853e-23dd-4106-8763-1bb3a6012d3f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:23.142817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-51b1b48a-45e9-42da-81e3-59cd4653c350 req-12ce853e-23dd-4106-8763-1bb3a6012d3f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:23.168114 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-51b1b48a-45e9-42da-81e3-59cd4653c350 req-12ce853e-23dd-4106-8763-1bb3a6012d3f service nova] Creating event network-vif-plugged:5a53af6b-06ae-4124-abe0-490e5199838b for instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a on n-h1-853316-12 Oct 17 12:58:23.183703 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-51b1b48a-45e9-42da-81e3-59cd4653c350 req-12ce853e-23dd-4106-8763-1bb3a6012d3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077816 Oct 17 12:58:23.187463 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1176/2351] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:58:23.475371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:23.488728 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df632da8-2da5-412b-8226-13ec8ee1e506 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1489 microversion: 2.1 time: 0.865141 Oct 17 12:58:23.490047 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1176/2352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:22 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1489 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:23.531321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:23.531902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:23.538353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:23.538830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:23.546612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:23.547534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:23.548008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:23.548440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:23.625500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:23.626101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:23.632162 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-64a82681-a6b2-454a-a879-0aa4a563f94d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749/action" status: 202 len: 0 microversion: 2.1 time: 0.106810 Oct 17 12:58:23.633677 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1177/2353] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:58:23 2022] POST /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 12:58:23.635914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:23.636415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:23.636863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:23.638130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:23.638627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:23.639243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:23.644080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:23.645137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:23.656028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:23.657414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:23.658061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:23.659035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:23.659693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:23.660273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:23.692870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:24.019650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:24.032956 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a71845d-283f-4f78-90c5-ba6eedb04bae tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1469 microversion: 2.1 time: 0.412372 Oct 17 12:58:24.034134 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1177/2354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:23 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:24.042041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:24.042908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:24.051809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:24.052690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:24.053371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:24.054472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:24.055230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:24.068030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:24.131618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:24.141366 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ebea7d38-a6ef-4384-8c96-f4e2e2d421a3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1494 microversion: 2.1 time: 0.503565 Oct 17 12:58:24.144934 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1178/2355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:23 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1494 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:24.156521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-979737135", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a4424844-a51c-4055-85b6-f06c1838ea28"}, {"port": "84c9f90b-5ab0-4503-ab48-950d99bd18d1", "tag": "port-1"}, {"port": "68123dfb-87fd-4618-8ce3-2a67002cb00b", "tag": "port-2"}, {"uuid": "5fe26a8c-2554-4486-866d-6588d0039dc9", "tag": "net-1"}, {"uuid": "5fe26a8c-2554-4486-866d-6588d0039dc9"}, {"uuid": "67d98f55-04c2-4b06-babb-3be8433f4cc5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "67d98f55-04c2-4b06-babb-3be8433f4cc5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "412a9635-06a4-45cd-861c-f8f8fad90fee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "189aecfd-b3a5-43e5-902d-a32022b088d9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8fe169cb-2f6f-4aa9-bf96-2cd36b16554f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--278946228"}], "key_name": "tempest-keypair-544563165", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:24.361341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:24.375051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1212f522-c2b2-4bbe-a03c-d73e3d2aa853 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1311 microversion: 2.1 time: 0.337771 Oct 17 12:58:24.377631 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1178/2356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:24 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1311 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:24.383887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:24.388078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:24.395045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:24.395769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:24.396467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:24.397452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:24.398130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:24.398784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:24.441810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] validate_networks() for [('a4424844-a51c-4055-85b6-f06c1838ea28', None, None, None, None, None), (None, None, '84c9f90b-5ab0-4503-ab48-950d99bd18d1', None, None, None), (None, None, '68123dfb-87fd-4618-8ce3-2a67002cb00b', None, None, None), ('5fe26a8c-2554-4486-866d-6588d0039dc9', None, None, None, None, None), ('5fe26a8c-2554-4486-866d-6588d0039dc9', None, None, None, None, None), ('67d98f55-04c2-4b06-babb-3be8433f4cc5', '10.2.2.100', None, None, None, None), ('67d98f55-04c2-4b06-babb-3be8433f4cc5', '10.2.2.200', None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:58:24.691815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:24.707569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b855c72b-3adf-49d8-bd13-001b75feece5 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1312 microversion: 2.1 time: 0.328465 Oct 17 12:58:24.711193 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1179/2357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:24 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:25.065809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:25.067598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:25.077286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:25.077781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:25.078236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:25.078948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:25.079569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:25.080143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:25.493760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39929884c9ad40f88466f6755622ce73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'babd3113b96b41bd90cbc7d38b3cac5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:25.513784 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69f28d63-1606-4b1e-aa6d-eda52c61578e tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 200 len: 1469 microversion: 2.1 time: 0.452650 Oct 17 12:58:25.530274 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1180/2358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:25 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 1469 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:25.546692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:25.548664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:25.561624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:25.562895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:25.563445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:25.564275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:25.564833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:25.565590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:25.977941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:25.991070 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ba57459-4476-4a05-a895-c352586f0525 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 200 len: 1474 microversion: 2.1 time: 0.467589 Oct 17 12:58:25.991818 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1181/2359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:25 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 1474 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:26.017376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:26.017992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:26.034753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:26.035245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:26.035680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:26.036395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:26.036837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:26.037263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:26.463709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:26.477052 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5abc906a-563f-4e64-a0ec-aa2346bd8e74 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1495 microversion: 2.1 time: 0.465274 Oct 17 12:58:26.478512 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1182/2360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:25 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1495 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:26.484252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-ef9f0871-d9c3-4b5f-b4db-31cc56b889ae req-63c82080-3af4-4a87-8860-4378e701ea7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6af7074-5d9d-4ccb-a888-c8624da0b069", "name": "network-vif-deleted", "tag": "c3c1bc7d-a473-4a3c-a60a-7a96779481d1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:26.495396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ef9f0871-d9c3-4b5f-b4db-31cc56b889ae req-63c82080-3af4-4a87-8860-4378e701ea7c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:26.496370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ef9f0871-d9c3-4b5f-b4db-31cc56b889ae req-63c82080-3af4-4a87-8860-4378e701ea7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:26.498065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ef9f0871-d9c3-4b5f-b4db-31cc56b889ae req-63c82080-3af4-4a87-8860-4378e701ea7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:26.523196 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-ef9f0871-d9c3-4b5f-b4db-31cc56b889ae req-63c82080-3af4-4a87-8860-4378e701ea7c service nova] Creating event network-vif-deleted:c3c1bc7d-a473-4a3c-a60a-7a96779481d1 for instance a6af7074-5d9d-4ccb-a888-c8624da0b069 on n-h1-853316-12 Oct 17 12:58:26.529779 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-ef9f0871-d9c3-4b5f-b4db-31cc56b889ae req-63c82080-3af4-4a87-8860-4378e701ea7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049372 Oct 17 12:58:26.530999 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1183/2361] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:26.536778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:26.537810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:26.546813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:26.547579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:26.548249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:26.549558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:26.550269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:26.550909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:26.597157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=15 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:26.816228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:26.829621 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-74f561bc-a687-4f64-aeb6-d07dba30fe4c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1312 microversion: 2.1 time: 0.297214 Oct 17 12:58:26.830233 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1184/2362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:26 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1312 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:26.843372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2075403658"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:26.847978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:26.854280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:26.855102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:26.855949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:26.857385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:26.858013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:26.858815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:27.164293 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a40ff938-c2b7-4c2b-bcbe-c851bfe423d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749/action" status: 202 len: 0 microversion: 2.1 time: 0.332043 Oct 17 12:58:27.166134 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1185/2363] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:58:26 2022] POST /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 12:58:27.476672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:27.477778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:27.482372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:27.487387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:27.488190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:27.489093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:27.490033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:27.490723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:27.491362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:27.700081 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ccdfa63-1e42-4995-9029-cf2dcf863a57 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1648 microversion: 2.1 time: 0.532348 Oct 17 12:58:27.704711 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1186/2364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:27 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1648 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:27.709453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:27.710053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] [instance: a6af7074-5d9d-4ccb-a888-c8624da0b069] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:27.723155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:27.723963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:27.734141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:27.735076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:27.735735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:27.736577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:27.754672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] HTTP exception thrown: Instance a6af7074-5d9d-4ccb-a888-c8624da0b069 could not be found. Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Request method failure captured: Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 HTTP/1.1 Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFMLV-mV0Z6K7QSX5eXHs2h_k8DL5goPnZ7_RCjjJxlpnxBmmxLBPGP-id6nV3w2xkT834uKgWMlQLlFwv9oaKYAXNQOWbyDFsCpY4K2TcTTlgzssyhkDkhsusYEtSa0ttVioboQ0FhkoH0xrOmfrAxQzsg7rzbIC1mkWM1w_bPV5w Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: babd3113b96b41bd90cbc7d38b3cac5f Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TenantUsagesTestJSON-1553690842 Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_babd3113b96b41bd90cbc7d38b3cac5f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/babd3113b96b41bd90cbc7d38b3cac5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/babd3113b96b41bd90cbc7d38b3cac5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/babd3113b96b41bd90cbc7d38b3cac5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TenantUsagesTestJSON-1553690842 Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: babd3113b96b41bd90cbc7d38b3cac5f Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1553690842 Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TenantUsagesTestJSON-1553690842-project Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 39929884c9ad40f88466f6755622ce73 Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TenantUsagesTestJSON-1553690842-project Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance a6af7074-5d9d-4ccb-a888-c8624da0b069 could not be found. Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a6af7074-5d9d-4ccb-a888-c8624da0b069'} Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6af7074-5d9d-4ccb-a888-c8624da0b069 could not be found. Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6af7074-5d9d-4ccb-a888-c8624da0b069 could not be found. Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:27.757407 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:27.761711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:27.761711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:27.761711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:27.761711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:27.761711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:27.761711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6af7074-5d9d-4ccb-a888-c8624da0b069 could not be found. Oct 17 12:58:27.761711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:27.764093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] Returning 404 to user: Instance a6af7074-5d9d-4ccb-a888-c8624da0b069 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:27.766037 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c1501b4e-59d6-4084-9975-c91304dbf31b tempest-TenantUsagesTestJSON-1553690842 tempest-TenantUsagesTestJSON-1553690842-project] 10.222.0.27 "GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069" status: 404 len: 111 microversion: 2.1 time: 0.059465 Oct 17 12:58:27.770740 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1187/2365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:27 2022] GET /compute/v2.1/servers/a6af7074-5d9d-4ccb-a888-c8624da0b069 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:58:27.776641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bae3dc82-9d90-473a-9298-65c626c40e4c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa821244820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:27.838897 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bae3dc82-9d90-473a-9298-65c626c40e4c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.066706 Oct 17 12:58:27.840062 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1188/2366] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:27 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:27.846316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:27.847160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:27.854302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:27.855131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:27.857224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:27.858222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:27.858960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:27.859867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:28.025192 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5cb73fbd-92e0-4116-9d2a-c5884f29c544 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1648 microversion: 2.1 time: 0.183384 Oct 17 12:58:28.025855 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1189/2367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:27 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1648 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:28.030776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:28.031388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:28.037736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:28.037988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:28.038912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:28.039134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:28.039657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:28.040086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:28.045511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:28.209551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:28.220725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85725a10-a425-4bb5-838f-c5ded16e1934 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1312 microversion: 2.1 time: 0.193629 Oct 17 12:58:28.221548 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1190/2368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:28 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:28.227459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-75dae6c6-a6cb-4735-8c09-886f97527d91 req-1387ff84-7e01-48e6-b7e1-381ebeb8997a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ed9aab-b664-467a-bb6b-fdc75b01ee14", "name": "network-vif-plugged", "status": "completed", "tag": "ee3c24f4-3686-4a11-91bb-dbb99f5a6896"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:28.243522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-75dae6c6-a6cb-4735-8c09-886f97527d91 req-1387ff84-7e01-48e6-b7e1-381ebeb8997a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:28.243522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-75dae6c6-a6cb-4735-8c09-886f97527d91 req-1387ff84-7e01-48e6-b7e1-381ebeb8997a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:28.243522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-75dae6c6-a6cb-4735-8c09-886f97527d91 req-1387ff84-7e01-48e6-b7e1-381ebeb8997a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:28.257326 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-75dae6c6-a6cb-4735-8c09-886f97527d91 req-1387ff84-7e01-48e6-b7e1-381ebeb8997a service nova] Creating event network-vif-plugged:ee3c24f4-3686-4a11-91bb-dbb99f5a6896 for instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 on n-h2-853316-12 Oct 17 12:58:28.264456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-75dae6c6-a6cb-4735-8c09-886f97527d91 req-1387ff84-7e01-48e6-b7e1-381ebeb8997a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040960 Oct 17 12:58:28.265205 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1191/2369] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:28.273639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b68b1ef0-670a-43d6-a8ee-41b0836b5cf9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:28.278875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b68b1ef0-670a-43d6-a8ee-41b0836b5cf9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:28.279707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b68b1ef0-670a-43d6-a8ee-41b0836b5cf9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:28.280299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b68b1ef0-670a-43d6-a8ee-41b0836b5cf9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:28.281629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b68b1ef0-670a-43d6-a8ee-41b0836b5cf9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:28.282287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b68b1ef0-670a-43d6-a8ee-41b0836b5cf9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:28.282864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b68b1ef0-670a-43d6-a8ee-41b0836b5cf9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:28.320353 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b68b1ef0-670a-43d6-a8ee-41b0836b5cf9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.053736 Oct 17 12:58:28.321190 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1192/2370] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 12:58:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:28.342394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853316-12", "block_migration": true, "disk_over_commit": false}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:28.345831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:28.352466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:28.352806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:28.353522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:28.354520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:28.355741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:28.356711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:28.386639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lazy-loading 'flavor' on Instance uuid 093eddd4-bc84-4fc5-b692-1a986ddcf78a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:58:28.401777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Going to try to live migrate instance to n-h2-853316-12 {{(pid=127540) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 12:58:29.110095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:58:29.111056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:58:29.111735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:58:29.112360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:58:29.113530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:58:29.149542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:29.150550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:29.151195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:29.152665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:29.153411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:29.154068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:29.181445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Getting quotas for project 8ed76e939ebc4a828650e77d8695c708. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:58:29.194508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Getting quotas for user ca1b49177f8441328c36765b43a918fc and project 8ed76e939ebc4a828650e77d8695c708. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:58:29.440795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:58:29.444784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='412a9635-06a4-45cd-861c-f8f8fad90fee',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='189aecfd-b3a5-43e5-902d-a32022b088d9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fe169cb-2f6f-4aa9-bf96-2cd36b16554f',volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:58:29.949701 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-847eafdb-89b5-4deb-9f75-b5a2c52d3413 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 5.802563 Oct 17 12:58:29.951745 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1179/2371] 10.222.0.27 () {62 vars in 1189 bytes} [Mon Oct 17 12:58:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 5805 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 12:58:29.961212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ca224628-d7f9-4528-89ef-dfbf3c256862 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251354c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:30.017181 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ca224628-d7f9-4528-89ef-dfbf3c256862 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.064046 Oct 17 12:58:30.017983 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1180/2372] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:29 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:30.034886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:30.035515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:30.042494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:30.043310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:30.045386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:30.046376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:30.047053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:30.047583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:30.350651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:30.363568 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8dddbce-15ae-4a7e-8129-eb0a4fdb2047 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1312 microversion: 2.1 time: 0.342292 Oct 17 12:58:30.367198 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1181/2373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:30 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:30.383388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72fe77ad-b75e-48b8-a508-0245d5849159 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:30.384598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72fe77ad-b75e-48b8-a508-0245d5849159 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:30.492721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72fe77ad-b75e-48b8-a508-0245d5849159 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:30.522061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72fe77ad-b75e-48b8-a508-0245d5849159 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:30.524766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72fe77ad-b75e-48b8-a508-0245d5849159 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:30.526609 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72fe77ad-b75e-48b8-a508-0245d5849159 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1284 microversion: 2.32 time: 0.158350 Oct 17 12:58:30.528661 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1182/2374] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:30 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:31.032096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-58cbf7eb-332a-45fc-bcfc-093901bddcd1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825165790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:31.114571 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-58cbf7eb-332a-45fc-bcfc-093901bddcd1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.086477 Oct 17 12:58:31.115150 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1183/2375] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:31 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:31.389340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:31.392087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:31.400884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:31.401376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:31.406943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:31.421580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:31.422277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:31.422733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:31.874653 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-010e6821-ecf4-4325-a56f-eaa12f99bb32 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a/action" status: 202 len: 0 microversion: 2.1 time: 3.539096 Oct 17 12:58:31.875265 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1193/2376] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:58:28 2022] POST /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a/action => generated 0 bytes in 3541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:58:31.886647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a37d4de5-f7fe-456c-9318-932a3e97139a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:31.888795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a37d4de5-f7fe-456c-9318-932a3e97139a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:31.917414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:31.941126 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d984482b-690b-4612-9fca-f55cebd39c13 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1497 microversion: 2.1 time: 0.549242 Oct 17 12:58:31.942210 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1184/2377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:31 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1497 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:31.961837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:31.985753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:32.024589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:32.026365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:32.030967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:32.036328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:32.039822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:32.041732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:32.214008 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4dad634-c539-4314-b00e-6f8e75777e6e tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.265951 Oct 17 12:58:32.218897 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1185/2378] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 12:58:31 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments => generated 197 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:32.241004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:32.256922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:32.278442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:32.286330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:32.286824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:32.287588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:32.288190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:32.288624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:32.408548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a37d4de5-f7fe-456c-9318-932a3e97139a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:32.416183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a37d4de5-f7fe-456c-9318-932a3e97139a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:32.421260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a37d4de5-f7fe-456c-9318-932a3e97139a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:32.425338 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a37d4de5-f7fe-456c-9318-932a3e97139a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1284 microversion: 2.32 time: 0.546097 Oct 17 12:58:32.426903 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1194/2379] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:31 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1284 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:32.433904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc53b239-29bb-4715-9d15-5c937c2357e1 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:32.471605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.server_groups [None req-dc53b239-29bb-4715-9d15-5c937c2357e1 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Querying cell 77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) for 1 instances {{(pid=127540) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 12:58:32.474028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc53b239-29bb-4715-9d15-5c937c2357e1 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:32.474735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc53b239-29bb-4715-9d15-5c937c2357e1 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:32.475397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc53b239-29bb-4715-9d15-5c937c2357e1 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:32.515079 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc53b239-29bb-4715-9d15-5c937c2357e1 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/962bed96-822e-451e-8e56-769f0760c77a" status: 200 len: 222 microversion: 2.1 time: 0.086905 Oct 17 12:58:32.515967 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1195/2380] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:58:32 2022] GET /compute/v2.1/os-server-groups/962bed96-822e-451e-8e56-769f0760c77a => generated 222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:32.533134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90014a46-97ce-48d6-8646-fb2b559c2ea3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82138ae50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:32.924562 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90014a46-97ce-48d6-8646-fb2b559c2ea3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.407076 Oct 17 12:58:32.925903 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1196/2381] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:32 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:32.944568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:32.945072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:32.964046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:32.964826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:32.966851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:32.968126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:32.969678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:32.970713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:33.076808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:33.092689 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ac52aff-1fe7-4ef2-9b90-8d116580509e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 0.870616 Oct 17 12:58:33.092925 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1186/2382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:32 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:33.102361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:33.108873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:33.119726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:33.123066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:33.123686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:33.127069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:33.127769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:33.129461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:33.215162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:58:33.346575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lazy-loading 'services' on Instance uuid 2dff0a31-d0a4-4203-9280-48996deaa841 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:58:33.405774 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c1ef3f88-4d99-4dac-9595-89b25fc59489 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 204 len: 0 microversion: 2.1 time: 0.309367 Oct 17 12:58:33.407316 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1187/2383] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:58:33 2022] DELETE /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:58:33.422788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:33.424065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:33.451014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:33.452015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:33.452772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:33.454143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:33.454986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:33.457066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:33.750188 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d224c06-2f51-4f66-9df5-8b0bfafdf367 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments/140d6d88-fddc-4894-ad61-b189ef869571" status: 202 len: 0 microversion: 2.1 time: 0.820150 Oct 17 12:58:33.753258 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1197/2384] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 12:58:32 2022] DELETE /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments/140d6d88-fddc-4894-ad61-b189ef869571 => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:58:33.765412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:33.766953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:33.793171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:33.795684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:33.796401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:33.814053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:33.814589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:33.815018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:34.149186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:34.159553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f6956f99-e80d-493c-a513-b87c3b2f05f3 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1503 microversion: 2.1 time: 0.743995 Oct 17 12:58:34.160609 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1188/2385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:33 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1503 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:34.179713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-45c21c28-11d5-4a45-961f-5af28943c47d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825147700>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:34.247281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:34.258445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:34.259901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:34.261064 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3939c96a-ad84-4aa7-be29-1497eb6d982e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1582 microversion: 2.32 time: 0.506342 Oct 17 12:58:34.261642 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1198/2386] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:33 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1582 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:34.277676 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-45c21c28-11d5-4a45-961f-5af28943c47d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.115783 Oct 17 12:58:34.278504 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1189/2387] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:34 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:34.298300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-ffe91274-0723-4684-bf1f-443de780ff93 req-5ff9b0a1-83ec-4ce7-b635-b8a6c5534877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93643651-ffe6-4925-ac21-a34be3ab4749", "name": "network-vif-plugged", "status": "completed", "tag": "2300358d-c0d9-4e82-a174-84c57b25bef4"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:34.300514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:34.301138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:34.309915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ffe91274-0723-4684-bf1f-443de780ff93 req-5ff9b0a1-83ec-4ce7-b635-b8a6c5534877 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:34.310834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ffe91274-0723-4684-bf1f-443de780ff93 req-5ff9b0a1-83ec-4ce7-b635-b8a6c5534877 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:34.311733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ffe91274-0723-4684-bf1f-443de780ff93 req-5ff9b0a1-83ec-4ce7-b635-b8a6c5534877 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:34.326148 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-ffe91274-0723-4684-bf1f-443de780ff93 req-5ff9b0a1-83ec-4ce7-b635-b8a6c5534877 service nova] Creating event network-vif-plugged:2300358d-c0d9-4e82-a174-84c57b25bef4 for instance 93643651-ffe6-4925-ac21-a34be3ab4749 on n-h2-853316-12 Oct 17 12:58:34.335818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:34.339899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-ffe91274-0723-4684-bf1f-443de780ff93 req-5ff9b0a1-83ec-4ce7-b635-b8a6c5534877 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053730 Oct 17 12:58:34.340656 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1190/2388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:34.368743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:34.369056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:34.369497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:34.370242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:34.370875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:34.374238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:35.191253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:35.192350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:35.209121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:35.213096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:35.214804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:35.216879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:35.217648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:35.218620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:35.588664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:35.642404 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78047e6d-ff32-47ae-ab5a-6724c212b7d7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 1.357619 Oct 17 12:58:35.666460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1199/2389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:34 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:35.701274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:35.716406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:35.745794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:35.751904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:35.753533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:35.764876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:35.766513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:35.767981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:36.224505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:36.241007 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4692a8d0-c7b5-472f-8992-da150f2f6409 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1503 microversion: 2.1 time: 1.057403 Oct 17 12:58:36.242183 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1191/2390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:35 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1503 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:36.248531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90795de4-f635-47d4-b394-877cacce59d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825104b80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:36.264410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:36.292185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:36.305709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:36.310044 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18813145-eb22-4499-8ea6-263fc30d4f7f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1592 microversion: 2.32 time: 0.638484 Oct 17 12:58:36.332446 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1200/2391] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:35 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1592 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:36.676830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:36.680302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:36.719699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:36.720926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:36.723122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:36.725047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:36.727149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:36.731521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:36.848755 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90795de4-f635-47d4-b394-877cacce59d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.605275 Oct 17 12:58:36.849574 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1192/2392] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:36 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:36.861298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a45c86fd-687c-41c6-96c6-03b4309367e2 req-f6d99551-2efb-4ab5-ab35-caae34595b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ed9aab-b664-467a-bb6b-fdc75b01ee14", "name": "network-vif-deleted", "tag": "ee3c24f4-3686-4a11-91bb-dbb99f5a6896"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:36.903746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a45c86fd-687c-41c6-96c6-03b4309367e2 req-f6d99551-2efb-4ab5-ab35-caae34595b56 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:36.904471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a45c86fd-687c-41c6-96c6-03b4309367e2 req-f6d99551-2efb-4ab5-ab35-caae34595b56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:36.905058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a45c86fd-687c-41c6-96c6-03b4309367e2 req-f6d99551-2efb-4ab5-ab35-caae34595b56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:36.929401 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a45c86fd-687c-41c6-96c6-03b4309367e2 req-f6d99551-2efb-4ab5-ab35-caae34595b56 service nova] Creating event network-vif-deleted:ee3c24f4-3686-4a11-91bb-dbb99f5a6896 for instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 on n-h2-853316-12 Oct 17 12:58:36.941212 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a45c86fd-687c-41c6-96c6-03b4309367e2 req-f6d99551-2efb-4ab5-ab35-caae34595b56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090260 Oct 17 12:58:36.942342 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1193/2393] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:37.006567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cfa4910c-e667-4832-9c15-3c4e5a80d7ea req-1c63b99b-3943-43f0-b3ee-983844296321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093eddd4-bc84-4fc5-b692-1a986ddcf78a", "name": "network-vif-unplugged", "status": "completed", "tag": "5a53af6b-06ae-4124-abe0-490e5199838b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:37.021169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cfa4910c-e667-4832-9c15-3c4e5a80d7ea req-1c63b99b-3943-43f0-b3ee-983844296321 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:37.029884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cfa4910c-e667-4832-9c15-3c4e5a80d7ea req-1c63b99b-3943-43f0-b3ee-983844296321 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:37.030379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cfa4910c-e667-4832-9c15-3c4e5a80d7ea req-1c63b99b-3943-43f0-b3ee-983844296321 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:37.078615 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cfa4910c-e667-4832-9c15-3c4e5a80d7ea req-1c63b99b-3943-43f0-b3ee-983844296321 service nova] Creating event network-vif-unplugged:5a53af6b-06ae-4124-abe0-490e5199838b for instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a on n-h1-853316-12 Oct 17 12:58:37.085780 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cfa4910c-e667-4832-9c15-3c4e5a80d7ea req-1c63b99b-3943-43f0-b3ee-983844296321 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084025 Oct 17 12:58:37.090771 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1194/2394] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:58:37.269427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:37.270279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:37.282694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:37.284642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:37.285187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:37.287174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:37.290081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:37.290816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:37.373270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:37.377003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:37.377769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:37.378485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lazy-loading 'fault' on Instance uuid e5ed9aab-b664-467a-bb6b-fdc75b01ee14 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:58:37.471261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:37.482975 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11bda00d-bbfe-443d-a8f0-6875af11a286 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 0.814329 Oct 17 12:58:37.485251 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1201/2395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:36 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:37.505808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:37.506872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:37.520761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:37.521601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:37.523033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:37.525452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:37.530136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c28ffd1511043d7be0c0cefa16413e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7caded0f2864eac9eb14f8b3744d927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:37.537784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:37.540921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:37.548724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a4765e0e-3e64-4d3c-8045-c93f8174ea80 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 200 len: 1302 microversion: 2.1 time: 0.282627 Oct 17 12:58:37.550356 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1195/2396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:37 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 1302 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:37.865338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0acde300-2780-4f77-ab7d-8528aa8f6d29 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825120e50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:38.012015 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0acde300-2780-4f77-ab7d-8528aa8f6d29 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.150508 Oct 17 12:58:38.014062 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1196/2397] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:37 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:38.222855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:38.242843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:38.246053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:38.249719 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ebdffa9f-91b5-4433-ad67-f17173ac3bc9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1592 microversion: 2.32 time: 0.761253 Oct 17 12:58:38.253654 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1202/2398] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:37 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1592 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:38.519920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:38.521142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:38.528909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:38.529924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:38.537347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:38.538387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:38.539166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:38.539934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:38.575738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:38.576412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:38.579639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:38.609870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:38.610440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:38.617426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:38.620961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:38.625518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:38.628564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:38.725946 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] HTTP exception thrown: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Request method failure captured: Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 HTTP/1.1 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFhTPL6TjVaarURrhAd52KY3XZZiIyHpDxucO17DABDltv5TPiEfWTjlCs54Cmjj2fsIsFbk5HWI6JJ4BKjli9ov6ux21k2rb1gah31d1wmMDs0LOcpcq1YTqiGH_m70C0Ep_ymKE0BxnWNb3dbcK3egKyPIfBSnc4dO5M3UsBXBZY Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7caded0f2864eac9eb14f8b3744d927", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9c28ffd1511043d7be0c0cefa16413e9 Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e5ed9aab-b664-467a-bb6b-fdc75b01ee14'} Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:38.755644 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Returning 404 to user: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae13c917-7bbd-4657-b110-c59353dae31d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 404 len: 111 microversion: 2.1 time: 0.188289 Oct 17 12:58:38.760629 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1203/2399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:38 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:58:38.791241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87c753f3-186d-406a-9068-ce95f92586b4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:38.850818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.server_groups [None req-87c753f3-186d-406a-9068-ce95f92586b4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Querying cell 77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) for 1 instances {{(pid=127540) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 12:58:38.851920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87c753f3-186d-406a-9068-ce95f92586b4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:38.854126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87c753f3-186d-406a-9068-ce95f92586b4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:38.857207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87c753f3-186d-406a-9068-ce95f92586b4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:38.878622 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87c753f3-186d-406a-9068-ce95f92586b4 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.107065 Oct 17 12:58:38.881508 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1204/2400] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 12:58:38 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:38.905667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-293c0bb5-7e63-40a9-ac45-99b97a1bc3bf tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:38.942366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.server_groups [None req-293c0bb5-7e63-40a9-ac45-99b97a1bc3bf tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Querying cell 77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) for 1 instances {{(pid=127540) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 12:58:38.943812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293c0bb5-7e63-40a9-ac45-99b97a1bc3bf tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:38.944674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293c0bb5-7e63-40a9-ac45-99b97a1bc3bf tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:38.945234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293c0bb5-7e63-40a9-ac45-99b97a1bc3bf tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:38.968321 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-293c0bb5-7e63-40a9-ac45-99b97a1bc3bf tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/962bed96-822e-451e-8e56-769f0760c77a" status: 200 len: 184 microversion: 2.1 time: 0.067583 Oct 17 12:58:38.972429 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1205/2401] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:58:38 2022] GET /compute/v2.1/os-server-groups/962bed96-822e-451e-8e56-769f0760c77a => generated 184 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:38.993815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:38.994578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:39.011570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:39.030204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:39.031005 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac5ab900-7356-402a-a5a1-4233fa39535f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 0.522807 Oct 17 12:58:39.036393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:39.037064 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1197/2402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:38 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:39.037203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:39.039472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:39.040111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:39.040713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:39.046713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bc599bf-3286-44e5-91ff-76966f7d6850 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251209d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:39.075210 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] HTTP exception thrown: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Request method failure captured: Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 HTTP/1.1 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFhTPL6TjVaarURrhAd52KY3XZZiIyHpDxucO17DABDltv5TPiEfWTjlCs54Cmjj2fsIsFbk5HWI6JJ4BKjli9ov6ux21k2rb1gah31d1wmMDs0LOcpcq1YTqiGH_m70C0Ep_ymKE0BxnWNb3dbcK3egKyPIfBSnc4dO5M3UsBXBZY Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7caded0f2864eac9eb14f8b3744d927", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9c28ffd1511043d7be0c0cefa16413e9 Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e5ed9aab-b664-467a-bb6b-fdc75b01ee14'} Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:58:39.076796 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Returning 404 to user: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60634ea3-cb34-4d3d-a687-79c9bee49d3d tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 404 len: 111 microversion: 2.1 time: 0.096927 Oct 17 12:58:39.080757 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1206/2403] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:58:38 2022] DELETE /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 12:58:39.094982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:39.095747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] [instance: e5ed9aab-b664-467a-bb6b-fdc75b01ee14] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:39.105249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:39.105810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:39.106340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:39.107102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:39.107556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:39.107996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:39.144257 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] HTTP exception thrown: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Request method failure captured: Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 HTTP/1.1 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFhTPL6TjVaarURrhAd52KY3XZZiIyHpDxucO17DABDltv5TPiEfWTjlCs54Cmjj2fsIsFbk5HWI6JJ4BKjli9ov6ux21k2rb1gah31d1wmMDs0LOcpcq1YTqiGH_m70C0Ep_ymKE0BxnWNb3dbcK3egKyPIfBSnc4dO5M3UsBXBZY Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7caded0f2864eac9eb14f8b3744d927", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 9c28ffd1511043d7be0c0cefa16413e9 Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e5ed9aab-b664-467a-bb6b-fdc75b01ee14'} Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.145810 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Returning 404 to user: Instance e5ed9aab-b664-467a-bb6b-fdc75b01ee14 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:39.149586 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07735508-3511-459b-83d4-7290065e98db tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14" status: 404 len: 111 microversion: 2.1 time: 0.061035 Oct 17 12:58:39.163682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1207/2404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:39 2022] GET /compute/v2.1/servers/e5ed9aab-b664-467a-bb6b-fdc75b01ee14 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:58:39.168804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-281b74f6-4c7c-4a8a-9b5f-79173d51dba5 req-cb372f94-b5ee-41df-972c-1eaf407935e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093eddd4-bc84-4fc5-b692-1a986ddcf78a", "tag": "5a53af6b-06ae-4124-abe0-490e5199838b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:39.175025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9bc599bf-3286-44e5-91ff-76966f7d6850 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.136530 Oct 17 12:58:39.176182 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1198/2405] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:39 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:39.177896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:39.191636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-281b74f6-4c7c-4a8a-9b5f-79173d51dba5 req-cb372f94-b5ee-41df-972c-1eaf407935e4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:39.192122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-281b74f6-4c7c-4a8a-9b5f-79173d51dba5 req-cb372f94-b5ee-41df-972c-1eaf407935e4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:39.192548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-281b74f6-4c7c-4a8a-9b5f-79173d51dba5 req-cb372f94-b5ee-41df-972c-1eaf407935e4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:39.202546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69a404f8-c2a5-4537-a41e-6cff2005c117 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:39.216638 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-69a404f8-c2a5-4537-a41e-6cff2005c117 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] HTTP exception thrown: Instance group 29ae8d48-a8a9-43c7-a66e-02074a1353ce could not be found. Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69a404f8-c2a5-4537-a41e-6cff2005c117 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Request method failure captured: Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-server-groups/29ae8d48-a8a9-43c7-a66e-02074a1353ce HTTP/1.1 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFhTPL6TjVaarURrhAd52KY3XZZiIyHpDxucO17DABDltv5TPiEfWTjlCs54Cmjj2fsIsFbk5HWI6JJ4BKjli9ov6ux21k2rb1gah31d1wmMDs0LOcpcq1YTqiGH_m70C0Ep_ymKE0BxnWNb3dbcK3egKyPIfBSnc4dO5M3UsBXBZY Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7caded0f2864eac9eb14f8b3744d927", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9c28ffd1511043d7be0c0cefa16413e9 Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance group 29ae8d48-a8a9-43c7-a66e-02074a1353ce could not be found. Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '29ae8d48-a8a9-43c7-a66e-02074a1353ce'} Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29ae8d48-a8a9-43c7-a66e-02074a1353ce could not be found. Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29ae8d48-a8a9-43c7-a66e-02074a1353ce could not be found. Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.220030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.224871 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.224871 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.224871 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:39.224871 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:39.224871 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29ae8d48-a8a9-43c7-a66e-02074a1353ce could not be found. Oct 17 12:58:39.224871 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.233181 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-281b74f6-4c7c-4a8a-9b5f-79173d51dba5 req-cb372f94-b5ee-41df-972c-1eaf407935e4 service nova] Creating event network-changed:5a53af6b-06ae-4124-abe0-490e5199838b for instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a on n-h1-853316-12 Oct 17 12:58:39.241863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69a404f8-c2a5-4537-a41e-6cff2005c117 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Returning 404 to user: Instance group 29ae8d48-a8a9-43c7-a66e-02074a1353ce could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:39.243168 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69a404f8-c2a5-4537-a41e-6cff2005c117 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/29ae8d48-a8a9-43c7-a66e-02074a1353ce" status: 404 len: 117 microversion: 2.1 time: 0.065968 Oct 17 12:58:39.245531 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1199/2406] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:39 2022] DELETE /compute/v2.1/os-server-groups/29ae8d48-a8a9-43c7-a66e-02074a1353ce => generated 117 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:58:39.248075 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-281b74f6-4c7c-4a8a-9b5f-79173d51dba5 req-cb372f94-b5ee-41df-972c-1eaf407935e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083026 Oct 17 12:58:39.254137 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1208/2407] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:39.262708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-18cf71b5-f585-40a2-abe0-e223e8db3b3b tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:39.279802 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-18cf71b5-f585-40a2-abe0-e223e8db3b3b tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] HTTP exception thrown: Instance group 8bb80ab7-1246-4fe4-975c-1efe27b47cca could not be found. Oct 17 12:58:39.280503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:39.281215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-18cf71b5-f585-40a2-abe0-e223e8db3b3b tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Request method failure captured: Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-server-groups/8bb80ab7-1246-4fe4-975c-1efe27b47cca HTTP/1.1 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFhTPL6TjVaarURrhAd52KY3XZZiIyHpDxucO17DABDltv5TPiEfWTjlCs54Cmjj2fsIsFbk5HWI6JJ4BKjli9ov6ux21k2rb1gah31d1wmMDs0LOcpcq1YTqiGH_m70C0Ep_ymKE0BxnWNb3dbcK3egKyPIfBSnc4dO5M3UsBXBZY Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7caded0f2864eac9eb14f8b3744d927", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9c28ffd1511043d7be0c0cefa16413e9 Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance group 8bb80ab7-1246-4fe4-975c-1efe27b47cca could not be found. Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8bb80ab7-1246-4fe4-975c-1efe27b47cca'} Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8bb80ab7-1246-4fe4-975c-1efe27b47cca could not be found. Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8bb80ab7-1246-4fe4-975c-1efe27b47cca could not be found. Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.285527 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.289009 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.289009 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.289009 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:39.289009 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:39.289009 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8bb80ab7-1246-4fe4-975c-1efe27b47cca could not be found. Oct 17 12:58:39.289009 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.295604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:39.296105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:39.296335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-18cf71b5-f585-40a2-abe0-e223e8db3b3b tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Returning 404 to user: Instance group 8bb80ab7-1246-4fe4-975c-1efe27b47cca could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:39.296536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:39.297478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:39.298110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:39.298436 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-18cf71b5-f585-40a2-abe0-e223e8db3b3b tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/8bb80ab7-1246-4fe4-975c-1efe27b47cca" status: 404 len: 117 microversion: 2.1 time: 0.047448 Oct 17 12:58:39.298933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:39.301288 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1200/2408] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:39 2022] DELETE /compute/v2.1/os-server-groups/8bb80ab7-1246-4fe4-975c-1efe27b47cca => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:58:39.317070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b197d01-92c9-4ebd-91f6-380673b367be tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:39.342464 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1b197d01-92c9-4ebd-91f6-380673b367be tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] HTTP exception thrown: Instance group e369c12f-b8d8-49ca-9ed7-e514047f06cc could not be found. Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b197d01-92c9-4ebd-91f6-380673b367be tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Request method failure captured: Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-server-groups/e369c12f-b8d8-49ca-9ed7-e514047f06cc HTTP/1.1 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFhTPL6TjVaarURrhAd52KY3XZZiIyHpDxucO17DABDltv5TPiEfWTjlCs54Cmjj2fsIsFbk5HWI6JJ4BKjli9ov6ux21k2rb1gah31d1wmMDs0LOcpcq1YTqiGH_m70C0Ep_ymKE0BxnWNb3dbcK3egKyPIfBSnc4dO5M3UsBXBZY Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7caded0f2864eac9eb14f8b3744d927", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9c28ffd1511043d7be0c0cefa16413e9 Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance group e369c12f-b8d8-49ca-9ed7-e514047f06cc could not be found. Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e369c12f-b8d8-49ca-9ed7-e514047f06cc'} Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e369c12f-b8d8-49ca-9ed7-e514047f06cc could not be found. Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e369c12f-b8d8-49ca-9ed7-e514047f06cc could not be found. Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.344663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.348351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.348351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.348351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:39.348351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:39.348351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e369c12f-b8d8-49ca-9ed7-e514047f06cc could not be found. Oct 17 12:58:39.348351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.348351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b197d01-92c9-4ebd-91f6-380673b367be tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Returning 404 to user: Instance group e369c12f-b8d8-49ca-9ed7-e514047f06cc could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:39.348351 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b197d01-92c9-4ebd-91f6-380673b367be tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/e369c12f-b8d8-49ca-9ed7-e514047f06cc" status: 404 len: 117 microversion: 2.1 time: 0.042234 Oct 17 12:58:39.351821 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1201/2409] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:39 2022] DELETE /compute/v2.1/os-server-groups/e369c12f-b8d8-49ca-9ed7-e514047f06cc => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:58:39.363253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-063ed959-95fd-41e4-a8cb-e3a25591f04c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:39.381601 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-063ed959-95fd-41e4-a8cb-e3a25591f04c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] HTTP exception thrown: Instance group caccb6f6-3986-4a46-9e27-b818b792b35e could not be found. Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-063ed959-95fd-41e4-a8cb-e3a25591f04c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Request method failure captured: Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-server-groups/caccb6f6-3986-4a46-9e27-b818b792b35e HTTP/1.1 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFhTPL6TjVaarURrhAd52KY3XZZiIyHpDxucO17DABDltv5TPiEfWTjlCs54Cmjj2fsIsFbk5HWI6JJ4BKjli9ov6ux21k2rb1gah31d1wmMDs0LOcpcq1YTqiGH_m70C0Ep_ymKE0BxnWNb3dbcK3egKyPIfBSnc4dO5M3UsBXBZY Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b7caded0f2864eac9eb14f8b3744d927", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b7caded0f2864eac9eb14f8b3744d927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: b7caded0f2864eac9eb14f8b3744d927 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerGroupTestJSON-202890571 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9c28ffd1511043d7be0c0cefa16413e9 Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerGroupTestJSON-202890571-project Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance group caccb6f6-3986-4a46-9e27-b818b792b35e could not be found. Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'caccb6f6-3986-4a46-9e27-b818b792b35e'} Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group caccb6f6-3986-4a46-9e27-b818b792b35e could not be found. Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group caccb6f6-3986-4a46-9e27-b818b792b35e could not be found. Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.384870 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:39.389015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:39.389015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:39.389015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:39.389015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:39.389015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group caccb6f6-3986-4a46-9e27-b818b792b35e could not be found. Oct 17 12:58:39.389015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 12:58:39.389015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-063ed959-95fd-41e4-a8cb-e3a25591f04c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Returning 404 to user: Instance group caccb6f6-3986-4a46-9e27-b818b792b35e could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:39.389015 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-063ed959-95fd-41e4-a8cb-e3a25591f04c tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/caccb6f6-3986-4a46-9e27-b818b792b35e" status: 404 len: 117 microversion: 2.1 time: 0.035211 Oct 17 12:58:39.393546 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1202/2410] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:39 2022] DELETE /compute/v2.1/os-server-groups/caccb6f6-3986-4a46-9e27-b818b792b35e => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:58:39.403519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2aa8c4e4-3e7b-441b-9a24-698cabd7a419 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:39.480488 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2aa8c4e4-3e7b-441b-9a24-698cabd7a419 tempest-ServerGroupTestJSON-202890571 tempest-ServerGroupTestJSON-202890571-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/962bed96-822e-451e-8e56-769f0760c77a" status: 204 len: 0 microversion: 2.1 time: 0.081677 Oct 17 12:58:39.482867 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1203/2411] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 12:58:39 2022] DELETE /compute/v2.1/os-server-groups/962bed96-822e-451e-8e56-769f0760c77a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:58:40.072841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:40.074378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:40.091515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:40.093551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:40.094261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:40.096349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:40.098137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:40.100227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:40.511013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:41.014551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:41.052218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:41.056187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:41.057390 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a15de7ff-ff6b-4897-9d1c-d2744ead7803 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1659 microversion: 2.32 time: 1.782178 Oct 17 12:58:41.068901 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1209/2412] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:39 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1659 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:41.099094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eeb0132c-b521-43cc-af35-ef8cce2a3127 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820edb040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:41.186993 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eeb0132c-b521-43cc-af35-ef8cce2a3127 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.101504 Oct 17 12:58:41.189235 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1210/2413] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:41 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:41.453912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:41.470908 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ff8c3c6-13ff-4d89-9359-938c0c32ba86 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 1.410419 Oct 17 12:58:41.471778 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1204/2414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:40 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:42.100324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:42.101909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:42.117013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:42.121316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:42.126809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:42.127931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:42.128741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:42.129593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:42.206652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b43ea62c-7062-48f7-90ef-0e9f316838ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825135af0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:42.307892 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b43ea62c-7062-48f7-90ef-0e9f316838ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.106681 Oct 17 12:58:42.309246 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1205/2415] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:42 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:42.415765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:42.498757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:42.500098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:42.516260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:42.518110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:42.523466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:42.526113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:42.528401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:42.536149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:43.001649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:43.044378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:43.055932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:43.057560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7130e6e4-6797-41f7-9baf-866bd41b3fc3 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1659 microversion: 2.32 time: 0.962279 Oct 17 12:58:43.062027 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1211/2416] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:42 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1659 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:43.324068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a94a512-2cfc-4feb-8513-c6aa4f484ea6 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820f25b80>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:43.402636 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a94a512-2cfc-4feb-8513-c6aa4f484ea6 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.082056 Oct 17 12:58:43.412642 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1212/2417] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:43 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:43.429649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:43.443963 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d734022b-e432-401d-8fba-6016136286d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 0.950488 Oct 17 12:58:43.448310 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1206/2418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:42 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:44.089734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:44.091360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:44.103602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:44.110028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:44.110863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:44.115364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:44.116446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:44.116904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:44.422993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b6079e19-e1a3-4788-a59d-aff20b90273f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8252293a0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:44.547389 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b6079e19-e1a3-4788-a59d-aff20b90273f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.132114 Oct 17 12:58:44.549016 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1207/2419] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:44 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:44.560486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:44.562708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:44.578675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:44.599795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:44.604670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:44.610368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:44.613818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:44.620038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:45.299306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:45.306082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:45.313956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:45.324086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:45.335477 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a4442b6-f73d-46c5-92eb-8613688d39b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1705 microversion: 2.32 time: 1.251501 Oct 17 12:58:45.337229 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1213/2420] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:44 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1705 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:45.344757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:45.353026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:45.397253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:45.398219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:45.401274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:45.402142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:45.402888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:45.403573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:45.475237 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a170f2cc-591a-435e-a7fc-8ced7363aba3 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136014 Oct 17 12:58:45.477947 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1214/2421] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 12:58:45 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:58:45.562951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aadc0c3f-e6fb-4e5e-8f19-bceb99cfe2fc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820f41430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:45.676429 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aadc0c3f-e6fb-4e5e-8f19-bceb99cfe2fc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.117525 Oct 17 12:58:45.685722 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1215/2422] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:45 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:58:45.693354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:45.695565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:45.714245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:45.714705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:45.715709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:45.716638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:45.717100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:45.717651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:45.794581 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43b44513-8892-4799-b239-9dad86bcb49a tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107609 Oct 17 12:58:45.795729 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1216/2423] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 12:58:45 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:58:45.920602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:45.921324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:45.931638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:45.932472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:45.933138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:45.940572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:45.941099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:45.941652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:45.985964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:58:46.107287 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32a8684b-e6a7-41d8-b82e-e1dd0c00533d tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 204 len: 0 microversion: 2.1 time: 0.189866 Oct 17 12:58:46.108600 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1217/2424] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:58:45 2022] DELETE /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 12:58:46.126015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:46.127022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:46.147498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:46.150650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:46.151828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:46.152986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:46.154330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:46.155080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:47.174862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:47.188283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a496f459-17db-4847-882c-920989c1ef2f tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1682 microversion: 2.1 time: 1.074859 Oct 17 12:58:47.189260 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1218/2425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:46 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1682 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:47.195098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:47.205175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:47.214271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:47.217150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:47.217741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:47.218665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:47.219268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:47.221361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:47.611850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:47.621954 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35e31e9c-e895-45f7-928d-6800732ca2a3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 3.071597 Oct 17 12:58:47.631046 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1208/2426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:44 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 3081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:47.644630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-faf87831-5e3a-4ffd-92d3-17b868cc6185 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8250cdd30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:47.717459 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-faf87831-5e3a-4ffd-92d3-17b868cc6185 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.084331 Oct 17 12:58:47.728115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1209/2427] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:47 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:48.216612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:48.219672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:48.239227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:48.241446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:48.243837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:48.245480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:48.246670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:48.247271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:48.516087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:48.527443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:48.541472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:48.551262 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea8d13da-a64d-4567-b6e3-c23e2688728e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1751 microversion: 2.32 time: 1.351424 Oct 17 12:58:48.551927 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1219/2428] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:47 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1751 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:48.655683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:48.656460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:48.669685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:48.681748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:48.682338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:48.686116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:48.686736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:48.689035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:48.826382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:48.833100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:48.844581 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d627a900-69d4-4d10-b750-c309bf176ab7 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1682 microversion: 2.1 time: 0.631968 Oct 17 12:58:48.854201 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1210/2429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:48 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1682 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:48.860747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-afd4832a-5388-45ec-9336-cfb6a38ec3f2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825104550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:48.946585 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-afd4832a-5388-45ec-9336-cfb6a38ec3f2 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.091134 Oct 17 12:58:48.947289 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1211/2430] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:48 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:49.545783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:49.557604 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c1cab49d-b95b-4c75-8064-80c70f3719c6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 0.905659 Oct 17 12:58:49.577198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:49.578359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:49.578703 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1220/2431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:48 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:49.591274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:49.594445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:49.595223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:49.596196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:49.598457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:49.599176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:49.875981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:49.876705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:49.892874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:49.894073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:49.894785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:49.895753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:49.896458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:49.897087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:51.494634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:51.510107 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d5282e9c-16cb-4b0a-8c36-bd78c3721f92 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1682 microversion: 2.1 time: 1.639652 Oct 17 12:58:51.522876 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1221/2432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:49 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1682 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:51.539845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d47fb51-2d17-4722-83df-59e22c87373f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82137a040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:51.674765 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d47fb51-2d17-4722-83df-59e22c87373f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.150520 Oct 17 12:58:51.675348 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1222/2433] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:51 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:51.691808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:51.695120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:51.721258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:51.721631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:51.722294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:51.723221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:51.726828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:51.727270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:51.893479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:51.921963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:51.936381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:51.937671 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db28326c-de2f-4af5-b731-531502b31106 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1751 microversion: 2.32 time: 2.364699 Oct 17 12:58:51.938319 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1212/2434] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:49 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1751 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:58:52.244442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-0ab94183-e8f9-4e0e-bc80-1fff0870b211 req-083d3e47-6d8e-4f95-baa7-b2e2a7a3ab2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dff0a31-d0a4-4203-9280-48996deaa841", "name": "network-vif-unplugged", "status": "completed", "tag": "0d24b606-1b0b-4095-be00-86b3411aa958"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:52.271666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:58:52.287557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0ab94183-e8f9-4e0e-bc80-1fff0870b211 req-083d3e47-6d8e-4f95-baa7-b2e2a7a3ab2c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:52.288157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0ab94183-e8f9-4e0e-bc80-1fff0870b211 req-083d3e47-6d8e-4f95-baa7-b2e2a7a3ab2c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:52.288617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0ab94183-e8f9-4e0e-bc80-1fff0870b211 req-083d3e47-6d8e-4f95-baa7-b2e2a7a3ab2c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:52.366872 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-0ab94183-e8f9-4e0e-bc80-1fff0870b211 req-083d3e47-6d8e-4f95-baa7-b2e2a7a3ab2c service nova] Creating event network-vif-unplugged:0d24b606-1b0b-4095-be00-86b3411aa958 for instance 2dff0a31-d0a4-4203-9280-48996deaa841 on n-h2-853316-12 Oct 17 12:58:52.388803 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-0ab94183-e8f9-4e0e-bc80-1fff0870b211 req-083d3e47-6d8e-4f95-baa7-b2e2a7a3ab2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149361 Oct 17 12:58:52.399160 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1213/2435] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:52.540856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:52.541577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:52.559756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:52.560501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:52.561101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:52.564367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:52.566236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:52.567459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:52.816030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:52.843362 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-22d95b77-7d44-41b6-9f33-308c2863a382 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1614 microversion: 2.1 time: 0.307825 Oct 17 12:58:52.844339 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1214/2436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:52 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1614 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:52.864052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-08abd908-6ae7-4dc9-bfc4-4e42ee063c96 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82506c040>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:52.997061 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-08abd908-6ae7-4dc9-bfc4-4e42ee063c96 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.151183 Oct 17 12:58:52.998261 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1215/2437] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:52 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:53.006076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:53.006076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:53.019644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:53.020482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:53.021145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:53.027433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:53.028838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:53.029464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:53.472867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:53.487592 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18e56939-6edf-48c1-92f3-5e5562d5ecbf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1505 microversion: 2.1 time: 1.808538 Oct 17 12:58:53.506287 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1223/2438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:51 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1505 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:53.811043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:53.835813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:53.843606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:53.849848 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7fab371-d25f-4fe0-a2aa-a07e1377010a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1751 microversion: 2.32 time: 0.850447 Oct 17 12:58:53.856078 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1216/2439] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:52 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1751 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:53.872600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:53.873221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:53.882618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:53.883100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:53.892031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:53.896064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:53.896797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:53.897580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:54.022930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3194a663-4826-4f58-9da9-2d08f2cc4b25 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251049d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:54.144327 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3194a663-4826-4f58-9da9-2d08f2cc4b25 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.127156 Oct 17 12:58:54.144922 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1217/2440] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:54 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:54.526214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:54.526851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:54.563120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:54.566411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:54.567225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:54.568595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:54.571471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:54.573311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:55.149464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7616e4a36c64457dbadf38f33731ccc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3503d17d744d78a6c72ecab706e9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:55.165495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-53cb94ed-535f-49ee-b5ff-555c355c04e9 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 200 len: 1614 microversion: 2.1 time: 1.295531 Oct 17 12:58:55.169162 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1224/2441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:53 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 1614 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:55.182013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:55.185037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:55.229668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:55.235806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:55.238058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:55.240721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:55.244523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:55.248930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:55.611929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:55.620074 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2538e03d-86d4-409e-a0b7-d33fcd311abf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1495 microversion: 2.1 time: 1.104193 Oct 17 12:58:55.630928 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1218/2442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:54 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1495 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:55.976771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a7ad28ee-6c0e-4502-885e-6574b2778007 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Action: 'create', calling method: .version_select at 0x7fa8251049d0>, body: {"pool": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:56.390308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:56.444107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:56.453769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:56.455520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85ec99ea-772d-4ccb-b8be-8857556aaaa4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1751 microversion: 2.32 time: 1.284926 Oct 17 12:58:56.462988 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1225/2443] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:55 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1751 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:56.469871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a20d21e0-d50a-49b4-b1cb-16e0e2b273a6 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820e08790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:56.575235 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a20d21e0-d50a-49b4-b1cb-16e0e2b273a6 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.107197 Oct 17 12:58:56.578963 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1226/2444] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:56 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:56.599902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6b13936c-c69c-4a9d-84d2-317d5f823b49 req-d25be9cc-711a-472b-933a-03abf7ef24a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dff0a31-d0a4-4203-9280-48996deaa841", "name": "network-vif-deleted", "tag": "0d24b606-1b0b-4095-be00-86b3411aa958"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:56.641076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6b13936c-c69c-4a9d-84d2-317d5f823b49 req-d25be9cc-711a-472b-933a-03abf7ef24a3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:56.647451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6b13936c-c69c-4a9d-84d2-317d5f823b49 req-d25be9cc-711a-472b-933a-03abf7ef24a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:56.649368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6b13936c-c69c-4a9d-84d2-317d5f823b49 req-d25be9cc-711a-472b-933a-03abf7ef24a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:56.709557 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6b13936c-c69c-4a9d-84d2-317d5f823b49 req-d25be9cc-711a-472b-933a-03abf7ef24a3 service nova] Creating event network-vif-deleted:0d24b606-1b0b-4095-be00-86b3411aa958 for instance 2dff0a31-d0a4-4203-9280-48996deaa841 on n-h2-853316-12 Oct 17 12:58:56.721387 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6b13936c-c69c-4a9d-84d2-317d5f823b49 req-d25be9cc-711a-472b-933a-03abf7ef24a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138352 Oct 17 12:58:56.721998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1227/2445] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:56.739574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4056326f-264e-43e8-b4dd-6ac3e7fd9978 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '.version_select at 0x7fa820f411f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:56.751999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4056326f-264e-43e8-b4dd-6ac3e7fd9978 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:56.754451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4056326f-264e-43e8-b4dd-6ac3e7fd9978 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:56.755177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4056326f-264e-43e8-b4dd-6ac3e7fd9978 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:56.832771 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4056326f-264e-43e8-b4dd-6ac3e7fd9978 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 404 microversion: 2.1 time: 0.107269 Oct 17 12:58:56.833438 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1228/2446] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 12:58:56 2022] GET /compute/v2.1/os-migrations => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:58:56.866855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:56.869919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:56.878011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:56.878972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:56.879659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:56.880607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:56.881275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:56.881917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:56.913280 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] HTTP exception thrown: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Request method failure captured: Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 HTTP/1.1 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVDQ1GFvZxFZbPB4MmHmmrRQbNl4VXOG7hEKGqgQ3c7nTN-11a4RRpcBxuY6b6BN9yP2033Nsn4itiCgHSTPv51SauvTJTFNJVrHNJy2HxBNXM7N4HUP5HQgdko-fTqEgBd3-6N8WtjcMGq366vsGOVgVVzhgZnVTv_WjBMYAuFtdN8 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 8f3503d17d744d78a6c72ecab706e9b0 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f3503d17d744d78a6c72ecab706e9b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 8f3503d17d744d78a6c72ecab706e9b0 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachSCSIVolumeTestJSON-1894890912-project Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7616e4a36c64457dbadf38f33731ccc5 Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1894890912-project Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '2dff0a31-d0a4-4203-9280-48996deaa841'} Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:58:56.915028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Returning 404 to user: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49b9a2e5-480c-4f89-917b-3736cd6ce33c tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 404 len: 111 microversion: 2.1 time: 0.064225 Oct 17 12:58:56.924727 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1229/2447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:56 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:58:56.928518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:56.929201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:56.952155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:56.952649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:56.956971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:56.957967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:56.958619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:56.971274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:58.089038 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e22fbc2d-c226-49f6-bdaa-452a13c9f647 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1648 microversion: 2.1 time: 1.164334 Oct 17 12:58:58.096628 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1230/2448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:58:56 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1648 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:58.118313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac243f13-e466-4173-8931-1cfa37a3fdf6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '.version_select at 0x7fa820d3b9d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:58.192374 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac243f13-e466-4173-8931-1cfa37a3fdf6 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780795782" status: 202 len: 0 microversion: 2.1 time: 0.090093 Oct 17 12:58:58.197532 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1231/2449] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 12:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780795782 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:58:58.224735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:58.227788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:58:58.254929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:58.256465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:58.258413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:58.263258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:58:58.263755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:58:58.270523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:58:59.158667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:59.178106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:59.180181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:58:59.190650 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21714c57-4c20-4e36-be96-c4c8b689289d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1797 microversion: 2.32 time: 0.991241 Oct 17 12:58:59.195867 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1232/2450] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:58:58 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1797 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:58:59.209967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9764d26-e57b-4f46-86f6-c18de57009a1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820a78160>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:58:59.284901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9764d26-e57b-4f46-86f6-c18de57009a1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 0.086333 Oct 17 12:58:59.286446 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1233/2451] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:58:59 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:58:59.298353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-257848860", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "5ab5fe2b-3424-46bb-bd5e-c78cc4ccf633"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:58:59.464188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] validate_networks() for [('5ab5fe2b-3424-46bb-bd5e-c78cc4ccf633', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:59:01.648847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:59:01.650043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:59:01.651126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:59:01.652364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:59:01.653352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:59:01.676517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:01.677260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:01.677858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:01.678923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:01.679593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:01.681669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:01.754011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for project 6c6509294f164045968c57ff20d25d18. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:59:01.766433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for user bd6001af2bfe4fe881afcaaf6cca9962 and project 6c6509294f164045968c57ff20d25d18. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:59:01.811533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:59:01.832103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:59:01.960133 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2cc3ee6f-355b-4991-b4d3-d76c2fcfc70b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.669948 Oct 17 12:59:01.968962 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1234/2452] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:58:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:59:01.974276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:01.981917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:01.993063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:01.993911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:01.994593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:01.995572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:01.997995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:01.998904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:03.063013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:03.072613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:03.077376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:03.081499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-203d360d-21fa-4db3-90c6-3ad53733abf9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1843 microversion: 2.32 time: 1.109878 Oct 17 12:59:03.087896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1235/2453] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:01 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1843 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:03.102598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ea3cc2f-c8d7-40e3-a7d5-46c46be08c55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d3b310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:03.213758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a7ad28ee-6c0e-4502-885e-6574b2778007 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.581527 Oct 17 12:59:03.225868 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1219/2454] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:58:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:03.236095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c8501e43-7503-4d7f-a644-34c469f831c2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:03.237213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c8501e43-7503-4d7f-a644-34c469f831c2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:03.380234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c8501e43-7503-4d7f-a644-34c469f831c2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:03.403767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c8501e43-7503-4d7f-a644-34c469f831c2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1210 microversion: 2.1 time: 0.176050 Oct 17 12:59:03.405728 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1220/2455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:03 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1210 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:03.424316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d167b05-0643-4b61-a69c-bdefc3c2f746 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Action: 'create', calling method: .version_select at 0x7fa825165700>, body: {"pool": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:04.372879 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ea3cc2f-c8d7-40e3-a7d5-46c46be08c55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1414 microversion: 2.1 time: 1.283598 Oct 17 12:59:04.376463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1236/2456] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:59:03 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1414 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:04.388071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:04.388950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:04.394550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:04.412139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:04.413109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:04.414186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:04.414939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:04.416731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:04.417783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:04.525475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:05.361485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:05.372570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:05.374035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:05.377711 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de94b44c-5580-40f4-ba30-90cc7dd7b900 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1843 microversion: 2.32 time: 1.000050 Oct 17 12:59:05.410109 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1237/2457] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:04 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1843 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:05.424589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:05.427247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:05.448890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:05.462386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:05.465271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:05.466400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:05.467575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:05.469709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:05.620265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=26 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:05.674285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:05.683758 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-726f9a27-c4dc-4d6e-9bc2-7a7bf37c71e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1268 microversion: 2.1 time: 0.270032 Oct 17 12:59:05.687820 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1238/2458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:05 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1268 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:05.696706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72a5197c-2afb-4a90-9343-3a4234dd227b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8209b4310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:05.773576 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72a5197c-2afb-4a90-9343-3a4234dd227b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1423 microversion: 2.1 time: 0.084431 Oct 17 12:59:05.774156 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1239/2459] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:59:05 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1423 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:05.789932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc1145a6-655c-4a67-a189-63e529435efb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d48dc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:05.866460 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc1145a6-655c-4a67-a189-63e529435efb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 200 len: 1423 microversion: 2.1 time: 0.080641 Oct 17 12:59:05.877312 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1240/2460] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 12:59:05 2022] GET /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:05.888068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cb4c5446-1a3f-4a76-bb74-6bfc9fe26edd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820cc1ee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:06.957732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cb4c5446-1a3f-4a76-bb74-6bfc9fe26edd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 204 len: 0 microversion: 2.1 time: 1.079065 Oct 17 12:59:06.959103 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1241/2461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:05 2022] DELETE /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:59:07.290657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-46978142-5688-4b82-94fb-9179014c06af req-80c3a41e-214b-4fc8-a3cb-2c0c42abbef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "tag": "3e96ea21-21b0-4e46-aee5-240154bd8bd8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:07.311271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-46978142-5688-4b82-94fb-9179014c06af req-80c3a41e-214b-4fc8-a3cb-2c0c42abbef1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:07.312008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-46978142-5688-4b82-94fb-9179014c06af req-80c3a41e-214b-4fc8-a3cb-2c0c42abbef1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:07.312669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-46978142-5688-4b82-94fb-9179014c06af req-80c3a41e-214b-4fc8-a3cb-2c0c42abbef1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:07.337388 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-46978142-5688-4b82-94fb-9179014c06af req-80c3a41e-214b-4fc8-a3cb-2c0c42abbef1 service nova] Creating event network-changed:3e96ea21-21b0-4e46-aee5-240154bd8bd8 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 12:59:07.347315 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-46978142-5688-4b82-94fb-9179014c06af req-80c3a41e-214b-4fc8-a3cb-2c0c42abbef1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386741 Oct 17 12:59:07.352044 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1242/2462] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:07.361335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:07.365311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:07.380359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:07.384824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:07.385473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:07.386997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:07.387639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:07.388242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:08.138847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:08.157731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:08.160537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:08.163295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e7c55291-58fe-43fc-9b80-8be43bb85554 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1864 microversion: 2.32 time: 0.809890 Oct 17 12:59:08.172601 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1243/2463] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:07 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1864 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:08.183848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:08.184708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:08.197648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:08.198506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:08.199203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:08.200147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:08.200941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:08.201607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:09.021864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:09.037484 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d99d4c87-f7ab-47fe-879d-39fc6c23861d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1310 microversion: 2.1 time: 0.863728 Oct 17 12:59:09.038533 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1244/2464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:08 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1310 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:09.045270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:09.046254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:09.053992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:09.054978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:09.056133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:09.057422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:09.059670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:09.060389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:09.097734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 12:59:09.236836 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-34e18832-3ca2-4003-8b2c-2acdfc806aa4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 204 len: 0 microversion: 2.1 time: 0.196149 Oct 17 12:59:09.238621 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1245/2465] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:59:09 2022] DELETE /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 12:59:09.250066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:09.251385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:09.264067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:09.264791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:09.265489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:09.266602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:09.268194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:09.268839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:09.902829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:09.916426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:09.924765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:09.926039 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ef603b5-decf-45fe-8711-1df900c142a0 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1885 microversion: 2.32 time: 0.685955 Oct 17 12:59:09.926993 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1246/2466] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:09 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1885 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:09.942625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1428850267", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "76738b67-1f67-4450-8954-529dd7a99e80"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:10.031163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] validate_networks() for [('76738b67-1f67-4450-8954-529dd7a99e80', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:59:10.593402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d167b05-0643-4b61-a69c-bdefc3c2f746 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.186007 Oct 17 12:59:10.602763 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1221/2467] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:59:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:10.610986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e7ce14f4-c9cc-43bd-b3eb-83a7adf0ec12 req-2b382831-4995-44e2-8e5e-8ad96f59bd24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "tag": "84c9f90b-5ab0-4503-ab48-950d99bd18d1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:10.664656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7ce14f4-c9cc-43bd-b3eb-83a7adf0ec12 req-2b382831-4995-44e2-8e5e-8ad96f59bd24 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:10.665158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7ce14f4-c9cc-43bd-b3eb-83a7adf0ec12 req-2b382831-4995-44e2-8e5e-8ad96f59bd24 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:10.666619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7ce14f4-c9cc-43bd-b3eb-83a7adf0ec12 req-2b382831-4995-44e2-8e5e-8ad96f59bd24 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:10.716308 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e7ce14f4-c9cc-43bd-b3eb-83a7adf0ec12 req-2b382831-4995-44e2-8e5e-8ad96f59bd24 service nova] Creating event network-changed:84c9f90b-5ab0-4503-ab48-950d99bd18d1 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 12:59:10.724459 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e7ce14f4-c9cc-43bd-b3eb-83a7adf0ec12 req-2b382831-4995-44e2-8e5e-8ad96f59bd24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119772 Oct 17 12:59:10.726978 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1222/2468] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:10.738647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:10.739902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:10.750889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:10.751982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:10.752622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:10.753681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:10.754601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:10.756279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:11.371413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:11.380710 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa2854fc-0512-4138-8f18-4724d9aa74a0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1310 microversion: 2.1 time: 0.652354 Oct 17 12:59:11.387246 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1223/2469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:10 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1310 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:11.392437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-38c4db91-2152-45d2-9782-298fa2bb786e req-c06715fa-e3cf-4e2c-96fd-e530d5e7690f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93643651-ffe6-4925-ac21-a34be3ab4749", "name": "network-vif-unplugged", "status": "completed", "tag": "2300358d-c0d9-4e82-a174-84c57b25bef4"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:11.420544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-38c4db91-2152-45d2-9782-298fa2bb786e req-c06715fa-e3cf-4e2c-96fd-e530d5e7690f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:11.421991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-38c4db91-2152-45d2-9782-298fa2bb786e req-c06715fa-e3cf-4e2c-96fd-e530d5e7690f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:11.432223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-38c4db91-2152-45d2-9782-298fa2bb786e req-c06715fa-e3cf-4e2c-96fd-e530d5e7690f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:11.458135 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-38c4db91-2152-45d2-9782-298fa2bb786e req-c06715fa-e3cf-4e2c-96fd-e530d5e7690f service nova] Creating event network-vif-unplugged:2300358d-c0d9-4e82-a174-84c57b25bef4 for instance 93643651-ffe6-4925-ac21-a34be3ab4749 on n-h2-853316-12 Oct 17 12:59:11.465722 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-38c4db91-2152-45d2-9782-298fa2bb786e req-c06715fa-e3cf-4e2c-96fd-e530d5e7690f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076653 Oct 17 12:59:11.466885 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1224/2470] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:11.481058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78d268e6-0c57-4476-9850-9b853d8be951 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Action: 'create', calling method: .version_select at 0x7fa825165ee0>, body: {"pool": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:11.724664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:11.796686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:12.956277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:59:12.956871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:59:12.957073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:59:12.957660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:59:12.958279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:59:12.976838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:12.977566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:12.978157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:12.979068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:12.983003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:12.983666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:13.028629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:59:13.045262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for user 638e5facdbe64d26bf3c4b5c12a33da7 and project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:59:13.078402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:59:13.081128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:59:13.189428 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60be327d-a58e-452b-a74b-d6358a6a7298 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.261335 Oct 17 12:59:13.197316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1247/2471] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:59:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:59:13.207782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:13.215155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:13.243326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:13.243823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:13.244266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:13.244986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:13.250860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:13.252618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:13.395788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:14.673708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:14.704232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:14.711914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:14.726731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e18ffd7f-f4d8-4541-9c2a-8d5bead52ae2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1885 microversion: 2.32 time: 1.525401 Oct 17 12:59:14.727165 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1248/2472] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:13 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1885 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:14.764728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:14.765249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:14.774843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:14.777896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:14.778456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:14.787074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:14.788010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:14.788911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:14.807726 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] HTTP exception thrown: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Request method failure captured: Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 HTTP/1.1 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVDQ1GFvZxFZbPB4MmHmmrRQbNl4VXOG7hEKGqgQ3c7nTN-11a4RRpcBxuY6b6BN9yP2033Nsn4itiCgHSTPv51SauvTJTFNJVrHNJy2HxBNXM7N4HUP5HQgdko-fTqEgBd3-6N8WtjcMGq366vsGOVgVVzhgZnVTv_WjBMYAuFtdN8 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 8f3503d17d744d78a6c72ecab706e9b0 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f3503d17d744d78a6c72ecab706e9b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 8f3503d17d744d78a6c72ecab706e9b0 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachSCSIVolumeTestJSON-1894890912-project Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7616e4a36c64457dbadf38f33731ccc5 Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1894890912-project Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '2dff0a31-d0a4-4203-9280-48996deaa841'} Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:59:14.818264 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:14.822424 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:14.827026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Returning 404 to user: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:59:14.828112 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af3fbd55-d6c5-4dcf-96d6-e681a003d3f8 tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 404 len: 111 microversion: 2.1 time: 0.100004 Oct 17 12:59:14.828950 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1249/2473] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 12:59:14 2022] DELETE /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:59:14.840591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:14.842869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:14.870639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:14.871626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:14.872264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:14.873183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:14.873827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:14.874465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:15.359292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:15.373509 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-28429ace-899a-494a-b8d5-f32dd68e911d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1310 microversion: 2.1 time: 0.539846 Oct 17 12:59:15.374431 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1250/2474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:14 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1310 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:15.379612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-02767e4e-da48-47f7-9e4c-3a98b173850a req-2a1dc5a6-f8ff-44d4-a63f-7739ca7cf890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "tag": "68123dfb-87fd-4618-8ce3-2a67002cb00b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:15.400887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-02767e4e-da48-47f7-9e4c-3a98b173850a req-2a1dc5a6-f8ff-44d4-a63f-7739ca7cf890 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:15.403034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-02767e4e-da48-47f7-9e4c-3a98b173850a req-2a1dc5a6-f8ff-44d4-a63f-7739ca7cf890 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:15.404075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-02767e4e-da48-47f7-9e4c-3a98b173850a req-2a1dc5a6-f8ff-44d4-a63f-7739ca7cf890 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:15.440576 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-02767e4e-da48-47f7-9e4c-3a98b173850a req-2a1dc5a6-f8ff-44d4-a63f-7739ca7cf890 service nova] Creating event network-changed:68123dfb-87fd-4618-8ce3-2a67002cb00b for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 12:59:15.455565 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-02767e4e-da48-47f7-9e4c-3a98b173850a req-2a1dc5a6-f8ff-44d4-a63f-7739ca7cf890 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079358 Oct 17 12:59:15.456432 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1251/2475] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:15.462770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-139b0b6f-dda6-4f65-bafa-3b91d5b7d361 req-6a148ee7-cde8-4bc9-a07b-669ca37732a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9676af66-f025-4c9a-a558-7e5257e29486", "tag": "0c622b6f-e4fc-4dbd-b902-8b42944bd3ba"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:15.478955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-139b0b6f-dda6-4f65-bafa-3b91d5b7d361 req-6a148ee7-cde8-4bc9-a07b-669ca37732a7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:15.482096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-139b0b6f-dda6-4f65-bafa-3b91d5b7d361 req-6a148ee7-cde8-4bc9-a07b-669ca37732a7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:15.483056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-139b0b6f-dda6-4f65-bafa-3b91d5b7d361 req-6a148ee7-cde8-4bc9-a07b-669ca37732a7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:15.506946 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-139b0b6f-dda6-4f65-bafa-3b91d5b7d361 req-6a148ee7-cde8-4bc9-a07b-669ca37732a7 service nova] Creating event network-changed:0c622b6f-e4fc-4dbd-b902-8b42944bd3ba for instance 9676af66-f025-4c9a-a558-7e5257e29486 on n-h2-853316-12 Oct 17 12:59:15.519295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-139b0b6f-dda6-4f65-bafa-3b91d5b7d361 req-6a148ee7-cde8-4bc9-a07b-669ca37732a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061193 Oct 17 12:59:15.521236 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1252/2476] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:15.548711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:15.549721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:15.559323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:15.559998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:15.560541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:15.562064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:15.562660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:15.564220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:15.704010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:15.753410 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6c2cc95-9c2e-4ac4-9ea8-6c4fe66ddfe5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1266 microversion: 2.1 time: 0.217807 Oct 17 12:59:15.772935 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1253/2477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:15 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:15.780184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:15.781023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] [instance: 2dff0a31-d0a4-4203-9280-48996deaa841] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:15.788513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:15.789264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:15.790050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:15.791049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:15.791695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:15.792394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:15.811551 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] HTTP exception thrown: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Request method failure captured: Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 HTTP/1.1 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVDQ1GFvZxFZbPB4MmHmmrRQbNl4VXOG7hEKGqgQ3c7nTN-11a4RRpcBxuY6b6BN9yP2033Nsn4itiCgHSTPv51SauvTJTFNJVrHNJy2HxBNXM7N4HUP5HQgdko-fTqEgBd3-6N8WtjcMGq366vsGOVgVVzhgZnVTv_WjBMYAuFtdN8 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 8f3503d17d744d78a6c72ecab706e9b0 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8f3503d17d744d78a6c72ecab706e9b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8f3503d17d744d78a6c72ecab706e9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 8f3503d17d744d78a6c72ecab706e9b0 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1894890912 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachSCSIVolumeTestJSON-1894890912-project Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7616e4a36c64457dbadf38f33731ccc5 Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1894890912-project Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '2dff0a31-d0a4-4203-9280-48996deaa841'} Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 12:59:15.815108 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:15.818761 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 12:59:15.818761 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 12:59:15.818761 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 12:59:15.818761 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 12:59:15.818761 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 12:59:15.818761 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. Oct 17 12:59:15.818761 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 12:59:15.823268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] Returning 404 to user: Instance 2dff0a31-d0a4-4203-9280-48996deaa841 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 12:59:15.825786 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f46503da-6330-454c-b22a-66a993bda98b tempest-AttachSCSIVolumeTestJSON-1894890912 tempest-AttachSCSIVolumeTestJSON-1894890912-project] 10.222.0.27 "GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841" status: 404 len: 111 microversion: 2.1 time: 0.050606 Oct 17 12:59:15.830711 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1254/2478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:15 2022] GET /compute/v2.1/servers/2dff0a31-d0a4-4203-9280-48996deaa841 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 12:59:15.845808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:15.846583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:15.856742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:15.857235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:15.857676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:15.859567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:15.867872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:15.872656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:16.601495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:16.626962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:16.628752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:16.630226 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55063158-994a-40a7-82c5-a8d137d69f99 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1885 microversion: 2.32 time: 0.798227 Oct 17 12:59:16.630990 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1255/2479] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:15 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1885 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:16.656071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:16.656782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:16.663384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:16.664378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:16.665047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:16.665819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:16.666462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:16.667004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:17.379725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:17.388693 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f91cb75a-95b7-4582-88e2-694580bf5b45 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1310 microversion: 2.1 time: 0.745018 Oct 17 12:59:17.397652 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1256/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:16 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1310 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:17.403555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:17.404466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:17.411195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:17.412074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:17.412520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:17.413240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:17.413699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:17.414342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:17.586535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:17.595952 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1d965a8-f081-476c-90d1-2a2bf6ad3f12 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1266 microversion: 2.1 time: 0.196870 Oct 17 12:59:17.596903 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1257/2481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:17 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:17.601771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3bda8a04-2ac7-4fb3-a3db-85a91a662cbe req-0237d4e3-cb34-4809-beb7-ffe0eab0f0fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "tag": "b965e48b-1ec7-4ed6-9c05-9c0ab419272f"}, {"server_uuid": "93643651-ffe6-4925-ac21-a34be3ab4749", "name": "network-vif-deleted", "tag": "2300358d-c0d9-4e82-a174-84c57b25bef4"}, {"name": "network-changed", "server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "tag": "0e3b2a77-e188-4c79-8863-df8a35716569"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:17.613498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3bda8a04-2ac7-4fb3-a3db-85a91a662cbe req-0237d4e3-cb34-4809-beb7-ffe0eab0f0fd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:17.614098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3bda8a04-2ac7-4fb3-a3db-85a91a662cbe req-0237d4e3-cb34-4809-beb7-ffe0eab0f0fd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:17.614628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3bda8a04-2ac7-4fb3-a3db-85a91a662cbe req-0237d4e3-cb34-4809-beb7-ffe0eab0f0fd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:17.629258 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3bda8a04-2ac7-4fb3-a3db-85a91a662cbe req-0237d4e3-cb34-4809-beb7-ffe0eab0f0fd service nova] Creating event network-changed:b965e48b-1ec7-4ed6-9c05-9c0ab419272f for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 12:59:17.629954 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3bda8a04-2ac7-4fb3-a3db-85a91a662cbe req-0237d4e3-cb34-4809-beb7-ffe0eab0f0fd service nova] Creating event network-vif-deleted:2300358d-c0d9-4e82-a174-84c57b25bef4 for instance 93643651-ffe6-4925-ac21-a34be3ab4749 on n-h2-853316-12 Oct 17 12:59:17.630597 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3bda8a04-2ac7-4fb3-a3db-85a91a662cbe req-0237d4e3-cb34-4809-beb7-ffe0eab0f0fd service nova] Creating event network-changed:0e3b2a77-e188-4c79-8863-df8a35716569 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 12:59:17.640088 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3bda8a04-2ac7-4fb3-a3db-85a91a662cbe req-0237d4e3-cb34-4809-beb7-ffe0eab0f0fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.041672 Oct 17 12:59:17.640974 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1258/2482] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:17.664196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:17.665173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:17.672563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:17.673480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:17.673927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:17.674683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:17.675142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:17.675571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:17.978406 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-78d268e6-0c57-4476-9850-9b853d8be951 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.507538 Oct 17 12:59:17.989342 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1225/2483] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:59:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:17.994519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-141b44ac-4f6a-4090-bac6-a80bf61dfaa3 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Action: 'create', calling method: .version_select at 0x7fa8250cdee0>, body: {"pool": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:18.270302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:18.288332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:18.291572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:18.298656 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fdaeae22-c083-4afe-af32-775dd09e0daf tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.639730 Oct 17 12:59:18.300308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1259/2484] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:17 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:59:18.416072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:18.417425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:18.426560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:18.427236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:18.427779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:18.429606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:18.430485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:18.432202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:18.439248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:19.072630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:19.082203 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca6f5415-ac88-46c2-8e98-b4285cefbd8d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1310 microversion: 2.1 time: 0.672873 Oct 17 12:59:19.082793 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1260/2485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:18 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1310 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:19.095499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:19.097298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:19.113174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:19.116041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:19.116950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:19.118563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:19.119044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:19.127279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:19.533005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:19.556445 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9d79b29b-8c32-43e2-81a1-c450f86731c1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1308 microversion: 2.1 time: 0.465813 Oct 17 12:59:19.560549 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1261/2486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:19 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:19.576005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:19.578425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:19.585527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:19.586031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:19.586694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:19.587647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:19.588106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:19.588589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:20.151608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:20.174554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:20.187041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:20.191236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fdf64f5c-9822-4c3f-8c82-2776fba1f809 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.628264 Oct 17 12:59:20.194046 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1262/2487] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:19 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:20.204687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a9d86ec9-32f4-48f6-8030-0bdbcd6508c0 req-ba032cac-0172-4ad0-ac4c-2bd10b6375dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "tag": "44c45404-14f1-47d8-ab4c-b3cb9a6bc6e8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:20.222810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a9d86ec9-32f4-48f6-8030-0bdbcd6508c0 req-ba032cac-0172-4ad0-ac4c-2bd10b6375dc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:20.223806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a9d86ec9-32f4-48f6-8030-0bdbcd6508c0 req-ba032cac-0172-4ad0-ac4c-2bd10b6375dc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:20.224710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a9d86ec9-32f4-48f6-8030-0bdbcd6508c0 req-ba032cac-0172-4ad0-ac4c-2bd10b6375dc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:20.242930 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a9d86ec9-32f4-48f6-8030-0bdbcd6508c0 req-ba032cac-0172-4ad0-ac4c-2bd10b6375dc service nova] Creating event network-changed:44c45404-14f1-47d8-ab4c-b3cb9a6bc6e8 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 12:59:20.256030 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a9d86ec9-32f4-48f6-8030-0bdbcd6508c0 req-ba032cac-0172-4ad0-ac4c-2bd10b6375dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059815 Oct 17 12:59:20.258542 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1263/2488] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:20.267290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:20.268758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:20.305439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:20.306220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:20.306477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:20.307243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:20.315112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:20.315583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:21.180836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:21.196912 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-316773d8-ba57-4e4f-a26a-fad0d1bbe554 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1310 microversion: 2.1 time: 0.936175 Oct 17 12:59:21.199036 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1264/2489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:20 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1310 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:21.419840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=17 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:21.438719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:21.728875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-babe5bf6-fb34-4217-8a23-7c8103bf65db req-f78ee0e3-7ccb-4ee3-8705-13347bbfbd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9676af66-f025-4c9a-a558-7e5257e29486", "name": "network-vif-plugged", "status": "completed", "tag": "0c622b6f-e4fc-4dbd-b902-8b42944bd3ba"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:21.754283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-babe5bf6-fb34-4217-8a23-7c8103bf65db req-f78ee0e3-7ccb-4ee3-8705-13347bbfbd22 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:21.756725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-babe5bf6-fb34-4217-8a23-7c8103bf65db req-f78ee0e3-7ccb-4ee3-8705-13347bbfbd22 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:21.759835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-babe5bf6-fb34-4217-8a23-7c8103bf65db req-f78ee0e3-7ccb-4ee3-8705-13347bbfbd22 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:21.788390 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-babe5bf6-fb34-4217-8a23-7c8103bf65db req-f78ee0e3-7ccb-4ee3-8705-13347bbfbd22 service nova] Creating event network-vif-plugged:0c622b6f-e4fc-4dbd-b902-8b42944bd3ba for instance 9676af66-f025-4c9a-a558-7e5257e29486 on n-h2-853316-12 Oct 17 12:59:21.805425 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-babe5bf6-fb34-4217-8a23-7c8103bf65db req-f78ee0e3-7ccb-4ee3-8705-13347bbfbd22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.602410 Oct 17 12:59:21.808815 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1265/2490] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:21.826568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:21.830697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:21.847752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:21.851770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:21.853067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:21.856770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:21.857700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:21.858409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:22.457928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:22.474627 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68447c1f-73e7-488e-a291-52f0a849aeb8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1308 microversion: 2.1 time: 0.660103 Oct 17 12:59:22.476876 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1266/2491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:21 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1308 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:22.491120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:22.491920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:22.512989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:22.513499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:22.513939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:22.514679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:22.515303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:22.515888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:23.007658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:23.054035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:23.217966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:23.236997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:23.246965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:23.249743 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-352f2bd0-0ab8-493a-8c41-bb5ac1d0e412 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.771132 Oct 17 12:59:23.251099 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1267/2492] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:22 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:23.269035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:23.269674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:23.288982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:23.289505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:23.289948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:23.295679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:23.305308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:23.305935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:24.063676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:24.082315 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5e95e537-d252-4bb4-a767-d7623126b336 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1310 microversion: 2.1 time: 0.829567 Oct 17 12:59:24.083436 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1268/2493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:23 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1310 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:24.097113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e5b8634e-855e-4ab2-b03a-9235771f9351 req-805a1cfd-2b69-433f-8ea5-cb53bfd353e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "918c48fc-3923-40c6-a877-39fd47337f64", "tag": "4cf3c20b-f534-4dcd-bc59-97245fdc9f8b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:24.108249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e5b8634e-855e-4ab2-b03a-9235771f9351 req-805a1cfd-2b69-433f-8ea5-cb53bfd353e9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:24.108991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e5b8634e-855e-4ab2-b03a-9235771f9351 req-805a1cfd-2b69-433f-8ea5-cb53bfd353e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:24.109579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e5b8634e-855e-4ab2-b03a-9235771f9351 req-805a1cfd-2b69-433f-8ea5-cb53bfd353e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:24.123579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e5b8634e-855e-4ab2-b03a-9235771f9351 req-805a1cfd-2b69-433f-8ea5-cb53bfd353e9 service nova] Creating event network-changed:4cf3c20b-f534-4dcd-bc59-97245fdc9f8b for instance 918c48fc-3923-40c6-a877-39fd47337f64 on n-h1-853316-12 Oct 17 12:59:24.129140 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e5b8634e-855e-4ab2-b03a-9235771f9351 req-805a1cfd-2b69-433f-8ea5-cb53bfd353e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042037 Oct 17 12:59:24.130233 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1269/2494] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:24.141347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:24.144297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:24.152512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:24.153249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:24.153865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:24.154747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:24.155351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:24.156074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:24.452771 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-141b44ac-4f6a-4090-bac6-a80bf61dfaa3 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.461915 Oct 17 12:59:24.453713 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1226/2495] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 12:59:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:24.458728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-56281030-8611-410d-b42d-49cf92892784 req-fccd3d83-2281-4026-baa4-8a2a91d13f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "tag": "549f3f80-1e4f-4580-9a65-68ec0e85d947"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:24.469487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-56281030-8611-410d-b42d-49cf92892784 req-fccd3d83-2281-4026-baa4-8a2a91d13f4b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:24.469972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-56281030-8611-410d-b42d-49cf92892784 req-fccd3d83-2281-4026-baa4-8a2a91d13f4b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:24.470446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-56281030-8611-410d-b42d-49cf92892784 req-fccd3d83-2281-4026-baa4-8a2a91d13f4b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:24.481762 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-56281030-8611-410d-b42d-49cf92892784 req-fccd3d83-2281-4026-baa4-8a2a91d13f4b service nova] Creating event network-changed:549f3f80-1e4f-4580-9a65-68ec0e85d947 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 12:59:24.487827 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-56281030-8611-410d-b42d-49cf92892784 req-fccd3d83-2281-4026-baa4-8a2a91d13f4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032786 Oct 17 12:59:24.488798 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1227/2496] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:24.494118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:24.495569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:24.502309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:24.503324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:24.504024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:24.505059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:24.505687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:24.506594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:24.573281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:24.583035 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-733619f3-8b23-41c6-af5f-1666413312bc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1308 microversion: 2.1 time: 0.451397 Oct 17 12:59:24.584204 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1270/2497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:24 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:24.590081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fe48adb-1f89-4bd3-b788-4c46101bd172 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Calling method '.version_select at 0x7fa820edb4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:25.051376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:25.067329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:25.068864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:25.070092 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b59f10ac-59ca-40ea-947c-cd9d022305d7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.580190 Oct 17 12:59:25.071036 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1228/2498] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:24 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:25.113455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:25.114195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:25.122080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:25.122744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:25.123253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:25.124069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:25.124595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:25.125097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:25.483573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:25.493295 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-24c282a7-21e0-4b13-b9c8-07a47bf4a437 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1493 microversion: 2.1 time: 0.383848 Oct 17 12:59:25.494591 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1229/2499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:25 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1493 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:25.519486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:25.520207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:25.527638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:25.528157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:25.528667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:25.529439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:25.530290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:25.530972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:25.690456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fe48adb-1f89-4bd3-b788-4c46101bd172 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/c6dcf8cc-9c5e-4974-8d67-e4e603a72f82" status: 200 len: 142 microversion: 2.1 time: 1.104664 Oct 17 12:59:25.691176 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1271/2500] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 12:59:24 2022] GET /compute/v2.1/os-floating-ips/c6dcf8cc-9c5e-4974-8d67-e4e603a72f82 => generated 142 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:25.699547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:25.700427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:25.721570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:25.722648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:25.723200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:25.724612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:25.726748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:25.727673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:26.008631 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c0ea1aff-bd8b-453e-a930-5ce740a21072 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1646 microversion: 2.1 time: 0.493024 Oct 17 12:59:26.009230 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1230/2501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:25 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1646 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:26.014960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a8db8604-4d4c-4e53-b572-93978142ce17 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Calling method '.version_select at 0x7fa82506c940>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:26.103939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:26.124587 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-82f61d76-a31d-4a3f-a0ad-831654505c22 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1308 microversion: 2.1 time: 0.429216 Oct 17 12:59:26.125395 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1272/2502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:25 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:26.133011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:26.133715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:26.162562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:26.163265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:26.163879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:26.164725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:26.165290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:26.165815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:26.449127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-28c86c05-2d7c-4747-a127-43d940d484aa tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1646 microversion: 2.1 time: 0.320446 Oct 17 12:59:26.462402 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1273/2503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:26 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1646 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:26.462402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:26.462402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:26.466115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:26.467011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:26.467676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:26.468714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:26.469289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:26.469841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:26.907165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:26.922858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:26.934822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:26.936225 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de931974-0d84-4f77-aa76-5ba8f1e63b8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.485196 Oct 17 12:59:26.936827 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1274/2504] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:26 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:26.947060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-468bda67-e1a4-45ec-bb73-793d7ac24bd5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:26.950828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-468bda67-e1a4-45ec-bb73-793d7ac24bd5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:26.961691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-468bda67-e1a4-45ec-bb73-793d7ac24bd5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:26.962430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-468bda67-e1a4-45ec-bb73-793d7ac24bd5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:26.963960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-468bda67-e1a4-45ec-bb73-793d7ac24bd5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:26.964676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-468bda67-e1a4-45ec-bb73-793d7ac24bd5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:26.965290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-468bda67-e1a4-45ec-bb73-793d7ac24bd5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:27.017571 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-468bda67-e1a4-45ec-bb73-793d7ac24bd5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.079489 Oct 17 12:59:27.026529 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1275/2505] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 12:59:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:27.215095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e62ca4db-91e3-4991-88d4-af992968c916 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'create', calling method: .version_select at 0x7fa820edb1f0>, body: {"keypair": {"name": "tempest-keypair-1028610316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNV9QV+mqIeyIX+AKzU4q9HUcwXhLzVuVzLcj8JOq5pRg3EzZfcX1JGBwFj+SHuMsoj8dbUX/NncoZO2cHA5d6CsEqI+JSkstDdcSb14xb1CbwEfdqw3SOu0f3GZxqGcQ=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:27.258925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-e62ca4db-91e3-4991-88d4-af992968c916 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Getting quotas for project ebdbecfa601e4e76bded1a6b0ff5bf3e. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:59:27.269485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-e62ca4db-91e3-4991-88d4-af992968c916 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Getting quotas for user 1c24155cc4964f9298aee2c596a79ac7 and project ebdbecfa601e4e76bded1a6b0ff5bf3e. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:59:27.296954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:27.341659 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e62ca4db-91e3-4991-88d4-af992968c916 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.313356 Oct 17 12:59:27.342646 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1276/2506] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:59:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:27.355148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:27.358702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:27.376052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:27.377998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:27.381552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:27.382913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:27.383708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:27.386907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:27.505319 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f40bf75-44ee-4b39-9e54-54ac44ef052a tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486/action" status: 202 len: 0 microversion: 2.1 time: 0.154095 Oct 17 12:59:27.510730 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1277/2507] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:59:27 2022] POST /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:59:27.525038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:27.526539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:27.535564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:27.536202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:27.536760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:27.537720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:27.538418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:27.539173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:27.883552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:27.892915 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7fa22ea-dd7e-4b04-95d1-836f1adc078e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1308 microversion: 2.1 time: 0.379148 Oct 17 12:59:27.906590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1278/2508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:27 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:27.911527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:27.912100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:27.927669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:27.928498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:27.930694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:27.948135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:27.951046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:27.958393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:28.632458 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-825676ea-e1a1-44ac-99e6-f1fa8c524f41 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1631 microversion: 2.1 time: 0.724608 Oct 17 12:59:28.637719 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1279/2509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:27 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1631 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:28.641609 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a8db8604-4d4c-4e53-b572-93978142ce17 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/c6dcf8cc-9c5e-4974-8d67-e4e603a72f82" status: 202 len: 0 microversion: 2.1 time: 2.630918 Oct 17 12:59:28.646444 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1231/2510] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:59:26 2022] DELETE /compute/v2.1/os-floating-ips/c6dcf8cc-9c5e-4974-8d67-e4e603a72f82 => generated 0 bytes in 2636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:59:28.654521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2306bbc0-113d-4a65-acfd-e80059962c50 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Calling method '.version_select at 0x7fa8250cdc10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:28.669998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:28.672030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:28.684371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:28.684959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:28.685468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:28.686278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:28.687048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:28.687547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:28.710792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:29.245484 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2306bbc0-113d-4a65-acfd-e80059962c50 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.596865 Oct 17 12:59:29.254660 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1232/2511] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 17 12:59:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 12:59:29.261262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853316-12", "block_migration": true, "disk_over_commit": false}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:29.265364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:29.290134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:29.291074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:29.291827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:29.293135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:29.294124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:29.295852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:29.330273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lazy-loading 'flavor' on Instance uuid 9676af66-f025-4c9a-a558-7e5257e29486 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 12:59:29.345652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Going to try to live migrate instance to n-h1-853316-12 {{(pid=127539) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 12:59:30.001638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:30.014666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:30.016574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:30.017863 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b2d7edb8-498a-446d-bdc2-9c1415a2fc26 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 1.378883 Oct 17 12:59:30.018448 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1280/2512] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:28 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:30.037705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:30.038828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:30.050494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:30.051322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:30.052748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:30.056306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:30.058137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:30.059279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:30.725588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:30.737927 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32cea48d-eefa-43c1-905c-d8f721fe6cce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1308 microversion: 2.1 time: 0.718180 Oct 17 12:59:30.739970 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1281/2513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:30 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1308 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:30.750246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-367bc697-01aa-4e56-9c08-2e6017eb333f tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Calling method '.version_select at 0x7fa820d485e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:31.408693 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-367bc697-01aa-4e56-9c08-2e6017eb333f tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.665569 Oct 17 12:59:31.410429 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1282/2514] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 12:59:30 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:31.423741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0f73d243-a366-4b42-bd05-d70dd1541e4a req-165c145d-ddaa-4a18-8c8f-f82f0fb19a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918c48fc-3923-40c6-a877-39fd47337f64", "name": "network-vif-plugged", "status": "completed", "tag": "4cf3c20b-f534-4dcd-bc59-97245fdc9f8b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:31.437000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0f73d243-a366-4b42-bd05-d70dd1541e4a req-165c145d-ddaa-4a18-8c8f-f82f0fb19a75 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:31.437795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0f73d243-a366-4b42-bd05-d70dd1541e4a req-165c145d-ddaa-4a18-8c8f-f82f0fb19a75 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:31.439197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0f73d243-a366-4b42-bd05-d70dd1541e4a req-165c145d-ddaa-4a18-8c8f-f82f0fb19a75 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:31.455185 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0f73d243-a366-4b42-bd05-d70dd1541e4a req-165c145d-ddaa-4a18-8c8f-f82f0fb19a75 service nova] Creating event network-vif-plugged:4cf3c20b-f534-4dcd-bc59-97245fdc9f8b for instance 918c48fc-3923-40c6-a877-39fd47337f64 on n-h1-853316-12 Oct 17 12:59:31.461004 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0f73d243-a366-4b42-bd05-d70dd1541e4a req-165c145d-ddaa-4a18-8c8f-f82f0fb19a75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049114 Oct 17 12:59:31.462339 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1283/2515] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:31.469111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:31.469818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:31.477053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:31.477533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:31.477962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:31.478681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:31.479291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:31.479715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:31.849927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:31.862313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:31.863923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:31.865147 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-504156c7-0a50-40cc-9bf6-fa80fb5677cc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.401234 Oct 17 12:59:31.882694 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1284/2516] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:31 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:31.882694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd5a6052-b4f2-4ad2-90e4-e44abcfe64b7 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Calling method '.version_select at 0x7fa820cf1940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:31.910033 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a58a1123-df93-4abd-97c6-f35f15486a46 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486/action" status: 202 len: 0 microversion: 2.1 time: 2.653025 Oct 17 12:59:31.911804 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1233/2517] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:59:29 2022] POST /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486/action => generated 0 bytes in 2656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:59:31.919107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:31.920424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:31.930473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:31.931205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:31.931699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:31.933368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:31.934056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:31.935016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:32.427828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:32.440439 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-78b230a5-ce91-42a7-be48-87a2c0b020d7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1308 microversion: 2.1 time: 0.526957 Oct 17 12:59:32.441811 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1234/2518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:31 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:32.460621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:32.462395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:32.474895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:32.475954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:32.476959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:32.477896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:32.478624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:32.480353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:33.130384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:33.136770 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2cbde229-39d9-47e7-a865-d58d9b576235 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.693638 Oct 17 12:59:33.153959 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1235/2519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:32 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:33.159734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-487863510", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ed32987-4304-4a23-af45-632f44568156"}], "security_groups": [{"name": "tempest-securitygroup--1788210257"}], "key_name": "tempest-keypair-1028610316", "user_data": "}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:33.429939 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd5a6052-b4f2-4ad2-90e4-e44abcfe64b7 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/88ae9cbe-f986-4062-ba57-32931a81bafb" status: 202 len: 0 microversion: 2.1 time: 1.563110 Oct 17 12:59:33.430939 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1285/2520] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:59:31 2022] DELETE /compute/v2.1/os-floating-ips/88ae9cbe-f986-4062-ba57-32931a81bafb => generated 0 bytes in 1564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:59:33.437370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:33.437981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:33.445447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:33.445945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:33.446411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:33.447975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:33.448782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:33.449379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:33.607972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] validate_networks() for [('3ed32987-4304-4a23-af45-632f44568156', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:59:34.328344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:59:34.329793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:59:34.330435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:59:34.331017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:59:34.331455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:59:34.342522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:34.343028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:34.343892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:34.344640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:34.345097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:34.345437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:34.345574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:34.357139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:34.359111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:34.360782 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-055df1cf-d3fb-4613-82f3-63bc987c47b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.928705 Oct 17 12:59:34.362110 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1286/2521] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:33 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:34.366461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Getting quotas for project ebdbecfa601e4e76bded1a6b0ff5bf3e. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:59:34.368107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c8070d6-7762-4f60-87f3-aedcc4215115 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Calling method '.version_select at 0x7fa820cf1ee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:34.373203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Getting quotas for user 1c24155cc4964f9298aee2c596a79ac7 and project ebdbecfa601e4e76bded1a6b0ff5bf3e. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:59:34.388647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:59:34.391493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:59:34.487929 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-22e12cfb-cf7d-44b1-a59a-69de923a596e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.332338 Oct 17 12:59:34.495438 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1236/2522] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:59:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:59:34.495895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:34.496525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:34.504041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:34.504675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:34.505166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:34.505884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:34.506417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:34.506849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:34.910135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:34.924660 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4441c819-1f97-40a0-8ad7-dd8020400a6a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1488 microversion: 2.1 time: 0.434431 Oct 17 12:59:34.925709 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1237/2523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:34 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1488 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:34.933991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:34.938140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:34.955618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:34.957570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:34.958824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:34.961295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:34.961931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:34.962714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:35.368461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:35.378434 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3288062c-2c16-4996-8a88-295d00dd6e0c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.451431 Oct 17 12:59:35.379036 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1238/2524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:34 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:35.389666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:35.390312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:35.405832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:35.406366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:35.412300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:35.413210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:35.426215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:35.426974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:35.600551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:35.625150 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6dae093-cf21-4075-bc1c-d7c919640a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1241 microversion: 2.1 time: 0.233326 Oct 17 12:59:35.628055 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1239/2525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:35 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1241 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:35.646942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa30b486-86be-4d5e-8813-d5b5d1a47a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:35.658640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa30b486-86be-4d5e-8813-d5b5d1a47a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:35.659663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa30b486-86be-4d5e-8813-d5b5d1a47a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:35.660281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa30b486-86be-4d5e-8813-d5b5d1a47a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:35.819408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa30b486-86be-4d5e-8813-d5b5d1a47a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 12:59:35.889232 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa30b486-86be-4d5e-8813-d5b5d1a47a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64/action" status: 202 len: 0 microversion: 2.1 time: 0.259272 Oct 17 12:59:35.892990 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1240/2526] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 12:59:35 2022] POST /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:59:35.915326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:35.916259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:35.927243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:35.927636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:35.928601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:35.929385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:35.929853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:35.930315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:36.531952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:36.551396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:36.552971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:36.554260 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68c4aa88-4811-4980-8c93-b069317bd6d4 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.662581 Oct 17 12:59:36.554836 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1241/2527] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:35 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:36.597751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:36.598400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:36.627084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:36.628105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:36.629026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:36.629905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:36.630543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:36.631127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:36.983156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:37.011011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:37.023382 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9d53e2e-a862-4794-95cd-edfc7e66eaea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.431975 Oct 17 12:59:37.024308 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1242/2528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:36 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:37.037329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:37.038216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:37.060254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:37.060769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:37.061216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:37.061942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:37.062421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:37.063059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:37.175667 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c8070d6-7762-4f60-87f3-aedcc4215115 tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/446d630b-e6fc-48c2-98d5-39af1fa3062e" status: 202 len: 0 microversion: 2.1 time: 2.812143 Oct 17 12:59:37.177019 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1287/2529] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:59:34 2022] DELETE /compute/v2.1/os-floating-ips/446d630b-e6fc-48c2-98d5-39af1fa3062e => generated 0 bytes in 2814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:59:37.186178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:37.187442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:37.200078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:37.200840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:37.201524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:37.202661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:37.204449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:37.205813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:37.289863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:37.328443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:37.338788 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3d77044-160c-4d08-b7cc-cd2c406ab2db tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1295 microversion: 2.1 time: 0.160469 Oct 17 12:59:37.340098 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1288/2530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:37 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1295 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:37.347387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5e5ef724-a993-4315-bcfc-a0a48b5a1a73 req-4e03eadb-b6fe-467e-ad72-5d5bfc8df7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9676af66-f025-4c9a-a558-7e5257e29486", "name": "network-vif-unplugged", "status": "completed", "tag": "0c622b6f-e4fc-4dbd-b902-8b42944bd3ba"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:37.370003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5e5ef724-a993-4315-bcfc-a0a48b5a1a73 req-4e03eadb-b6fe-467e-ad72-5d5bfc8df7cb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:37.370793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5e5ef724-a993-4315-bcfc-a0a48b5a1a73 req-4e03eadb-b6fe-467e-ad72-5d5bfc8df7cb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:37.372142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5e5ef724-a993-4315-bcfc-a0a48b5a1a73 req-4e03eadb-b6fe-467e-ad72-5d5bfc8df7cb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:37.416652 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5e5ef724-a993-4315-bcfc-a0a48b5a1a73 req-4e03eadb-b6fe-467e-ad72-5d5bfc8df7cb service nova] Creating event network-vif-unplugged:0c622b6f-e4fc-4dbd-b902-8b42944bd3ba for instance 9676af66-f025-4c9a-a558-7e5257e29486 on n-h2-853316-12 Oct 17 12:59:37.425812 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5e5ef724-a993-4315-bcfc-a0a48b5a1a73 req-4e03eadb-b6fe-467e-ad72-5d5bfc8df7cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083939 Oct 17 12:59:37.427826 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1289/2531] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:37.441245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50cf925a-9dd3-41b9-b365-5b25cfe8a49b tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] Calling method '.version_select at 0x7fa820cf13a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:37.871650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:37.876329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:37.887989 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b487f283-fc19-49c4-9ed5-e5c6f5595de0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.862559 Oct 17 12:59:37.889860 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1243/2532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:37 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:37.895237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:37.896227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:37.906811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:37.907649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:37.908613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:37.909770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:37.910419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:37.910848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:38.477914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:38.512841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:38.520834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:38.523361 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a0be7cd0-56af-48cd-9d6b-f853d1f3f32d tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.632278 Oct 17 12:59:38.525716 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1244/2533] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:37 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:38.554490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:38.561156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:38.592819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:38.593337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:38.614473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:38.619517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:38.620959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:38.621631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:39.147185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:39.171277 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3242ea41-2ab2-4ff2-a35f-7b7f6ecdf05a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.627316 Oct 17 12:59:39.175960 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1245/2534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:38 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:39.191250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:39.195235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:39.209413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:39.210219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:39.210818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:39.211712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:39.212335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:39.214094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:39.421515 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50cf925a-9dd3-41b9-b365-5b25cfe8a49b tempest-FloatingIPDetailsTestJSON-384976964 tempest-FloatingIPDetailsTestJSON-384976964-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/27cd5076-6415-4b47-8efc-466b447af1ca" status: 202 len: 0 microversion: 2.1 time: 1.989906 Oct 17 12:59:39.422718 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1290/2535] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 12:59:37 2022] DELETE /compute/v2.1/os-floating-ips/27cd5076-6415-4b47-8efc-466b447af1ca => generated 0 bytes in 1994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 12:59:39.428826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:39.429845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:39.449599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:39.458081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:39.458544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:39.459328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:39.459848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:39.460576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:39.733112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:39.748364 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a1b65523-5665-4f7f-bc5f-ac6b0ac0a510 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1363 microversion: 2.1 time: 0.569564 Oct 17 12:59:39.748999 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1246/2536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:39 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1363 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:39.767765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:39.768402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:39.778299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:39.779101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:39.779836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:39.780773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:39.782042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:39.790504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:40.055250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:40.066322 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-39b8f154-b913-43ba-9611-d3223b60e5fb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.641253 Oct 17 12:59:40.070378 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1291/2537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:39 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:40.077570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-36f985c4-8811-4995-9b38-610350f5d309 req-e177dd20-8347-4a3c-be7f-f709ec289fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9676af66-f025-4c9a-a558-7e5257e29486", "tag": "0c622b6f-e4fc-4dbd-b902-8b42944bd3ba"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:40.089209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-36f985c4-8811-4995-9b38-610350f5d309 req-e177dd20-8347-4a3c-be7f-f709ec289fb3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:40.090549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-36f985c4-8811-4995-9b38-610350f5d309 req-e177dd20-8347-4a3c-be7f-f709ec289fb3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:40.091298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-36f985c4-8811-4995-9b38-610350f5d309 req-e177dd20-8347-4a3c-be7f-f709ec289fb3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:40.105676 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-36f985c4-8811-4995-9b38-610350f5d309 req-e177dd20-8347-4a3c-be7f-f709ec289fb3 service nova] Creating event network-changed:0c622b6f-e4fc-4dbd-b902-8b42944bd3ba for instance 9676af66-f025-4c9a-a558-7e5257e29486 on n-h2-853316-12 Oct 17 12:59:40.112033 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-36f985c4-8811-4995-9b38-610350f5d309 req-e177dd20-8347-4a3c-be7f-f709ec289fb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040190 Oct 17 12:59:40.112691 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1292/2538] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:40.204806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:40.205517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:40.212717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:40.213750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:40.214386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:40.215302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:40.215921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:40.216518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:40.393023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:40.403804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:40.405766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:40.407276 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9a5ea2cc-55f6-4baa-a042-e921df9de9c9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.657152 Oct 17 12:59:40.408807 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1247/2539] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:39 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:40.779016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:40.779984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:40.804557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:40.805550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:40.806208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:40.807913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:40.808679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:40.814439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:41.075956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:41.116431 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fde776e1-6de5-4a3f-b880-c28ddeb803cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.912592 Oct 17 12:59:41.120407 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1293/2540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:40 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:59:41.140694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:41.141812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:41.149422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:41.150586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:41.152134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:41.154775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:41.155481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:41.156294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:41.216612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:41.224897 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a2fc5838-5a5f-4640-bd36-04e815e4e54e tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1363 microversion: 2.1 time: 0.451606 Oct 17 12:59:41.242450 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1248/2541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:40 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:59:41.436703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:41.437462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:41.452717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:41.453315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:41.453902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:41.458776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:41.459322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:41.459835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:41.918344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:41.933876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:41.936772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:41.943739 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b48adffc-252c-49d6-9b06-44e03c0ef902 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.508424 Oct 17 12:59:41.945841 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1249/2542] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:41 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:59:41.952492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-933a31f8-51bc-4ba9-afad-40842b9f6216 req-c3f042b1-b32b-4df4-a75c-beeb007efbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c5672f-8586-4476-85ec-81ff1d7400d6", "tag": "0ce82388-1237-4910-b3bf-0a4abe30dd52"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:41.969809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-933a31f8-51bc-4ba9-afad-40842b9f6216 req-c3f042b1-b32b-4df4-a75c-beeb007efbb0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:41.971410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-933a31f8-51bc-4ba9-afad-40842b9f6216 req-c3f042b1-b32b-4df4-a75c-beeb007efbb0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:41.972110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-933a31f8-51bc-4ba9-afad-40842b9f6216 req-c3f042b1-b32b-4df4-a75c-beeb007efbb0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:41.997559 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-933a31f8-51bc-4ba9-afad-40842b9f6216 req-c3f042b1-b32b-4df4-a75c-beeb007efbb0 service nova] Creating event network-changed:0ce82388-1237-4910-b3bf-0a4abe30dd52 for instance e6c5672f-8586-4476-85ec-81ff1d7400d6 on n-h2-853316-12 Oct 17 12:59:42.008672 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-933a31f8-51bc-4ba9-afad-40842b9f6216 req-c3f042b1-b32b-4df4-a75c-beeb007efbb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058825 Oct 17 12:59:42.014236 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1250/2543] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:42.087236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:42.116554 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9e84e67f-84ec-451d-ad05-49a41ebaaa8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.994370 Oct 17 12:59:42.123537 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1294/2544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:41 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:42.144794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:42.145304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:42.157211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:42.171356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:42.172099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:42.173052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:42.173515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:42.173942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:42.260471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:42.261506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:42.270080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:42.270697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:42.271216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:42.271998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:42.272661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:42.273181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:42.831648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:42.846216 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9de7b48c-863f-4e4a-9007-020959bd091a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.705501 Oct 17 12:59:42.847162 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1251/2545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:42 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:59:42.979471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:42.980138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:42.994731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:42.997220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:43.000522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:43.010883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:43.011687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:43.012833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:43.223109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:43.247555 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ba29e2b-e713-4ef9-baf3-e0ce5c844788 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1363 microversion: 2.1 time: 0.993727 Oct 17 12:59:43.249991 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1295/2546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:42 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1363 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:59:43.264972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:43.265690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:43.272540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:43.273031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:43.273465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:43.274179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:43.274951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:43.275477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:43.324294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:43.342629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:43.346786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:43.350053 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70e66063-0005-449e-a755-58ca3856bd15 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.378794 Oct 17 12:59:43.365467 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1252/2547] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:42 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 12:59:43.880568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:43.885665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:43.900834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:43.902286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:43.905272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:43.906642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:43.907219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:43.908031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:44.071595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:44.085149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1fb0893b-7d6a-47b8-a157-6bfa4dcfced7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.833083 Oct 17 12:59:44.099623 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1296/2548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:43 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:44.280236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:44.280942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:44.290755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:44.293490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:44.293991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:44.294786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:44.299948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:44.300406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:44.358371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:44.382617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:44.517947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:44.529224 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3707ff52-933b-42d4-9519-0fe103e82f31 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.657729 Oct 17 12:59:44.530071 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1253/2549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:43 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:44.535566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:44.536478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:44.545124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:44.548105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:44.549056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:44.551723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:44.552453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:44.553535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:44.647448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:44.663535 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da92a8d9-5784-46e8-b9e6-36e0f43a10f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1363 microversion: 2.1 time: 0.383871 Oct 17 12:59:44.664899 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1297/2550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:44 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:59:45.120981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:45.134974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:45.158806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:45.159848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:45.160637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:45.162222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:45.163292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:45.164326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:45.326101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:45.340955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:45.345005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:45.347473 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e9bdfa3-a232-4427-9231-4d9f42356bbc tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.815402 Oct 17 12:59:45.348678 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1254/2551] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:44 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:45.552762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:45.553374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:45.566122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:45.566852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:45.567455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:45.568353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:45.568974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:45.569564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:45.879255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:45.887926 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e92d8565-8622-4ab9-bbe4-33fef781bb93 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.774777 Oct 17 12:59:45.900697 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1298/2552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:45 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:45.905900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:45.906538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:45.921836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:45.922366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:45.922984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:45.923885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:45.924520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:45.925102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:46.067950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:46.094147 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-768a7e47-5cc1-4ed1-8754-6d392332cf16 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.545121 Oct 17 12:59:46.116030 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1255/2553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:45 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:59:46.379567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:46.380238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:46.401962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:46.407934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:46.410062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:46.415521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:46.417314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:46.424972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:46.791635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:46.865684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:46.868546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:46.870101 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab7e233c-9721-4357-93a7-5c9eb2b8d5fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.498084 Oct 17 12:59:46.871862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:46.883769 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1256/2554] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:46 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:46.900971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d06a5f65-4322-4d79-acb4-75da2ff81ad8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1363 microversion: 2.1 time: 0.996016 Oct 17 12:59:46.910250 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1299/2555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:45 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1363 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:46.927626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:46.928493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:46.939878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:46.940524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:46.942416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:46.943257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:46.953150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:46.957887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:47.121001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:47.121824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:47.130083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:47.138318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:47.138790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:47.140234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:47.140784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:47.141268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:47.317296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:47.330869 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-32d21548-f51b-4b37-abc6-653840320eed tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.407038 Oct 17 12:59:47.342616 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1257/2556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:46 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:47.579325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:47.597163 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-61a46c7c-c513-4a25-9693-6621a5bba76e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.475987 Oct 17 12:59:47.598017 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1300/2557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:47 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:47.915341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:47.916812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:47.943701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:47.947647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:47.960302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:47.962353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:47.963485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:47.963953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:47.964696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:47.965175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:47.965605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:47.966955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:47.967437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:47.968175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:47.968645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:47.969070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:48.374423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:48.397871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:48.401514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:48.403923 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bde0a8b4-5618-4e44-8b5f-88f33f98d8b6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.492426 Oct 17 12:59:48.421378 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1258/2558] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:47 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:48.433532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-00ea67be-386e-4b00-bd66-89d05c819d00 req-61d7655a-ada2-4df9-aaa8-027d8b4e11b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c5672f-8586-4476-85ec-81ff1d7400d6", "name": "network-vif-plugged", "status": "completed", "tag": "0ce82388-1237-4910-b3bf-0a4abe30dd52"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:48.446506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00ea67be-386e-4b00-bd66-89d05c819d00 req-61d7655a-ada2-4df9-aaa8-027d8b4e11b1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:48.447275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00ea67be-386e-4b00-bd66-89d05c819d00 req-61d7655a-ada2-4df9-aaa8-027d8b4e11b1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:48.447993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00ea67be-386e-4b00-bd66-89d05c819d00 req-61d7655a-ada2-4df9-aaa8-027d8b4e11b1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:48.480918 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-00ea67be-386e-4b00-bd66-89d05c819d00 req-61d7655a-ada2-4df9-aaa8-027d8b4e11b1 service nova] Creating event network-vif-plugged:0ce82388-1237-4910-b3bf-0a4abe30dd52 for instance e6c5672f-8586-4476-85ec-81ff1d7400d6 on n-h2-853316-12 Oct 17 12:59:48.513621 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-00ea67be-386e-4b00-bd66-89d05c819d00 req-61d7655a-ada2-4df9-aaa8-027d8b4e11b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089973 Oct 17 12:59:48.515111 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1259/2559] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:48.544403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:48.567694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:48.569134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:48.573513 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90ccf33c-0f87-4827-942c-05ec6ee95242 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1363 microversion: 2.1 time: 0.646342 Oct 17 12:59:48.578641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:48.579470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:48.580070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:48.581067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:48.581815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:48.582449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:48.595220 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1301/2560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:47 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1363 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:48.624393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:48.625009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:48.641685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:48.643247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:48.643859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:48.645002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:48.646103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:48.646572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:49.068539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:49.097714 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aa98d680-a5b5-49ed-b083-70d3d85e958d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.477080 Oct 17 12:59:49.102833 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1302/2561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:48 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:49.344372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:49.353146 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8750d2f-a23e-47b2-a088-38536732df11 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1503 microversion: 2.1 time: 0.819732 Oct 17 12:59:49.356506 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1260/2562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:48 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1503 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:49.438773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:49.440625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:49.450912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:49.451847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:49.452543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:49.453497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:49.454470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:49.455174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:49.485601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:49.607732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:49.608745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:49.624539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:49.625164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:49.625703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:49.626545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:49.627104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:49.627630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:49.937439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:49.954503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:49.956117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:49.957415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4c710b9e-b3e8-4494-97be-5bc93f66489b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.527252 Oct 17 12:59:49.967194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1303/2563] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:49 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:50.023220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:50.031681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:50.039286 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-374c57c7-3c90-4ab5-b04e-b260de0b237f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1363 microversion: 2.1 time: 0.442143 Oct 17 12:59:50.041420 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1261/2564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:49 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1363 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:59:50.132239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:50.133552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:50.142834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:50.144149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:50.144929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:50.146836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:50.148151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:50.148743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:50.380473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:50.381066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:50.397800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:50.398324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:50.398767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:50.399477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:50.399931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:50.401096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:50.537128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:50.595937 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f5d1187f-0bec-45dc-ac9f-5320923da6bf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.462261 Oct 17 12:59:50.601699 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1304/2565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:50 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:50.895956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:50.920621 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93eb6506-6999-4a32-a1b6-b16461a3762d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1478 microversion: 2.1 time: 0.544309 Oct 17 12:59:50.927167 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1262/2566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:50 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1478 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:50.951258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1111e872-5f0f-4e07-aab5-e78cb3955718 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '.version_select at 0x7fa8251bd820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:50.956792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1111e872-5f0f-4e07-aab5-e78cb3955718 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:50.957542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1111e872-5f0f-4e07-aab5-e78cb3955718 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:50.958341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1111e872-5f0f-4e07-aab5-e78cb3955718 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:50.983432 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1111e872-5f0f-4e07-aab5-e78cb3955718 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 790 microversion: 2.1 time: 0.036753 Oct 17 12:59:50.999780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:51.000406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:51.014015 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1305/2567] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 12:59:50 2022] GET /compute/v2.1/os-migrations => generated 790 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:51.021585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:51.023053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:51.023671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:51.024502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:51.027448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:51.030647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:51.034244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:51.036203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:51.045823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:51.047092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:51.047544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:51.048258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:51.048711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:51.049141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:51.588652 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ccebe35-e3e4-497f-be59-1b23a1736579 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1631 microversion: 2.1 time: 0.573336 Oct 17 12:59:51.594335 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1306/2568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:51 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1631 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:51.602600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:51.604897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:51.620097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:51.625107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:51.625814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:51.630906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:51.636401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:51.637154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:51.645833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:51.658462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:51.662844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:51.664899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-025978a4-7e7c-4aae-97fe-c66122357804 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.683122 Oct 17 12:59:51.666786 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1263/2569] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:50 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:51.683371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8eedfc10-e0f5-4f62-bcf0-5da46bb4666a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Action: 'create', calling method: .version_select at 0x7fa82054bf70>, body: {"keypair": {"name": "tempest-keypair-701747243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd5RRWMd0E5c9GAfTFrZko3XzB5EER9VMQuwidyeOJ5+WZMSg4zt4dBu7Eo/OUtyXNJx6aOir5HaphKfZAoSEHBV5lM2fUnd5ziiZYuI5SDPOxBMupDZb1WmQQZHOYszg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:51.736322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:51.761815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-8eedfc10-e0f5-4f62-bcf0-5da46bb4666a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for project 6c6509294f164045968c57ff20d25d18. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:59:51.783197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-8eedfc10-e0f5-4f62-bcf0-5da46bb4666a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for user bd6001af2bfe4fe881afcaaf6cca9962 and project 6c6509294f164045968c57ff20d25d18. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:59:51.862884 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8eedfc10-e0f5-4f62-bcf0-5da46bb4666a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194505 Oct 17 12:59:51.864943 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1264/2570] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 12:59:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:51.873319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:51.874620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:51.909254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:51.910721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:51.912518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:51.913567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:51.914291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:51.916442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:52.473225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:52.482677 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5c176cef-8790-49f4-b602-c51bc0d8cb49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1549 microversion: 2.1 time: 0.886829 Oct 17 12:59:52.495034 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1307/2571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:51 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1549 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:52.510147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:52.510881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:52.520391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:52.525751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:52.527275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:52.527275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:52.531449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:52.532021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:52.707860 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c019eb91-a465-4152-85ba-0b8318091cd1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.202150 Oct 17 12:59:52.708455 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1308/2572] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 12:59:52 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 12:59:52.719652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:52.720335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:52.730471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:52.732130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:52.734825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:52.736254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:52.737426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:52.738961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:52.813801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:52.837085 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be1a620c-6e4f-4219-a70f-ec9cdbdaa7f4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.970828 Oct 17 12:59:52.839544 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1265/2573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:51 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:53.197101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:53.209886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:53.224883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:53.242054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40e9a0a9-9169-4958-b11c-a8efbbb70c5a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.519090 Oct 17 12:59:53.248072 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1309/2574] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:52 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:53.865416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:53.866953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:53.877526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:53.878385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:53.879023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:53.880212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:53.880880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:53.881505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:54.273720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:54.274374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:54.281694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:54.287091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:54.287549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:54.288302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:54.288773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:54.289208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:54.671159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:54.687641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:54.689195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:54.690749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a1ac44a2-be61-4450-8813-80e48e996b58 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.421707 Oct 17 12:59:54.691538 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1310/2575] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:54 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:55.033006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:55.053105 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7af799d-fdd2-4d53-8f90-d911ebed8700 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 1.191684 Oct 17 12:59:55.055106 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1266/2576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:53 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:55.733086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:55.736310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:55.759056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:55.760226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:55.760779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:55.761719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:55.762544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:55.763883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:56.078959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:56.080469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:56.088888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:56.089743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:56.090609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:56.091843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:56.092818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:56.093481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:56.310929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:56.341189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:56.359678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:56.363601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78d8ae19-709e-4c82-b5fc-e6fd8d32780a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.646181 Oct 17 12:59:56.377398 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1311/2577] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:55 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:56.626997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:56.648136 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bba565a6-af90-45a0-9c56-df85ad431b7f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.572781 Oct 17 12:59:56.657890 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1267/2578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:56 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 12:59:57.395023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:57.396386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:57.408713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 12:59:57.410504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:57.412851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:57.414893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:57.416981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:57.422482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:57.423290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:57.643352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f0292e33-2766-4047-9e29-ead1fbe6824f req-fef7a389-c0c4-49ab-8c1d-3c7d73717df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c5672f-8586-4476-85ec-81ff1d7400d6", "tag": "0ce82388-1237-4910-b3bf-0a4abe30dd52"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:57.663941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f0292e33-2766-4047-9e29-ead1fbe6824f req-fef7a389-c0c4-49ab-8c1d-3c7d73717df5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:57.664609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f0292e33-2766-4047-9e29-ead1fbe6824f req-fef7a389-c0c4-49ab-8c1d-3c7d73717df5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:57.667720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f0292e33-2766-4047-9e29-ead1fbe6824f req-fef7a389-c0c4-49ab-8c1d-3c7d73717df5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:57.688445 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f0292e33-2766-4047-9e29-ead1fbe6824f req-fef7a389-c0c4-49ab-8c1d-3c7d73717df5 service nova] Creating event network-changed:0ce82388-1237-4910-b3bf-0a4abe30dd52 for instance e6c5672f-8586-4476-85ec-81ff1d7400d6 on n-h2-853316-12 Oct 17 12:59:57.711935 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f0292e33-2766-4047-9e29-ead1fbe6824f req-fef7a389-c0c4-49ab-8c1d-3c7d73717df5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314396 Oct 17 12:59:57.713775 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1268/2579] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 12:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 12:59:57.719226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1406224641", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "5ab5fe2b-3424-46bb-bd5e-c78cc4ccf633"}], "security_groups": [{"name": "tempest-securitygroup--1262508778"}], "key_name": "tempest-keypair-701747243", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 12:59:58.124529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:58.140264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:58.145436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:58.149130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6efd21c9-6c87-4a71-ac16-475b8e2ef96c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.757941 Oct 17 12:59:58.162574 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1312/2580] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:57 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 12:59:58.174016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:58.174910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:58.182426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:58.184024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:58.185169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:58.187125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:58.187961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:58.189821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:58.234729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] validate_networks() for [('5ab5fe2b-3424-46bb-bd5e-c78cc4ccf633', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 12:59:59.217222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:59.239375 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-938aea3a-ed74-4fea-bd7d-f98d0c47a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 1.069564 Oct 17 12:59:59.250884 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1313/2581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:58 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 12:59:59.256616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:59.257241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:59.269632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:59.270148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:59.270654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:59.272857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:59.276063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:59.276755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:59.291252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 12:59:59.291972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 12:59:59.292813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 12:59:59.293824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 12:59:59.294434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 12:59:59.311816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:59.315342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:59.316026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:59.316882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 12:59:59.318309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 12:59:59.320929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 12:59:59.367423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for project 6c6509294f164045968c57ff20d25d18. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 12:59:59.378103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for user bd6001af2bfe4fe881afcaaf6cca9962 and project 6c6509294f164045968c57ff20d25d18. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 12:59:59.411034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 12:59:59.416755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 12:59:59.520721 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09c4e160-66ae-40b6-b5be-2ab0afcaf174 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.805462 Oct 17 12:59:59.521904 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1269/2582] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 12:59:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 12:59:59.533733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-22d6f0ec-a331-470f-b081-7c1acc9b7477 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 12:59:59.534836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-22d6f0ec-a331-470f-b081-7c1acc9b7477 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 12:59:59.745940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-22d6f0ec-a331-470f-b081-7c1acc9b7477 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 12:59:59.754304 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-22d6f0ec-a331-470f-b081-7c1acc9b7477 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1234 microversion: 2.1 time: 0.224599 Oct 17 12:59:59.759672 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1270/2583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 12:59:59 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1234 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:00.269905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:00.270564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:00.280936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:00.282048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:00.282765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:00.283641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:00.284377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:00.284965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:00.428983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:00.454075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:00.462368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:00.466278 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3be2f3d9-c8be-46c9-b41a-22a144114aed tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 1.214127 Oct 17 13:00:00.472984 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1314/2584] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 12:59:59 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:00.715445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:00.733458 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34e11ea7-284f-4e1d-b54d-dde034b9a7b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.467404 Oct 17 13:00:00.737312 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1271/2585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:00 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:00.786955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:00.787574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:00.795998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:00.796495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:00.796929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:00.797628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:00.798080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:00.798542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:01.016792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:01.028212 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a5a9d41-b8f3-43f0-9011-212c3ec6ce8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1286 microversion: 2.1 time: 0.248114 Oct 17 13:00:01.028796 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1315/2586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:00 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1286 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:01.502934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:01.504048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:01.516754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:01.518147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:01.519080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:01.519981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:01.520726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:01.523020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:01.760736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:01.761355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:01.770601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:01.771100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:01.771539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:01.772246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:01.772702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:01.773132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:02.135997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:02.148036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:02.150691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:02.156247 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9d593e1c-db68-4681-8506-d00c9555f549 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.659363 Oct 17 13:00:02.158267 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1272/2587] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:01 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:02.164007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:02.165360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:02.179128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:02.181628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:02.182504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:02.183426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:02.184084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:02.184864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:02.288409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:02.331641 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49da9a58-b03b-4317-96e4-d0317999e01c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1498 microversion: 2.1 time: 0.574838 Oct 17 13:00:02.332273 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1316/2588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:01 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1498 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:02.459951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:02.477084 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f425769f-c10f-4402-b90d-7f06b2a1196e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1292 microversion: 2.1 time: 0.316209 Oct 17 13:00:02.495900 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1273/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:02 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1292 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:03.193594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:03.194359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:03.215708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:03.222495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:03.223099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:03.224120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:03.224806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:03.231393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:03.362195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:03.363417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:03.376928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:03.378940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:03.379655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:03.381107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:03.381971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:03.382963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:03.759831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:03.776570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:03.782952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:03.784332 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9820ac57-8708-417e-8ea1-5f41ab887c09 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.596457 Oct 17 13:00:03.787163 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1317/2590] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:03 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:03.803016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:03.803914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:03.812854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:03.816167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:03.817049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:03.818117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:03.820040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:03.820759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:03.967268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:03.976133 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b302cb5a-7902-4565-901d-dbf41a79a9bb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1292 microversion: 2.1 time: 0.187685 Oct 17 13:00:03.996339 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1318/2591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:03 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:04.817760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:04.818563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:04.833638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:04.834631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:04.835327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:04.836291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:04.836975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:04.838488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:05.144979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:05.172945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:05.182277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:05.183692 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-39bfb361-3489-40e7-af6a-f158c2162e78 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.370600 Oct 17 13:00:05.187089 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1319/2592] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:04 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:00:05.207580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:05.208896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:05.234583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:05.236026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:05.236757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:05.237362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:05.238438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:05.239506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:05.240404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:05.249967 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf1dbc65-0906-4a68-8186-4d3a604b7299 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 200 len: 1475 microversion: 2.1 time: 1.897360 Oct 17 13:00:05.254056 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1274/2593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:03 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 1475 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:05.279964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1758253938"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:05.282748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:05.298889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:05.299732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:05.302109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:05.304282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:05.307841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:05.309901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:05.689908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:05.693506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:05.702703 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31d68f8a-a556-4537-b07d-609c3220538c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.513597 Oct 17 13:00:05.703290 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1320/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:05 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:05.816107 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c36c501b-103f-4dfa-992f-e85fb5880349 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64/action" status: 202 len: 0 microversion: 2.1 time: 0.541903 Oct 17 13:00:05.825290 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1275/2595] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:00:05 2022] POST /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:00:05.833257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7395fd61-fb6b-4872-9bfe-deafa17578df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820e08c10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:05.914635 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7395fd61-fb6b-4872-9bfe-deafa17578df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.089444 Oct 17 13:00:05.915904 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1321/2596] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:05 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:06.220236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:06.220873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:06.236275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:06.236907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:06.238991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:06.239771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:06.240245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:06.240686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:06.731582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:06.733686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:06.745691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:06.746547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:06.747835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:06.749347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:06.750211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:06.750854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:07.030207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:07.045217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:07.047203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:07.051026 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab512981-6df9-4e06-85bf-4eb4b6154a59 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.835794 Oct 17 13:00:07.055508 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1276/2597] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:06 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:00:07.071904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aabd8eb5-58ac-40e0-b265-373f8882087d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820c43160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:07.148523 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aabd8eb5-58ac-40e0-b265-373f8882087d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.091650 Oct 17 13:00:07.157314 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1277/2598] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:07 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:07.249429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:07.269937 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-54d30c67-ed98-402b-abf4-5261be659d10 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.545789 Oct 17 13:00:07.270942 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1322/2599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:06 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:07.979432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-33b760d4-7ee4-478b-98ee-f29ea0aba339 req-3566cf3a-9e04-432e-a253-8cd234b6fb5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651ae713-e756-4012-8bc9-34d9ac55544d", "tag": "d761a4e4-c380-4593-b615-9914264ed85f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:08.014856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-33b760d4-7ee4-478b-98ee-f29ea0aba339 req-3566cf3a-9e04-432e-a253-8cd234b6fb5e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:08.016100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-33b760d4-7ee4-478b-98ee-f29ea0aba339 req-3566cf3a-9e04-432e-a253-8cd234b6fb5e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:08.016798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-33b760d4-7ee4-478b-98ee-f29ea0aba339 req-3566cf3a-9e04-432e-a253-8cd234b6fb5e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:08.036439 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-33b760d4-7ee4-478b-98ee-f29ea0aba339 req-3566cf3a-9e04-432e-a253-8cd234b6fb5e service nova] Creating event network-changed:d761a4e4-c380-4593-b615-9914264ed85f for instance 651ae713-e756-4012-8bc9-34d9ac55544d on n-h2-853316-12 Oct 17 13:00:08.044332 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-33b760d4-7ee4-478b-98ee-f29ea0aba339 req-3566cf3a-9e04-432e-a253-8cd234b6fb5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076679 Oct 17 13:00:08.045597 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1278/2600] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:08.084691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:08.085700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:08.094311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:08.095446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:08.096096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:08.097051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:08.097726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:08.098425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:08.166883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04b6b8d4-f39c-4447-897c-53cbb4f92aa7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82508f8b0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:08.281449 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04b6b8d4-f39c-4447-897c-53cbb4f92aa7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.121099 Oct 17 13:00:08.286460 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1279/2601] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:08 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:08.301689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:08.302792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:08.312899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:08.313611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:08.314280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:08.316088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:08.317020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:08.317615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:08.874059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:08.885281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:08.893698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:08.895255 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-772dc904-b7d5-475a-b157-d2a5855d385f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.815523 Oct 17 13:00:08.896646 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1323/2602] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:08 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:09.276145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:09.284512 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3cd09b08-0cc3-4a38-a1d7-6fbdf6c59afd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.991020 Oct 17 13:00:09.286481 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1280/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:08 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:09.302843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-79705ac3-acfc-465e-bb6c-70a908e47b25 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d3b5e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:09.396748 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-79705ac3-acfc-465e-bb6c-70a908e47b25 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.099021 Oct 17 13:00:09.406344 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1324/2604] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:09 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:09.924789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:09.926182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:09.928835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:09.930402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:09.946145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:09.947876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:09.948606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:09.949585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:09.950287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:09.950944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:10.318094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:10.319456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:10.328440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:10.329297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:10.329926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:10.331250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:10.332086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:10.333002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:10.503358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:10.526007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:10.531993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:10.533232 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-00ff3f94-fbb5-48bd-bcd6-091176cd7454 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.613273 Oct 17 13:00:10.538651 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1281/2605] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:09 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:10.544149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5cf871f1-dcc3-4419-b655-cde81f2850d8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820a61790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:10.624380 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5cf871f1-dcc3-4419-b655-cde81f2850d8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.084287 Oct 17 13:00:10.624976 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1282/2606] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:10 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:10.977017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:10.988915 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dae39793-b41f-40a1-bae4-7042532adc2b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.681052 Oct 17 13:00:10.995172 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1325/2607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:10 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:11.563943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:11.564828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:11.590364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:11.593663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:11.600740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:11.601923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:11.605429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:11.611819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:11.641856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-380ed49d-9b7f-4bf1-bd94-b65a443b9601 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82140bd30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:11.719064 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-380ed49d-9b7f-4bf1-bd94-b65a443b9601 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.083053 Oct 17 13:00:11.720834 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1326/2608] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:11 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:11.816066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-69ca573d-f12a-430a-9b96-d6d5a8f71911 req-a341c8e4-5487-427a-b613-0e22a5b7968b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-plugged", "status": "completed", "tag": "3e96ea21-21b0-4e46-aee5-240154bd8bd8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:11.850826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-69ca573d-f12a-430a-9b96-d6d5a8f71911 req-a341c8e4-5487-427a-b613-0e22a5b7968b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:11.854089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-69ca573d-f12a-430a-9b96-d6d5a8f71911 req-a341c8e4-5487-427a-b613-0e22a5b7968b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:11.855748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-69ca573d-f12a-430a-9b96-d6d5a8f71911 req-a341c8e4-5487-427a-b613-0e22a5b7968b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:11.894997 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-69ca573d-f12a-430a-9b96-d6d5a8f71911 req-a341c8e4-5487-427a-b613-0e22a5b7968b service nova] Creating event network-vif-plugged:3e96ea21-21b0-4e46-aee5-240154bd8bd8 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:00:11.908155 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-69ca573d-f12a-430a-9b96-d6d5a8f71911 req-a341c8e4-5487-427a-b613-0e22a5b7968b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095811 Oct 17 13:00:11.910189 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1327/2609] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:12.019462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:12.020162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:12.030810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:12.033324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:12.033945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:12.034874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:12.037332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:12.037950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:12.251836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:12.268866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:12.277013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:12.278581 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ca86bdb-de52-46ec-af30-6932eb143cef tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.718635 Oct 17 13:00:12.283791 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1283/2610] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:11 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:12.354683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:12.374146 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-41545573-9d02-44fe-add0-4ea51aeb3845 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.358799 Oct 17 13:00:12.375396 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1328/2611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:12 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:12.740420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba0b42e0-334d-4460-b653-8d64b7acc4a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820a610d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:12.848807 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba0b42e0-334d-4460-b653-8d64b7acc4a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.116250 Oct 17 13:00:12.849963 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1284/2612] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:12 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:13.316150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:13.316815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:13.334251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:13.334875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:13.335312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:13.336022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:13.336474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:13.337007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:13.401508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:13.402143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:13.420967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:13.421476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:13.421925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:13.429757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:13.430295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:13.434261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:13.449085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:14.010341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:14.026122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:14.031637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:14.038383 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5fb3f006-df08-4d0d-8986-caa66ad1cc8f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.726460 Oct 17 13:00:14.067617 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1329/2613] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:13 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:00:14.075240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06988058-b76f-4bf1-88fd-2a0fd9bb2fac tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d0e310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:14.148017 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-06988058-b76f-4bf1-88fd-2a0fd9bb2fac tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.078676 Oct 17 13:00:14.151829 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1330/2614] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:14 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:14.157487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-44b7c666-c475-43ba-939d-048c606abd41 req-11f09347-f802-466e-bf84-61a3c571c8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-plugged", "status": "completed", "tag": "84c9f90b-5ab0-4503-ab48-950d99bd18d1"}, {"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-plugged", "status": "completed", "tag": "549f3f80-1e4f-4580-9a65-68ec0e85d947"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:14.171538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-44b7c666-c475-43ba-939d-048c606abd41 req-11f09347-f802-466e-bf84-61a3c571c8ad service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:14.172337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-44b7c666-c475-43ba-939d-048c606abd41 req-11f09347-f802-466e-bf84-61a3c571c8ad service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:14.173192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-44b7c666-c475-43ba-939d-048c606abd41 req-11f09347-f802-466e-bf84-61a3c571c8ad service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:14.188446 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-44b7c666-c475-43ba-939d-048c606abd41 req-11f09347-f802-466e-bf84-61a3c571c8ad service nova] Creating event network-vif-plugged:84c9f90b-5ab0-4503-ab48-950d99bd18d1 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:00:14.188945 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-44b7c666-c475-43ba-939d-048c606abd41 req-11f09347-f802-466e-bf84-61a3c571c8ad service nova] Creating event network-vif-plugged:549f3f80-1e4f-4580-9a65-68ec0e85d947 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:00:14.199629 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-44b7c666-c475-43ba-939d-048c606abd41 req-11f09347-f802-466e-bf84-61a3c571c8ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046209 Oct 17 13:00:14.200441 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1331/2615] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:14.348519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:14.361354 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52730a05-980e-463f-8c5d-7ce8eb7cae3b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.961064 Oct 17 13:00:14.363856 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1285/2616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:13 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:14.990174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1752955-9182-4910-88fb-6da9b9e4302a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Action: 'create', calling method: .version_select at 0x7fa820dd31f0>, body: {"keypair": {"name": "tempest-keypair-1209851031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj827ZNPtWQeJyxEyf8z2kjeUzscFo0tNGDGoU5euSx0or6aIElMXkHIc67kJHBmRj6SBsdSFyqIHSPQihQilW4O1LR1eIk1RDGuLBooWIf9WbQeqkPiA5rSKAWYtwqDA=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:15.021065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d1752955-9182-4910-88fb-6da9b9e4302a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Getting quotas for project 1b99cb2247534fafa72b854244f7d088. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:00:15.036150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d1752955-9182-4910-88fb-6da9b9e4302a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Getting quotas for user ca5d4216b6e942ada4f9ba5135541a80 and project 1b99cb2247534fafa72b854244f7d088. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:00:15.070642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:15.072898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:15.081986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:15.082833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:15.083672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:15.085386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:15.087518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:15.088359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:15.112062 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1752955-9182-4910-88fb-6da9b9e4302a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.604596 Oct 17 13:00:15.112700 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1332/2617] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:00:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:15.165357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff72eb29-1934-4983-966c-88e37f60817c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82086d790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:15.232842 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff72eb29-1934-4983-966c-88e37f60817c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.071629 Oct 17 13:00:15.233730 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1333/2618] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:15 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:15.390552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:15.391674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:15.407021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:15.409657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:15.411164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:15.413766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:15.417094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:15.421612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:15.883284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:15.905604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:15.909821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:15.915497 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1d8ee98-f701-4c32-9cc9-91b61ba37ebd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.850697 Oct 17 13:00:15.917762 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1286/2619] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:15 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:15.937859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:15.947230 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-33172c8b-08ae-4cc3-bb25-fa014e267679 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.563856 Oct 17 13:00:15.954687 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1334/2620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:15 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:16.142061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1315140062", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "ed7274e4-7f65-4ca3-9605-a8adc6fbcbdc"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:16.223643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] validate_networks() for [('ed7274e4-7f65-4ca3-9605-a8adc6fbcbdc', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:00:16.249853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-167618d9-4360-4f09-a012-9fb3e13beabf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d0e430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:16.323937 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-167618d9-4360-4f09-a012-9fb3e13beabf tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.078745 Oct 17 13:00:16.333400 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1335/2621] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:16 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:16.339452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-977e6be6-c4b7-408c-80c4-3beb188dc3df req-5e887c68-6333-4316-813a-3dc35ccc94ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-plugged", "status": "completed", "tag": "0e3b2a77-e188-4c79-8863-df8a35716569"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:16.350782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-977e6be6-c4b7-408c-80c4-3beb188dc3df req-5e887c68-6333-4316-813a-3dc35ccc94ff service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:16.351568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-977e6be6-c4b7-408c-80c4-3beb188dc3df req-5e887c68-6333-4316-813a-3dc35ccc94ff service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:16.353057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-977e6be6-c4b7-408c-80c4-3beb188dc3df req-5e887c68-6333-4316-813a-3dc35ccc94ff service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:16.366395 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-977e6be6-c4b7-408c-80c4-3beb188dc3df req-5e887c68-6333-4316-813a-3dc35ccc94ff service nova] Creating event network-vif-plugged:0e3b2a77-e188-4c79-8863-df8a35716569 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:00:16.377304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-977e6be6-c4b7-408c-80c4-3beb188dc3df req-5e887c68-6333-4316-813a-3dc35ccc94ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041011 Oct 17 13:00:16.378551 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1336/2622] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:16.947605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:16.948508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:16.963603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:16.964117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:16.964568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:16.965298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:16.965761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:16.966215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:17.568774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:17.599011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:17.620510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:17.626345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58aec824-7c61-40e5-8549-1051bcdc0f8a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.685683 Oct 17 13:00:17.644075 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1337/2623] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:16 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:17.644075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:17.644075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:17.653844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:17.654650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:17.659286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:17.668089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:17.672388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:17.675091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:17.711745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:00:17.717141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:00:17.717989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:00:17.719871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:00:17.721885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:00:17.760809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:17.761424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:17.761957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:17.762962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:17.763629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:17.764264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:17.801150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Getting quotas for project 0f2f3b892f2846fca8da344efe2a5061. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:00:17.820608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Getting quotas for user 047647d05b0d437eb36f95cbc940e96a and project 0f2f3b892f2846fca8da344efe2a5061. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:00:17.866709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:00:17.878958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:00:17.982665 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3b1cb646-3957-432e-8348-af61cf783409 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.959172 Oct 17 13:00:17.984215 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1287/2624] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:00:17.994691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7108c6e8-ab25-43af-aa72-d68557ec9449 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820c43550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:18.013055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:18.025960 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6ba844c-1a16-4f55-a2d4-27bd9fb8d7d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.393963 Oct 17 13:00:18.030978 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1338/2625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:17 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:18.037842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-512923dd-0954-483b-9a80-081b7f41352f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:18.038721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-512923dd-0954-483b-9a80-081b7f41352f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:18.130494 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7108c6e8-ab25-43af-aa72-d68557ec9449 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.144803 Oct 17 13:00:18.131327 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1288/2626] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:17 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:18.164854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-512923dd-0954-483b-9a80-081b7f41352f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:18.175387 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-512923dd-0954-483b-9a80-081b7f41352f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1216 microversion: 2.1 time: 0.143028 Oct 17 13:00:18.194872 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1339/2627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:18 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:18.523605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fa9283bf-95cd-4272-a374-ecaf94aba950 req-b235fee1-90f4-459c-9326-00e1ee523db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-plugged", "status": "completed", "tag": "44c45404-14f1-47d8-ab4c-b3cb9a6bc6e8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:18.556406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fa9283bf-95cd-4272-a374-ecaf94aba950 req-b235fee1-90f4-459c-9326-00e1ee523db0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:18.557340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fa9283bf-95cd-4272-a374-ecaf94aba950 req-b235fee1-90f4-459c-9326-00e1ee523db0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:18.559617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fa9283bf-95cd-4272-a374-ecaf94aba950 req-b235fee1-90f4-459c-9326-00e1ee523db0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:18.613723 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fa9283bf-95cd-4272-a374-ecaf94aba950 req-b235fee1-90f4-459c-9326-00e1ee523db0 service nova] Creating event network-vif-plugged:44c45404-14f1-47d8-ab4c-b3cb9a6bc6e8 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:00:18.631847 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fa9283bf-95cd-4272-a374-ecaf94aba950 req-b235fee1-90f4-459c-9326-00e1ee523db0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112285 Oct 17 13:00:18.635153 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1289/2628] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:18.662359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:18.663404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:18.685684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:18.687903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:18.692466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:18.696526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:18.699209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:18.699676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:19.061150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:19.062384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:19.088139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:19.091999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:19.096093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:19.097120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:19.099461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:19.099606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:19.348965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:19.370624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:19.380264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:19.387147 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec8d4643-e601-482f-aa62-8e9e118674b9 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.723666 Oct 17 13:00:19.387804 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1340/2629] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:18 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:19.403973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c054b9f-db56-4578-b063-83fd86976213 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d0ea60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:19.516799 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5c054b9f-db56-4578-b063-83fd86976213 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.127819 Oct 17 13:00:19.533047 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1341/2630] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:19 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:19.570097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:19.570657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:19.595501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:19.602180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:19.602978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:19.605385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:19.608300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:19.610740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:19.631507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:19.643944 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79517a6d-f987-49da-b41b-09b66789deb0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.588519 Oct 17 13:00:19.648215 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1290/2631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:19 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:19.802817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:19.820749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c2a7d84-82a0-4756-8db6-97ef730b9950 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1212 microversion: 2.1 time: 0.272249 Oct 17 13:00:19.822603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1244120749", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "31731662-881a-480d-95e8-d7e187d81c94"}], "security_groups": [{"name": "tempest-securitygroup--1161571000"}], "key_name": "tempest-keypair-1209851031", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:19.826111 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1342/2632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:19 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1212 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:20.150755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] validate_networks() for [('31731662-881a-480d-95e8-d7e187d81c94', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:00:20.418859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:20.419603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:20.434664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:20.440821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:20.442120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:20.444393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:20.445696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:20.447010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:21.385303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:21.407109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:21.410701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:21.415625 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e59a452-18b4-45f0-97a6-14d4180085f6 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 1.000275 Oct 17 13:00:21.417261 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1343/2633] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:20 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:21.431419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-95bddf1c-ec75-4a61-91ad-ce10cac58ee1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d488b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:21.533618 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-95bddf1c-ec75-4a61-91ad-ce10cac58ee1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.114811 Oct 17 13:00:21.534835 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1344/2634] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:21 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:21.551137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:21.552318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:21.573135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:21.574255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:21.575001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:21.576819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:21.577858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:21.578950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:22.373401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:00:22.373947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:00:22.384490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:00:22.385467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:00:22.386135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:00:22.394672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:22.407667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:22.409773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:22.412484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:22.413767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:22.414959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:22.416807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:22.478012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Getting quotas for project 1b99cb2247534fafa72b854244f7d088. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:00:22.493954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Getting quotas for user ca5d4216b6e942ada4f9ba5135541a80 and project 1b99cb2247534fafa72b854244f7d088. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:00:22.530518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:00:22.537196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:00:22.661406 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f87c272d-a2d2-4d0d-ba33-c582a9db32ce tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.848319 Oct 17 13:00:22.669132 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1291/2635] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:00:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:00:22.674823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:22.681631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:22.695933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:22.700007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:22.700907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:22.707393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:22.708186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:22.709078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:22.886777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:22.896281 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f857447c-0463-4a84-91a2-c9bf40aafcf5 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1274 microversion: 2.1 time: 0.225304 Oct 17 13:00:22.903167 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1292/2636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:22 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1274 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:22.911756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-32542549-5f8e-48d3-9fb7-a0555fcf11db req-4ef80219-61d6-4bd4-9d1a-c3c5a82830f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-plugged", "status": "completed", "tag": "b965e48b-1ec7-4ed6-9c05-9c0ab419272f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:22.956107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32542549-5f8e-48d3-9fb7-a0555fcf11db req-4ef80219-61d6-4bd4-9d1a-c3c5a82830f1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:22.957902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32542549-5f8e-48d3-9fb7-a0555fcf11db req-4ef80219-61d6-4bd4-9d1a-c3c5a82830f1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:22.958629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32542549-5f8e-48d3-9fb7-a0555fcf11db req-4ef80219-61d6-4bd4-9d1a-c3c5a82830f1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:22.991816 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-32542549-5f8e-48d3-9fb7-a0555fcf11db req-4ef80219-61d6-4bd4-9d1a-c3c5a82830f1 service nova] Creating event network-vif-plugged:b965e48b-1ec7-4ed6-9c05-9c0ab419272f for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:00:23.002708 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-32542549-5f8e-48d3-9fb7-a0555fcf11db req-4ef80219-61d6-4bd4-9d1a-c3c5a82830f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097316 Oct 17 13:00:23.004835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1293/2637] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:23.015045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:23.022356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:23.033454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:23.037472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:23.038187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:23.039170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:23.042156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:23.042899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:23.141120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:23.154845 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a7f9d5ef-1e63-4459-975a-cfcf2d92d24c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 1.614408 Oct 17 13:00:23.157016 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1345/2638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:21 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:23.172823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97f32de7-2385-4b46-90e7-3544129a0f96 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251de4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:23.257345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97f32de7-2385-4b46-90e7-3544129a0f96 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.097693 Oct 17 13:00:23.257933 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1346/2639] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:23 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:23.263260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9250f176-9f00-4b49-afa2-7d3ec2d156e8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:23.280111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9250f176-9f00-4b49-afa2-7d3ec2d156e8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:23.400831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:23.423872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:23.442568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:23.452050 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb33557c-71d5-4ff7-8e8a-9cf2cdbfaad2 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.439747 Oct 17 13:00:23.462194 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1294/2640] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:23 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:23.531291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9250f176-9f00-4b49-afa2-7d3ec2d156e8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:23.554893 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9250f176-9f00-4b49-afa2-7d3ec2d156e8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1242 microversion: 2.1 time: 0.286027 Oct 17 13:00:23.562624 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1347/2641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:23 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1242 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:23.942746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:23.944689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:24.032818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:24.036014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:24.038643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:24.043286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:24.044523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:24.047249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:24.195217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:24.196680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:24.217244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:24.220750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:24.224003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:24.228029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:24.233480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:24.238544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:24.507807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:24.534318 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4a2d76f2-a188-497b-b219-e52a842c18e0 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 0.586935 Oct 17 13:00:24.535691 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1295/2642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:23 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:24.542077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dd847984-203b-43c0-a23e-8066025e4967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820b49ca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:24.640604 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dd847984-203b-43c0-a23e-8066025e4967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.103460 Oct 17 13:00:24.649132 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1296/2643] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:24 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:24.649132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:24.649132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:24.656304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:24.656953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:24.657646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:24.669745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:24.673353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:24.674071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:25.071813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:25.080723 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3c21dd7-fb3a-4489-9475-2b11f9512187 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.892286 Oct 17 13:00:25.105238 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1348/2644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:24 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:25.110366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:25.110998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:25.126010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:25.130034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:25.130612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:25.132671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:25.136301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:25.137291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:25.211136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:25.233600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:25.235134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:25.241646 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7c222db-3ae8-4e75-b3b1-944b47b343b8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 0.593768 Oct 17 13:00:25.243449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1297/2645] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:24 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:25.250331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:25.251031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:25.260106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:25.260818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:25.261753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:25.262783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:25.263447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:25.264655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:25.316262 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-333c1bc2-94aa-4a25-b6d6-f620cc16d735 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/ips" status: 200 len: 146 microversion: 2.1 time: 0.071476 Oct 17 13:00:25.317415 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1298/2646] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:00:25 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/ips => generated 146 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:25.455212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7d8ae256-d8ed-48d0-a4d9-b31b408323fa req-5dbebb69-d116-4e24-8e3c-fcea402d5910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651ae713-e756-4012-8bc9-34d9ac55544d", "name": "network-vif-plugged", "status": "completed", "tag": "d761a4e4-c380-4593-b615-9914264ed85f"}, {"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-plugged", "status": "completed", "tag": "68123dfb-87fd-4618-8ce3-2a67002cb00b"}, {"server_uuid": "918c48fc-3923-40c6-a877-39fd47337f64", "name": "network-vif-plugged", "status": "completed", "tag": "4cf3c20b-f534-4dcd-bc59-97245fdc9f8b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:25.529876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d8ae256-d8ed-48d0-a4d9-b31b408323fa req-5dbebb69-d116-4e24-8e3c-fcea402d5910 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:25.530626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d8ae256-d8ed-48d0-a4d9-b31b408323fa req-5dbebb69-d116-4e24-8e3c-fcea402d5910 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:25.531973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d8ae256-d8ed-48d0-a4d9-b31b408323fa req-5dbebb69-d116-4e24-8e3c-fcea402d5910 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:25.589988 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7d8ae256-d8ed-48d0-a4d9-b31b408323fa req-5dbebb69-d116-4e24-8e3c-fcea402d5910 service nova] Creating event network-vif-plugged:d761a4e4-c380-4593-b615-9914264ed85f for instance 651ae713-e756-4012-8bc9-34d9ac55544d on n-h2-853316-12 Oct 17 13:00:25.590654 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7d8ae256-d8ed-48d0-a4d9-b31b408323fa req-5dbebb69-d116-4e24-8e3c-fcea402d5910 service nova] Creating event network-vif-plugged:68123dfb-87fd-4618-8ce3-2a67002cb00b for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:00:25.591959 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7d8ae256-d8ed-48d0-a4d9-b31b408323fa req-5dbebb69-d116-4e24-8e3c-fcea402d5910 service nova] Creating event network-vif-plugged:4cf3c20b-f534-4dcd-bc59-97245fdc9f8b for instance 918c48fc-3923-40c6-a877-39fd47337f64 on n-h1-853316-12 Oct 17 13:00:25.622012 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7d8ae256-d8ed-48d0-a4d9-b31b408323fa req-5dbebb69-d116-4e24-8e3c-fcea402d5910 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.173687 Oct 17 13:00:25.623319 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1299/2647] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:25.624538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:25.631373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:25.632111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:25.638599 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c873f49d-cb8c-4659-a62b-119321f25f05 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1294 microversion: 2.1 time: 0.542158 Oct 17 13:00:25.642025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:25.642557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:25.643003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:25.643799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:25.644265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:25.644694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:25.650117 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1349/2648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:25 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1294 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:25.692823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dfa9ffe7-2760-442b-9a20-ddaa7c487c5d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820cbe790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:25.809593 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dfa9ffe7-2760-442b-9a20-ddaa7c487c5d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.150699 Oct 17 13:00:25.823914 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1350/2649] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:25 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:26.120845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:26.121628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:26.141177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:26.145131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:26.145739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:26.147479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:26.152716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:26.153714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:26.442354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:26.450755 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-64de6be2-86a2-4722-8498-81c979f7f9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 0.825729 Oct 17 13:00:26.463978 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1300/2650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:25 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:26.467695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:26.470596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:26.481793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:26.482305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:26.482753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:26.483449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:26.483927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:26.484330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:26.912429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:26.942494 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9acaae90-06e9-47de-976d-3a1b648f7bd9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1360 microversion: 2.1 time: 0.823268 Oct 17 13:00:26.945038 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1351/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:26 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1360 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:26.960851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:26.962307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:26.972538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:26.973865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:26.974556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:26.975833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:26.976522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:26.977611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:27.027459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:27.215821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:27.228225 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f78f287-145f-4227-a338-d6fedc0ea0e9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1300 microversion: 2.1 time: 0.280057 Oct 17 13:00:27.231440 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1352/2652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:26 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1300 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:27.236630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f18a5b3-5a7f-4982-b2b0-f67f20b2de98 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d46c10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:27.333028 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f18a5b3-5a7f-4982-b2b0-f67f20b2de98 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.100119 Oct 17 13:00:27.334255 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1353/2653] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:27 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:27.345448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-720ec9eb-a49e-445a-89a0-8c04db1644c0 req-6c5a1ccf-ec5b-4f58-8dcd-f250b40153d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db947939-9d30-45de-a790-d1da3ba82de3", "tag": "b22ae5dd-49b4-47bb-8111-249adf68b999"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:27.356275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-720ec9eb-a49e-445a-89a0-8c04db1644c0 req-6c5a1ccf-ec5b-4f58-8dcd-f250b40153d1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:27.356767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-720ec9eb-a49e-445a-89a0-8c04db1644c0 req-6c5a1ccf-ec5b-4f58-8dcd-f250b40153d1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:27.357395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-720ec9eb-a49e-445a-89a0-8c04db1644c0 req-6c5a1ccf-ec5b-4f58-8dcd-f250b40153d1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:27.370231 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-720ec9eb-a49e-445a-89a0-8c04db1644c0 req-6c5a1ccf-ec5b-4f58-8dcd-f250b40153d1 service nova] Creating event network-changed:b22ae5dd-49b4-47bb-8111-249adf68b999 for instance db947939-9d30-45de-a790-d1da3ba82de3 on n-h1-853316-12 Oct 17 13:00:27.382003 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-720ec9eb-a49e-445a-89a0-8c04db1644c0 req-6c5a1ccf-ec5b-4f58-8dcd-f250b40153d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046207 Oct 17 13:00:27.382922 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1354/2654] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:27.479012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:27.480013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:27.492482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:27.493069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:27.493499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:27.499995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:27.500594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:27.501058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:27.686766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:27.696563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:27.710210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:27.712963 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68193ec6-dfbf-4915-b479-5463ea724dbe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1873 microversion: 2.32 time: 1.249017 Oct 17 13:00:27.714055 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1301/2655] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:26 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1873 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:27.760123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:27.774573 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c346e6e4-8c6b-4c95-9841-9e4185f61e89 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 0.300498 Oct 17 13:00:27.798688 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1355/2656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:27 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:27.968021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:27.968834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:27.976304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:27.981098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:27.981821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:27.983901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:27.985066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:27.986929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:28.255273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:28.256228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:28.268724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:28.274299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:28.275877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:28.276337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:28.280291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:28.280783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:28.281229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:28.479083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:28.493307 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87ff9473-0203-434c-9d32-1d65f3901d24 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1300 microversion: 2.1 time: 0.239321 Oct 17 13:00:28.511540 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1356/2657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:28 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1300 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:28.527039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-414e10d9-1f19-4485-b35e-50445fce1236 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d0e430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:28.638356 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-414e10d9-1f19-4485-b35e-50445fce1236 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.123175 Oct 17 13:00:28.643334 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1357/2658] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:28 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:28.744310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:28.745067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:28.754907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:28.762532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:28.763349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:28.764331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:28.765007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:28.765651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:29.081159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:29.093525 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-76c56782-b490-4f49-9384-0563d4259d49 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1544 microversion: 2.1 time: 1.127438 Oct 17 13:00:29.098531 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1302/2659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:27 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1544 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:29.104238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:29.104867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:29.122204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:29.122703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:29.123262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:29.125437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:29.126118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:29.126747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:29.502844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:29.526210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:29.526210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:29.526210 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5c59c980-c26b-409f-b688-55b0b59b0469 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2826 microversion: 2.32 time: 0.779723 Oct 17 13:00:29.526210 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1358/2660] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:00:28 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2826 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:00:29.531065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:29.533317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:29.548909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:29.552368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:29.553059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:29.553976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:29.556039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:29.556672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:29.675605 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c9b49d4-1561-4604-a27a-e4f45a2663b6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150075 Oct 17 13:00:29.684276 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1359/2661] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:00:29 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:29.684276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:29.684276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:29.703751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:29.704340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:29.704898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:29.705737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:29.706580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:29.714555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:29.877267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:29.901946 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c5f18a1-a45a-4e5e-878c-89949eb3256f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 0.802165 Oct 17 13:00:29.918741 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1303/2662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:29 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:29.935318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fce598d-f1ab-44b9-8b01-f59d7ea34c4a"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:29.940686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:29.954486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:29.955897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:29.957321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:29.958265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:29.963281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:29.963927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:30.435142 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-498dffe8-d45c-4d7d-b1ab-8e7e3f7545d8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513460 Oct 17 13:00:30.442435 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1304/2663] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:00:29 2022] POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:30.447143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:30.447744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:30.467871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:30.468811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:30.469266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:30.469989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:30.482678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:30.483199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:30.499830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:30.527666 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29ab2275-680b-4cb9-978b-5f723b572d42 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.849257 Oct 17 13:00:30.538571 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1360/2664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:29 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:30.549763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9af939a6-62c6-4873-bb51-dacbd1b5e20d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251bdf70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:30.640986 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9af939a6-62c6-4873-bb51-dacbd1b5e20d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.101302 Oct 17 13:00:30.647082 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1361/2665] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:30 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:30.928912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:30.929528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:30.940196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:30.947030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:30.947740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:30.948635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:30.949245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:30.949821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:31.365691 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cb34904d-c1c4-47b3-8799-ab81d3a1a2dd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.928718 Oct 17 13:00:31.366519 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1305/2666] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 13:00:30 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77/os-interface => generated 1832 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:00:31.553243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:31.556484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:31.561792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:31.571428 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-24ed2fcc-7fe5-435e-816c-4a8a8d0d29c3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 0.645679 Oct 17 13:00:31.584294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:31.585653 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1362/2667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:30 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:31.586572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:31.587273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:31.588223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:31.588910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:31.589548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:31.645266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:31.666030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aa328ece-be43-40ea-8eb2-a5248450bf79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820edbd30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:31.745050 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aa328ece-be43-40ea-8eb2-a5248450bf79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.083874 Oct 17 13:00:31.754125 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1363/2668] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:31 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:32.179490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:32.192154 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31e6788f-3438-446a-964a-fed8efa0a625 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.643010 Oct 17 13:00:32.202487 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1306/2669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:31 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:32.612206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:32.612803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:32.626605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:32.627350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:32.627979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:32.628867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:32.629476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:32.630678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:32.639359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8ce423d7-fc33-47eb-9001-f20277e8b640 req-10df0353-3d44-47a1-82a4-e7a938bc0925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b2265a-9332-47d0-aca4-df5bfd6d236a", "tag": "30416dd9-de36-46fc-a524-4b075b1466d1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:32.645689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:32.652538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:32.688478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8ce423d7-fc33-47eb-9001-f20277e8b640 req-10df0353-3d44-47a1-82a4-e7a938bc0925 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:32.688967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8ce423d7-fc33-47eb-9001-f20277e8b640 req-10df0353-3d44-47a1-82a4-e7a938bc0925 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:32.689663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8ce423d7-fc33-47eb-9001-f20277e8b640 req-10df0353-3d44-47a1-82a4-e7a938bc0925 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:32.733196 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8ce423d7-fc33-47eb-9001-f20277e8b640 req-10df0353-3d44-47a1-82a4-e7a938bc0925 service nova] Creating event network-changed:30416dd9-de36-46fc-a524-4b075b1466d1 for instance a9b2265a-9332-47d0-aca4-df5bfd6d236a on n-h2-853316-12 Oct 17 13:00:32.757619 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8ce423d7-fc33-47eb-9001-f20277e8b640 req-10df0353-3d44-47a1-82a4-e7a938bc0925 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121804 Oct 17 13:00:32.762366 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1307/2670] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:00:32.772161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7715f5c2-dcd9-483e-a8df-b998deb8be27 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820c61670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:32.896608 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7715f5c2-dcd9-483e-a8df-b998deb8be27 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.129421 Oct 17 13:00:32.897231 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1308/2671] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:32 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:33.219351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:33.220985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:33.231814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:33.238405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:33.239243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:33.241066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:33.242812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:33.246981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:33.535850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:34.015524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:34.051155 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a90d14c2-8043-48ef-914e-7b8ee10a23d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.836819 Oct 17 13:00:34.052164 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1309/2672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:33 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:34.058495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6bcebdf-7851-45d1-bab5-7f9f0605e0fc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820b5f160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:34.138861 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6bcebdf-7851-45d1-bab5-7f9f0605e0fc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.085192 Oct 17 13:00:34.149431 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1310/2673] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:34 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:34.751864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:34.765309 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c38eaa5-2994-411b-9304-342b70dbb103 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 2.157787 Oct 17 13:00:34.769056 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1364/2674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:32 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:35.077652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:35.079703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:35.092944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:35.100038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:35.100794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:35.101996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:35.102861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:35.103614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:35.157020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7eb90329-a036-42f1-978d-9c6cacd63a0c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251de310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:35.250070 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7eb90329-a036-42f1-978d-9c6cacd63a0c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.096986 Oct 17 13:00:35.266006 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1365/2675] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:35 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:35.793984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:35.794649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:35.820043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:35.822383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:35.826328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:35.840319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:35.841145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:35.841757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:35.964931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:35.979243 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89d7b407-54b1-4adc-8b1b-edcb5edf1d0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.906613 Oct 17 13:00:35.981936 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1311/2676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:35 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:36.267053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-069c6afe-1c9a-4a0d-90e9-5476cc4fa231 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8252bf940>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:36.345491 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-069c6afe-1c9a-4a0d-90e9-5476cc4fa231 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.082600 Oct 17 13:00:36.346083 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1312/2677] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:36 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:36.690196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:36.705295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-421b2dca-5c7f-4117-be04-a1a27648e55f tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 0.916492 Oct 17 13:00:36.709853 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1366/2678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:35 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:36.931805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-1c8e109d-8511-43e6-87bd-f6c980aeb42d req-c4063e3e-c8b8-4bd5-98ba-5632febf2d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651ae713-e756-4012-8bc9-34d9ac55544d", "tag": "d761a4e4-c380-4593-b615-9914264ed85f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:36.966826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1c8e109d-8511-43e6-87bd-f6c980aeb42d req-c4063e3e-c8b8-4bd5-98ba-5632febf2d3c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:36.967818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1c8e109d-8511-43e6-87bd-f6c980aeb42d req-c4063e3e-c8b8-4bd5-98ba-5632febf2d3c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:36.969819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1c8e109d-8511-43e6-87bd-f6c980aeb42d req-c4063e3e-c8b8-4bd5-98ba-5632febf2d3c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:37.007173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:37.008726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:37.017248 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-1c8e109d-8511-43e6-87bd-f6c980aeb42d req-c4063e3e-c8b8-4bd5-98ba-5632febf2d3c service nova] Creating event network-changed:d761a4e4-c380-4593-b615-9914264ed85f for instance 651ae713-e756-4012-8bc9-34d9ac55544d on n-h2-853316-12 Oct 17 13:00:37.022848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:37.029476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:37.035698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:37.036726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:37.039900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:37.042447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:37.042648 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-1c8e109d-8511-43e6-87bd-f6c980aeb42d req-c4063e3e-c8b8-4bd5-98ba-5632febf2d3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115312 Oct 17 13:00:37.049078 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1313/2679] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:37.362928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bfa4565a-ef2e-4598-85e6-e2b5aef0fde9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d97550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:37.459701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:37.476964 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bfa4565a-ef2e-4598-85e6-e2b5aef0fde9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.116905 Oct 17 13:00:37.486389 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1314/2680] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:37 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:37.495355 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4101a865-7e1e-43b0-bf12-80939ab74835 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.489346 Oct 17 13:00:37.497785 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1367/2681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:37 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:37.736153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:37.737315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:37.760468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:37.766141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:37.766932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:37.768013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:37.768646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:37.771462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:38.452592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:38.461934 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8aab7650-8c4c-4db9-bea6-895c672a6dd9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 0.730500 Oct 17 13:00:38.466575 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1315/2682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:37 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:38.495256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d6b12311-c993-4013-a9e0-8f9625a4457a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8207dd670>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:38.525209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:38.526075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:38.536019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:38.540494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:38.541395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:38.542994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:38.546073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:38.553325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:38.593672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d6b12311-c993-4013-a9e0-8f9625a4457a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.103783 Oct 17 13:00:38.605139 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1368/2683] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:38 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:39.129123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:39.163804 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4fd79f71-75f6-4744-9165-89c059ddb25a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.642387 Oct 17 13:00:39.170134 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1316/2684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:38 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:39.247474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4cdc8182-d161-42b4-abf9-5c28722f0e4c req-5e95d473-faaa-4530-9613-92fd78bf585f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db947939-9d30-45de-a790-d1da3ba82de3", "name": "network-vif-plugged", "status": "completed", "tag": "b22ae5dd-49b4-47bb-8111-249adf68b999"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:39.270368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4cdc8182-d161-42b4-abf9-5c28722f0e4c req-5e95d473-faaa-4530-9613-92fd78bf585f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:39.271134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4cdc8182-d161-42b4-abf9-5c28722f0e4c req-5e95d473-faaa-4530-9613-92fd78bf585f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:39.272602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4cdc8182-d161-42b4-abf9-5c28722f0e4c req-5e95d473-faaa-4530-9613-92fd78bf585f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:39.298681 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4cdc8182-d161-42b4-abf9-5c28722f0e4c req-5e95d473-faaa-4530-9613-92fd78bf585f service nova] Creating event network-vif-plugged:b22ae5dd-49b4-47bb-8111-249adf68b999 for instance db947939-9d30-45de-a790-d1da3ba82de3 on n-h1-853316-12 Oct 17 13:00:39.304461 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4cdc8182-d161-42b4-abf9-5c28722f0e4c req-5e95d473-faaa-4530-9613-92fd78bf585f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064180 Oct 17 13:00:39.305991 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1369/2685] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:39.319330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cddc735d-5383-47fe-b22d-3ef939746633 req-48649f8d-b222-4f89-bfa7-d2ef547d1c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "tag": "3e96ea21-21b0-4e46-aee5-240154bd8bd8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:39.377909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cddc735d-5383-47fe-b22d-3ef939746633 req-48649f8d-b222-4f89-bfa7-d2ef547d1c7c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:39.380187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cddc735d-5383-47fe-b22d-3ef939746633 req-48649f8d-b222-4f89-bfa7-d2ef547d1c7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:39.382657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cddc735d-5383-47fe-b22d-3ef939746633 req-48649f8d-b222-4f89-bfa7-d2ef547d1c7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:39.433668 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cddc735d-5383-47fe-b22d-3ef939746633 req-48649f8d-b222-4f89-bfa7-d2ef547d1c7c service nova] Creating event network-changed:3e96ea21-21b0-4e46-aee5-240154bd8bd8 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:00:39.451880 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cddc735d-5383-47fe-b22d-3ef939746633 req-48649f8d-b222-4f89-bfa7-d2ef547d1c7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135885 Oct 17 13:00:39.455489 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1317/2686] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:39.493309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:39.494494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:39.535930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:39.542858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:39.543977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:39.545115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:39.545785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:39.546464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:39.610902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c96ad541-abfc-4f14-b7bb-b8c058c80075 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820502700>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:39.703997 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c96ad541-abfc-4f14-b7bb-b8c058c80075 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.096890 Oct 17 13:00:39.705382 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1318/2687] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:39 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:40.193480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:40.194586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:40.214097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:40.214806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:40.216660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:40.218604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:40.221271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:40.223668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:40.290684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:40.301372 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50c81cf8-c7d0-4897-a522-5ac397299e67 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 0.814345 Oct 17 13:00:40.301958 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1370/2688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:39 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:40.723157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17e09f9d-9ec4-420d-8546-e616d750c8e0 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8212a83a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:40.833815 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-17e09f9d-9ec4-420d-8546-e616d750c8e0 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.115937 Oct 17 13:00:40.846089 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1371/2689] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:40 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:41.246512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:41.260921 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb065b15-8058-435a-a9be-850913208518 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 1.072225 Oct 17 13:00:41.266034 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1319/2690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:40 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:41.327540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:41.329004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:41.340273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:41.340996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:41.344471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:41.345681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:41.346375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:41.346967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:41.859295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-54f04c3d-c2a2-41f7-bcf2-076cf2b2e7f8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8250ab790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:41.954610 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-54f04c3d-c2a2-41f7-bcf2-076cf2b2e7f8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.099289 Oct 17 13:00:41.957371 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1320/2691] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:41 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:42.292950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:42.294494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:42.309010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:42.312012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:42.312648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:42.316112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:42.316833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:42.317436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:42.389352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:42.400080 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c4dd38a-e9ae-432f-a264-4fff268f53a6 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1316 microversion: 2.1 time: 1.076840 Oct 17 13:00:42.400695 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1372/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:41 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1316 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:42.547021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:42.556427 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d5abb49-d42a-4013-b8a4-44b8318b379f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.268716 Oct 17 13:00:42.557329 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1321/2693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:42 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:42.973251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-413b796a-90a7-4c3c-a7ab-7a5c39b451dd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251deee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:43.059474 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-413b796a-90a7-4c3c-a7ab-7a5c39b451dd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.090395 Oct 17 13:00:43.060069 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1373/2694] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:42 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:43.427056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:43.428489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:43.444223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:43.446874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:43.447511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:43.450685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:43.451367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:43.452054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:43.582937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:43.584174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:43.600930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:43.602258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:43.603065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:43.604717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:43.605506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:43.606087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:44.252938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:44.260761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:44.260968 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-28c9ac93-90f9-4398-8a90-0cc79bb60c81 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.654559 Oct 17 13:00:44.260968 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1374/2695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:43 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:44.260968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a57d9280-1809-494b-99aa-694b2941945b req-f78e4acc-555b-46cd-9cc8-a8e2660b858e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b2265a-9332-47d0-aca4-df5bfd6d236a", "name": "network-vif-plugged", "status": "completed", "tag": "30416dd9-de36-46fc-a524-4b075b1466d1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:44.260968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a57d9280-1809-494b-99aa-694b2941945b req-f78e4acc-555b-46cd-9cc8-a8e2660b858e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:44.260968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a57d9280-1809-494b-99aa-694b2941945b req-f78e4acc-555b-46cd-9cc8-a8e2660b858e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:44.260968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a57d9280-1809-494b-99aa-694b2941945b req-f78e4acc-555b-46cd-9cc8-a8e2660b858e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:44.270060 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a57d9280-1809-494b-99aa-694b2941945b req-f78e4acc-555b-46cd-9cc8-a8e2660b858e service nova] Creating event network-vif-plugged:30416dd9-de36-46fc-a524-4b075b1466d1 for instance a9b2265a-9332-47d0-aca4-df5bfd6d236a on n-h2-853316-12 Oct 17 13:00:44.276897 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a57d9280-1809-494b-99aa-694b2941945b req-f78e4acc-555b-46cd-9cc8-a8e2660b858e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040457 Oct 17 13:00:44.277975 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1375/2696] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:44.285025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d831c21c-6713-4b2e-bbb9-569bc868e453 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251de3a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:44.293373 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a721737-bcec-44ba-b2cd-ad77ec603cf3 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1503 microversion: 2.1 time: 0.865467 Oct 17 13:00:44.322486 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1322/2697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:43 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1503 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:44.347019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:44.353852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:44.361179 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d831c21c-6713-4b2e-bbb9-569bc868e453 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.081854 Oct 17 13:00:44.362604 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1376/2698] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:44 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:44.382005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:44.383675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:44.384148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:44.390272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:44.390999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:44.392161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:44.462936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:00:44.641601 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2b7f6182-4bfe-49bc-818b-500dd3dc999d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "DELETE /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 204 len: 0 microversion: 2.1 time: 0.317658 Oct 17 13:00:44.643193 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1323/2699] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:00:44 2022] DELETE /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:00:44.653236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:44.654757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:44.681385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:44.682556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:44.683258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:44.685551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:44.695605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:44.697151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:45.002774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:45.013067 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86882765-3153-404e-9814-ba8e75111f6c tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1509 microversion: 2.1 time: 0.364256 Oct 17 13:00:45.030850 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1377/2700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:44 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:45.268972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:45.270059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:45.287314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:45.287817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:45.288328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:45.289630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:45.290399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:45.291212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:45.387685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c737c5a-574c-46e0-8b17-05cd6659631a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251d4160>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:45.531003 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c737c5a-574c-46e0-8b17-05cd6659631a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1414 microversion: 2.1 time: 0.151622 Oct 17 13:00:45.531762 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1378/2701] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:45 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1414 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:45.603605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:45.623850 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-23090db8-a341-44d0-90d0-0cf5a33f7c54 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1368 microversion: 2.1 time: 0.357328 Oct 17 13:00:45.629555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1324/2702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:45 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:46.045788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:46.046435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:46.062483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:46.062483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:46.062483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:46.062483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:46.062483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:46.072374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:46.343737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:46.354256 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-943d7f40-e2e2-43e5-84ef-98cec52c3187 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1509 microversion: 2.1 time: 0.315240 Oct 17 13:00:46.355939 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1379/2703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:46 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:46.548293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b4b9fc55-75ca-4490-8982-ad4a554592e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820bf9310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:46.656773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:46.657396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:46.660622 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b4b9fc55-75ca-4490-8982-ad4a554592e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1423 microversion: 2.1 time: 0.116159 Oct 17 13:00:46.661432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1325/2704] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:46 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1423 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:46.674382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:46.674776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:46.675218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:46.676726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:46.677364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:46.678557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:46.690473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5338e54c-7c62-4995-9183-22b7222f570a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820c615e0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:46.794356 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5338e54c-7c62-4995-9183-22b7222f570a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 200 len: 1423 microversion: 2.1 time: 0.116642 Oct 17 13:00:46.799409 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1326/2705] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:00:46 2022] GET /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:46.832854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69e9e80d-7356-45a9-bff3-e701fc8aa3e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820bf9310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:47.161022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:47.169538 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bee8f89e-59e0-4400-a6f6-9c047eef2504 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1558 microversion: 2.1 time: 0.518670 Oct 17 13:00:47.172330 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1380/2706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:46 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1558 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:47.197804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:47.198398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:47.206515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:47.207204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:47.207810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:47.208882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:47.209505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:47.210092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:47.245985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:47.462036 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1dfb5e70-62c4-4302-9f76-2e4a48fbb6c9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.268914 Oct 17 13:00:47.463567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1381/2707] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:00:47 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-interface => generated 284 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:47.469353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:47.470283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:47.477454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:47.477957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:47.478501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:47.480182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:47.480840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:47.481455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:47.677753 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69e9e80d-7356-45a9-bff3-e701fc8aa3e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 204 len: 0 microversion: 2.1 time: 0.849003 Oct 17 13:00:47.683942 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1327/2708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:46 2022] DELETE /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:00:47.699150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:47.701999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:47.716644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:47.717413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:47.718101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:47.722302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:47.723396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:47.724010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:47.762441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:00:47.887805 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-20e29e37-37ae-43cc-b2b4-fab7626bafe9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 204 len: 0 microversion: 2.1 time: 0.201439 Oct 17 13:00:47.888419 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1328/2709] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:00:47 2022] DELETE /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:00:48.035815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-365792540", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "76738b67-1f67-4450-8954-529dd7a99e80"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:48.108296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] validate_networks() for [('76738b67-1f67-4450-8954-529dd7a99e80', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:00:48.600449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:48.612676 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-73252a9b-5c6f-4468-8b71-437cf9c99aff tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1509 microversion: 2.1 time: 1.147017 Oct 17 13:00:48.613257 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1382/2710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:47 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1509 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:48.842103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:00:48.842624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:00:48.843320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:00:48.844527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:00:48.845065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:00:48.858542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:48.859202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:48.860184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:48.861356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:48.862420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:48.862994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:48.896344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:00:48.915663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for user 638e5facdbe64d26bf3c4b5c12a33da7 and project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:00:48.932877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:00:48.963871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:00:49.097367 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69a82d39-b6ac-488c-b2bf-97f3fd9e6057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065214 Oct 17 13:00:49.103462 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1329/2711] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:00:49.112724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5561aa43-002a-404b-875e-cddb71a41b42 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:49.113336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5561aa43-002a-404b-875e-cddb71a41b42 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:49.205761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7db649fa-687e-4ec4-a739-ca136c247b29 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:49.213652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7db649fa-687e-4ec4-a739-ca136c247b29 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:49.214222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7db649fa-687e-4ec4-a739-ca136c247b29 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:49.214623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7db649fa-687e-4ec4-a739-ca136c247b29 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:49.268382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7db649fa-687e-4ec4-a739-ca136c247b29 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:00:49.326753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5561aa43-002a-404b-875e-cddb71a41b42 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:49.341560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5561aa43-002a-404b-875e-cddb71a41b42 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1207 microversion: 2.1 time: 0.232384 Oct 17 13:00:49.342871 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1383/2712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:49 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1207 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:49.363093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-edd16951-94e0-4549-9077-7d9a66d2cf2a req-afd9e36a-7ced-4518-aeea-5f392493bbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db947939-9d30-45de-a790-d1da3ba82de3", "name": "network-vif-deleted", "tag": "b22ae5dd-49b4-47bb-8111-249adf68b999"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:49.369453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:49.400857 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7db649fa-687e-4ec4-a739-ca136c247b29 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/action" status: 202 len: 0 microversion: 2.1 time: 0.200911 Oct 17 13:00:49.402999 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1330/2713] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:00:49 2022] POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:00:49.419924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-edd16951-94e0-4549-9077-7d9a66d2cf2a req-afd9e36a-7ced-4518-aeea-5f392493bbf4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:49.421297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-edd16951-94e0-4549-9077-7d9a66d2cf2a req-afd9e36a-7ced-4518-aeea-5f392493bbf4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:49.421997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-edd16951-94e0-4549-9077-7d9a66d2cf2a req-afd9e36a-7ced-4518-aeea-5f392493bbf4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:49.428194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:49.429034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:49.451508 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-edd16951-94e0-4549-9077-7d9a66d2cf2a req-afd9e36a-7ced-4518-aeea-5f392493bbf4 service nova] Creating event network-vif-deleted:b22ae5dd-49b4-47bb-8111-249adf68b999 for instance db947939-9d30-45de-a790-d1da3ba82de3 on n-h1-853316-12 Oct 17 13:00:49.456130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:49.456927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:49.459287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:49.462826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:49.463837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:49.466194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:49.473480 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-edd16951-94e0-4549-9077-7d9a66d2cf2a req-afd9e36a-7ced-4518-aeea-5f392493bbf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126014 Oct 17 13:00:49.476815 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1384/2714] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:49.643936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:49.645662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:49.667574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:49.670764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:49.671308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:49.675684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:49.676546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:49.677199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:49.779241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:49.779787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:49.780322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:49.781282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lazy-loading 'fault' on Instance uuid db947939-9d30-45de-a790-d1da3ba82de3 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:00:49.808165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:49.842084 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e401468-da14-4cab-8014-980867fb4ab8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.433216 Oct 17 13:00:49.845163 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1331/2715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:49 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:49.947110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047647d05b0d437eb36f95cbc940e96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2f3b892f2846fca8da344efe2a5061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:49.964890 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c038863-1db0-4b70-90bb-ea76c4ed9715 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 200 len: 1306 microversion: 2.1 time: 0.324436 Oct 17 13:00:49.968011 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1385/2716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:49 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 1306 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:50.369736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:50.370349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:50.372374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:50.389115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:50.390262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:50.391072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:50.392175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:50.393018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:50.393874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:50.611672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:50.627575 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93bcc098-9b77-4ee6-bbc2-106107cae0e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1259 microversion: 2.1 time: 0.261694 Oct 17 13:00:50.628467 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1332/2717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:50 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:50.868226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:50.868847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:50.875803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:50.876214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:50.876842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:50.877553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:50.878011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:50.878463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:50.996704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:50.998041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:51.010151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.011092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.011863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.012888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.013802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.014625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.040879 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] HTTP exception thrown: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Request method failure captured: Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 HTTP/1.1 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHfU7Bg9FxIZ_vKjxK3HuOjWb3FxHPy4rCuJxAmomx_M8oTOGP52AnYVUt9W1mIKdcI5_UxCrXZwRdGx3A91rvF7NVEiEwotA-bLW7wkThXu-2a12XIp_yxFQkiKLm_loz0QNtL-r8QCzEscOir2_82cBNJOWtKSoe4Tm0CQBXnZj0 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f2f3b892f2846fca8da344efe2a5061", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 047647d05b0d437eb36f95cbc940e96a Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'db947939-9d30-45de-a790-d1da3ba82de3'} Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.043237 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.049947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.049947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.049947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.049947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:00:51.049947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:00:51.049947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.049947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.052768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Returning 404 to user: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:00:51.053945 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d24afe3-c1cc-443d-beea-6a8ef9b26d97 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 404 len: 111 microversion: 2.1 time: 0.066153 Oct 17 13:00:51.055857 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1333/2718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:50 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:00:51.073631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-892345835", "metadata": {"image_type": "test"}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:51.077663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:51.094508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.095954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.096980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.098006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.098975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.099740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.127152 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] HTTP exception thrown: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Request method failure captured: Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3/action HTTP/1.1 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 111 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHfU7Bg9FxIZ_vKjxK3HuOjWb3FxHPy4rCuJxAmomx_M8oTOGP52AnYVUt9W1mIKdcI5_UxCrXZwRdGx3A91rvF7NVEiEwotA-bLW7wkThXu-2a12XIp_yxFQkiKLm_loz0QNtL-r8QCzEscOir2_82cBNJOWtKSoe4Tm0CQBXnZj0 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f2f3b892f2846fca8da344efe2a5061", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 047647d05b0d437eb36f95cbc940e96a Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-892345835", "metadata": {"image_type": "test"}}} Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'db947939-9d30-45de-a790-d1da3ba82de3', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-892345835', 'metadata': {'image_type': 'test'}}}} Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:00:51.130150 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.136954 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.142206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Returning 404 to user: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:00:51.143641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-479154fe-aae3-496f-b0d6-1e1f9f2eb9a1 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "POST /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3/action" status: 404 len: 111 microversion: 2.1 time: 0.081308 Oct 17 13:00:51.144858 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1334/2719] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 17 13:00:51 2022] POST /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:00:51.168463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8a6ce63e-bf56-4574-b05b-40c279eebe9d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-311419142", "metadata": {"image_type": "test"}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:51.174141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8a6ce63e-bf56-4574-b05b-40c279eebe9d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Failed to fetch instance by id tempest-invalid-480874873 {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:00:51.174991 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-8a6ce63e-bf56-4574-b05b-40c279eebe9d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] HTTP exception thrown: Instance tempest-invalid-480874873 could not be found. Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8a6ce63e-bf56-4574-b05b-40c279eebe9d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Request method failure captured: Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/tempest-invalid-480874873/action HTTP/1.1 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 111 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHfU7Bg9FxIZ_vKjxK3HuOjWb3FxHPy4rCuJxAmomx_M8oTOGP52AnYVUt9W1mIKdcI5_UxCrXZwRdGx3A91rvF7NVEiEwotA-bLW7wkThXu-2a12XIp_yxFQkiKLm_loz0QNtL-r8QCzEscOir2_82cBNJOWtKSoe4Tm0CQBXnZj0 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f2f3b892f2846fca8da344efe2a5061", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 047647d05b0d437eb36f95cbc940e96a Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-311419142", "metadata": {"image_type": "test"}}} Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance tempest-invalid-480874873 could not be found. Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'tempest-invalid-480874873', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-311419142', 'metadata': {'image_type': 'test'}}}} Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-480874873 could not be found. Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:00:51.178851 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-480874873 could not be found. Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-480874873 could not be found. Oct 17 13:00:51.185425 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.187703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8a6ce63e-bf56-4574-b05b-40c279eebe9d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Returning 404 to user: Instance tempest-invalid-480874873 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:00:51.191094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8a6ce63e-bf56-4574-b05b-40c279eebe9d tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-480874873/action" status: 404 len: 100 microversion: 2.1 time: 0.025825 Oct 17 13:00:51.192565 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1335/2720] 10.222.0.27 () {60 vars in 1246 bytes} [Mon Oct 17 13:00:51 2022] POST /compute/v2.1/servers/tempest-invalid-480874873/action => generated 100 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:00:51.205272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a96e07f4-fc2d-4b18-9639-de0f981d454b tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1629667571"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:51.212388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a96e07f4-fc2d-4b18-9639-de0f981d454b tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:00:51.217700 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-a96e07f4-fc2d-4b18-9639-de0f981d454b tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a96e07f4-fc2d-4b18-9639-de0f981d454b tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Request method failure captured: Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 57 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHfU7Bg9FxIZ_vKjxK3HuOjWb3FxHPy4rCuJxAmomx_M8oTOGP52AnYVUt9W1mIKdcI5_UxCrXZwRdGx3A91rvF7NVEiEwotA-bLW7wkThXu-2a12XIp_yxFQkiKLm_loz0QNtL-r8QCzEscOir2_82cBNJOWtKSoe4Tm0CQBXnZj0 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f2f3b892f2846fca8da344efe2a5061", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 047647d05b0d437eb36f95cbc940e96a Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: {"createImage": {"name": "tempest-test-snap-1629667571"}} Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1629667571'}}} Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.225105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.228974 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.234313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a96e07f4-fc2d-4b18-9639-de0f981d454b tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:00:51.237460 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a96e07f4-fc2d-4b18-9639-de0f981d454b tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.039064 Oct 17 13:00:51.239896 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1336/2721] 10.222.0.27 () {60 vars in 1275 bytes} [Mon Oct 17 13:00:51 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:00:51.255928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75533146-b3d0-4954-bcc3-2537dd250192 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-806383799"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:51.265343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-75533146-b3d0-4954-bcc3-2537dd250192 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:00:51.267555 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-75533146-b3d0-4954-bcc3-2537dd250192 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75533146-b3d0-4954-bcc3-2537dd250192 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Request method failure captured: Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 56 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHfU7Bg9FxIZ_vKjxK3HuOjWb3FxHPy4rCuJxAmomx_M8oTOGP52AnYVUt9W1mIKdcI5_UxCrXZwRdGx3A91rvF7NVEiEwotA-bLW7wkThXu-2a12XIp_yxFQkiKLm_loz0QNtL-r8QCzEscOir2_82cBNJOWtKSoe4Tm0CQBXnZj0 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f2f3b892f2846fca8da344efe2a5061", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 047647d05b0d437eb36f95cbc940e96a Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: {"createImage": {"name": "tempest-test-snap-806383799"}} Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-806383799'}}} Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.273590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:00:51.277563 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.280395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75533146-b3d0-4954-bcc3-2537dd250192 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:00:51.281588 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75533146-b3d0-4954-bcc3-2537dd250192 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.035574 Oct 17 13:00:51.282874 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1337/2722] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 17 13:00:51 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:00:51.296864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:51.303030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:51.318640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.319518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.321146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.323995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.324663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.325469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.356758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] HTTP exception thrown: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Request method failure captured: Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 HTTP/1.1 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHfU7Bg9FxIZ_vKjxK3HuOjWb3FxHPy4rCuJxAmomx_M8oTOGP52AnYVUt9W1mIKdcI5_UxCrXZwRdGx3A91rvF7NVEiEwotA-bLW7wkThXu-2a12XIp_yxFQkiKLm_loz0QNtL-r8QCzEscOir2_82cBNJOWtKSoe4Tm0CQBXnZj0 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f2f3b892f2846fca8da344efe2a5061", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 047647d05b0d437eb36f95cbc940e96a Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'db947939-9d30-45de-a790-d1da3ba82de3'} Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:00:51.360465 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.364342 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.368004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Returning 404 to user: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:00:51.370572 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0158098c-24b6-4e17-9819-37fba223da55 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "DELETE /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 404 len: 111 microversion: 2.1 time: 0.082544 Oct 17 13:00:51.373666 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1338/2723] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:00:51 2022] DELETE /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:00:51.381993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:51.386483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] [instance: db947939-9d30-45de-a790-d1da3ba82de3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:51.405135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.407180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.407180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.409833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.416856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.417351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.456367 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] HTTP exception thrown: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Request method failure captured: Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 HTTP/1.1 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHfU7Bg9FxIZ_vKjxK3HuOjWb3FxHPy4rCuJxAmomx_M8oTOGP52AnYVUt9W1mIKdcI5_UxCrXZwRdGx3A91rvF7NVEiEwotA-bLW7wkThXu-2a12XIp_yxFQkiKLm_loz0QNtL-r8QCzEscOir2_82cBNJOWtKSoe4Tm0CQBXnZj0 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f2f3b892f2846fca8da344efe2a5061", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f2f3b892f2846fca8da344efe2a5061"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0f2f3b892f2846fca8da344efe2a5061 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-832722370 Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 047647d05b0d437eb36f95cbc940e96a Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesNegativeTestJSON-832722370-project Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'db947939-9d30-45de-a790-d1da3ba82de3'} Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:00:51.457951 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.463435 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:00:51.463435 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:00:51.463435 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:00:51.463435 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:00:51.463435 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:00:51.463435 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. Oct 17 13:00:51.463435 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:00:51.464770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] Returning 404 to user: Instance db947939-9d30-45de-a790-d1da3ba82de3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:00:51.465831 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-821d5f4f-0c0c-459e-b799-d907f0f965a9 tempest-ImagesNegativeTestJSON-832722370 tempest-ImagesNegativeTestJSON-832722370-project] 10.222.0.27 "GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3" status: 404 len: 111 microversion: 2.1 time: 0.087912 Oct 17 13:00:51.466602 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1339/2724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:51 2022] GET /compute/v2.1/servers/db947939-9d30-45de-a790-d1da3ba82de3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:00:51.652983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:51.653607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:51.665354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.665854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.666327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.667049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.667507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.667940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:51.796267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:51.809415 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41feb08b-c901-4c31-bccb-4f5878761fe8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1265 microversion: 2.1 time: 0.161083 Oct 17 13:00:51.828222 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1340/2725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:51 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:51.949911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:51.974399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6430c001-648c-4b88-bfeb-6461ecb6bc1f req-2e4e14ea-b3dc-4e48-9aaf-2f3d12993c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918c48fc-3923-40c6-a877-39fd47337f64", "name": "network-vif-unplugged", "status": "completed", "tag": "4cf3c20b-f534-4dcd-bc59-97245fdc9f8b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:51.979382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c98ce86-5661-4fa3-9ee8-14ce86004c58 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 1.115004 Oct 17 13:00:51.979971 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1386/2726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:50 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:51.993849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6430c001-648c-4b88-bfeb-6461ecb6bc1f req-2e4e14ea-b3dc-4e48-9aaf-2f3d12993c8b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:51.998332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6430c001-648c-4b88-bfeb-6461ecb6bc1f req-2e4e14ea-b3dc-4e48-9aaf-2f3d12993c8b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:51.999784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6430c001-648c-4b88-bfeb-6461ecb6bc1f req-2e4e14ea-b3dc-4e48-9aaf-2f3d12993c8b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:52.029193 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6430c001-648c-4b88-bfeb-6461ecb6bc1f req-2e4e14ea-b3dc-4e48-9aaf-2f3d12993c8b service nova] Creating event network-vif-unplugged:4cf3c20b-f534-4dcd-bc59-97245fdc9f8b for instance 918c48fc-3923-40c6-a877-39fd47337f64 on n-h1-853316-12 Oct 17 13:00:52.054600 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6430c001-648c-4b88-bfeb-6461ecb6bc1f req-2e4e14ea-b3dc-4e48-9aaf-2f3d12993c8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083764 Oct 17 13:00:52.055207 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1341/2727] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:00:52.840041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:52.841038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:52.857677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:52.858203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:52.861053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:52.864331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:52.864740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:52.865203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:52.986022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-37f5f728-8c6b-4c64-96f4-2f20d35582bf req-f3014ab7-8053-4d1d-b674-47a99423d790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918c48fc-3923-40c6-a877-39fd47337f64", "name": "network-vif-deleted", "tag": "4cf3c20b-f534-4dcd-bc59-97245fdc9f8b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:53.004550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-37f5f728-8c6b-4c64-96f4-2f20d35582bf req-f3014ab7-8053-4d1d-b674-47a99423d790 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:53.015293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-37f5f728-8c6b-4c64-96f4-2f20d35582bf req-f3014ab7-8053-4d1d-b674-47a99423d790 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:53.015873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-37f5f728-8c6b-4c64-96f4-2f20d35582bf req-f3014ab7-8053-4d1d-b674-47a99423d790 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:53.048000 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-37f5f728-8c6b-4c64-96f4-2f20d35582bf req-f3014ab7-8053-4d1d-b674-47a99423d790 service nova] Creating event network-vif-deleted:4cf3c20b-f534-4dcd-bc59-97245fdc9f8b for instance 918c48fc-3923-40c6-a877-39fd47337f64 on n-h1-853316-12 Oct 17 13:00:53.063171 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-37f5f728-8c6b-4c64-96f4-2f20d35582bf req-f3014ab7-8053-4d1d-b674-47a99423d790 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081080 Oct 17 13:00:53.063793 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1342/2728] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:00:53.069359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:53.070607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:53.090131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:53.090703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:53.091166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:53.091896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:53.096074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:53.097562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:53.648267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:53.665512 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e5b3891f-21a9-4f41-bdc5-6ae13708fdd7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1307 microversion: 2.1 time: 0.829467 Oct 17 13:00:53.692237 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1387/2729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:52 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1307 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:53.971541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:53.983655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f0b08a76-0717-4304-b0bd-b4d1a52d6597 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.918379 Oct 17 13:00:53.984238 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1343/2730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:53 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:54.691585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:54.692816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:54.703098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:54.703801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:54.704404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:54.705579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:54.706457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:54.707262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:55.013897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:55.014623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:55.032845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:55.033437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:55.034256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:55.037555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:55.038968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:55.039829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:55.349626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:55.374504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f6cc0c81-b9c6-4ddb-8d16-065185ca07ad tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1307 microversion: 2.1 time: 0.686295 Oct 17 13:00:55.380824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1388/2731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:54 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1307 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:55.393231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9463f79e-f2be-467f-b208-d14cc9839bcd req-c8a65998-e89f-43c3-8880-15e217358dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fce287-b697-437a-9415-b3326aa662e4", "tag": "3511c7db-cba3-4207-ac57-1fac9cad0e41"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:55.436588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:55.441357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9463f79e-f2be-467f-b208-d14cc9839bcd req-c8a65998-e89f-43c3-8880-15e217358dec service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:55.441829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9463f79e-f2be-467f-b208-d14cc9839bcd req-c8a65998-e89f-43c3-8880-15e217358dec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:55.442422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9463f79e-f2be-467f-b208-d14cc9839bcd req-c8a65998-e89f-43c3-8880-15e217358dec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:55.447647 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f4df6a6-a0f4-4dcc-be2f-69e97f43ad6d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.437777 Oct 17 13:00:55.461928 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9463f79e-f2be-467f-b208-d14cc9839bcd req-c8a65998-e89f-43c3-8880-15e217358dec service nova] Creating event network-changed:3511c7db-cba3-4207-ac57-1fac9cad0e41 for instance 38fce287-b697-437a-9415-b3326aa662e4 on n-h2-853316-12 Oct 17 13:00:55.469895 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9463f79e-f2be-467f-b208-d14cc9839bcd req-c8a65998-e89f-43c3-8880-15e217358dec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085371 Oct 17 13:00:55.470727 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1344/2732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:55 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:55.471338 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1389/2733] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:55.489156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f4e0a0bb-5401-4bae-9c7c-fdba1170b587 req-00a88967-1a48-4031-bee9-bfd434e6fa51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b2265a-9332-47d0-aca4-df5bfd6d236a", "tag": "30416dd9-de36-46fc-a524-4b075b1466d1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:00:55.506326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4e0a0bb-5401-4bae-9c7c-fdba1170b587 req-00a88967-1a48-4031-bee9-bfd434e6fa51 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:55.506822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4e0a0bb-5401-4bae-9c7c-fdba1170b587 req-00a88967-1a48-4031-bee9-bfd434e6fa51 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:55.507625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4e0a0bb-5401-4bae-9c7c-fdba1170b587 req-00a88967-1a48-4031-bee9-bfd434e6fa51 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:55.529125 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f4e0a0bb-5401-4bae-9c7c-fdba1170b587 req-00a88967-1a48-4031-bee9-bfd434e6fa51 service nova] Creating event network-changed:30416dd9-de36-46fc-a524-4b075b1466d1 for instance a9b2265a-9332-47d0-aca4-df5bfd6d236a on n-h2-853316-12 Oct 17 13:00:55.536345 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f4e0a0bb-5401-4bae-9c7c-fdba1170b587 req-00a88967-1a48-4031-bee9-bfd434e6fa51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064147 Oct 17 13:00:55.537475 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1345/2734] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:00:56.404901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:56.405761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:56.415792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:56.416355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:56.416796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:56.417538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:56.417994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:56.418484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:56.474204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:56.474913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:56.482461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:56.482973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:56.483387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:56.484096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:56.484577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:56.484988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:56.629266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:56.639211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-617397c9-54a9-421b-b57d-20b9bae77c40 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.171324 Oct 17 13:00:56.639917 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1346/2735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:56 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:00:56.966816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:56.989218 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5398e3eb-3a36-4952-8ee4-10c7c39860a8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1307 microversion: 2.1 time: 0.586011 Oct 17 13:00:57.009998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1390/2736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:56 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1307 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:57.666263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:57.666984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:57.697198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:57.699409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:57.700566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:57.703737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:57.706118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:57.708172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:58.034177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:58.035476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:58.049382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:58.050144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:58.051313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:58.056648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:58.057434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:58.058187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:58.142219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:58.165791 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1796ec28-6e3e-40a1-9e17-431aff587007 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.505698 Oct 17 13:00:58.175828 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1347/2737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:57 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:58.989025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:58.997959 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f8127f9c-4d96-4185-bc4e-87e9258ae931 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1307 microversion: 2.1 time: 0.968693 Oct 17 13:00:59.005342 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1391/2738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:58 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1307 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:00:59.208278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:00:59.208918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:00:59.219171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:59.224156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:00:59.249628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:59.253076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:59.254330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:59.258531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:00:59.260255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:00:59.262759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:00:59.582473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:00:59.594181 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2187cd7-8504-446b-821a-c628ab125e7b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.399800 Oct 17 13:00:59.603597 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1348/2739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:00:59 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:00.046838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:00.053155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:00.075153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:00.076319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=58 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:00.078750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:00.079464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:00.080617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:00.081855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:00.083510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:00.084147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:00.394694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:00.408322 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a56221f-79d1-41ac-8dc1-e92eb2f2a08a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1307 microversion: 2.1 time: 0.374915 Oct 17 13:01:00.408926 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1392/2740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:00 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:00.620752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:00.622076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:00.629812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:00.630367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:00.630985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:00.631953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:00.632776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:00.633576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:01.047869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:01.084725 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7af1ecf0-30f9-4539-a334-9c1507171815 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.468510 Oct 17 13:01:01.087759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1349/2741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:00 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:01.387950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8fa65036-d123-4787-8539-0d54a14534a3 req-30a6a889-7191-47e9-a4ba-04218cc76eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fce287-b697-437a-9415-b3326aa662e4", "name": "network-vif-plugged", "status": "completed", "tag": "3511c7db-cba3-4207-ac57-1fac9cad0e41"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:01.409518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8fa65036-d123-4787-8539-0d54a14534a3 req-30a6a889-7191-47e9-a4ba-04218cc76eb2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:01.411451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8fa65036-d123-4787-8539-0d54a14534a3 req-30a6a889-7191-47e9-a4ba-04218cc76eb2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:01.412054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8fa65036-d123-4787-8539-0d54a14534a3 req-30a6a889-7191-47e9-a4ba-04218cc76eb2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:01.434277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:01.435397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:01.437328 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8fa65036-d123-4787-8539-0d54a14534a3 req-30a6a889-7191-47e9-a4ba-04218cc76eb2 service nova] Creating event network-vif-plugged:3511c7db-cba3-4207-ac57-1fac9cad0e41 for instance 38fce287-b697-437a-9415-b3326aa662e4 on n-h2-853316-12 Oct 17 13:01:01.448970 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8fa65036-d123-4787-8539-0d54a14534a3 req-30a6a889-7191-47e9-a4ba-04218cc76eb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064560 Oct 17 13:01:01.451107 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1393/2742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:01:01.452504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:01.453164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:01.453609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:01.454356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:01.454810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:01.455336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:01.572162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:01.572950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:01.597814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:01.600007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:01.600543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:01.603681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:01.604171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:01.604608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:01.834243 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f9ff3b3f-1e62-4b9a-adb5-0fd8af75f39f tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1816 microversion: 2.1 time: 0.269320 Oct 17 13:01:01.835433 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1394/2743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:01 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1816 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:01.857372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0543c452-9885-4ef8-a63b-2a1f6c507215 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:01.861526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0543c452-9885-4ef8-a63b-2a1f6c507215 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:01.862029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0543c452-9885-4ef8-a63b-2a1f6c507215 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:01.862495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0543c452-9885-4ef8-a63b-2a1f6c507215 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:01.863234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0543c452-9885-4ef8-a63b-2a1f6c507215 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:01.863694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0543c452-9885-4ef8-a63b-2a1f6c507215 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:01.864119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0543c452-9885-4ef8-a63b-2a1f6c507215 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:01.895678 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0543c452-9885-4ef8-a63b-2a1f6c507215 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039801 Oct 17 13:01:01.914308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1395/2744] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 13:01:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:01:01.993889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:02.005615 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4a0cdeba-edf4-4b75-bc0c-33912131bf4e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1307 microversion: 2.1 time: 0.575305 Oct 17 13:01:02.019910 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1350/2745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:01 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1307 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:02.117215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:02.119202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:02.131107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:02.131976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:02.133249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:02.135181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:02.135857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:02.137575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:02.528615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:02.542748 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-96374e3d-0972-480b-9f59-3137208fe4a0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.433667 Oct 17 13:01:02.545111 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1396/2746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:02 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:03.035141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:03.037855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:03.054989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:03.057601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:03.060416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:03.063220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:03.066795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:03.069354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:03.572787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:03.574300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:03.584638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:03.585494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:03.587376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:03.588270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:03.588928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:03.589506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:03.649746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:03.663125 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e17b244e-f280-4802-a1db-9803b0a9170d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1307 microversion: 2.1 time: 0.633598 Oct 17 13:01:03.697445 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1351/2747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:03 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1307 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:03.946429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:03.956340 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df4f474f-d6f0-4bfc-a436-86ffbd0b8021 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.388900 Oct 17 13:01:03.956925 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1397/2748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:03 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:04.677842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8652cf13-ca2e-4601-bbc4-8a4b105be16a", "device": "/dev/xvdb"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:04.681181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:04.691732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:04.693251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:04.702748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:04.703257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:04.704183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:04.705722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:04.706450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:04.707165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:04.714896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:04.715621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:04.717245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:04.719282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:04.719879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:04.720666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:05.162846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:05.178353 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ef31e8ce-7792-4be7-b58e-5590441e5527 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1488 microversion: 2.1 time: 0.487941 Oct 17 13:01:05.181969 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1398/2749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:04 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1488 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:05.191072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:05.191914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:05.198443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:05.199137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:05.199775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:05.200714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:05.201454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:05.202097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:05.239392 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d5d8d6cc-14f8-4e73-88fb-cb0a6b8e17cd tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "POST /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567936 Oct 17 13:01:05.240786 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1352/2750] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:01:04 2022] POST /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:05.252210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:05.253771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:05.276357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:05.276910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:05.277450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:05.291229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:05.292180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:05.292659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:05.339895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:05.367277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lazy-loading 'flavor' on Instance uuid 38fce287-b697-437a-9415-b3326aa662e4 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:01:05.499861 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ce92627-4004-467f-870b-69d3e82e9d79 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4/action" status: 202 len: 0 microversion: 2.1 time: 0.256544 Oct 17 13:01:05.501013 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1353/2751] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:01:05 2022] POST /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:01:05.515672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:05.516539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:05.557270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:05.558058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:05.558686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:05.559903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:05.561427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:05.562427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:05.675476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:05.714980 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-055c8043-5f78-4226-99b6-ae8d6a24f1c8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.530862 Oct 17 13:01:05.717246 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1399/2752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:05 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:06.295853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:06.311961 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff30b9f4-3756-4b33-876c-58dea0c3e1ab tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1496 microversion: 2.1 time: 0.803591 Oct 17 13:01:06.314754 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1354/2753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:05 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1496 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:06.747330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:06.750059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:06.763562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:06.764622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:06.766338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:06.767245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:06.769405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:06.770069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:07.164490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:07.181663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08a82924-c491-46ad-af8f-9aa188ed0a21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.439195 Oct 17 13:01:07.183259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1400/2754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:06 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:07.346006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:07.347246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:07.359878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:07.360376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:07.363843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:07.364579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:07.370096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:07.371307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:07.904207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:07.914382 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6f74aea6-8882-478d-95c4-533025beaad9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 200 len: 1479 microversion: 2.1 time: 0.571462 Oct 17 13:01:07.915127 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1355/2755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:07 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 1479 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:07.948516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-929239646"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:07.952391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:07.979188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:07.980232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:07.981906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:07.982818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:07.983724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:07.984438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:08.057788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:08.213641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:08.214423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:08.228596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:08.232557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:08.233828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:08.237275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:08.239228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:08.243335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:08.405409 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be50e2ad-d642-4b3f-b338-7e3635255025 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4/action" status: 202 len: 0 microversion: 2.1 time: 0.463003 Oct 17 13:01:08.414459 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1401/2756] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:01:07 2022] POST /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:01:08.422220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e716fc4f-eb35-402e-9b99-1792b37ec69b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820f25af0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:08.531073 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e716fc4f-eb35-402e-9b99-1792b37ec69b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.114387 Oct 17 13:01:08.535142 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1402/2757] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:08 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:09.087374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:09.114959 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d09d004-7010-476f-b293-7fec4d4e8120 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.905912 Oct 17 13:01:09.122427 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1356/2758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:08 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:09.549803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7076e10c-1010-431b-b546-ce95b78b02be tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251a0d30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:09.641335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7076e10c-1010-431b-b546-ce95b78b02be tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.096282 Oct 17 13:01:09.642516 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1403/2759] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:09 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:10.149380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:10.150053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:10.167680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:10.171924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:10.174457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:10.176950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:10.179295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:10.181226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:10.661075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e4f50690-33f0-4b3e-b847-d2c8a77d24ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251a0ca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:10.738842 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e4f50690-33f0-4b3e-b847-d2c8a77d24ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.083104 Oct 17 13:01:10.739687 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1404/2760] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:10 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:10.779886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:10.795509 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67c7e512-0fbd-4ddb-bbc6-11aad23385cd tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.651797 Oct 17 13:01:10.796104 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1357/2761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:10 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:11.761144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0f7c55ee-ebfa-4b0e-8204-809451a73cfd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82519d310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:11.831184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:11.832381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:11.860259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:11.860968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:11.867111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:11.868047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:11.869759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:11.870325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:11.874288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:11.926768 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0f7c55ee-ebfa-4b0e-8204-809451a73cfd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.172861 Oct 17 13:01:11.928283 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1405/2762] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:11 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:12.551639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:12.568164 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2defceab-ecf3-4ea1-97b9-8e312200c137 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.748567 Oct 17 13:01:12.570497 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1358/2763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:11 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:12.945379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c32ce38-0ecf-4762-ba1c-ef8d58ec95aa tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82519d9d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:13.100896 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c32ce38-0ecf-4762-ba1c-ef8d58ec95aa tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.160818 Oct 17 13:01:13.121100 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1406/2764] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:12 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:13.603039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:13.603675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:13.619587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:13.620081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:13.620526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:13.626045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:13.627928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:13.628393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:14.118142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-623fea45-b825-4963-9284-64e555fd9600 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251deee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:14.224157 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-623fea45-b825-4963-9284-64e555fd9600 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.111053 Oct 17 13:01:14.244582 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1407/2765] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:14 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:14.324937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:14.360962 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-27925b36-5ff4-457f-84c0-4fe53cc8ad15 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1724 microversion: 2.1 time: 0.764298 Oct 17 13:01:14.377544 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1359/2766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:13 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1724 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:15.254078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a67052a7-70dd-4b3e-bbce-c00ee35aa36b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251a0040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:15.326297 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a67052a7-70dd-4b3e-bbce-c00ee35aa36b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.080999 Oct 17 13:01:15.340276 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1408/2767] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:15 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:15.395491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:15.396979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:15.418676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:15.421415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:15.422077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:15.424957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:15.425681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:15.426338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:16.342837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:16.353751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fb08f97-f088-4737-9744-c70d3f5ae577 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251433a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:16.371902 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f22f21bf-2752-4f64-876d-d3ee61388b33 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1701 microversion: 2.1 time: 0.984812 Oct 17 13:01:16.395307 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1360/2768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:15 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1701 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:16.424922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f76cde16-94a0-4daf-a13d-8488bb77da91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:16.449877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76cde16-94a0-4daf-a13d-8488bb77da91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:16.450667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76cde16-94a0-4daf-a13d-8488bb77da91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:16.452854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76cde16-94a0-4daf-a13d-8488bb77da91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:16.465416 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fb08f97-f088-4737-9744-c70d3f5ae577 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.125926 Oct 17 13:01:16.480520 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1409/2769] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:16 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:16.544055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f76cde16-94a0-4daf-a13d-8488bb77da91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Going to try to start instance {{(pid=127539) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:01:16.635023 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f76cde16-94a0-4daf-a13d-8488bb77da91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/action" status: 202 len: 0 microversion: 2.1 time: 0.214786 Oct 17 13:01:16.636628 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1361/2770] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:01:16 2022] POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:01:16.668215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:16.669956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:16.690363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:16.691513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:16.693036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:16.694796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:16.696334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:16.698328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:16.822999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9c9d6cc-960a-4903-9b05-a667e2f44d74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Action: 'create', calling method: .version_select at 0x7fa8251a01f0>, body: {"keypair": {"name": "tempest-keypair-549952109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuMnAB3uAZwdbt1wyjpkjD2i9qSD4nsHQx4llSOn4d+/4ruZ/dtBynLEIOiqHtWyDO7TppSl6e8CqW8OK93aoMAM9EH4mL6H2Mb4tZFb9ZrGDa86ej8bMu0HwxSaevnQA=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:16.866537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c9c9d6cc-960a-4903-9b05-a667e2f44d74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Getting quotas for project 8a5f7427b14445159ef1d9f3057c4a73. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:01:16.890288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c9c9d6cc-960a-4903-9b05-a667e2f44d74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Getting quotas for user 455a7e9ecc4d4089955c666603ca8b43 and project 8a5f7427b14445159ef1d9f3057c4a73. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:01:17.009397 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c9c9d6cc-960a-4903-9b05-a667e2f44d74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.522736 Oct 17 13:01:17.020988 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1410/2771] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:01:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:17.251228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:17.266809 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90d82be8-9a62-4a57-b5be-657b91a49a52 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1710 microversion: 2.1 time: 0.612053 Oct 17 13:01:17.287353 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1362/2772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:16 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1710 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:17.484325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1992c0c-1f59-4e4e-8121-a1252fd804b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825143700>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:17.554245 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1992c0c-1f59-4e4e-8121-a1252fd804b3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.074118 Oct 17 13:01:17.557623 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1411/2773] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:17 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:18.296330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:18.297050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:18.327489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:18.331803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:18.347070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:18.356841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:18.362535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:18.363986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:18.570743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=6,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:18.576603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-30080698-a360-4884-89f8-691d00b608e3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825130a60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:18.694090 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-30080698-a360-4884-89f8-691d00b608e3 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.123565 Oct 17 13:01:18.707318 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1412/2774] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:18 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:18.942805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:18.959334 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-718c6499-c3f0-42de-8f34-0edab781fbe3 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1710 microversion: 2.1 time: 0.667823 Oct 17 13:01:18.963454 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1363/2775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:18 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1710 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:19.139673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-fe5262b7-d361-404b-b2b1-10e9ea05b8b3 req-37030ee1-9977-44a5-a5ed-6a6fe287a061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fce287-b697-437a-9415-b3326aa662e4", "name": "network-vif-plugged", "status": "completed", "tag": "3511c7db-cba3-4207-ac57-1fac9cad0e41"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:19.200243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fe5262b7-d361-404b-b2b1-10e9ea05b8b3 req-37030ee1-9977-44a5-a5ed-6a6fe287a061 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:19.204886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fe5262b7-d361-404b-b2b1-10e9ea05b8b3 req-37030ee1-9977-44a5-a5ed-6a6fe287a061 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:19.206928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fe5262b7-d361-404b-b2b1-10e9ea05b8b3 req-37030ee1-9977-44a5-a5ed-6a6fe287a061 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:19.230669 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-fe5262b7-d361-404b-b2b1-10e9ea05b8b3 req-37030ee1-9977-44a5-a5ed-6a6fe287a061 service nova] Creating event network-vif-plugged:3511c7db-cba3-4207-ac57-1fac9cad0e41 for instance 38fce287-b697-437a-9415-b3326aa662e4 on n-h2-853316-12 Oct 17 13:01:19.248870 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-fe5262b7-d361-404b-b2b1-10e9ea05b8b3 req-37030ee1-9977-44a5-a5ed-6a6fe287a061 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118846 Oct 17 13:01:19.253453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1413/2776] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:19.553238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:19.555214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:19.583938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:19.584586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:19.585349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:19.586114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:19.588946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:19.589529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:19.720503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0edb62c-64b9-442b-a274-a6dd8d400efd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825130d30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:19.794042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0edb62c-64b9-442b-a274-a6dd8d400efd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.086804 Oct 17 13:01:19.794843 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1414/2777] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:19 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:19.987116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:19.988013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:20.001209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:20.002065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:20.002719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:20.008025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:20.008608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:20.009362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:20.081498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:20.102834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:20.106230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:20.113290 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7499a11a-4012-499a-96bb-f62c3bd7f79b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2945 microversion: 2.32 time: 0.564496 Oct 17 13:01:20.115111 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1364/2778] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:01:19 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2945 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:01:20.149345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:20.149853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:20.164619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:20.165430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:20.166047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:20.167001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:20.167689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:20.168286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:20.446900 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b74ce14-f509-4cbb-8891-ace65b56694b tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.302205 Oct 17 13:01:20.447857 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1365/2779] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 13:01:20 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77/os-interface => generated 1832 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:01:20.505037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:20.524633 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-880caf5a-679e-40a4-9daa-de6bf662de34 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1714 microversion: 2.1 time: 0.539913 Oct 17 13:01:20.538206 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1415/2780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:19 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1714 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:20.818779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0fe68db1-601c-4184-9f9e-e26a3ae2393e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82514ca60>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:20.951860 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0fe68db1-601c-4184-9f9e-e26a3ae2393e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.146169 Oct 17 13:01:20.953760 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1366/2781] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:20 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:21.092430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1391014197", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "099d737f-6740-42e1-bf9d-49d84605893b"}], "security_groups": [{"name": "tempest-securitygroup--1902833377"}], "key_name": "tempest-keypair-549952109", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:21.353105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] validate_networks() for [('099d737f-6740-42e1-bf9d-49d84605893b', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:01:21.369658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:21.370599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:21.379011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=62 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:21.383011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:21.384194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:21.384862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:21.385789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:21.386502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:21.387103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:21.605767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52c8202c-b729-4b85-b62d-bce82e4a5ec5 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1862 microversion: 2.1 time: 0.240642 Oct 17 13:01:21.606401 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1367/2782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:21 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1862 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:21.628866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853316-12", "block_migration": true, "disk_over_commit": false}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:21.631754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:21.638901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:21.639672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:21.640294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:21.641187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:21.641809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:21.642496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:21.699496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lazy-loading 'flavor' on Instance uuid 651ae713-e756-4012-8bc9-34d9ac55544d {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:01:21.704163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:21.731679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Going to try to live migrate instance to n-h1-853316-12 {{(pid=127539) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:01:23.306528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Getting quotas for project 8a5f7427b14445159ef1d9f3057c4a73. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:01:23.322080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Getting quotas for user 455a7e9ecc4d4089955c666603ca8b43 and project 8a5f7427b14445159ef1d9f3057c4a73. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:01:23.365274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:01:23.365760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:01:23.370794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:01:23.371978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:01:23.373572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:01:23.412513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:23.413472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:23.414737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:23.417299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:23.418831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:23.421031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:23.497610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Getting quotas for project 8a5f7427b14445159ef1d9f3057c4a73. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:01:23.513861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Getting quotas for user 455a7e9ecc4d4089955c666603ca8b43 and project 8a5f7427b14445159ef1d9f3057c4a73. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:01:23.538152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:01:23.547621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:01:23.656212 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cfe920c9-e1af-4ab8-96fd-952870ffb7e3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.568493 Oct 17 13:01:23.668043 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1416/2783] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:01:21 2022] POST /compute/v2.1/servers => generated 407 bytes in 2581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:01:23.679835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b76302ff-807e-41fb-a945-e45d17520e8e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82140b820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:23.824818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b76302ff-807e-41fb-a945-e45d17520e8e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.149256 Oct 17 13:01:23.828928 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1417/2784] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:23 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:23.849735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c508e37d-331a-4ee2-b93f-f4ff1cb91642 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:23.852007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c508e37d-331a-4ee2-b93f-f4ff1cb91642 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:24.391861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c508e37d-331a-4ee2-b93f-f4ff1cb91642 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:24.403806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c508e37d-331a-4ee2-b93f-f4ff1cb91642 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1269 microversion: 2.1 time: 0.572504 Oct 17 13:01:24.404728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1418/2785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:23 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1269 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:24.802749 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bbcec0a5-eecf-4162-8b41-8e56cf011fee tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/action" status: 202 len: 0 microversion: 2.1 time: 3.175374 Oct 17 13:01:24.813656 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1368/2786] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:01:21 2022] POST /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/action => generated 0 bytes in 3189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:01:24.816560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:24.817175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:24.845557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c2ddadef-50a5-4e4f-98b2-d83894263779 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820c615e0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:24.855044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:24.855566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:24.860755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:24.863684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:24.864198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:24.864644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:25.000638 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c2ddadef-50a5-4e4f-98b2-d83894263779 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.160244 Oct 17 13:01:25.002120 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1369/2787] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:24 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:25.432698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:25.433677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:25.456058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:25.462760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:25.463290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:25.472618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:25.475387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:25.480359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:25.668848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:25.690510 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aa8574af-0a43-4334-98be-545ccec09052 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.878297 Oct 17 13:01:25.694653 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1419/2788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:24 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:25.725836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:25.735704 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-28f0acad-6993-4e80-a043-e6c1ea44d0ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1265 microversion: 2.1 time: 0.309993 Oct 17 13:01:25.740246 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1370/2789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:25 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:26.016519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e23bc47-0981-4ec2-80fd-63dd04f7ce7c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251740d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:26.090921 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e23bc47-0981-4ec2-80fd-63dd04f7ce7c tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.077916 Oct 17 13:01:26.091794 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1420/2790] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:26 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:26.718457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:26.719210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:26.729487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:26.730494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:26.731292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:26.733637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:26.734283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:26.734840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:26.764294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:26.765606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:26.774407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:26.775512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:26.776161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:26.777683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:26.778410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:26.779028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:27.044566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:27.074242 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff27c349-8f66-4d63-9d5d-7e7987c4a067 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1327 microversion: 2.1 time: 0.316683 Oct 17 13:01:27.090300 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1421/2791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:26 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1327 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:27.108848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25bb6db7-01f3-4981-9718-adc5c06d7e47 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251995e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:27.198517 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25bb6db7-01f3-4981-9718-adc5c06d7e47 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.094561 Oct 17 13:01:27.205185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:27.208351 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1422/2792] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:27 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:27.219589 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eeb19285-abb7-410c-8c98-a6af567aa234 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.504828 Oct 17 13:01:27.220199 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1371/2793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:26 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:28.111677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:28.112232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:28.136375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:28.142226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:28.142902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:28.143663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:28.144148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:28.144582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:28.215488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe622e29-545f-4384-8af5-d3b916c7ade6 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8204ba280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:28.339533 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe622e29-545f-4384-8af5-d3b916c7ade6 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.128367 Oct 17 13:01:28.342718 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1372/2794] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:28 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:28.359258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:28.365675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:28.396040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:28.397003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:28.398535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:28.400780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:28.402821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:28.405870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:28.535852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:28.545049 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d8b4fd93-6e94-4484-8a44-425e496dda1d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1327 microversion: 2.1 time: 0.442827 Oct 17 13:01:28.545643 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1423/2795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:28 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1327 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:28.871628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:28.899322 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04ca81fa-5cfd-480f-9c1e-d79d700e505a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.549931 Oct 17 13:01:28.904400 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1373/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:28 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:29.358504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0d2acdb-391e-4245-aa85-5bca219d186e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8251bdf70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:29.450639 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0d2acdb-391e-4245-aa85-5bca219d186e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.097314 Oct 17 13:01:29.451817 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1424/2797] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:29 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:29.569200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:29.570659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:29.583391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:29.584858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:29.585513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:29.587036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:29.587532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:29.588008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:29.949441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:29.950388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:29.963751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:29.964258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:29.964706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:29.965425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:29.972629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:29.973312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:30.356727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:30.378635 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f5e2d64-a843-4771-b600-10a7fcb3f575 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 0.810752 Oct 17 13:01:30.385338 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1374/2798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:29 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:30.468720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02d07fb3-3499-49d7-9601-9aa697210203 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82054bee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:30.591781 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02d07fb3-3499-49d7-9601-9aa697210203 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.126051 Oct 17 13:01:30.594508 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1375/2799] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:30 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:30.884721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:30.929770 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4f02754f-918d-4e2a-b937-8003fd291f20 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.977743 Oct 17 13:01:30.934523 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1425/2800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:29 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:31.244588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2316c3d2-8dec-4943-a133-d7600d55b750"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:31.247909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:31.270880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:31.271336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:31.272564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:31.296226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:31.296779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:31.297236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:31.409982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:31.410884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:31.427861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:31.430607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:31.431217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:31.431670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:31.432590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:31.433200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:31.433474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:31.936661 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b67b62d3-0df9-4b2b-91d3-5389e043042c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "POST /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692639 Oct 17 13:01:31.949232 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1376/2801] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:01:31 2022] POST /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:31.966902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f78bebf3-2e79-4e42-b3cf-ceb6f2e6299d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82054b1f0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:32.002700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:32.019196 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c634f3bb-2ccc-4487-9db8-d4d51867bd3d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 0.611298 Oct 17 13:01:32.041368 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1426/2802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:31 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:32.069383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:32.070976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:32.095869 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f78bebf3-2e79-4e42-b3cf-ceb6f2e6299d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.145205 Oct 17 13:01:32.096095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:32.096474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:32.096925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:32.097648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:32.098102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:32.105900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:32.106359 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1377/2803] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:31 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:33.054021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:33.055818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:33.073919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:33.074687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:33.075344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:33.079049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:33.079950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:33.083634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:33.390679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:33.401271 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3672dbf5-4c8d-4877-b314-bc64f2d09db9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 1.355361 Oct 17 13:01:33.411616 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1427/2804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:32 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:33.429989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-70c545b2-226a-43a4-9d52-e925c17ecfb0 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820f25820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:33.464871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:33.572839 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-70c545b2-226a-43a4-9d52-e925c17ecfb0 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.155102 Oct 17 13:01:33.576132 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1428/2805] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:33 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:33.593226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5001bc4f-eb41-4eb8-8e2f-98ff5bc426f7 req-745bea03-0b3c-43f3-ae43-4afc73029946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677f6d75-a1e6-46ad-bffa-d56e90f02504", "tag": "c3a2e0af-8344-49fc-827b-b2a722ffacb0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:33.637758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5001bc4f-eb41-4eb8-8e2f-98ff5bc426f7 req-745bea03-0b3c-43f3-ae43-4afc73029946 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:33.647004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5001bc4f-eb41-4eb8-8e2f-98ff5bc426f7 req-745bea03-0b3c-43f3-ae43-4afc73029946 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:33.647715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5001bc4f-eb41-4eb8-8e2f-98ff5bc426f7 req-745bea03-0b3c-43f3-ae43-4afc73029946 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:33.708475 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5001bc4f-eb41-4eb8-8e2f-98ff5bc426f7 req-745bea03-0b3c-43f3-ae43-4afc73029946 service nova] Creating event network-changed:c3a2e0af-8344-49fc-827b-b2a722ffacb0 for instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 on n-h1-853316-12 Oct 17 13:01:33.745574 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5001bc4f-eb41-4eb8-8e2f-98ff5bc426f7 req-745bea03-0b3c-43f3-ae43-4afc73029946 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167697 Oct 17 13:01:33.750231 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1429/2806] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:33.789730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:33.807212 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dc2abac0-294a-4e36-8375-adf4d755e7c3 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 0.759211 Oct 17 13:01:33.815994 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1378/2807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:33 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:34.436040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=16 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:34.442567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:34.443637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:34.474150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:34.475177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:34.489541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:34.491061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:34.491723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:34.492164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:34.590575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-439a48c2-9e01-4367-9cd6-9d3c58eb9138 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825258af0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:34.674768 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-439a48c2-9e01-4367-9cd6-9d3c58eb9138 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.089342 Oct 17 13:01:34.675620 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1379/2808] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:34 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:34.837316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:34.840687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:34.861978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:34.862551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:34.863032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:34.863809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:34.864273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:34.864724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:35.382941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:35.400887 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab306645-13ea-4e43-aab2-53b4c2ac03c5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.964282 Oct 17 13:01:35.403669 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1430/2809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:34 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:35.604078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:35.630136 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc1cd3f6-9551-4cb8-ae23-afdc5365ce06 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 0.785283 Oct 17 13:01:35.646850 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1380/2810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:34 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:35.694573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d06e1e41-9904-4b49-be98-a35393d85c73 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82519d700>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:35.809412 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d06e1e41-9904-4b49-be98-a35393d85c73 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.121572 Oct 17 13:01:35.810011 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1431/2811] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:35 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:36.431450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:36.432235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:36.444946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:36.445615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:36.446183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:36.447024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:36.447594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:36.458926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:36.656301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:36.657252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:36.677509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:36.679658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:36.685579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:36.689105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:36.692384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:36.694046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:36.750367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:36.759993 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1c292b3-fa6f-42b7-b939-9a06279faa83 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.333923 Oct 17 13:01:36.772760 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1381/2812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:36 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:36.832717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2831f0b5-29dd-497d-9bbf-dd6880fbbd3e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8252299d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:36.886696 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2831f0b5-29dd-497d-9bbf-dd6880fbbd3e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.058100 Oct 17 13:01:36.887576 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1382/2813] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:36 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:37.260990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:37.274264 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a9d418b-bb29-47cd-913f-5ade3e640254 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 0.620518 Oct 17 13:01:37.275122 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1432/2814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:36 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:37.797214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:37.798610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:37.841773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:37.842506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:37.845318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:37.846262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:37.850324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:37.853949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:37.904049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5eca2088-08e3-42e4-83e3-149877f5fd9e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82514c040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:38.010708 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5eca2088-08e3-42e4-83e3-149877f5fd9e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.111226 Oct 17 13:01:38.011492 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1433/2815] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:37 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:38.182480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:38.199138 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d7f6021-da77-473b-9401-01a3209462db tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.406464 Oct 17 13:01:38.203073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1383/2816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:37 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:38.296696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:38.297317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:38.320474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:38.320971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:38.321413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:38.322123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:38.322607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:38.323031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:38.830607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:38.842351 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7cd3e928-324c-4655-9111-78868ba8e21a tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 0.549268 Oct 17 13:01:38.861794 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1434/2817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:38 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:39.031207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9be3e73-89a9-42b0-8de8-d1b8f9dadc34 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8204ba4c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:39.135145 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9be3e73-89a9-42b0-8de8-d1b8f9dadc34 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.109720 Oct 17 13:01:39.140076 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1384/2818] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:39 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:39.227437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:39.228872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:39.242768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:39.246993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:39.247672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:39.248778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:39.249495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:39.251698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:39.704423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:39.715243 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-401c8f17-e643-4ca0-b4f4-93501373215e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.492807 Oct 17 13:01:39.718829 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1435/2819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:39 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:39.870058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:39.870741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:39.878639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:39.879446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:39.880085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:39.881273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:39.881963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:39.882599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:40.087188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:40.104987 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e59e6f07-332a-404c-b5bd-40d745a6cfea tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 0.239530 Oct 17 13:01:40.108129 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1385/2820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:39 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:40.153374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-220304ab-8c31-4781-8598-2b501c397051 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825199af0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:40.241178 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-220304ab-8c31-4781-8598-2b501c397051 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.090909 Oct 17 13:01:40.247967 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1436/2821] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:40 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:40.742889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:40.743925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:40.755166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:40.756209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:40.757116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:40.759205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:40.760858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:40.762962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:41.107073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:41.122131 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e83130a4-dba7-4d8d-a9f1-3ba449d73dd7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.383934 Oct 17 13:01:41.122893 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1386/2822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:40 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:41.139128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:41.140330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:41.160092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:41.174990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:41.175764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:41.176723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:41.177414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:41.178762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:41.257721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-98fd0ee1-9c1e-46ff-b865-42ef521659df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82506c670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:41.343455 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-98fd0ee1-9c1e-46ff-b865-42ef521659df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1439 microversion: 2.1 time: 0.090329 Oct 17 13:01:41.344060 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1387/2823] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:41 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:41.687446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c73de1c9-17d8-43a8-ac32-82b45474c107 req-6a310bdf-03a0-4be9-8f78-2105d6f9e8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6d75-a1e6-46ad-bffa-d56e90f02504", "name": "network-vif-plugged", "status": "completed", "tag": "c3a2e0af-8344-49fc-827b-b2a722ffacb0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:41.707612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c73de1c9-17d8-43a8-ac32-82b45474c107 req-6a310bdf-03a0-4be9-8f78-2105d6f9e8a2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:41.708097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c73de1c9-17d8-43a8-ac32-82b45474c107 req-6a310bdf-03a0-4be9-8f78-2105d6f9e8a2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:41.708532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c73de1c9-17d8-43a8-ac32-82b45474c107 req-6a310bdf-03a0-4be9-8f78-2105d6f9e8a2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:41.733202 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c73de1c9-17d8-43a8-ac32-82b45474c107 req-6a310bdf-03a0-4be9-8f78-2105d6f9e8a2 service nova] Creating event network-vif-plugged:c3a2e0af-8344-49fc-827b-b2a722ffacb0 for instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 on n-h1-853316-12 Oct 17 13:01:41.752529 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c73de1c9-17d8-43a8-ac32-82b45474c107 req-6a310bdf-03a0-4be9-8f78-2105d6f9e8a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071583 Oct 17 13:01:41.755243 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1388/2824] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:01:41.914718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:41.926119 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58c07b57-6684-462a-a15d-bd70f4cc59ec tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 0.791755 Oct 17 13:01:41.938678 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1437/2825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:41 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:42.152532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:42.153979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:42.179642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:42.183651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:42.184329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:42.185314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:42.185981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:42.186658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:42.359704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a920a0c-3e26-4daa-80f4-014b5bc5301a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82514cd30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:42.432433 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a920a0c-3e26-4daa-80f4-014b5bc5301a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1448 microversion: 2.1 time: 0.076566 Oct 17 13:01:42.437149 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1438/2826] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:42 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1448 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:42.451641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c796907-bcd6-4ac2-8ce8-a8c29fe82360 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d1aca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:42.523227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:42.546849 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a39372a-177d-4295-b6b1-9907ff86a846 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.399097 Oct 17 13:01:42.559499 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1389/2827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:42 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:42.577340 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c796907-bcd6-4ac2-8ce8-a8c29fe82360 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 200 len: 1448 microversion: 2.1 time: 0.129618 Oct 17 13:01:42.582363 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1439/2828] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:01:42 2022] GET /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 1448 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:42.597663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-12a5c6b0-453e-4772-a750-10fc4ca39508 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa825243820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:42.964867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:42.965945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:42.980655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:42.981428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:42.982037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:42.983694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:42.984329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:42.984919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:43.434541 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-12a5c6b0-453e-4772-a750-10fc4ca39508 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 204 len: 0 microversion: 2.1 time: 0.840795 Oct 17 13:01:43.435802 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1390/2829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:42 2022] DELETE /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:01:43.445084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:43.445736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:43.456585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:43.462949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:43.463547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:43.465383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:43.465383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:43.465383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:43.527127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:01:43.541968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:43.781802 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a371eb26-dba1-490f-8883-1e8fa39e7035 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 204 len: 0 microversion: 2.1 time: 0.341737 Oct 17 13:01:43.782891 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1391/2830] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:01:43 2022] DELETE /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:01:43.792725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:43.812516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:43.852329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:43.853291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:43.859885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:43.861430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:43.862202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:43.867215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:44.142314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:44.160266 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0406831c-f9ec-48c8-a32e-8a38b68c70fb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1395 microversion: 2.1 time: 1.198079 Oct 17 13:01:44.163115 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1440/2831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:42 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1395 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:44.178680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2110611401", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "76738b67-1f67-4450-8954-529dd7a99e80"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:44.328812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:44.329616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] validate_networks() for [('76738b67-1f67-4450-8954-529dd7a99e80', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:01:44.343154 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1cea3e25-7b78-45e0-9b70-4abd87839638 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.558683 Oct 17 13:01:44.361509 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1392/2832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:43 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:45.188890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:45.189777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:45.203505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:45.204239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:45.204863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:45.205751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:45.206249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:45.206690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:45.560097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:01:45.560628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:01:45.561327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:01:45.561832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:01:45.562354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:01:45.573098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:45.573934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:45.574487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:45.575306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:45.575838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:45.576352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:45.598840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:01:45.605826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for user 638e5facdbe64d26bf3c4b5c12a33da7 and project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:01:45.620204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:01:45.622705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:01:45.678972 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a9598b1-49c2-4f70-9952-3ecbea9f704e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513112 Oct 17 13:01:45.688469 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1441/2833] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:01:45.701389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:45.702068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:45.712023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:45.712720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:45.713317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:45.714231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:45.714875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:45.715494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:45.889158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:45.900682 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8bd5d10e-42e1-444c-ac46-857bbe1c740f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.210865 Oct 17 13:01:45.924783 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1442/2834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:45 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:45.945053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bcb7ed9f-3208-4504-a5b2-cfe5e0681669 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:45.958572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bcb7ed9f-3208-4504-a5b2-cfe5e0681669 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:46.049256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bcb7ed9f-3208-4504-a5b2-cfe5e0681669 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:46.058776 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bcb7ed9f-3208-4504-a5b2-cfe5e0681669 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1208 microversion: 2.1 time: 0.131336 Oct 17 13:01:46.061388 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1443/2835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:45 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:46.259018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:46.277436 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa52a304-dd1b-4735-8de0-df6f304b4145 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1576 microversion: 2.1 time: 1.091671 Oct 17 13:01:46.288553 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1393/2836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:45 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1576 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:46.312563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:46.313915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:46.324811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:46.326087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:46.326819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:46.328487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:46.329835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:46.330617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:46.465682 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-76c32590-d969-443b-a8df-e1419f46ce74 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158602 Oct 17 13:01:46.466772 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1444/2837] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:01:46 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:46.925544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:46.926454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:46.952884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:46.955498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:46.955964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:46.956711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:46.961616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:46.962112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:47.095662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:47.097790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:47.112248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:47.114193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:47.114834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:47.116718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:47.117681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:47.118390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:47.162811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:47.256207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:47.283471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8aecf0c4-56dd-46eb-b1ad-16a3a3019d30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1260 microversion: 2.1 time: 0.200567 Oct 17 13:01:47.299408 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1445/2838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:47 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:47.315158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e0d0518d-3245-461f-ac03-4d64651fc31d req-655d06b8-3426-45e9-b1a7-ae12949581b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fce287-b697-437a-9415-b3326aa662e4", "name": "network-vif-deleted", "tag": "3511c7db-cba3-4207-ac57-1fac9cad0e41"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:47.342806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e0d0518d-3245-461f-ac03-4d64651fc31d req-655d06b8-3426-45e9-b1a7-ae12949581b7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:47.350950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:47.357172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e0d0518d-3245-461f-ac03-4d64651fc31d req-655d06b8-3426-45e9-b1a7-ae12949581b7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:47.358071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e0d0518d-3245-461f-ac03-4d64651fc31d req-655d06b8-3426-45e9-b1a7-ae12949581b7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:47.376077 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e0d0518d-3245-461f-ac03-4d64651fc31d req-655d06b8-3426-45e9-b1a7-ae12949581b7 service nova] Creating event network-vif-deleted:3511c7db-cba3-4207-ac57-1fac9cad0e41 for instance 38fce287-b697-437a-9415-b3326aa662e4 on n-h2-853316-12 Oct 17 13:01:47.378717 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10900ab8-a874-4e4e-aaf1-4778cd7c4dac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.445506 Oct 17 13:01:47.383851 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1394/2839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:46 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:47.395518 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e0d0518d-3245-461f-ac03-4d64651fc31d req-655d06b8-3426-45e9-b1a7-ae12949581b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094689 Oct 17 13:01:47.396133 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1446/2840] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:48.317371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:48.317990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:48.330785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:48.331582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:48.335065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:48.336001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:48.336652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:48.337247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:48.416875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:48.418645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:48.445024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:48.446631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:48.447350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:48.448362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:48.449159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:48.449994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:48.467128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:48.477461 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2bf17aa6-cf35-466b-9555-4cefdf116671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1266 microversion: 2.1 time: 0.164135 Oct 17 13:01:48.482210 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1395/2841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:48 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:48.830239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:48.844035 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7fc2c8f0-a42d-416d-8688-07a8f63de4a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.435052 Oct 17 13:01:48.847936 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1447/2842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:48 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:49.512651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:49.514010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:49.527340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:49.528752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:49.530402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:49.531756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:49.535089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:49.535284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:49.777495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:49.788553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b78c333f-5ab5-4247-ae58-2377977a8119 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.280676 Oct 17 13:01:49.789632 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1396/2843] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:49 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:49.854025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:49.855728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:49.862400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:49.869710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:49.870717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:49.874741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:49.876875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:49.877869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:49.879802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:49.881092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:49.881847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:49.884730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:49.886717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:49.887946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:49.889477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:49.891099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:50.135121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:50.150677 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9da93b2b-3347-42cf-97c8-a562d82826ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.285850 Oct 17 13:01:50.153449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1397/2844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:49 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:50.164907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-40150c1b-81dc-42b9-bc00-7e157dd457ad req-9422f616-55f1-4aeb-bca0-c93e0db98157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677f6d75-a1e6-46ad-bffa-d56e90f02504", "tag": "c3a2e0af-8344-49fc-827b-b2a722ffacb0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:50.187142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-40150c1b-81dc-42b9-bc00-7e157dd457ad req-9422f616-55f1-4aeb-bca0-c93e0db98157 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:50.187635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-40150c1b-81dc-42b9-bc00-7e157dd457ad req-9422f616-55f1-4aeb-bca0-c93e0db98157 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:50.188074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-40150c1b-81dc-42b9-bc00-7e157dd457ad req-9422f616-55f1-4aeb-bca0-c93e0db98157 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:50.219157 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-40150c1b-81dc-42b9-bc00-7e157dd457ad req-9422f616-55f1-4aeb-bca0-c93e0db98157 service nova] Creating event network-changed:c3a2e0af-8344-49fc-827b-b2a722ffacb0 for instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 on n-h1-853316-12 Oct 17 13:01:50.233332 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-40150c1b-81dc-42b9-bc00-7e157dd457ad req-9422f616-55f1-4aeb-bca0-c93e0db98157 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078394 Oct 17 13:01:50.234760 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1398/2845] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:50.748410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:50.772139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-810d2f2f-41a0-45bf-9f9a-c8be9428f07d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1576 microversion: 2.1 time: 0.923156 Oct 17 13:01:50.775765 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1448/2846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:49 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1576 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:50.818984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:50.819878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:50.855591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:50.857706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:50.858663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:50.859865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:50.861653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:50.865049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:51.180223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:51.180925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:51.199969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:51.203451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:51.206129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:51.207042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:51.207543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:51.207990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:51.714795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:51.737340 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-96f0f527-8820-477a-82fd-7fdad9e4a422 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.925205 Oct 17 13:01:51.738373 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1399/2847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:50 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:51.806835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:51.821913 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f82dbd0d-2d2c-4738-b24f-954d81e79e8a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.646539 Oct 17 13:01:51.824610 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1449/2848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:51 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:51.962027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d2cb6ff8-521a-4905-a35f-27b2f952a53c req-248b8225-9c97-4666-b544-8b8552bc807a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651ae713-e756-4012-8bc9-34d9ac55544d", "name": "network-vif-unplugged", "status": "completed", "tag": "d761a4e4-c380-4593-b615-9914264ed85f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:51.977743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:51.980646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d2cb6ff8-521a-4905-a35f-27b2f952a53c req-248b8225-9c97-4666-b544-8b8552bc807a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:51.981477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d2cb6ff8-521a-4905-a35f-27b2f952a53c req-248b8225-9c97-4666-b544-8b8552bc807a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:51.982319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d2cb6ff8-521a-4905-a35f-27b2f952a53c req-248b8225-9c97-4666-b544-8b8552bc807a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:52.002819 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d2cb6ff8-521a-4905-a35f-27b2f952a53c req-248b8225-9c97-4666-b544-8b8552bc807a service nova] Creating event network-vif-unplugged:d761a4e4-c380-4593-b615-9914264ed85f for instance 651ae713-e756-4012-8bc9-34d9ac55544d on n-h2-853316-12 Oct 17 13:01:52.011134 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d2cb6ff8-521a-4905-a35f-27b2f952a53c req-248b8225-9c97-4666-b544-8b8552bc807a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063461 Oct 17 13:01:52.012152 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1400/2849] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:52.761357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:52.762193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:52.778917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:52.779569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:52.780125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:52.781180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:52.781753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:52.782349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:52.851142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:52.852014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:52.873151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:52.873664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:52.874113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:52.874857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:52.875356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:52.875816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:53.141145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:53.151705 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e9462fa-ff0c-4334-87e7-627ca51804ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.305842 Oct 17 13:01:53.160427 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1401/2850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:52 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:53.337330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:53.347729 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58c14852-cd4b-4b81-8f11-8d32bdf0decb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.590196 Oct 17 13:01:53.348561 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1450/2851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:52 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:53.451068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:53.454335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:53.462231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:53.462932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:53.463576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:53.468280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:53.468955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:53.469775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:53.604048 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] HTTP exception thrown: Volume b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f could not be found. Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Request method failure captured: Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: request: PUT /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments/2316c3d2-8dec-4943-a133-d7600d55b750 HTTP/1.1 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 74 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHet7s3vb2zryl95a40_JFJ_k8Vv6Uldx0ldKxZN6kbpbIKl5p1Tq1OdrcuOImdGmZ38cVZTzw9FjMKOcNM_0sz1GW9jsyCNrCuIZHZqGNOfbUhE7tW9vF-nPAEpSJWIiW6ic4WGaEdXEyDD80W9xx5iWt-sYHhSqRd-Ntba84ZpVY Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 692645e026d84090b1e00fa171ea1578 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesAdminNegativeTest-1201315727 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_692645e026d84090b1e00fa171ea1578", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/692645e026d84090b1e00fa171ea1578"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/692645e026d84090b1e00fa171ea1578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/692645e026d84090b1e00fa171ea1578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesAdminNegativeTest-1201315727 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 692645e026d84090b1e00fa171ea1578 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1201315727 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesAdminNegativeTest-1201315727-project-admin Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6e34fa225d314f798aa65c323a67e195 Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesAdminNegativeTest-1201315727-project-admin Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: {"volumeAttachment": {"volumeId": "b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f"}} Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: exception: Volume b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f could not be found. Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': 'a9b2265a-9332-47d0-aca4-df5bfd6d236a', 'id': '2316c3d2-8dec-4943-a133-d7600d55b750', 'body': {'volumeAttachment': {'volumeId': 'b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f'}}} Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f could not be found. (HTTP 404) (Request-ID: req-6e6f3790-095b-4a09-8549-d135e14fd368) Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:01:53.643620 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f could not be found. Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f could not be found. Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f could not be found. Oct 17 13:01:53.648712 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:01:53.652127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Returning 400 to user: Volume b5bb6d38-bf14-4bc8-a5ed-8fd788c74d5f could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:01:53.653579 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c526e846-f7e3-42fa-ab6e-e4f6498d042f tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments/2316c3d2-8dec-4943-a133-d7600d55b750" status: 400 len: 107 microversion: 2.1 time: 0.490985 Oct 17 13:01:53.660464 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1402/2852] 10.222.0.27 () {60 vars in 1433 bytes} [Mon Oct 17 13:01:53 2022] PUT /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments/2316c3d2-8dec-4943-a133-d7600d55b750 => generated 107 bytes in 494 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:01:53.765797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:53.766483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:53.782789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:53.783597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:53.784307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:53.786063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:53.787305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:53.788323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:53.889711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lazy-loading 'services' on Instance uuid a9b2265a-9332-47d0-aca4-df5bfd6d236a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:01:53.987380 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6a8795d0-0e5a-41f7-b70b-c769f37d713b tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments/2316c3d2-8dec-4943-a133-d7600d55b750" status: 202 len: 0 microversion: 2.1 time: 0.225538 Oct 17 13:01:53.988185 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1451/2853] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:01:53 2022] DELETE /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments/2316c3d2-8dec-4943-a133-d7600d55b750 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:01:54.002767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:54.013468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:54.029950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:54.030841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:54.040339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.042389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.043082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.051208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.051708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.052155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.056456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.057169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.059080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.060093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.062341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.063043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.124399 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-101b56ca-172c-48c2-bfbd-0cb50e8534f4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130645 Oct 17 13:01:54.125634 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1403/2854] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:01:53 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:54.133062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3668ae86-fd2c-421d-b5af-bfcbf318d8fd req-269d76ee-4a93-444c-b82d-a5c2ba9fea02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651ae713-e756-4012-8bc9-34d9ac55544d", "tag": "d761a4e4-c380-4593-b615-9914264ed85f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:54.157986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3668ae86-fd2c-421d-b5af-bfcbf318d8fd req-269d76ee-4a93-444c-b82d-a5c2ba9fea02 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.158644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3668ae86-fd2c-421d-b5af-bfcbf318d8fd req-269d76ee-4a93-444c-b82d-a5c2ba9fea02 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.158861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3668ae86-fd2c-421d-b5af-bfcbf318d8fd req-269d76ee-4a93-444c-b82d-a5c2ba9fea02 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.175040 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3668ae86-fd2c-421d-b5af-bfcbf318d8fd req-269d76ee-4a93-444c-b82d-a5c2ba9fea02 service nova] Creating event network-changed:d761a4e4-c380-4593-b615-9914264ed85f for instance 651ae713-e756-4012-8bc9-34d9ac55544d on n-h2-853316-12 Oct 17 13:01:54.181333 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3668ae86-fd2c-421d-b5af-bfcbf318d8fd req-269d76ee-4a93-444c-b82d-a5c2ba9fea02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054133 Oct 17 13:01:54.181943 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1404/2855] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:54.191094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-eaeb6b50-6429-44ee-a11e-5eeda5bf1125 req-9f00210b-e325-48ab-89eb-438d956c7e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800f7d25-a5d5-415d-b3c3-29fd11e206d6", "tag": "19335654-baf3-4919-893c-8ea11fd4b242"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:01:54.207996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lazy-loading 'services' on Instance uuid e6c5672f-8586-4476-85ec-81ff1d7400d6 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:01:54.210760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eaeb6b50-6429-44ee-a11e-5eeda5bf1125 req-9f00210b-e325-48ab-89eb-438d956c7e5d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.211795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eaeb6b50-6429-44ee-a11e-5eeda5bf1125 req-9f00210b-e325-48ab-89eb-438d956c7e5d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.212554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eaeb6b50-6429-44ee-a11e-5eeda5bf1125 req-9f00210b-e325-48ab-89eb-438d956c7e5d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.226284 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-eaeb6b50-6429-44ee-a11e-5eeda5bf1125 req-9f00210b-e325-48ab-89eb-438d956c7e5d service nova] Creating event network-changed:19335654-baf3-4919-893c-8ea11fd4b242 for instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 on n-h1-853316-12 Oct 17 13:01:54.231890 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-eaeb6b50-6429-44ee-a11e-5eeda5bf1125 req-9f00210b-e325-48ab-89eb-438d956c7e5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044860 Oct 17 13:01:54.233513 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1405/2856] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:54.239091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:54.239791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:54.248211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.249070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.250094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.251084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.262023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.266135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.343812 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f9e515d3-c829-4da7-8338-94f833e7622c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/os-volume_attachments/9fce598d-f1ab-44b9-8b01-f59d7ea34c4a" status: 202 len: 0 microversion: 2.1 time: 0.331779 Oct 17 13:01:54.349515 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1452/2857] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:01:54 2022] DELETE /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/os-volume_attachments/9fce598d-f1ab-44b9-8b01-f59d7ea34c4a => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:01:54.378529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:54.391162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:54.437340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.438915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.441924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:54.443006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:54.458023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:54.460382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:55.071229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:55.083330 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d3a4435e-9f55-497f-b218-6d0d817ef91d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.848340 Oct 17 13:01:55.084394 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1406/2858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:54 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:55.137408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:55.139927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:55.155532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:55.156043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:55.156487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:55.157213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:55.157674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:55.158113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:55.247928 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a08cd92f-fe06-40c9-a22e-48c1f545fcd4 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114563 Oct 17 13:01:55.249034 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1407/2859] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:01:55 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:55.312954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:55.324086 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5448deeb-2c5f-438e-af07-0d62ec63f4d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.953477 Oct 17 13:01:55.324720 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1453/2860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:54 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:56.109606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:56.110283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:56.124898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:56.125402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:56.125844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:56.126615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:56.128023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:56.132980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:56.264000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:56.268709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:56.276743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:56.282147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:56.287744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:56.288550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:56.289923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:56.291056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:56.291799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:56.292458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:56.338662 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11d2bc5e-52da-4ff9-b787-2e3e9e64f167 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081172 Oct 17 13:01:56.340890 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1454/2861] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:01:56 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:56.351356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:56.353488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:56.360700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:56.361529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:56.362972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:56.363967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:56.364680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:56.367759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:56.814262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:56.823833 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-83230c14-beaf-46e8-afb2-74ee29258199 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.477590 Oct 17 13:01:56.827129 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1455/2862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:56 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:57.353519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:57.356307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:57.371567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:57.372169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:57.379068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:57.384128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:57.384665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:57.386693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:57.488364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:57.503787 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-871a9863-5396-4d87-84cf-f0e0a61bb2d0 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 1.398552 Oct 17 13:01:57.504375 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1408/2863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:56 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:57.523624 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e02e308f-2262-430e-a3e3-a9927f2d1400 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153211 Oct 17 13:01:57.525092 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1456/2864] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:01:57 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:57.853217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:57.854115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:57.870253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:57.871086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:57.871686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:57.872742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:57.873441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:57.874027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:58.263687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:58.268489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:01:58.279233 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f4c414b-a578-4c83-b332-7f253da1a1d4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.432117 Oct 17 13:01:58.280255 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1409/2865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:57 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:01:58.530656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:58.532977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:58.538511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:58.540791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:58.546862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:58.547363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:58.547807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:58.548510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:58.560142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:58.560715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:58.560970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:58.561405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:58.561965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:58.563804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:58.564644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:58.565181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:58.635642 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3be682f3-5c11-463f-8843-44de50b8edd3 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101454 Oct 17 13:01:58.642035 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1410/2866] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:01:58 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:58.892819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:01:58.917588 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e8d93fd-2219-451c-959b-4df771d14fdf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.391670 Oct 17 13:01:58.918218 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1457/2867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:58 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:01:59.305616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:59.306381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:59.318710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:59.321570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:59.322535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:59.324429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:59.326735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:59.327614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:59.650996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:59.653322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:59.660699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:59.661186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:59.662129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:59.662961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:59.664485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:59.664943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:59.701105 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-66b0f6db-3178-4ef3-ace0-08a952e5e4ad tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055767 Oct 17 13:01:59.701947 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1458/2868] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:01:59 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:01:59.944241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:01:59.944867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:01:59.951097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:59.951582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:59.952214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:01:59.952913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:01:59.953364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:01:59.953787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:00.009868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:00.028202 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4399a19a-070d-4134-a041-4afd5caf0847 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.726492 Oct 17 13:02:00.029501 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1411/2869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:59 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:00.266115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:00.283828 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b5f5d0f-37cb-4e09-a242-f57f82c270ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.343838 Oct 17 13:02:00.286133 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1459/2870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:01:59 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:00.714054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:00.717396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:00.726933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:00.728349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:00.729313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:00.730268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:00.730911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:00.731610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:00.767233 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f297987e-f8f9-4e97-b773-e9ab5257f917 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057405 Oct 17 13:02:00.768438 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1412/2871] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:00 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:01.062512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:01.064232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:01.078433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:01.081068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:01.082539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:01.086426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:01.087174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:01.089095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:01.312718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:01.314863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:01.324461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:01.325926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:01.326643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:01.328317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:01.329035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:01.329872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:01.411427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:01.419910 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85c2eb82-bd28-425d-9c09-46eed4ad506b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.366295 Oct 17 13:02:01.434494 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1460/2872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:01 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:01.559844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:01.576566 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6204938b-c6d7-4c83-8ca5-d6a74a7b73ac tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.270104 Oct 17 13:02:01.579511 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1413/2873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:01 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:01.791078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:01.793726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:01.806306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:01.809708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:01.811946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:01.812411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:01.813161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:01.813634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:01.814069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:01.867348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:01.885004 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f73ff98-8d28-4692-aad8-2be37d15a6a8 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107080 Oct 17 13:02:01.886636 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1461/2874] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:01 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:02:02.191326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1018465920", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "31731662-881a-480d-95e8-d7e187d81c94"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:02.273865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] validate_networks() for [('31731662-881a-480d-95e8-d7e187d81c94', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:02:02.446840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:02.447539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:02.459827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:02.460331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:02.460774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:02.461489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:02.461952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:02.462416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:03.351427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:03.363956 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3f99c90-e8af-4885-8e1f-755677837670 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.921834 Oct 17 13:02:03.371680 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1462/2875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:02 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:03.391254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:03.394935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:03.414114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:03.418929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:03.419540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:03.423351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:03.424022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:03.424565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:03.480311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:02:03.480897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:02:03.481410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:02:03.482405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:02:03.483041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:02:03.512608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:03.513113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:03.513563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:03.515074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:03.515819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:03.516271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:03.554351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Getting quotas for project 1b99cb2247534fafa72b854244f7d088. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:02:03.564903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Getting quotas for user ca5d4216b6e942ada4f9ba5135541a80 and project 1b99cb2247534fafa72b854244f7d088. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:02:03.592272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:02:03.595078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:02:03.665043 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd7b4b57-fb15-449e-a5a9-6d002c3697d6 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.477998 Oct 17 13:02:03.666293 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1414/2876] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:02:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:02:03.679667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ebda4c1-48b2-4525-8423-792230337f8a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:03.682849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ebda4c1-48b2-4525-8423-792230337f8a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:03.793543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ebda4c1-48b2-4525-8423-792230337f8a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:03.819530 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ebda4c1-48b2-4525-8423-792230337f8a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1218 microversion: 2.1 time: 0.144340 Oct 17 13:02:03.847468 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1415/2877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:03 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:03.894682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:03.910418 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3878b650-c599-422f-b688-12f18ac30fe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.537052 Oct 17 13:02:03.911267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1463/2878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:03 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:04.400368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:04.401343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:04.408208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:04.417871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:04.418698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:04.419693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:04.420378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:04.421650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:04.602789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:04.615778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-706b1073-2f14-475d-8141-98ac27610218 req-b0a65a66-8f40-4cb8-8080-a3dc4f01a2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800f7d25-a5d5-415d-b3c3-29fd11e206d6", "name": "network-vif-plugged", "status": "completed", "tag": "19335654-baf3-4919-893c-8ea11fd4b242"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:04.616607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3722ccf5-1ce1-4ac6-a902-2126faad1c30 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.220949 Oct 17 13:02:04.617594 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1416/2879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:04 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:04.638266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-706b1073-2f14-475d-8141-98ac27610218 req-b0a65a66-8f40-4cb8-8080-a3dc4f01a2b7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:04.638772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-706b1073-2f14-475d-8141-98ac27610218 req-b0a65a66-8f40-4cb8-8080-a3dc4f01a2b7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:04.639211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-706b1073-2f14-475d-8141-98ac27610218 req-b0a65a66-8f40-4cb8-8080-a3dc4f01a2b7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:04.652114 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-706b1073-2f14-475d-8141-98ac27610218 req-b0a65a66-8f40-4cb8-8080-a3dc4f01a2b7 service nova] Creating event network-vif-plugged:19335654-baf3-4919-893c-8ea11fd4b242 for instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 on n-h1-853316-12 Oct 17 13:02:04.657713 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-706b1073-2f14-475d-8141-98ac27610218 req-b0a65a66-8f40-4cb8-8080-a3dc4f01a2b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046408 Oct 17 13:02:04.658731 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1464/2880] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:02:04.860799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:04.861609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:04.872694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:04.873440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:04.873979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:04.875223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:04.889381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:04.890116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:04.935841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:04.936641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:04.952371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:04.952921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:04.956069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:04.959981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:04.960726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:04.962228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:05.019138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:05.031890 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c5e56bbc-7d25-4d22-8e61-18e33a5b6e07 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1270 microversion: 2.1 time: 0.175982 Oct 17 13:02:05.036069 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1417/2881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:04 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:05.336098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:05.353849 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-708700e9-1094-4f41-8423-f24e9ca892b4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.422733 Oct 17 13:02:05.358945 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1465/2882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:04 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:05.641439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:05.642927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:05.655730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:05.656841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:05.659018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:05.660018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:05.662470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:05.663380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:06.063357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:06.064345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:06.076120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:06.076628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:06.077082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:06.077976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:06.080683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:06.081312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:06.127962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:06.137424 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-00693385-807a-423d-b05c-90cbbf01d0fd tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1308 microversion: 2.1 time: 0.500885 Oct 17 13:02:06.138026 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1418/2883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:05 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1308 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:06.217406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:06.231807 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7ad66354-b522-4445-abc1-7acb926ffa47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1276 microversion: 2.1 time: 0.172416 Oct 17 13:02:06.234478 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1466/2884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:06 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:06.394444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:06.395069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:06.406032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:06.406467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:06.406948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:06.407663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:06.408121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:06.408551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:06.847139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:06.860918 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-16ae4baa-d3bb-4f18-b9f9-1dea0e96a5ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.470292 Oct 17 13:02:06.874844 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1419/2885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:06 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:07.169214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:07.169840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:07.188779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:07.192347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:07.194513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:07.195433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:07.196920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:07.202004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:07.265255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:07.265882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:07.284802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:07.289523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:07.290013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:07.290779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:07.297559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:07.299106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:07.981269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:08.000178 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5cdd2e4a-e6de-4da6-8a12-eb85275aa297 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1318 microversion: 2.1 time: 0.738963 Oct 17 13:02:08.016791 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1420/2886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:07 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:08.038831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-37d84310-fbb5-4145-8e78-deb12aa912d9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:08.049507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37d84310-fbb5-4145-8e78-deb12aa912d9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:08.049927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37d84310-fbb5-4145-8e78-deb12aa912d9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:08.050415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37d84310-fbb5-4145-8e78-deb12aa912d9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:08.112369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-37d84310-fbb5-4145-8e78-deb12aa912d9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:02:08.214842 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-37d84310-fbb5-4145-8e78-deb12aa912d9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/action" status: 202 len: 0 microversion: 2.1 time: 0.196343 Oct 17 13:02:08.219028 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1421/2887] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:02:08 2022] POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:02:08.231146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:08.237290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:08.252024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:08.254382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:08.254857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:08.258106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:08.258665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:08.260374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:08.358896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:08.373702 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f04b996-1127-40fb-aa4f-dd2e57af8033 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 200 len: 1488 microversion: 2.1 time: 1.211240 Oct 17 13:02:08.374712 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1467/2888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:07 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 1488 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:08.384707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:08.385728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:08.405263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:08.406176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:08.406848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:08.407789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:08.408466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:08.409113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:08.621996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:08.635948 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-632e28d5-1e29-42c3-aada-5b57ed8f325f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.415606 Oct 17 13:02:08.637723 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1422/2889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:08 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:08.643992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-870633832"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:08.653003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:08.667378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:08.667867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:08.668305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:08.669004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:08.669453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:08.669870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:08.796702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:08.811266 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58a3b633-2b97-4693-b3e9-ff4bcfaab645 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1678 microversion: 2.1 time: 0.435193 Oct 17 13:02:08.812085 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1468/2890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:08 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1678 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:09.032524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:09.033275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:09.050357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:09.053348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:09.054003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:09.055239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:09.056278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:09.061041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:09.243668 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd6768dc-27f9-4777-a1cc-f9fc14998e00 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6/action" status: 202 len: 0 microversion: 2.1 time: 0.604570 Oct 17 13:02:09.246239 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1423/2891] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:02:08 2022] POST /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:02:09.272338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d68c3072-80cf-4f1e-8a58-43acdc6b4788 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820c61c10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:09.375272 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d68c3072-80cf-4f1e-8a58-43acdc6b4788 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.122883 Oct 17 13:02:09.389231 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1424/2892] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:09 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:09.407905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:09.422192 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-020d073a-bfe0-4b05-9cc1-c0e141479642 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1318 microversion: 2.1 time: 0.394677 Oct 17 13:02:09.422804 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1469/2893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:09 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:09.668521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:09.669999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:09.685427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:09.689697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:09.690459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:09.691312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:09.693000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:09.694925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:09.840462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:09.841256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:09.851591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:09.855000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:09.855579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:09.856436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:09.860124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:09.860872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:10.090536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:10.111124 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aada7552-369b-441e-8b92-ae7324052c9c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.454510 Oct 17 13:02:10.112035 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1425/2894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:09 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:10.278094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:10.296162 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f8e5b20d-0790-489b-9eae-b6e52cea9e21 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1678 microversion: 2.1 time: 0.456876 Oct 17 13:02:10.297721 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1470/2895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:09 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1678 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:10.359354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-253a7b7c-2ed7-40ae-a370-5aa044277007 req-9a1e133a-59a7-49ef-9f97-8c899c6774c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa273e4-58c3-4196-8587-527e9992b9ee", "tag": "30d2b573-84af-4ce7-8ade-e9c51be7e322"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:10.392001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-253a7b7c-2ed7-40ae-a370-5aa044277007 req-9a1e133a-59a7-49ef-9f97-8c899c6774c2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:10.392844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-253a7b7c-2ed7-40ae-a370-5aa044277007 req-9a1e133a-59a7-49ef-9f97-8c899c6774c2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:10.393376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-253a7b7c-2ed7-40ae-a370-5aa044277007 req-9a1e133a-59a7-49ef-9f97-8c899c6774c2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:10.405780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c61b930a-d30f-4d34-abfc-ba582eefb057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d2a670>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:10.427862 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-253a7b7c-2ed7-40ae-a370-5aa044277007 req-9a1e133a-59a7-49ef-9f97-8c899c6774c2 service nova] Creating event network-changed:30d2b573-84af-4ce7-8ade-e9c51be7e322 for instance 2aa273e4-58c3-4196-8587-527e9992b9ee on n-h2-853316-12 Oct 17 13:02:10.443142 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-253a7b7c-2ed7-40ae-a370-5aa044277007 req-9a1e133a-59a7-49ef-9f97-8c899c6774c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083668 Oct 17 13:02:10.450880 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1426/2896] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:10.456964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:10.459307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:10.479404 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c61b930a-d30f-4d34-abfc-ba582eefb057 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.079126 Oct 17 13:02:10.480072 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1471/2897] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:10 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:10.486960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:10.487766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:10.488217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:10.488935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:10.492006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:10.492504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:10.534936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:11.116548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:11.140938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:11.141550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:11.164151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:11.178909 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9fa496b-5d96-4973-a69d-4fd234b70fd1 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1318 microversion: 2.1 time: 0.713061 Oct 17 13:02:11.179762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:11.180262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:11.181019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:11.181490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:11.181917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:11.183643 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1427/2898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:10 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:11.324230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:11.324832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:11.334753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:11.335686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:11.336286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:11.337180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:11.337848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:11.353103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:11.531385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:11.542870 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1bf57873-3520-4c68-90b5-62772c0d485a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.405775 Oct 17 13:02:11.545510 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1472/2899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:11 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:11.576927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-386eaafe-d12d-49b9-9fbb-790a53fde7c5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820e49dc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:11.657283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-386eaafe-d12d-49b9-9fbb-790a53fde7c5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.095160 Oct 17 13:02:11.663632 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1473/2900] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:11 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:12.216375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:12.217282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:12.225993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:12.227367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:12.227934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:12.229517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:12.230230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:12.230913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:12.237453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:12.257793 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10f63ba0-feb2-4466-a91d-6d112d47db5d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1678 microversion: 2.1 time: 0.937171 Oct 17 13:02:12.258536 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1428/2901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:11 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1678 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:12.571033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:12.572231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:12.579375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:12.580056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:12.580652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:12.581652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:12.582595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:12.583789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:12.835095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:12.845105 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20f3da0a-2b6d-4c1b-940e-34f8df7a3001 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1318 microversion: 2.1 time: 0.642276 Oct 17 13:02:12.846958 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1474/2902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:12 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:12.853788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc8caa72-e18f-45ee-9c62-54d6042174d6 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820e49670>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:12.918149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc8caa72-e18f-45ee-9c62-54d6042174d6 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.069275 Oct 17 13:02:12.934626 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1475/2903] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:12 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:13.018985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:13.030414 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ab2f96b-46bf-44dc-82ca-175d28eafdea tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.464683 Oct 17 13:02:13.046188 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1429/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:12 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:13.295556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:13.296174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:13.310798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:13.311682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:13.313583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:13.315881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:13.316544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:13.319594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:13.636866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:13.659048 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0fc9166f-830d-4a24-b84f-7688ae40c4f8 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1678 microversion: 2.1 time: 0.368146 Oct 17 13:02:13.664850 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1476/2905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:13 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1678 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:13.875071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:13.877444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:13.888563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:13.890431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:13.896882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:13.897395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:13.897844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:13.898607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:13.899063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:13.909408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:13.944484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff077e5e-0971-4de8-bee5-18540924a041 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820e49d30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:14.014611 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff077e5e-0971-4de8-bee5-18540924a041 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.077660 Oct 17 13:02:14.015951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1477/2906] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:13 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:14.056235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:14.057123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:14.065721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:14.066552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:14.067189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:14.068666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:14.069580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:14.070231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:14.530717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:14.542139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-434e7e34-ae2c-4a66-89e9-7b986a743063 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.489924 Oct 17 13:02:14.558251 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1478/2907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:14 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:14.660329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:14.684126 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-746f6769-1673-466f-a583-df124ec8f98d tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1318 microversion: 2.1 time: 0.817032 Oct 17 13:02:14.702347 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1430/2908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:13 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:14.708838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:14.709778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:14.716348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:14.716767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:14.717405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:14.718358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:14.718976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:14.719562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:15.031284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-64b7dab2-fb22-4560-be8b-99d06806c81b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8204bb310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:15.123069 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-64b7dab2-fb22-4560-be8b-99d06806c81b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.095802 Oct 17 13:02:15.123281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:15.123869 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1431/2909] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:15 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:15.131844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-23fa2f2b-77d3-4ab8-874e-bcf0df7869ce tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1678 microversion: 2.1 time: 0.427735 Oct 17 13:02:15.133505 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1479/2910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:14 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1678 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:15.568954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:15.569588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:15.584381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:15.585943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:15.586706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:15.588669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:15.589626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:15.592466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:15.714803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:15.715575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:15.724707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:15.726410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:15.733315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:15.734081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:15.734594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:15.735232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:15.848197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:15.859092 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-06f54ed2-7e4d-4cc9-8fb6-ec5b86948c5c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1719 microversion: 2.1 time: 0.295062 Oct 17 13:02:15.859946 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1432/2911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:15 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1719 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:16.138878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b725b01-4c97-4ec2-b83e-9ca8d3277d6b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8250a4310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:16.189056 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b725b01-4c97-4ec2-b83e-9ca8d3277d6b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.053945 Oct 17 13:02:16.190297 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1433/2912] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:16 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:16.195776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:16.196685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:16.203275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:16.204067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:16.204851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:16.205788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:16.206561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:16.207211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:16.230731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:16.245777 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3bdff39d-3ab6-460b-b28a-97cf1b8ceb6a tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1318 microversion: 2.1 time: 0.534734 Oct 17 13:02:16.246391 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1480/2913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:15 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:16.367061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:16.375637 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8848ea72-4a4c-4daf-a0d1-e3527a0e9103 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1678 microversion: 2.1 time: 0.184012 Oct 17 13:02:16.382805 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1434/2914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:16 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:16.406514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a77bc2ba-c640-4ded-a7cd-78418424569f req-b85c6d34-2163-41a3-8257-c1af6d0258c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800f7d25-a5d5-415d-b3c3-29fd11e206d6", "name": "network-vif-plugged", "status": "completed", "tag": "19335654-baf3-4919-893c-8ea11fd4b242"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:16.417778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a77bc2ba-c640-4ded-a7cd-78418424569f req-b85c6d34-2163-41a3-8257-c1af6d0258c8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:16.419150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a77bc2ba-c640-4ded-a7cd-78418424569f req-b85c6d34-2163-41a3-8257-c1af6d0258c8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:16.420556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a77bc2ba-c640-4ded-a7cd-78418424569f req-b85c6d34-2163-41a3-8257-c1af6d0258c8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:16.453885 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a77bc2ba-c640-4ded-a7cd-78418424569f req-b85c6d34-2163-41a3-8257-c1af6d0258c8 service nova] Creating event network-vif-plugged:19335654-baf3-4919-893c-8ea11fd4b242 for instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 on n-h1-853316-12 Oct 17 13:02:16.465386 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a77bc2ba-c640-4ded-a7cd-78418424569f req-b85c6d34-2163-41a3-8257-c1af6d0258c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063872 Oct 17 13:02:16.467063 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1481/2915] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:16.884413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:16.885061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:16.891972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:16.892498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:16.892939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:16.893859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:16.894349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:16.894987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.084535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:17.098035 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5024a69a-a0de-44f6-ad4d-d06b00b3a008 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1709 microversion: 2.1 time: 0.217416 Oct 17 13:02:17.098859 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1435/2916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:16 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1709 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:17.123001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5accf064-8637-4300-ad16-66cf70070cde tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '.version_select at 0x7fa8251308b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:17.128120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5accf064-8637-4300-ad16-66cf70070cde tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.129414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5accf064-8637-4300-ad16-66cf70070cde tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.131013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5accf064-8637-4300-ad16-66cf70070cde tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.140217 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5accf064-8637-4300-ad16-66cf70070cde tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.022077 Oct 17 13:02:17.141069 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1482/2917] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 13:02:17 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:17.155016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:17.155642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:17.162325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.163736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.164699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.166074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.166799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.167562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.209386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db06177f-a3f8-4bc5-bd05-a29928375cd5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820f255e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:17.289985 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db06177f-a3f8-4bc5-bd05-a29928375cd5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.085268 Oct 17 13:02:17.299873 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1483/2918] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:17 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:17.306980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:17.308067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:17.329502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.334784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.350043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.351308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.352539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.353195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.408684 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-714c0024-daa2-4e3f-bcae-aec3f00e3ef1 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1862 microversion: 2.1 time: 0.257213 Oct 17 13:02:17.412306 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1436/2919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:17 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1862 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:17.417963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:17.418920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:17.425287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.426141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.439255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.440639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.441963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.442507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.636792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:17.647255 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-998aa35a-b150-4873-a67c-1952b1ee1390 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1678 microversion: 2.1 time: 0.233393 Oct 17 13:02:17.648719 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1437/2920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:17 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:17.655282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:17.656508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:17.667672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.668452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.668905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.669623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:17.670081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:17.670775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:17.853049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:17.873240 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-efe38a68-ed3d-442e-84f1-babc4f828c1f tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1318 microversion: 2.1 time: 0.568171 Oct 17 13:02:17.874415 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1484/2921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:17 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:17.938511 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a0863282-a569-475c-8f33-c529c992e761 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1862 microversion: 2.1 time: 0.288400 Oct 17 13:02:17.943850 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1438/2922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:17 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1862 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:18.044229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:18.045728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:18.056784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.057466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.059463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.060397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.061082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.061676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.069769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:18.191936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lazy-loading 'services' on Instance uuid 651ae713-e756-4012-8bc9-34d9ac55544d {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:02:18.281813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c689bc4d-2d26-49d3-819c-0249bd0d5f58 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments/8652cf13-ca2e-4601-bbc4-8a4b105be16a" status: 202 len: 0 microversion: 2.1 time: 0.246605 Oct 17 13:02:18.282472 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1485/2923] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:02:18 2022] DELETE /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments/8652cf13-ca2e-4601-bbc4-8a4b105be16a => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:02:18.296494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:18.299599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:18.315742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-442211ae-d5b6-4583-b8ef-f618b39482c8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82140b820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:18.329488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.330883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.337318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.339445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.339995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.341492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.384989 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-442211ae-d5b6-4583-b8ef-f618b39482c8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.078975 Oct 17 13:02:18.385795 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1486/2924] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:18 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:18.449563 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b1604887-7764-493a-83e6-fd1c3348e937 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161009 Oct 17 13:02:18.453274 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1439/2925] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:18 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:18.672850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d340436c-670e-4862-be80-fe2aaedce251 req-7cb40eee-24a8-48f7-8a42-e68ddc665141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa273e4-58c3-4196-8587-527e9992b9ee", "name": "network-vif-plugged", "status": "completed", "tag": "30d2b573-84af-4ce7-8ade-e9c51be7e322"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:18.675702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:18.677921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:18.685333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d340436c-670e-4862-be80-fe2aaedce251 req-7cb40eee-24a8-48f7-8a42-e68ddc665141 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.686066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d340436c-670e-4862-be80-fe2aaedce251 req-7cb40eee-24a8-48f7-8a42-e68ddc665141 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.686702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.687071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d340436c-670e-4862-be80-fe2aaedce251 req-7cb40eee-24a8-48f7-8a42-e68ddc665141 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.687467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.688002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.688833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.689438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.690310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.702970 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d340436c-670e-4862-be80-fe2aaedce251 req-7cb40eee-24a8-48f7-8a42-e68ddc665141 service nova] Creating event network-vif-plugged:30d2b573-84af-4ce7-8ade-e9c51be7e322 for instance 2aa273e4-58c3-4196-8587-527e9992b9ee on n-h2-853316-12 Oct 17 13:02:18.708268 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d340436c-670e-4862-be80-fe2aaedce251 req-7cb40eee-24a8-48f7-8a42-e68ddc665141 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039258 Oct 17 13:02:18.709414 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1487/2926] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:18.901384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:18.902138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:18.918086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.919462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.922341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.923216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:18.924154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:18.925395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:18.962226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:18.977233 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19501c23-f41e-4fa4-9120-9d798fe42ffe tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1655 microversion: 2.1 time: 0.308316 Oct 17 13:02:18.979252 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1440/2927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:18 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1655 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:19.008519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fbaa0a72-7f8f-4199-ad0e-a4e1241ea54d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:19.021959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbaa0a72-7f8f-4199-ad0e-a4e1241ea54d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:19.024497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbaa0a72-7f8f-4199-ad0e-a4e1241ea54d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:19.025151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbaa0a72-7f8f-4199-ad0e-a4e1241ea54d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:19.071059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fbaa0a72-7f8f-4199-ad0e-a4e1241ea54d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Going to try to start instance {{(pid=127539) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:02:19.139094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fbaa0a72-7f8f-4199-ad0e-a4e1241ea54d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/action" status: 202 len: 0 microversion: 2.1 time: 0.137619 Oct 17 13:02:19.143901 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1441/2928] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:02:19 2022] POST /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:02:19.151998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:19.152715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:19.160644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:19.163270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:19.164785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:19.167452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:19.168264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:19.168943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:19.487354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:19.498023 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ffba3585-8c8a-43dc-8e67-284c9e27fcfa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1664 microversion: 2.1 time: 0.352474 Oct 17 13:02:19.499779 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1442/2929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:19 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1664 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:19.505909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f46872e-982f-4007-980b-80438555cbea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820fb1d30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:19.581035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:19.591107 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3f46872e-982f-4007-980b-80438555cbea tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.090264 Oct 17 13:02:19.594326 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1443/2930] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:19 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:19.596036 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b69c7917-7578-487c-951b-6cd8c2334861 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1318 microversion: 2.1 time: 0.699239 Oct 17 13:02:19.597113 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1488/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:18 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1318 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:19.608714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:19.618020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:19.630451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:19.631791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:19.632628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:19.633701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:19.634543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:19.635246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:19.684829 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2bd021df-a385-49f6-836c-532c3f3fd50d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083965 Oct 17 13:02:19.685783 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1444/2932] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:19 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:20.529206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:20.530109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:20.549454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:20.550312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:20.551439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:20.552947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:20.553579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:20.554239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:20.611680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7b06f8b2-a918-4d54-9004-16d68a47c879 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820fb1820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:20.717949 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7b06f8b2-a918-4d54-9004-16d68a47c879 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.111094 Oct 17 13:02:20.718714 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1445/2933] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:20 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:20.736020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:20.745651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:20.772086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:20.779293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:20.783823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:20.784934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:20.788373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:20.792310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:20.884359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:20.894665 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4f5247a0-29b8-4150-9ff2-2cf7c517555c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1664 microversion: 2.1 time: 0.371475 Oct 17 13:02:20.903790 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1489/2934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:20 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1664 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:20.909961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:20.913719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:20.923686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:20.924463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:20.925129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:20.928006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:20.928776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:20.932626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:20.985409 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f54b50df-acbc-4e82-bba5-b06d54a38cc4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080051 Oct 17 13:02:20.994364 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1490/2935] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:20 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:21.141326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:21.156062 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d02c463-0dd9-4ca6-893c-cac5232621cf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1508 microversion: 2.1 time: 0.435362 Oct 17 13:02:21.156927 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1446/2936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:20 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1508 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:21.741885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d40692a-99b8-46c9-a550-e8894ae179d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8212abf70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:21.920053 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d40692a-99b8-46c9-a550-e8894ae179d1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.176369 Oct 17 13:02:21.922878 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1491/2937] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:21 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:21.942905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:21.946392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:21.971484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:21.981721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:21.983003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:21.987535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:22.008199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:22.012338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:22.013489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:22.015419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:22.016527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:22.042968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:22.043780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:22.045351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:22.046722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:22.048762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:22.050936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:22.054607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:22.141758 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec4b8275-30e7-42ad-8398-52214fe15714 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146439 Oct 17 13:02:22.144021 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1492/2938] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:21 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:02:22.638677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:22.651848 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-61b15e44-52dc-42ea-9f75-b0d3f4262c49 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1664 microversion: 2.1 time: 0.715816 Oct 17 13:02:22.657253 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1447/2939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:21 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1664 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:22.947440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a1d5d0f-c736-471c-9fe9-50908551addb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820f1dca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:23.084142 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a1d5d0f-c736-471c-9fe9-50908551addb tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.141078 Oct 17 13:02:23.085698 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1493/2940] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:22 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:23.169487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:23.189856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:23.220656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:23.221964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:23.223039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:23.227707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:23.229115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:23.230971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:23.376998 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d277d996-ba6d-4dc6-9087-924a5b36c65a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.223348 Oct 17 13:02:23.385571 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1448/2941] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:23 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:23.680473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:23.681525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:23.692887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:23.696250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:23.710984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:23.711771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:23.712250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:23.712882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:24.101336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04665fab-7078-4e8c-b801-faa40b4ee04b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8212eab80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:24.149277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:24.166813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fbf99a71-6022-433e-837e-68cd19891c75 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1668 microversion: 2.1 time: 0.491386 Oct 17 13:02:24.169384 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1494/2942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:23 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1668 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:24.199728 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04665fab-7078-4e8c-b801-faa40b4ee04b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.102179 Oct 17 13:02:24.201187 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1449/2943] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:24 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:24.397278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:24.400262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:24.446537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:24.449530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:24.451527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:24.453358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:24.458535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:24.461914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:24.509318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "079fcf24-33d7-4277-979c-b2c43bf4bc76"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:24.517092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:24.529372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:24.530295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:24.531347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:24.532577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:24.533444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:24.534144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:24.572326 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd979f03-af20-41b6-b7d9-6b9ffef9bdcb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180611 Oct 17 13:02:24.572919 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1495/2944] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:24 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:24.622812 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] HTTP exception thrown: Volume 8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 could not be found. Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Request method failure captured: Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: request: PUT /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee/os-volume_attachments/8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 HTTP/1.1 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 74 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHet7s3vb2zryl95a40_JFJ_k8Vv6Uldx0ldKxZN6kbpbIKl5p1Tq1OdrcuOImdGmZ38cVZTzw9FjMKOcNM_0sz1GW9jsyCNrCuIZHZqGNOfbUhE7tW9vF-nPAEpSJWIiW6ic4WGaEdXEyDD80W9xx5iWt-sYHhSqRd-Ntba84ZpVY Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 692645e026d84090b1e00fa171ea1578 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesAdminNegativeTest-1201315727 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_692645e026d84090b1e00fa171ea1578", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/692645e026d84090b1e00fa171ea1578"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/692645e026d84090b1e00fa171ea1578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/692645e026d84090b1e00fa171ea1578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesAdminNegativeTest-1201315727 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 692645e026d84090b1e00fa171ea1578 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1201315727 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesAdminNegativeTest-1201315727-project-admin Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6e34fa225d314f798aa65c323a67e195 Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesAdminNegativeTest-1201315727-project-admin Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: {"volumeAttachment": {"volumeId": "079fcf24-33d7-4277-979c-b2c43bf4bc76"}} Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: exception: Volume 8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 could not be found. Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '2aa273e4-58c3-4196-8587-527e9992b9ee', 'id': '8dc88c15-41c3-4e46-8e67-f2fd710e0dd3', 'body': {'volumeAttachment': {'volumeId': '079fcf24-33d7-4277-979c-b2c43bf4bc76'}}} Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 could not be found. (HTTP 404) (Request-ID: req-20d33543-fcbc-4f3b-ac92-b63e49dccedb) Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:02:24.625193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 could not be found. Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 could not be found. Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 could not be found. Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:24.630860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] Returning 404 to user: Volume 8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:02:24.637731 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a233a24b-5488-45db-b1ec-1adca49d912e tempest-VolumesAdminNegativeTest-1201315727 tempest-VolumesAdminNegativeTest-1201315727-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee/os-volume_attachments/8dc88c15-41c3-4e46-8e67-f2fd710e0dd3" status: 404 len: 109 microversion: 2.1 time: 0.129148 Oct 17 13:02:24.637731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1450/2945] 10.222.0.27 () {60 vars in 1433 bytes} [Mon Oct 17 13:02:24 2022] PUT /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee/os-volume_attachments/8dc88c15-41c3-4e46-8e67-f2fd710e0dd3 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:02:25.216187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5520050a-79c6-4abe-af86-08d4071403e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82120ae50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:25.353011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5520050a-79c6-4abe-af86-08d4071403e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.140589 Oct 17 13:02:25.353968 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1496/2946] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:25 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:25.586208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:25.589407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:25.626798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:25.628292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:25.628759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:25.629857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:25.630368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:25.630812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:25.758337 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-935f81e8-3863-42ac-a0d0-5279345c857f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169215 Oct 17 13:02:25.760804 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1451/2947] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:25 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:26.369501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-417e112a-281e-4004-9df0-e2974f063735 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d48ca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:26.449857 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-417e112a-281e-4004-9df0-e2974f063735 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.084450 Oct 17 13:02:26.459436 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1497/2948] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:26 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:26.771024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:26.773829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:26.798006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:26.800134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:26.802897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:26.803616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:26.811065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:26.815055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:26.906109 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d5912b3c-8e13-42d5-8c97-81df04a73105 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139235 Oct 17 13:02:26.909526 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1452/2949] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:26 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:27.470923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b88c249-fecd-4189-83f3-70acaa61b658 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820f25160>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:27.580989 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9b88c249-fecd-4189-83f3-70acaa61b658 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.118125 Oct 17 13:02:27.581760 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1498/2950] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:27 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:27.928764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:27.935457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:27.944823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:27.965037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:27.968110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:27.970204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:27.973088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:27.974488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:28.080911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf1d8cca-cb7b-4916-9e96-3d9717dde0a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162369 Oct 17 13:02:28.082414 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1453/2951] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:27 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:28.602719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf8ed48e-2fda-48a1-ad6b-6c2fec5f4146 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82138a280>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:28.673180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf8ed48e-2fda-48a1-ad6b-6c2fec5f4146 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.079482 Oct 17 13:02:28.677136 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1499/2952] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:28 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:29.094357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:29.096727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:29.110360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:29.118939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:29.121389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:29.126143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:29.126755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:29.127375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:29.209365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:29.212211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:29.222580 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72eb38d6-e13d-454a-86d3-8afa94018acf tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132178 Oct 17 13:02:29.223228 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1454/2953] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:29 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:02:29.229093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:29.231473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:29.233908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:29.234970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:29.237394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:29.240795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:29.315179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:02:29.636414 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6cd37f57-2c41-458a-a2f2-a410c0639ea9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 204 len: 0 microversion: 2.1 time: 0.429595 Oct 17 13:02:29.642435 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1500/2954] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:02:29 2022] DELETE /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:02:29.661038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:29.661926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:29.688442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:29.689008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:29.691884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41fa01a0-10ee-45e7-b4f8-be9418a33b05 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820e49a60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:29.694644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:29.695412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:29.695889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:29.696325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:29.875670 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-41fa01a0-10ee-45e7-b4f8-be9418a33b05 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.189421 Oct 17 13:02:29.892463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1501/2955] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:29 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:30.155762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:30.188786 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7742f8fb-1e44-48d7-92b3-3a5bc7248b47 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1514 microversion: 2.1 time: 0.541320 Oct 17 13:02:30.196334 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1455/2956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:29 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1514 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:30.898526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-732385c2-8c27-4d3e-b8dd-c00308b609d5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82138af70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:31.012701 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-732385c2-8c27-4d3e-b8dd-c00308b609d5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1413 microversion: 2.1 time: 0.120249 Oct 17 13:02:31.025180 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1502/2957] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:30 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:31.224314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:31.225676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:31.241700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:31.244085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:31.244721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:31.245633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:31.251137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:31.251910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:31.572074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:31.581675 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd703b84-8383-485a-9548-3ad00fc10e1c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1514 microversion: 2.1 time: 0.362116 Oct 17 13:02:31.582494 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1456/2958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:31 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1514 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:32.030927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f49e07d3-41f0-4cd7-9063-c60c66ec7a85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820d0f700>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:32.608095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:32.608785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:32.647316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:32.650868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:32.657343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:32.668495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:32.674211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:32.674729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:32.967295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:32.980501 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bdb6c3d9-f2f5-4d85-aca3-9be808281adf tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 200 len: 1303 microversion: 2.1 time: 0.376830 Oct 17 13:02:33.000066 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1457/2959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:32 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 1303 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:33.000066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-10764502-e774-4bc1-b6bf-78111b36f76e req-656e7cd2-3e9c-4a5d-afaf-aecf366a7825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa273e4-58c3-4196-8587-527e9992b9ee", "name": "network-vif-deleted", "tag": "30d2b573-84af-4ce7-8ade-e9c51be7e322"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:33.039477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10764502-e774-4bc1-b6bf-78111b36f76e req-656e7cd2-3e9c-4a5d-afaf-aecf366a7825 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:33.045442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10764502-e774-4bc1-b6bf-78111b36f76e req-656e7cd2-3e9c-4a5d-afaf-aecf366a7825 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:33.046068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10764502-e774-4bc1-b6bf-78111b36f76e req-656e7cd2-3e9c-4a5d-afaf-aecf366a7825 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:33.098249 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-10764502-e774-4bc1-b6bf-78111b36f76e req-656e7cd2-3e9c-4a5d-afaf-aecf366a7825 service nova] Creating event network-vif-deleted:30d2b573-84af-4ce7-8ade-e9c51be7e322 for instance 2aa273e4-58c3-4196-8587-527e9992b9ee on n-h2-853316-12 Oct 17 13:02:33.121634 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-10764502-e774-4bc1-b6bf-78111b36f76e req-656e7cd2-3e9c-4a5d-afaf-aecf366a7825 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127642 Oct 17 13:02:33.125746 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1458/2960] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:34.010214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:34.011958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: 2aa273e4-58c3-4196-8587-527e9992b9ee] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:34.019737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:34.021530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:34.022188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:34.024221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:34.024878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:34.025465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:34.045424 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] HTTP exception thrown: Instance 2aa273e4-58c3-4196-8587-527e9992b9ee could not be found. Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Request method failure captured: Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee HTTP/1.1 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVHSyCzem7EfxBh61gB58R87LBnHoGhfO8IGbJdLd0D45NAfOnf-l_uNZNopQ0_pIloqnjuvdzMLpaQxfOthBNEzAVStghuUrNWSffUk0nTSZEYTtjOYJpdbJkyIBtIRn8IuPMRz-jrjjsR3XHFtdFOCzuiyOei2fKzWfXeSGoblsGg Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 1b99cb2247534fafa72b854244f7d088 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesAdminNegativeTest-2007129650 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b99cb2247534fafa72b854244f7d088", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b99cb2247534fafa72b854244f7d088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b99cb2247534fafa72b854244f7d088"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b99cb2247534fafa72b854244f7d088"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesAdminNegativeTest-2007129650 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 1b99cb2247534fafa72b854244f7d088 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2007129650 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesAdminNegativeTest-2007129650-project Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ca5d4216b6e942ada4f9ba5135541a80 Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesAdminNegativeTest-2007129650-project Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 2aa273e4-58c3-4196-8587-527e9992b9ee could not be found. Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '2aa273e4-58c3-4196-8587-527e9992b9ee'} Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa273e4-58c3-4196-8587-527e9992b9ee could not be found. Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa273e4-58c3-4196-8587-527e9992b9ee could not be found. Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:02:34.047149 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa273e4-58c3-4196-8587-527e9992b9ee could not be found. Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Returning 404 to user: Instance 2aa273e4-58c3-4196-8587-527e9992b9ee could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:02:34.052155 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b966b206-bbdc-4729-8a09-84103c7e4abc tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee" status: 404 len: 111 microversion: 2.1 time: 0.044177 Oct 17 13:02:34.053553 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1459/2961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:34 2022] GET /compute/v2.1/servers/2aa273e4-58c3-4196-8587-527e9992b9ee => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:02:39.480454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:39.608460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:41.057430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:41.058897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:41.077147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:41.079090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:41.080840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:41.081856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:41.084435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:41.085144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:41.165880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:02:41.378938 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e3423fca-b07c-4f2b-a1af-2745e189e532 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 204 len: 0 microversion: 2.1 time: 0.324589 Oct 17 13:02:41.381232 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1460/2962] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:02:41 2022] DELETE /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:02:41.405049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:41.407055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:41.419866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:41.421396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:41.422996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:41.424772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:41.433904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:41.447200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:41.742625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:41.759260 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0e0432aa-eb9a-4d68-9cfd-a7731b8332f9 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1683 microversion: 2.1 time: 0.364131 Oct 17 13:02:41.777302 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1461/2963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:41 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1683 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:42.785089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:42.787019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:42.810192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:42.810192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:42.810192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:42.810192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:42.810192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:42.810192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:43.639942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:43.653069 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b933630-75e0-468d-879d-bac1499ec2aa tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1683 microversion: 2.1 time: 0.872701 Oct 17 13:02:43.656832 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1462/2964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:42 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1683 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:44.687825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:44.688500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:44.698230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:44.698735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:44.699176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:44.700999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:44.702308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:44.703644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:45.083605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:45.101006 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90572049-5a7a-4297-89c0-702d1ec53a0c tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1683 microversion: 2.1 time: 0.421309 Oct 17 13:02:45.119883 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1463/2965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:44 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1683 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:45.526184 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f49e07d3-41f0-4cd7-9063-c60c66ec7a85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1422 microversion: 2.1 time: 13.501075 Oct 17 13:02:45.528119 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1503/2966] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:32 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1422 bytes in 13504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:45.546380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fac15d73-dbe2-4660-a401-c211fb9744db tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8204ce310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:45.606912 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fac15d73-dbe2-4660-a401-c211fb9744db tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 200 len: 1422 microversion: 2.1 time: 0.066042 Oct 17 13:02:45.608384 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1464/2967] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:02:45 2022] GET /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 1422 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:45.761204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-453465867", "imageRef": "ddc41a0b-e267-4a80-bc8e-89c53bf16209", "flavorRef": "452", "networks": [{"uuid": "76738b67-1f67-4450-8954-529dd7a99e80"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:45.877916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] validate_networks() for [('76738b67-1f67-4450-8954-529dd7a99e80', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:02:46.136013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:46.138032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:46.146661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:46.147695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:46.148301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:46.149462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:46.150127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:46.150796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:46.274785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5d4216b6e942ada4f9ba5135541a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99cb2247534fafa72b854244f7d088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:46.280347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:46.300355 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b638cb19-4227-43dc-99c9-08151af34639 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 200 len: 1615 microversion: 2.1 time: 0.172158 Oct 17 13:02:46.304893 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1465/2968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:46 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 1615 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:46.317751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e7c4c9b4-0c11-43f2-ad5d-57c0bffed55c req-6a75d564-12ed-4f96-a0f2-25cc1adfaeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b2265a-9332-47d0-aca4-df5bfd6d236a", "name": "network-vif-deleted", "tag": "30416dd9-de36-46fc-a524-4b075b1466d1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:46.346255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7c4c9b4-0c11-43f2-ad5d-57c0bffed55c req-6a75d564-12ed-4f96-a0f2-25cc1adfaeae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:46.346749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7c4c9b4-0c11-43f2-ad5d-57c0bffed55c req-6a75d564-12ed-4f96-a0f2-25cc1adfaeae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:46.347187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7c4c9b4-0c11-43f2-ad5d-57c0bffed55c req-6a75d564-12ed-4f96-a0f2-25cc1adfaeae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:46.367316 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e7c4c9b4-0c11-43f2-ad5d-57c0bffed55c req-6a75d564-12ed-4f96-a0f2-25cc1adfaeae service nova] Creating event network-vif-deleted:30416dd9-de36-46fc-a524-4b075b1466d1 for instance a9b2265a-9332-47d0-aca4-df5bfd6d236a on n-h2-853316-12 Oct 17 13:02:46.374557 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e7c4c9b4-0c11-43f2-ad5d-57c0bffed55c req-6a75d564-12ed-4f96-a0f2-25cc1adfaeae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068089 Oct 17 13:02:46.383659 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1466/2969] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:47.098690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:02:47.099855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:02:47.100356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:02:47.100985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:02:47.104118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:02:47.114295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:47.114698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:47.115141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:47.115877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:47.116341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:47.116766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:47.136234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:02:47.142670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for user 638e5facdbe64d26bf3c4b5c12a33da7 and project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:02:47.156578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:02:47.159448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ddc41a0b-e267-4a80-bc8e-89c53bf16209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:02:47.229126 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-70ea2fb9-f544-45ba-af94-45e696a98a40 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472136 Oct 17 13:02:47.238238 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1504/2970] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:02:47.251675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f9bef55-57ee-4243-9a33-61bd7914244f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:47.253006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f9bef55-57ee-4243-9a33-61bd7914244f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:47.329764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:47.332004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f9bef55-57ee-4243-9a33-61bd7914244f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:47.335973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] [instance: a9b2265a-9332-47d0-aca4-df5bfd6d236a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:47.346187 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f9bef55-57ee-4243-9a33-61bd7914244f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1207 microversion: 2.1 time: 0.101332 Oct 17 13:02:47.353093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:47.353652 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1467/2971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:47 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1207 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:47.354381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:47.354972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:47.355849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:47.356456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:47.357678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:47.373670 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] HTTP exception thrown: Instance a9b2265a-9332-47d0-aca4-df5bfd6d236a could not be found. Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Request method failure captured: Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a HTTP/1.1 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVHSyCzem7EfxBh61gB58R87LBnHoGhfO8IGbJdLd0D45NAfOnf-l_uNZNopQ0_pIloqnjuvdzMLpaQxfOthBNEzAVStghuUrNWSffUk0nTSZEYTtjOYJpdbJkyIBtIRn8IuPMRz-jrjjsR3XHFtdFOCzuiyOei2fKzWfXeSGoblsGg Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 1b99cb2247534fafa72b854244f7d088 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-VolumesAdminNegativeTest-2007129650 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b99cb2247534fafa72b854244f7d088", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b99cb2247534fafa72b854244f7d088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b99cb2247534fafa72b854244f7d088"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b99cb2247534fafa72b854244f7d088"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-VolumesAdminNegativeTest-2007129650 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 1b99cb2247534fafa72b854244f7d088 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2007129650 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-VolumesAdminNegativeTest-2007129650-project Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ca5d4216b6e942ada4f9ba5135541a80 Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-VolumesAdminNegativeTest-2007129650-project Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance a9b2265a-9332-47d0-aca4-df5bfd6d236a could not be found. Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a9b2265a-9332-47d0-aca4-df5bfd6d236a'} Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b2265a-9332-47d0-aca4-df5bfd6d236a could not be found. Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b2265a-9332-47d0-aca4-df5bfd6d236a could not be found. Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:02:47.375950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:02:47.381066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:02:47.381066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:02:47.381066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:02:47.381066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:02:47.381066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:02:47.381066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b2265a-9332-47d0-aca4-df5bfd6d236a could not be found. Oct 17 13:02:47.381066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:02:47.382675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Returning 404 to user: Instance a9b2265a-9332-47d0-aca4-df5bfd6d236a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:02:47.383731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-813ad0df-b71a-4928-b284-6ce55e753d35 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a" status: 404 len: 111 microversion: 2.1 time: 0.057921 Oct 17 13:02:47.384790 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1505/2972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:47 2022] GET /compute/v2.1/servers/a9b2265a-9332-47d0-aca4-df5bfd6d236a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:02:47.393651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8623e2c1-b1ba-4bf0-9748-904ba52e6468 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] Calling method '.version_select at 0x7fa82045ad30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:47.426456 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8623e2c1-b1ba-4bf0-9748-904ba52e6468 tempest-VolumesAdminNegativeTest-2007129650 tempest-VolumesAdminNegativeTest-2007129650-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209851031" status: 202 len: 0 microversion: 2.1 time: 0.036587 Oct 17 13:02:47.427440 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1468/2973] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209851031 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:02:48.373193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:48.374622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:48.391170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:48.392041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:48.392732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:48.393867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:48.397433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:48.398447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:48.561952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:48.576746 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-317a4a7f-9756-4fd0-8737-c58504fb0e0e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1203 microversion: 2.1 time: 0.206427 Oct 17 13:02:48.587881 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1506/2974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:48 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1203 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:49.603730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:49.604344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:49.620368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:49.620807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:49.621254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:49.622197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:49.622822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:49.623416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:49.721860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:49.729691 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62cf9667-21a9-420e-8d80-8cbc2841f2fe tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1265 microversion: 2.1 time: 0.130657 Oct 17 13:02:49.730322 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1469/2975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:49 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:02:50.158741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7059787b-f0a6-4a15-b682-74a926ce8381 req-1984b0a9-952d-4b2d-bb9e-96d843010acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800f7d25-a5d5-415d-b3c3-29fd11e206d6", "name": "network-vif-unplugged", "status": "completed", "tag": "19335654-baf3-4919-893c-8ea11fd4b242"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:50.199698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7059787b-f0a6-4a15-b682-74a926ce8381 req-1984b0a9-952d-4b2d-bb9e-96d843010acb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:50.200610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7059787b-f0a6-4a15-b682-74a926ce8381 req-1984b0a9-952d-4b2d-bb9e-96d843010acb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:50.203810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7059787b-f0a6-4a15-b682-74a926ce8381 req-1984b0a9-952d-4b2d-bb9e-96d843010acb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:50.257999 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7059787b-f0a6-4a15-b682-74a926ce8381 req-1984b0a9-952d-4b2d-bb9e-96d843010acb service nova] Creating event network-vif-unplugged:19335654-baf3-4919-893c-8ea11fd4b242 for instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 on n-h1-853316-12 Oct 17 13:02:50.297503 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7059787b-f0a6-4a15-b682-74a926ce8381 req-1984b0a9-952d-4b2d-bb9e-96d843010acb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130885 Oct 17 13:02:50.299615 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1507/2976] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:02:50.756035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:50.756662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:50.787177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:50.790079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:50.793474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:50.794893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:50.795714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:50.799460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:51.396816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:51.428637 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e1ed3c33-e0af-402f-9f06-0d4f258ae7e8 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.675896 Oct 17 13:02:51.431586 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1470/2977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:50 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:52.459461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:52.462058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:52.495795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:52.496640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:52.498625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:52.499653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:52.500133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:52.503202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:52.621263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-00d49e61-c630-4dbc-b541-0be110b7cf9f req-4c2a43a3-68ca-4268-a097-b609daec26e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913a78a1-642c-4b41-935c-7f6bd67eb254", "tag": "fb59e54d-3d37-4a64-af26-4d71c0e7555b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:02:52.652898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:52.680453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00d49e61-c630-4dbc-b541-0be110b7cf9f req-4c2a43a3-68ca-4268-a097-b609daec26e4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:52.682433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00d49e61-c630-4dbc-b541-0be110b7cf9f req-4c2a43a3-68ca-4268-a097-b609daec26e4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:52.684041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00d49e61-c630-4dbc-b541-0be110b7cf9f req-4c2a43a3-68ca-4268-a097-b609daec26e4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:52.724463 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-00d49e61-c630-4dbc-b541-0be110b7cf9f req-4c2a43a3-68ca-4268-a097-b609daec26e4 service nova] Creating event network-changed:fb59e54d-3d37-4a64-af26-4d71c0e7555b for instance 913a78a1-642c-4b41-935c-7f6bd67eb254 on n-h2-853316-12 Oct 17 13:02:52.741310 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-00d49e61-c630-4dbc-b541-0be110b7cf9f req-4c2a43a3-68ca-4268-a097-b609daec26e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127781 Oct 17 13:02:52.743973 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1471/2978] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:02:53.050005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:53.060794 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-57e8614b-f5d1-46c0-99ee-7a634b7569cc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.608267 Oct 17 13:02:53.065691 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1508/2979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:52 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:54.090982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:54.092359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:54.118497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:54.119383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:54.121535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:54.127003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:54.127748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:54.128366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:55.553992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:55.583427 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e58d554-b755-4d34-9f58-79a5f5084e32 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 1.493962 Oct 17 13:02:55.586347 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1472/2980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:54 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:56.610150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:56.610752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:56.630889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:56.640333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:56.641182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:56.643278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:56.643924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:56.646547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:56.651582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:56.655426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:56.724051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:56.724562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:56.739171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:56.744618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:56.746580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:56.761292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:56.831730 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-38c04ca1-dd4b-41d8-b8e8-29b9ba301d3b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.184162 Oct 17 13:02:56.833004 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1473/2981] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:02:56 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:02:56.975039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:56.975833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:56.996629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:56.997433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:56.998214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:57.000403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:57.001248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:57.004238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:57.107701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:02:57.128346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:57.151757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:57.288648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:57.306068 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1551bbd8-8ec3-4b0c-a2ed-39b5e9f963f1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.698416 Oct 17 13:02:57.308388 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1509/2982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:56 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:57.354976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:02:57.467377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8740d4fa-87f1-4a0f-8697-e4354296824c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 204 len: 0 microversion: 2.1 time: 0.495888 Oct 17 13:02:57.468081 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1474/2983] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:02:56 2022] DELETE /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:02:57.480140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:57.480882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:57.493399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:57.496885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:57.497495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:57.499512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:57.514406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:57.517781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:57.966253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:57.980810 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b5cd8da4-1ae6-4ba6-b5ce-6f209223ed91 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1674 microversion: 2.1 time: 0.505684 Oct 17 13:02:57.982308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1510/2984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:57 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1674 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:58.334068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:58.334836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:58.352532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:58.353404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:58.354043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:58.354959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:58.355593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:58.356190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:58.637168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:58.656256 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72f309bd-b0f6-47ef-98f8-9961cea28a76 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.325387 Oct 17 13:02:58.660830 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1475/2985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:58 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:59.007518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:59.008154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:59.017290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:59.017789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:59.018247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:59.018971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:59.020094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:59.020481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:59.556463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:02:59.568352 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db132b27-8fd2-49ff-a945-b5847ce21cdf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1674 microversion: 2.1 time: 0.565395 Oct 17 13:02:59.571188 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1511/2986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:59 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1674 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:02:59.685740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:02:59.687107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:02:59.698036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:59.705418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:59.705857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:02:59.706648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:02:59.707119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:02:59.708224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:00.599684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:00.600653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:00.624830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:00.625409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:00.625939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:00.626788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:00.639048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:00.646801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:01.463725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:01.474685 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e239b420-e2c7-46dd-a3a1-1cdef2bf87ca tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1674 microversion: 2.1 time: 0.877845 Oct 17 13:03:01.492662 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1512/2987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:00 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1674 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:01.940695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:01.957538 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1079829f-1db9-408f-bf43-89b9ccef24e9 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 2.269269 Oct 17 13:03:01.977962 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1476/2988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:02:59 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:02.505121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:02.506459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:02.517853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:02.518854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:02.518854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:02.519803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:02.520275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:02.520711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:02.984899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:02.986476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:02.999970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:03.000738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:03.001369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:03.009061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:03.009829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:03.013870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:03.130755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:03.139118 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d083258-462f-47cb-b00b-5fd6a924fd0b tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1674 microversion: 2.1 time: 0.638463 Oct 17 13:03:03.145661 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1513/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:02 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1674 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:03:04.176476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:04.182648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:04.211763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:04.215558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:04.216382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:04.217416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:04.218480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:04.219684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:04.569423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:04.587564 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a356324-4f26-473b-a752-4cc44b8ae31a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1606 microversion: 2.1 time: 0.412427 Oct 17 13:03:04.588228 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1514/2990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:04 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1606 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:04.771107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:04.790766 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9b6a7b1-a78f-4fd3-9313-2bc46baa2c86 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 1.809546 Oct 17 13:03:04.793875 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1477/2991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:02 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:04.811421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-902e3f15-b7e6-4c51-ad20-de1eb5b92d68 req-d9cd5c3f-d14e-4b01-a100-062fee8e941c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c5672f-8586-4476-85ec-81ff1d7400d6", "name": "network-vif-deleted", "tag": "0ce82388-1237-4910-b3bf-0a4abe30dd52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:04.848892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-902e3f15-b7e6-4c51-ad20-de1eb5b92d68 req-d9cd5c3f-d14e-4b01-a100-062fee8e941c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:04.851730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-902e3f15-b7e6-4c51-ad20-de1eb5b92d68 req-d9cd5c3f-d14e-4b01-a100-062fee8e941c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:04.852893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-902e3f15-b7e6-4c51-ad20-de1eb5b92d68 req-d9cd5c3f-d14e-4b01-a100-062fee8e941c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:04.870609 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-902e3f15-b7e6-4c51-ad20-de1eb5b92d68 req-d9cd5c3f-d14e-4b01-a100-062fee8e941c service nova] Creating event network-vif-deleted:0ce82388-1237-4910-b3bf-0a4abe30dd52 for instance e6c5672f-8586-4476-85ec-81ff1d7400d6 on n-h2-853316-12 Oct 17 13:03:04.878430 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-902e3f15-b7e6-4c51-ad20-de1eb5b92d68 req-d9cd5c3f-d14e-4b01-a100-062fee8e941c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071971 Oct 17 13:03:04.888781 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1515/2992] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:05.618392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:05.619990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:05.634638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:05.638308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:05.638972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:05.640886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:05.643944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:05.644820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:05.695474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:05.696493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:05.697150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:05.697803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lazy-loading 'fault' on Instance uuid e6c5672f-8586-4476-85ec-81ff1d7400d6 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:03:05.769240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:05.779188 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-551e1d99-a2c4-4b6f-b4fb-46421d1475a4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 200 len: 1327 microversion: 2.1 time: 0.167391 Oct 17 13:03:05.782453 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1478/2993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:05 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 1327 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:05.832308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:05.833023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:05.849651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:05.850141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:05.850725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:05.851438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:05.851873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:05.852418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:06.201153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:06.215607 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7ad431a-d6f9-40e2-9d8e-cd2c78906671 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.389968 Oct 17 13:03:06.216725 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1516/2994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:05 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:06.814609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:06.815637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:06.840669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:06.841195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:06.841661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:06.842426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:06.842891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:06.843327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:06.914191 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] HTTP exception thrown: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Request method failure captured: Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 HTTP/1.1 Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVGukySUZVCaPkT0QeFoX_ncVI_so4gdvev2SVac-69k9kh1wSe_2cwkuvBq3sy5yKPj_eeT8wT2O978Q2btizn1ocWk9tIGzy1tiYZyZo_sv6w454OTFB7KrfHmXim-2gtu8qmzIt3w3I7QErrs6blmvU-JtpMm0qQkTZjCmFuJ7QI Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ebdbecfa601e4e76bded1a6b0ff5bf3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1c24155cc4964f9298aee2c596a79ac7 Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e6c5672f-8586-4476-85ec-81ff1d7400d6'} Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:06.916267 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:06.920519 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:06.920519 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:06.920519 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:06.920519 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:03:06.920519 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:03:06.920519 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:03:06.920519 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:06.923975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Returning 404 to user: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:03:06.942879 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6f32c885-23c5-4e0b-99e1-4a29b15bfb4d tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 404 len: 111 microversion: 2.1 time: 0.142181 Oct 17 13:03:06.945959 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1479/2995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:06 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:03:06.953319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72582ed5-8488-422a-9248-1e4eda63c6a9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '.version_select at 0x7fa820cccb80>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:06.993758 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72582ed5-8488-422a-9248-1e4eda63c6a9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028610316" status: 202 len: 0 microversion: 2.1 time: 0.044336 Oct 17 13:03:06.995551 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1517/2996] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028610316 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:03:07.241576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:07.242422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:07.258807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:07.262928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:07.263956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:07.270595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:07.271726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:07.275656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:07.610598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:07.623972 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9bb223c5-7f72-47a0-b5f5-440ffc62ab84 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.388690 Oct 17 13:03:07.624987 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1480/2997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:07 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:07.674931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1166649472", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5ab5fe2b-3424-46bb-bd5e-c78cc4ccf633"}], "block_device_mapping_v2": [{"uuid": "67e82906-0888-4e24-a913-40e425849475", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:07.794592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] validate_networks() for [('5ab5fe2b-3424-46bb-bd5e-c78cc4ccf633', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:03:08.658009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:08.665357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:08.704275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:08.707189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:08.708224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:08.711209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:08.713161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:08.714895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:08.997321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:09.005851 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-295115d2-a80b-4387-9a0a-ec5a3f65c7f7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.355289 Oct 17 13:03:09.013164 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1481/2998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:08 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:09.711701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:03:09.712186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:03:09.712810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:03:09.713295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:03:09.713721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:03:09.716168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:09.734920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:09.735610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:09.740720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:09.742726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:09.744240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:09.745887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:09.773523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=63 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:09.799093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for project 6c6509294f164045968c57ff20d25d18. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:03:09.834582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Getting quotas for user bd6001af2bfe4fe881afcaaf6cca9962 and project 6c6509294f164045968c57ff20d25d18. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:03:09.946796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:03:09.949064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67e82906-0888-4e24-a913-40e425849475',volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:03:10.007770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-96119a01-c1b3-4764-af41-5115e21ad09b req-1481a526-cb2b-4779-b88c-9cd96ea13615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913a78a1-642c-4b41-935c-7f6bd67eb254", "name": "network-vif-plugged", "status": "completed", "tag": "fb59e54d-3d37-4a64-af26-4d71c0e7555b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:10.029198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-96119a01-c1b3-4764-af41-5115e21ad09b req-1481a526-cb2b-4779-b88c-9cd96ea13615 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:10.031957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-96119a01-c1b3-4764-af41-5115e21ad09b req-1481a526-cb2b-4779-b88c-9cd96ea13615 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:10.035765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-96119a01-c1b3-4764-af41-5115e21ad09b req-1481a526-cb2b-4779-b88c-9cd96ea13615 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:10.078763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-96119a01-c1b3-4764-af41-5115e21ad09b req-1481a526-cb2b-4779-b88c-9cd96ea13615 service nova] Creating event network-vif-plugged:fb59e54d-3d37-4a64-af26-4d71c0e7555b for instance 913a78a1-642c-4b41-935c-7f6bd67eb254 on n-h2-853316-12 Oct 17 13:03:10.090891 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-96119a01-c1b3-4764-af41-5115e21ad09b req-1481a526-cb2b-4779-b88c-9cd96ea13615 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085692 Oct 17 13:03:10.095039 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1482/2999] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:03:10.106807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:10.108380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:10.123863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:10.125300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:10.129202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:10.131626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:10.133545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:10.134103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:10.230269 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01d64248-355a-480b-887a-74aa7b36ea2c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.559892 Oct 17 13:03:10.230925 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1518/3000] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:03:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:03:10.247984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ba8e55d7-b90f-43d7-884e-9b5109a1a753 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:10.262728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ba8e55d7-b90f-43d7-884e-9b5109a1a753 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:10.457745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:10.464407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba8e55d7-b90f-43d7-884e-9b5109a1a753 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:10.479507 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ba8e55d7-b90f-43d7-884e-9b5109a1a753 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1053 microversion: 2.1 time: 0.240862 Oct 17 13:03:10.480148 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1519/3001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:10 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1053 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:03:10.489888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac205656-7920-4fb1-acc1-99b136e1ede7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.389695 Oct 17 13:03:10.490536 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1483/3002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:10 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:10.496047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dac865d1-a3d7-410e-98b6-b19cfb097dc9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'create', calling method: .version_select at 0x7fa820f8bb80>, body: {"keypair": {"name": "tempest-keypair-2128077013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiK1uKbx1FJy4T5NKnKeCQNHgkK+/hzyaktv1kNgtbSnosEcuiLgiDKQAxuBfQuS7MFZ7dVd4kGALJcu/XOUVHPW/0KtRmewDJTo4IW3nnNGmoqr6wYdRaIvuoCyRgBGw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:10.525842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-dac865d1-a3d7-410e-98b6-b19cfb097dc9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Getting quotas for project ebdbecfa601e4e76bded1a6b0ff5bf3e. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:03:10.532403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-dac865d1-a3d7-410e-98b6-b19cfb097dc9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Getting quotas for user 1c24155cc4964f9298aee2c596a79ac7 and project ebdbecfa601e4e76bded1a6b0ff5bf3e. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:03:10.569248 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dac865d1-a3d7-410e-98b6-b19cfb097dc9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087783 Oct 17 13:03:10.570094 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1520/3003] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:03:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:11.515106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:11.516060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:11.516684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:11.517378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:11.533293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:11.535155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:11.537243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:11.540274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:11.544389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:11.546686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:11.547095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:11.548065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:11.548831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:11.551895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:11.553945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:11.554985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:11.782793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:11.795513 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d063d2cd-d3be-4900-8d36-caaa1eae42fe tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1151 microversion: 2.1 time: 0.284140 Oct 17 13:03:11.797468 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1484/3004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:11 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1151 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:12.186505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:12.204078 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5e7f6e6f-4cd2-4d52-8406-57ec6ae2dbda tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1307 microversion: 2.1 time: 0.687484 Oct 17 13:03:12.218848 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1521/3005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:11 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1307 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:03:12.829942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:12.830593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:12.837820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:12.838352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:12.843561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:12.844526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:12.845168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:12.856822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:12.908820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:13.049416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:13.059691 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1795c0c3-a1f4-4d2b-8aa0-e114352df94c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1169 microversion: 2.1 time: 0.238687 Oct 17 13:03:13.071420 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1485/3006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:12 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1169 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:13.240124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:13.241693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:13.266069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:13.268338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:13.269858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:13.273126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:13.274755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:13.275366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:13.556321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:13.575173 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e37ee81e-8afd-4110-b11a-369e58baa2b4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1487 microversion: 2.1 time: 0.349677 Oct 17 13:03:13.577847 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1522/3007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:13 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1487 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:13.603673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:13.604931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:13.619786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:13.620290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:13.622728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:13.624401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:13.628167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:13.629036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:13.703405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:03:13.929911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6666867c-d66d-4cd7-8f34-26deebd5c69f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 204 len: 0 microversion: 2.1 time: 0.329971 Oct 17 13:03:13.931877 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1486/3008] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:03:13 2022] DELETE /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:03:13.940467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:13.942432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:13.964504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:13.965099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:13.965654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:13.966517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:13.967062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:13.967682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:14.099537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:14.100724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:14.112477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:14.116143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:14.116833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:14.120685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:14.121527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:14.122133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:14.367815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:14.386596 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-551b9da6-e773-4df7-894f-50540133c437 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1493 microversion: 2.1 time: 0.450218 Oct 17 13:03:14.392543 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1523/3009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:13 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1493 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:14.407203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-560678114", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ed32987-4304-4a23-af45-632f44568156"}], "security_groups": [{"name": "tempest-securitygroup--77221898"}], "key_name": "tempest-keypair-2128077013", "user_data": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:14.646501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] validate_networks() for [('3ed32987-4304-4a23-af45-632f44568156', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:03:14.655368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:14.664499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b6b0fb6-af87-4275-b8d5-7897dd5c6ac5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1211 microversion: 2.1 time: 0.569446 Oct 17 13:03:14.665084 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1487/3010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:14 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1211 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:15.421578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:15.423138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:15.431375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:15.432197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:15.433009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:15.434624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:15.435309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:15.436038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:15.884755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:15.896542 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-041d7302-786f-40c5-a2de-c83070501266 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1493 microversion: 2.1 time: 0.479679 Oct 17 13:03:15.897167 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1488/3011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:15 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1493 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:15.936984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:15.937581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:15.965058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:15.966776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:15.969470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:15.972329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:15.978980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:15.980523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:16.437195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:16.459463 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c86c93c4-6785-4bfb-b8eb-4445c0c24f72 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1211 microversion: 2.1 time: 0.538450 Oct 17 13:03:16.460818 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1489/3012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:15 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1211 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:16.545777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:03:16.547369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:03:16.549802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:03:16.552302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:03:16.553278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:03:16.586255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:16.595025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:16.595820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:16.597467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:16.601026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:16.601922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:16.659141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Getting quotas for project ebdbecfa601e4e76bded1a6b0ff5bf3e. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:03:16.668024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Getting quotas for user 1c24155cc4964f9298aee2c596a79ac7 and project ebdbecfa601e4e76bded1a6b0ff5bf3e. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:03:16.705736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:03:16.710055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:03:16.804863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-365dc6ba-15a4-4181-ae1f-14c433ccbd47 req-1d8f3bf3-c024-4a8a-9256-4c0a025e5957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913a78a1-642c-4b41-935c-7f6bd67eb254", "name": "network-vif-deleted", "tag": "fb59e54d-3d37-4a64-af26-4d71c0e7555b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:16.821713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-365dc6ba-15a4-4181-ae1f-14c433ccbd47 req-1d8f3bf3-c024-4a8a-9256-4c0a025e5957 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:16.822793 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b046c58f-f25f-4d56-9bd0-f4b429ce6ee2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.428810 Oct 17 13:03:16.831559 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1524/3013] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:03:14 2022] POST /compute/v2.1/servers => generated 400 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:03:16.832792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-365dc6ba-15a4-4181-ae1f-14c433ccbd47 req-1d8f3bf3-c024-4a8a-9256-4c0a025e5957 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:16.834415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-365dc6ba-15a4-4181-ae1f-14c433ccbd47 req-1d8f3bf3-c024-4a8a-9256-4c0a025e5957 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:16.844557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c46773ab-12e2-4d7a-adca-4199ec77125c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:16.845572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c46773ab-12e2-4d7a-adca-4199ec77125c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:16.881486 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-365dc6ba-15a4-4181-ae1f-14c433ccbd47 req-1d8f3bf3-c024-4a8a-9256-4c0a025e5957 service nova] Creating event network-vif-deleted:fb59e54d-3d37-4a64-af26-4d71c0e7555b for instance 913a78a1-642c-4b41-935c-7f6bd67eb254 on n-h2-853316-12 Oct 17 13:03:16.899170 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-365dc6ba-15a4-4181-ae1f-14c433ccbd47 req-1d8f3bf3-c024-4a8a-9256-4c0a025e5957 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098044 Oct 17 13:03:16.906716 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1490/3014] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:16.930068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:16.932298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:16.952586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:16.954541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:16.956086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:16.957733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:16.958588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:16.959377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:17.069301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:17.070743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:17.071953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:17.072669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lazy-loading 'fault' on Instance uuid 913a78a1-642c-4b41-935c-7f6bd67eb254 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:03:17.163329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c46773ab-12e2-4d7a-adca-4199ec77125c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:17.177712 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c46773ab-12e2-4d7a-adca-4199ec77125c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1237 microversion: 2.1 time: 0.343502 Oct 17 13:03:17.186991 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1525/3015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:16 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1237 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:17.213014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-dc79bd67-2d27-4709-bc45-87988d2b30a5 req-4f45a8e9-d768-49d7-b9b9-6bcc324d97d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da2b394-f53d-4cf0-a3d1-fcfb88307986", "tag": "bd12cbd3-a84c-4da7-8c9d-71f5c4054fff"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:17.235976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dc79bd67-2d27-4709-bc45-87988d2b30a5 req-4f45a8e9-d768-49d7-b9b9-6bcc324d97d8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:17.238813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dc79bd67-2d27-4709-bc45-87988d2b30a5 req-4f45a8e9-d768-49d7-b9b9-6bcc324d97d8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:17.241067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dc79bd67-2d27-4709-bc45-87988d2b30a5 req-4f45a8e9-d768-49d7-b9b9-6bcc324d97d8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:17.273274 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-dc79bd67-2d27-4709-bc45-87988d2b30a5 req-4f45a8e9-d768-49d7-b9b9-6bcc324d97d8 service nova] Creating event network-changed:bd12cbd3-a84c-4da7-8c9d-71f5c4054fff for instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 on n-h1-853316-12 Oct 17 13:03:17.286477 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-dc79bd67-2d27-4709-bc45-87988d2b30a5 req-4f45a8e9-d768-49d7-b9b9-6bcc324d97d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082117 Oct 17 13:03:17.287403 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1526/3016] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:17.398807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:17.408196 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f38cf00-dead-4133-975b-d15370811ede tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 200 len: 1297 microversion: 2.1 time: 0.486815 Oct 17 13:03:17.413274 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1491/3017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:16 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 1297 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:17.485203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:17.486616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:17.509460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:17.522897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:17.523523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:17.524406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:17.527547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:17.528125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.048336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:18.054200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:18.069469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Searching by: {'deleted': False, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:03:18.094476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.096395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.096910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.099004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.101775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.102273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.163946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:03:18.199597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:18.217389 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-199edba3-d2cc-4756-a203-30ac6e184f36 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1211 microversion: 2.1 time: 0.736797 Oct 17 13:03:18.239767 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1527/3018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:17 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1211 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:18.244130 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-384f5ad4-39cf-4556-bd64-56af5abf0c6f tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.200163 Oct 17 13:03:18.245121 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1492/3019] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 13:03:18 2022] GET /compute/v2.1/servers => generated 334 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:18.260276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:18.260789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:18.264731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:18.265412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:18.266242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Searching by: {'deleted': False, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:03:18.278671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.279156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.280449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.282776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.284288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.289737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.290552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.290970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.291374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.291815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.292299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.292736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.365034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:03:18.507869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:18.524467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.524963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.525409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.527397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:18.546442 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f9d9964-cb59-48e6-a10b-98fcc3bd42fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1233 microversion: 2.1 time: 0.303888 Oct 17 13:03:18.548240 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1528/3020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:18 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1233 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:18.554390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:18.555396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:18.564053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.564557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.565424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.566707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:18.567438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:18.568304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:18.608899 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 HTTP/1.1 Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '913a78a1-642c-4b41-935c-7f6bd67eb254'} Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:18.613306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:18.620245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:18.620245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:18.620245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:03:18.620245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:03:18.620245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:03:18.620245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:18.624119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:03:18.625347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-172f1480-02c8-43a6-87b1-c26b19dbb219 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 404 len: 111 microversion: 2.1 time: 0.075573 Oct 17 13:03:18.626489 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1529/3021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:18 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:03:18.652940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88e1b5f1-8d91-4cc1-9aff-d0d404dbf749 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8214bc8b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:19.098601 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25fd7c9a-5e88-437b-bc07-e3a315113136 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.841858 Oct 17 13:03:19.099268 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1493/3022] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:03:18 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:19.140024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c32c07bf-f80b-4195-aebb-1b5a061d9b44 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:19.177473 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c32c07bf-f80b-4195-aebb-1b5a061d9b44 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041650 Oct 17 13:03:19.178466 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1494/3023] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:03:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:19.244719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:19.245654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:19.260777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:19.261287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:19.261756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:19.268677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:19.273332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:19.273809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.260944 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88e1b5f1-8d91-4cc1-9aff-d0d404dbf749 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 204 len: 0 microversion: 2.1 time: 1.621580 Oct 17 13:03:20.262325 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1530/3024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:18 2022] DELETE /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 0 bytes in 1626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:03:20.270999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:20.271829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:20.284264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:20.285447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:20.286326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.287804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:20.288603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:20.289399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.324228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:03:20.339303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:20.354660 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8bea1801-2b48-4405-b829-0a90dd1bcf8b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1211 microversion: 2.1 time: 1.114079 Oct 17 13:03:20.357694 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1495/3025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:19 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1211 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:03:20.377945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:20.379437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:20.388411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:20.389488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:20.390328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.391583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:20.392521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:20.393362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.515383 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e61f57a-60e5-45ac-9461-6d3859ceccb8 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "DELETE /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 204 len: 0 microversion: 2.1 time: 0.251302 Oct 17 13:03:20.516099 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1531/3026] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:03:20 2022] DELETE /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:03:20.527573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:20.528188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:20.538894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:20.539648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:20.541251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.543268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:20.543919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:20.544600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.580807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:20.584976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:03:20.593857 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee611407-1392-4c5b-916c-6813d5cb23fa tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1295 microversion: 2.1 time: 0.234948 Oct 17 13:03:20.598004 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1496/3027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:20 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1295 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:20.609621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:20.611449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:20.630119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:20.633752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:20.636023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.636976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:20.638404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:20.641677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:20.758030 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3a224b41-2bf3-4840-be73-c8f5abe4c340 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 204 len: 0 microversion: 2.1 time: 0.234835 Oct 17 13:03:20.759497 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1532/3028] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:03:20 2022] DELETE /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:03:20.922977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-617952373", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "76738b67-1f67-4450-8954-529dd7a99e80"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:20.996807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] validate_networks() for [('76738b67-1f67-4450-8954-529dd7a99e80', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:03:21.127000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:21.138720 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7592efab-1580-4cf9-ab43-e7c30dd4d781 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1701 microversion: 2.1 time: 0.538177 Oct 17 13:03:21.139652 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1497/3029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:20 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1701 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:21.383134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:21.385415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:21.397897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:21.400170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:21.401934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:21.403890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:21.406841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:21.407724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:21.803665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:03:21.804926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:03:21.805812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:03:21.806673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:03:21.807312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:03:21.820247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:21.821608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:21.822247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:21.823184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:21.824013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:21.824704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:21.850735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:03:21.857596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Getting quotas for user 638e5facdbe64d26bf3c4b5c12a33da7 and project ba4fbca8fe5047cea1f9b2aeee10d54a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:03:21.905048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:03:21.910520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:03:22.001164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:22.015535 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f9ab0282-83d7-43dd-94d5-032a7cfeb275 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1211 microversion: 2.1 time: 0.639121 Oct 17 13:03:22.020359 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1498/3030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:21 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1211 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:22.030664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:22.031705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:22.049470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:22.052869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:22.053580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:22.055948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:22.056663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:22.061307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:22.124576 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e7c4de6-9e67-4ec9-8618-6bd52e8d013a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206372 Oct 17 13:03:22.131414 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1533/3031] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:03:22.136988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f2e44a17-5da8-4820-8740-c1fe14f62d01 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:22.137251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f2e44a17-5da8-4820-8740-c1fe14f62d01 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:22.165307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:22.320231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f2e44a17-5da8-4820-8740-c1fe14f62d01 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:22.328598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f2e44a17-5da8-4820-8740-c1fe14f62d01 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1207 microversion: 2.1 time: 0.195807 Oct 17 13:03:22.334389 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1534/3032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:22 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1207 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:03:22.347661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:22.353221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:22.376520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:22.377033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:22.377507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:22.384414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:22.385151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:22.387978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:22.871088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:22.896861 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b015d1c4-cab6-4901-bb4b-f97214920a64 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1701 microversion: 2.1 time: 0.561057 Oct 17 13:03:22.899916 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1535/3033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:22 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1701 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:23.041017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:23.041703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:23.053563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:23.055092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:23.056430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:23.060095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:23.060905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:23.062325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:23.426226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:23.435697 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-40fb5a22-fcf6-4522-b830-57178cc64075 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1295 microversion: 2.1 time: 1.413716 Oct 17 13:03:23.450643 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1499/3034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:22 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1295 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:23.455836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:23.456478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:23.477232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:23.477697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:23.478141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:23.479179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:23.483083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:23.483642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:23.529770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:23.560107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:23.574667 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2a28d102-50b0-48d2-85e4-eeb380d37d62 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1211 microversion: 2.1 time: 0.538359 Oct 17 13:03:23.593266 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1536/3035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:23 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1211 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:23.719167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:23.735717 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ad7c71c-0f65-4976-9e68-80f350677e59 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1203 microversion: 2.1 time: 0.282796 Oct 17 13:03:23.736201 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1500/3036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:23 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1203 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:23.927130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:23.927881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:23.946124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:23.946674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:23.947131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:23.954767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:23.955751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:23.956804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:24.336512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:24.374069 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d763f60-7afb-4340-abf1-54a72507edfb tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1701 microversion: 2.1 time: 0.446082 Oct 17 13:03:24.390463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1537/3037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:23 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1701 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:24.467863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:24.468645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:24.497054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:24.498705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:24.499202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:24.499645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:24.500395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:24.500852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:24.515312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:24.604790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:24.605941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:24.626408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:24.634918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:24.637838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:24.647056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:24.647558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:24.649150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:25.449446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:25.463275 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c095765d-798b-4c4e-adc7-e232f0f69a98 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1361 microversion: 2.1 time: 1.007561 Oct 17 13:03:25.465972 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1501/3038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:24 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1361 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:25.476151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:25.486904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:25.502499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:25.503211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:25.505678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:25.506637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:25.509800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:25.510427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:25.526914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:25.551133 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40496212-e025-4edb-8e4b-cd9f0c818cee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 0.948672 Oct 17 13:03:25.553410 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1538/3039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:24 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:25.563714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:25.564331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:25.593767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:25.594397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:25.594625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:25.595335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:25.595787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:25.596215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:25.735017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:25.746711 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-578c8eaf-804f-4550-b8e5-f9696ea4800e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1265 microversion: 2.1 time: 0.279148 Oct 17 13:03:25.748244 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1502/3040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:25 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:26.325862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d5bec46b-4833-4036-83c5-4ad8abbd5864 req-b769a21e-8a33-4043-a5f5-a2927404e7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6d75-a1e6-46ad-bffa-d56e90f02504", "name": "network-vif-unplugged", "status": "completed", "tag": "c3a2e0af-8344-49fc-827b-b2a722ffacb0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:26.337431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d5bec46b-4833-4036-83c5-4ad8abbd5864 req-b769a21e-8a33-4043-a5f5-a2927404e7ed service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:26.338139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d5bec46b-4833-4036-83c5-4ad8abbd5864 req-b769a21e-8a33-4043-a5f5-a2927404e7ed service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:26.339094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d5bec46b-4833-4036-83c5-4ad8abbd5864 req-b769a21e-8a33-4043-a5f5-a2927404e7ed service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:26.356639 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d5bec46b-4833-4036-83c5-4ad8abbd5864 req-b769a21e-8a33-4043-a5f5-a2927404e7ed service nova] Creating event network-vif-unplugged:c3a2e0af-8344-49fc-827b-b2a722ffacb0 for instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 on n-h1-853316-12 Oct 17 13:03:26.370765 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d5bec46b-4833-4036-83c5-4ad8abbd5864 req-b769a21e-8a33-4043-a5f5-a2927404e7ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049911 Oct 17 13:03:26.373549 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1503/3041] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:26.683099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:26.684377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:26.699928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:26.700702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:26.701147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:26.703116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:26.703581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:26.704014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:26.741388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:03:26.880986 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67bd8945-a074-4d40-91df-75561fb6f1e7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 204 len: 0 microversion: 2.32 time: 0.505584 Oct 17 13:03:26.885748 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1504/3042] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:03:26 2022] DELETE /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:03:26.893793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:26.895331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:26.917085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:26.917964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:26.918585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:26.919566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:26.920453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:26.921439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:27.059471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:27.072930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:27.085095 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fb9b8e80-f59f-4799-bcd1-62d3e001e5d9 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1701 microversion: 2.1 time: 1.528661 Oct 17 13:03:27.101492 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1539/3043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:25 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1701 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:27.122790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:27.123844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:27.144969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:27.145619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:27.146068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:27.151232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:27.152023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:27.153956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:27.452193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:27.465487 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d3d006b-ee06-4b37-9661-00c8293a3fa7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1361 microversion: 2.1 time: 0.578017 Oct 17 13:03:27.466650 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1505/3044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:26 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:27.493741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:27.494699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:27.508684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:27.510682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:27.511311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:27.512226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:27.512888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:27.514793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:27.876786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:27.891883 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e5bbadf5-e2bc-4dd6-b0ab-3083aa7a5625 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 0.786587 Oct 17 13:03:27.892498 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1540/3045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:27 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:27.927958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:27.928857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:27.952859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:27.956713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:27.957442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:27.960421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:27.961158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:27.966588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:28.308141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:28.462670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:28.481917 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4831bff8-1f40-4797-bb49-865646287f26 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 1.012703 Oct 17 13:03:28.482432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1506/3046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:27 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:28.489427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4eb55876-83a3-4314-ab8a-700a05e0b93e req-49f5be5c-4fc9-48b5-b00d-ea106c8b180e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800f7d25-a5d5-415d-b3c3-29fd11e206d6", "name": "network-vif-deleted", "tag": "19335654-baf3-4919-893c-8ea11fd4b242"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:28.502366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:28.519650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4eb55876-83a3-4314-ab8a-700a05e0b93e req-49f5be5c-4fc9-48b5-b00d-ea106c8b180e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:28.521657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4eb55876-83a3-4314-ab8a-700a05e0b93e req-49f5be5c-4fc9-48b5-b00d-ea106c8b180e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:28.527609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4eb55876-83a3-4314-ab8a-700a05e0b93e req-49f5be5c-4fc9-48b5-b00d-ea106c8b180e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:28.565564 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4eb55876-83a3-4314-ab8a-700a05e0b93e req-49f5be5c-4fc9-48b5-b00d-ea106c8b180e service nova] Creating event network-vif-deleted:19335654-baf3-4919-893c-8ea11fd4b242 for instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 on n-h1-853316-12 Oct 17 13:03:28.575595 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4eb55876-83a3-4314-ab8a-700a05e0b93e req-49f5be5c-4fc9-48b5-b00d-ea106c8b180e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090497 Oct 17 13:03:28.580602 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1507/3047] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:28.592686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:28.594862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:28.610245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:28.614488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:28.616158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:28.619855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:28.620669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:28.621968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:28.737980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:28.749584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:28.751339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:28.754103 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db74c7ce-bc5e-4efa-abe1-b13ac1104faa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2951 microversion: 2.32 time: 0.855073 Oct 17 13:03:28.767659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1541/3048] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:27 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2951 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:28.783496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:28.785007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:28.792559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:28.793658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:28.795554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:28.796558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:28.797265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:28.797912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:29.138840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:29.147924 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a8b11e5-c344-4e58-8893-0fae7bdcd664 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1361 microversion: 2.1 time: 0.378861 Oct 17 13:03:29.166369 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1542/3049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:28 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:29.190326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455a7e9ecc4d4089955c666603ca8b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f7427b14445159ef1d9f3057c4a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:29.199362 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f05506f-241b-40c2-80d3-8251df67a614 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 200 len: 1633 microversion: 2.1 time: 0.612179 Oct 17 13:03:29.199953 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1508/3050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:28 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 1633 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:29.212152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:29.212769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:29.231265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:29.233273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:29.235045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:29.236282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:29.238764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:29.239533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:29.399965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0093434-6b38-431f-9f4a-28ae67168e40 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Action: 'create', calling method: .version_select at 0x7fa821244ee0>, body: {"pool": null} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:30.652276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:30.664285 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e413fb1-3799-4ab5-9409-df618a1dfe66 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 1.455772 Oct 17 13:03:30.665241 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1509/3051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:29 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:30.678771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3e25bc54-3ead-482e-bbca-6cf1b8cac675 req-d5983958-8510-44b6-aa10-857b5131cbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0f6a09-8e29-486f-a866-75047d3370ac", "tag": "7dc84daa-ad60-4da6-a960-1cfccaec2339"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:30.705455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3e25bc54-3ead-482e-bbca-6cf1b8cac675 req-d5983958-8510-44b6-aa10-857b5131cbe2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:30.707321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3e25bc54-3ead-482e-bbca-6cf1b8cac675 req-d5983958-8510-44b6-aa10-857b5131cbe2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:30.708023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3e25bc54-3ead-482e-bbca-6cf1b8cac675 req-d5983958-8510-44b6-aa10-857b5131cbe2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:30.744050 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3e25bc54-3ead-482e-bbca-6cf1b8cac675 req-d5983958-8510-44b6-aa10-857b5131cbe2 service nova] Creating event network-changed:7dc84daa-ad60-4da6-a960-1cfccaec2339 for instance 5d0f6a09-8e29-486f-a866-75047d3370ac on n-h2-853316-12 Oct 17 13:03:30.757496 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3e25bc54-3ead-482e-bbca-6cf1b8cac675 req-d5983958-8510-44b6-aa10-857b5131cbe2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088211 Oct 17 13:03:30.761101 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1510/3052] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:30.774945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:30.781880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:30.798328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:30.801890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:30.802539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:30.803299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:30.816409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:30.816973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:31.819647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0093434-6b38-431f-9f4a-28ae67168e40 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.652010 Oct 17 13:03:31.828372 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1543/3053] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 13:03:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:31.831826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:31.832467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:31.839924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:31.843425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:31.848781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:31.849726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:31.850754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:31.851429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:31.852432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:31.862699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:31.879663 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f9070f00-4721-4c0f-9ab4-b8bdef843f1f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 1.116973 Oct 17 13:03:31.896408 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1511/3054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:30 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:31.930068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:31.935937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:31.959717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:31.962671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:31.964290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:31.967068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:31.967759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:31.969406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:32.324692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=28 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:32.504335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:32.523650 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93ec8bf5-ddcb-43a2-bbc7-6a9640db380c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1361 microversion: 2.1 time: 0.610183 Oct 17 13:03:32.532067 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1512/3055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:31 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1361 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:32.551690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:32.554642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] [instance: 677f6d75-a1e6-46ad-bffa-d56e90f02504] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:32.570491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:32.570998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:32.571441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:32.572164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:32.572624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:32.579038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:32.615976 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] HTTP exception thrown: Instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 could not be found. Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Request method failure captured: Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 HTTP/1.1 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVIcGDoWPnRceMmN2-JU7e0gd2Gv_wKkQEAF8IRFqloTGEeAYX5DCPbLC53MDf0OPSJHqolbpi2GgyHIVUfBDMRqOAoS6JLmNUQsXY4cFTFoKEt_U6_9hNj_L9exIwgo4zVjtqB-6-RbO-i2Mbs2Sz4iQPfypwGnYtPeLRjTrSgNvR0 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8a5f7427b14445159ef1d9f3057c4a73 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1134002846 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a5f7427b14445159ef1d9f3057c4a73", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a5f7427b14445159ef1d9f3057c4a73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a5f7427b14445159ef1d9f3057c4a73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a5f7427b14445159ef1d9f3057c4a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1134002846 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8a5f7427b14445159ef1d9f3057c4a73 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1134002846 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1134002846-project Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 455a7e9ecc4d4089955c666603ca8b43 Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1134002846-project Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 could not be found. Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '677f6d75-a1e6-46ad-bffa-d56e90f02504'} Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 could not be found. Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 could not be found. Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:32.621155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:32.625914 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:32.625914 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:32.625914 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:32.625914 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:03:32.625914 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:03:32.625914 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 could not be found. Oct 17 13:03:32.625914 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:32.632509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Returning 404 to user: Instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:03:32.637550 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25f02d47-fb35-4268-a070-fc219addfe03 tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504" status: 404 len: 111 microversion: 2.1 time: 0.103233 Oct 17 13:03:32.640707 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1513/3056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:32 2022] GET /compute/v2.1/servers/677f6d75-a1e6-46ad-bffa-d56e90f02504 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:03:32.655488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4c52f0cb-4b2e-4b3a-96b9-294116b0a5d3 req-4d298064-3bf8-45e6-9860-e2617d1f8b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6d75-a1e6-46ad-bffa-d56e90f02504", "name": "network-vif-deleted", "tag": "c3a2e0af-8344-49fc-827b-b2a722ffacb0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:32.681054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c52f0cb-4b2e-4b3a-96b9-294116b0a5d3 req-4d298064-3bf8-45e6-9860-e2617d1f8b74 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:32.682479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c52f0cb-4b2e-4b3a-96b9-294116b0a5d3 req-4d298064-3bf8-45e6-9860-e2617d1f8b74 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:32.685504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c52f0cb-4b2e-4b3a-96b9-294116b0a5d3 req-4d298064-3bf8-45e6-9860-e2617d1f8b74 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:32.725826 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4c52f0cb-4b2e-4b3a-96b9-294116b0a5d3 req-4d298064-3bf8-45e6-9860-e2617d1f8b74 service nova] Creating event network-vif-deleted:c3a2e0af-8344-49fc-827b-b2a722ffacb0 for instance 677f6d75-a1e6-46ad-bffa-d56e90f02504 on n-h1-853316-12 Oct 17 13:03:32.759920 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4c52f0cb-4b2e-4b3a-96b9-294116b0a5d3 req-4d298064-3bf8-45e6-9860-e2617d1f8b74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113550 Oct 17 13:03:32.764513 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1514/3057] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:32.806565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:32.807600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:32.838778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:32.841352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:32.842312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:32.843854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:32.844549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:32.845181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:33.492559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:33.503248 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9fbad29-79c0-4804-8d0a-8178118fc4ae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 0.736358 Oct 17 13:03:33.508047 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1515/3058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:32 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:33.518986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9c3b1c3-56f0-495e-8777-5c7fc0b421b2 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Calling method '.version_select at 0x7fa8250a4430>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:33.544958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:33.569248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:33.570787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:33.574035 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-052970a1-ec92-47b2-aac9-46522a910b9c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2951 microversion: 2.32 time: 1.752424 Oct 17 13:03:33.578607 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1544/3059] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:31 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2951 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:33.593233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e37d9837-67e7-44bb-bc4c-e0f3c209d89d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] Calling method '.version_select at 0x7fa821291dc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:33.637981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e37d9837-67e7-44bb-bc4c-e0f3c209d89d tempest-ServersTestJSON-1134002846 tempest-ServersTestJSON-1134002846-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549952109" status: 202 len: 0 microversion: 2.1 time: 0.057450 Oct 17 13:03:33.639195 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1545/3060] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 13:03:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549952109 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:03:33.646519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a598070f-dcfb-4e2a-b736-4c45aa287706 req-a5b24d38-cf02-4955-98f3-24e3823796e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4d1fab-16d8-4238-b1f5-4d58fa217fa5", "tag": "c8643a34-1273-49f5-973a-36a22df2f278"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:33.673260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a598070f-dcfb-4e2a-b736-4c45aa287706 req-a5b24d38-cf02-4955-98f3-24e3823796e9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:33.674043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a598070f-dcfb-4e2a-b736-4c45aa287706 req-a5b24d38-cf02-4955-98f3-24e3823796e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:33.675189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a598070f-dcfb-4e2a-b736-4c45aa287706 req-a5b24d38-cf02-4955-98f3-24e3823796e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:33.706555 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a598070f-dcfb-4e2a-b736-4c45aa287706 req-a5b24d38-cf02-4955-98f3-24e3823796e9 service nova] Creating event network-changed:c8643a34-1273-49f5-973a-36a22df2f278 for instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 on n-h2-853316-12 Oct 17 13:03:33.720083 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a598070f-dcfb-4e2a-b736-4c45aa287706 req-a5b24d38-cf02-4955-98f3-24e3823796e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078809 Oct 17 13:03:33.722514 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1546/3061] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:33.731414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:33.732784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:33.743892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:33.745094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:33.746229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:33.747258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:33.748167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:33.749053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:34.011314 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9c3b1c3-56f0-495e-8777-5c7fc0b421b2 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/26fb0428-b5f2-4f6e-a506-39541d1e2b17" status: 200 len: 142 microversion: 2.1 time: 0.500262 Oct 17 13:03:34.011912 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1516/3062] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:03:33 2022] GET /compute/v2.1/os-floating-ips/26fb0428-b5f2-4f6e-a506-39541d1e2b17 => generated 142 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:34.017065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:34.017989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:34.035007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:34.036008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:34.036643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:34.037587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:34.038253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:34.042591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:34.418019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:34.433157 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-67783c4f-9ec1-4549-9646-079aa7eda8e1 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 0.709000 Oct 17 13:03:34.434094 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1547/3063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:33 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:34.453334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b13d1903-d457-44c6-9b74-38b49db94c1a tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Calling method '.version_select at 0x7fa820f8bdc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:34.549333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:34.565994 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5661859f-4e0c-43ad-b85d-98703aeb1220 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1361 microversion: 2.1 time: 0.551756 Oct 17 13:03:34.568772 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1517/3064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:34 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1361 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:34.575067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:34.577241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:34.594885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:34.596753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:34.597495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:34.598833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:34.600123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:34.601058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:34.869656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:34.887606 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c3188c81-7d67-45d4-a021-e4944e79f7d4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 0.317424 Oct 17 13:03:34.888607 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1518/3065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:34 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:34.894383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:34.895311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:34.903357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:34.904531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:34.905224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:34.906413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:34.907092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:34.907574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:35.511917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b13d1903-d457-44c6-9b74-38b49db94c1a tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.076426 Oct 17 13:03:35.512357 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1548/3066] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 13:03:34 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:35.516879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:35.517495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:35.538834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:35.540768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:35.542777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:35.545313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:35.549803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:35.551006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:36.174515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:36.179012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:36.185553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:36.192045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:36.193371 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75857b16-b78e-445a-94a5-1cbbe92a2780 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2951 microversion: 2.32 time: 1.303655 Oct 17 13:03:36.193935 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1519/3067] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:34 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2951 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:36.218582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b65185e-a04f-49d9-a667-0c39bf7e1209 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Calling method '.version_select at 0x7fa820474ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:36.329758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:36.363523 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b95bb06-af5b-484e-b1b0-ac6d5ed2e7ba tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 0.845505 Oct 17 13:03:36.366015 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1549/3068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:35 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:36.395638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:36.401990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:36.424900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:36.426698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:36.427917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:36.431476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:36.432783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:36.434658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:37.713607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:37.732927 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b448ef2-e279-40c5-abd9-454f5c18f1a1 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1361 microversion: 2.1 time: 1.364953 Oct 17 13:03:37.733522 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1550/3069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:36 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1361 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:37.755125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:37.755741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:37.773118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:37.773612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:37.774372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:37.775263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:37.775905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:37.776499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:38.397526 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b65185e-a04f-49d9-a667-0c39bf7e1209 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/26fb0428-b5f2-4f6e-a506-39541d1e2b17" status: 202 len: 0 microversion: 2.1 time: 2.193541 Oct 17 13:03:38.399795 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1520/3070] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 13:03:36 2022] DELETE /compute/v2.1/os-floating-ips/26fb0428-b5f2-4f6e-a506-39541d1e2b17 => generated 0 bytes in 2205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:03:38.413912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:38.416443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:38.457898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:38.458424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:38.458873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:38.468019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:38.468558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:38.469076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:38.545344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:38.554721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-574fd8a0-a981-47f7-b545-03b30ecbd057 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 0.804382 Oct 17 13:03:38.570744 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1551/3071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:37 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:38.571600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:38.572168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:38.595412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:38.595913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:38.596355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:38.602979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:38.603472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:38.603913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:38.831732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:38.868713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:38.875122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:38.877408 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2adcd3b6-cce5-4908-8cbf-76cbb3d25885 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2909 microversion: 2.32 time: 0.476384 Oct 17 13:03:38.879182 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1521/3072] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:38 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2909 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:38.885029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8ad4c64-f7fc-4224-a523-d2abdfa9b7b7 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Action: 'create', calling method: .version_select at 0x7fa820476700>, body: {"pool": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:39.149819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:39.159847 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-47d3703e-60e6-4df2-804b-0e56a134c215 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 0.593205 Oct 17 13:03:39.178545 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1552/3073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:38 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:39.188169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d6da7b9c-cdfb-4b0d-8df1-ace818dce698 req-196258c6-9fa2-43b9-abb1-44f86ea50f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f6a09-8e29-486f-a866-75047d3370ac", "name": "network-vif-plugged", "status": "completed", "tag": "7dc84daa-ad60-4da6-a960-1cfccaec2339"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:39.215276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d6da7b9c-cdfb-4b0d-8df1-ace818dce698 req-196258c6-9fa2-43b9-abb1-44f86ea50f54 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:39.217912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d6da7b9c-cdfb-4b0d-8df1-ace818dce698 req-196258c6-9fa2-43b9-abb1-44f86ea50f54 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:39.218447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d6da7b9c-cdfb-4b0d-8df1-ace818dce698 req-196258c6-9fa2-43b9-abb1-44f86ea50f54 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:39.254791 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d6da7b9c-cdfb-4b0d-8df1-ace818dce698 req-196258c6-9fa2-43b9-abb1-44f86ea50f54 service nova] Creating event network-vif-plugged:7dc84daa-ad60-4da6-a960-1cfccaec2339 for instance 5d0f6a09-8e29-486f-a866-75047d3370ac on n-h2-853316-12 Oct 17 13:03:39.267740 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d6da7b9c-cdfb-4b0d-8df1-ace818dce698 req-196258c6-9fa2-43b9-abb1-44f86ea50f54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088047 Oct 17 13:03:39.269920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1553/3074] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:39.276598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:39.277840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:39.286643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:39.287370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:39.314241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:39.320736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:39.321618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:39.325611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:39.952186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:39.967305 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e0e5974b-08e6-43c2-9314-5cf27a8871f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1361 microversion: 2.1 time: 0.695174 Oct 17 13:03:39.967425 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1554/3075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:39 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1361 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:39.972295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:39.972948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:39.989621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:39.994500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:39.995250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:39.996175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:39.996811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:39.997426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:40.529984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:40.541971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-39482c9e-0565-41f5-be57-fddba2b20cc7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 0.573475 Oct 17 13:03:40.546284 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1555/3076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:39 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:40.561885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:40.566089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:40.580457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:40.586304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:40.588091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:40.589999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:40.591138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:40.591925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:40.796169 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8ad4c64-f7fc-4224-a523-d2abdfa9b7b7 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.915576 Oct 17 13:03:40.811119 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1522/3077] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 13:03:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:40.820326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:40.820881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:40.840086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:40.842940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:40.843716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:40.845449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:40.848262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:40.850588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:41.046731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:41.062263 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f51d1912-b40a-41fd-b23c-e239a226a80a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 0.249743 Oct 17 13:03:41.062867 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1523/3078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:40 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:41.077565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-12c36cf3-9c60-42f5-a181-44908c26acd6 req-33748be7-ef44-4de1-8d44-88cf123b1774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-deleted", "tag": "44c45404-14f1-47d8-ab4c-b3cb9a6bc6e8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:41.117025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-12c36cf3-9c60-42f5-a181-44908c26acd6 req-33748be7-ef44-4de1-8d44-88cf123b1774 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:41.118399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-12c36cf3-9c60-42f5-a181-44908c26acd6 req-33748be7-ef44-4de1-8d44-88cf123b1774 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:41.120083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-12c36cf3-9c60-42f5-a181-44908c26acd6 req-33748be7-ef44-4de1-8d44-88cf123b1774 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:41.139336 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-12c36cf3-9c60-42f5-a181-44908c26acd6 req-33748be7-ef44-4de1-8d44-88cf123b1774 service nova] Creating event network-vif-deleted:44c45404-14f1-47d8-ab4c-b3cb9a6bc6e8 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:41.146440 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-12c36cf3-9c60-42f5-a181-44908c26acd6 req-33748be7-ef44-4de1-8d44-88cf123b1774 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082322 Oct 17 13:03:41.147696 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1524/3079] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:41.156182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e03932df-ae2f-46bf-9cec-8aa39cb94c3a tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Calling method '.version_select at 0x7fa8250a4940>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:42.067285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:42.094653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:42.101687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:42.103433 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c52107fa-3e6a-4b29-b295-8a61fdc4bded tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2863 microversion: 2.32 time: 1.555211 Oct 17 13:03:42.108124 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1556/3080] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:40 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2863 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:42.132722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:42.133844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:42.145725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:42.153696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:42.154494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:42.155323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:42.157142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:42.162565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:42.688900 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e03932df-ae2f-46bf-9cec-8aa39cb94c3a tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/0f65313e-50cd-48b0-9611-034c0bbb240d" status: 202 len: 0 microversion: 2.1 time: 1.539740 Oct 17 13:03:42.693649 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1525/3081] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 13:03:41 2022] DELETE /compute/v2.1/os-floating-ips/0f65313e-50cd-48b0-9611-034c0bbb240d => generated 0 bytes in 1545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:03:42.702128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6adc2f51-7e13-47e3-9167-131d64e70e96 req-6370f833-ebf2-4f92-977c-fadbed95a539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-unplugged", "status": "completed", "tag": "3e96ea21-21b0-4e46-aee5-240154bd8bd8"}, {"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-unplugged", "status": "completed", "tag": "549f3f80-1e4f-4580-9a65-68ec0e85d947"}, {"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-unplugged", "status": "completed", "tag": "0e3b2a77-e188-4c79-8863-df8a35716569"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:42.719250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6adc2f51-7e13-47e3-9167-131d64e70e96 req-6370f833-ebf2-4f92-977c-fadbed95a539 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:42.726923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6adc2f51-7e13-47e3-9167-131d64e70e96 req-6370f833-ebf2-4f92-977c-fadbed95a539 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:42.727926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6adc2f51-7e13-47e3-9167-131d64e70e96 req-6370f833-ebf2-4f92-977c-fadbed95a539 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:42.767636 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6adc2f51-7e13-47e3-9167-131d64e70e96 req-6370f833-ebf2-4f92-977c-fadbed95a539 service nova] Creating event network-vif-unplugged:3e96ea21-21b0-4e46-aee5-240154bd8bd8 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:42.768985 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6adc2f51-7e13-47e3-9167-131d64e70e96 req-6370f833-ebf2-4f92-977c-fadbed95a539 service nova] Creating event network-vif-unplugged:549f3f80-1e4f-4580-9a65-68ec0e85d947 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:42.769403 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6adc2f51-7e13-47e3-9167-131d64e70e96 req-6370f833-ebf2-4f92-977c-fadbed95a539 service nova] Creating event network-vif-unplugged:0e3b2a77-e188-4c79-8863-df8a35716569 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:42.776542 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6adc2f51-7e13-47e3-9167-131d64e70e96 req-6370f833-ebf2-4f92-977c-fadbed95a539 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.081539 Oct 17 13:03:42.777744 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1526/3082] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:42.785328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:42.786464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:42.797986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:42.813241 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-77724a5b-c881-41b9-a1cd-3201ab8363e5 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1547 microversion: 2.1 time: 0.702902 Oct 17 13:03:42.813993 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1557/3083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:42 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1547 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:42.837240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:42.842065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:42.844515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:42.845599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:42.845961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:42.846545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:42.854772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:42.857584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:42.872058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:42.874852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:42.875307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:42.876995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:42.879117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:42.879765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:43.059167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:43.069216 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8f5abe07-edc1-473d-be26-da9995f492a7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 0.289978 Oct 17 13:03:43.070131 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1527/3084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:42 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:43.075546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb71e20f-3431-4500-92fd-6e23bf0236f1 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Calling method '.version_select at 0x7fa820474430>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:43.152701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-bb71e20f-3431-4500-92fd-6e23bf0236f1 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0f65313e-50cd-48b0-9611-034c0bbb240d could not be found", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:03:43.155059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-bb71e20f-3431-4500-92fd-6e23bf0236f1 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] HTTP exception thrown: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb71e20f-3431-4500-92fd-6e23bf0236f1 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Request method failure captured: Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-floating-ips/0f65313e-50cd-48b0-9611-034c0bbb240d HTTP/1.1 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVKgARKTqa53WEIi_4kpDXeTxifXNSZHS5jbNiaeN7TWWlZKjvqHzE9aMMeAz9sWGFcQ5kp-ZHwosVhZP-T9VI-7x3gbchVo6OGczOFofr8tdXihwaZ-wAB-LVsO1wTYFsmlMyf8wZDpuUrhGc77kqPB7kJCP6qGIemGw1RnYXrZbhg Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 81b73231f1c645e1aceafdec0a6d5ea5 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FloatingIPsTestJSON-1446498459 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b73231f1c645e1aceafdec0a6d5ea5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b73231f1c645e1aceafdec0a6d5ea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b73231f1c645e1aceafdec0a6d5ea5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b73231f1c645e1aceafdec0a6d5ea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FloatingIPsTestJSON-1446498459 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 81b73231f1c645e1aceafdec0a6d5ea5 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1446498459 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FloatingIPsTestJSON-1446498459-project Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 65418b5024a04168b704ab57509cec17 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FloatingIPsTestJSON-1446498459-project Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: exception: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '0f65313e-50cd-48b0-9611-034c0bbb240d'} Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0f65313e-50cd-48b0-9611-034c0bbb240d could not be found Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-570c3dda-36bb-487a-8775-39cd5ced37b7'] Oct 17 13:03:43.163393 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d. Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb71e20f-3431-4500-92fd-6e23bf0236f1 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Returning 404 to user: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb71e20f-3431-4500-92fd-6e23bf0236f1 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/0f65313e-50cd-48b0-9611-034c0bbb240d" status: 404 len: 111 microversion: 2.1 time: 0.093563 Oct 17 13:03:43.168285 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1528/3085] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:03:43 2022] GET /compute/v2.1/os-floating-ips/0f65313e-50cd-48b0-9611-034c0bbb240d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:03:43.178620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:43.179129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:43.191644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:43.191896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:43.192346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:43.193334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:43.193834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:43.194392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:43.295711 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-afa9fd0d-908b-4873-8b7f-3410529b13d2 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127133 Oct 17 13:03:43.296903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1529/3086] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:03:43 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:43.306337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:43.307182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:43.321410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:43.322290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:43.323726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:43.325259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:43.326271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:43.327326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:43.665819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:43.681031 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0d9a929-66e4-4ab9-ae9e-26951131cffc tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 0.841449 Oct 17 13:03:43.681783 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1558/3087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:42 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:43.703455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85fbb585-5e75-4c86-ad7b-dc03cabfdde8 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Calling method '.version_select at 0x7fa820afddc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:43.840390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-85fbb585-5e75-4c86-ad7b-dc03cabfdde8 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0f65313e-50cd-48b0-9611-034c0bbb240d could not be found", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:03:43.844077 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-85fbb585-5e75-4c86-ad7b-dc03cabfdde8 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] HTTP exception thrown: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85fbb585-5e75-4c86-ad7b-dc03cabfdde8 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Request method failure captured: Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-floating-ips/0f65313e-50cd-48b0-9611-034c0bbb240d HTTP/1.1 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVKgARKTqa53WEIi_4kpDXeTxifXNSZHS5jbNiaeN7TWWlZKjvqHzE9aMMeAz9sWGFcQ5kp-ZHwosVhZP-T9VI-7x3gbchVo6OGczOFofr8tdXihwaZ-wAB-LVsO1wTYFsmlMyf8wZDpuUrhGc77kqPB7kJCP6qGIemGw1RnYXrZbhg Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 81b73231f1c645e1aceafdec0a6d5ea5 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-FloatingIPsTestJSON-1446498459 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b73231f1c645e1aceafdec0a6d5ea5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b73231f1c645e1aceafdec0a6d5ea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b73231f1c645e1aceafdec0a6d5ea5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b73231f1c645e1aceafdec0a6d5ea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-FloatingIPsTestJSON-1446498459 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 81b73231f1c645e1aceafdec0a6d5ea5 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1446498459 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-FloatingIPsTestJSON-1446498459-project Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 65418b5024a04168b704ab57509cec17 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-FloatingIPsTestJSON-1446498459-project Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: exception: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '0f65313e-50cd-48b0-9611-034c0bbb240d'} Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0f65313e-50cd-48b0-9611-034c0bbb240d could not be found Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7e27ca0-b526-4f66-944c-911579ecef06'] Oct 17 13:03:43.844959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d. Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85fbb585-5e75-4c86-ad7b-dc03cabfdde8 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] Returning 404 to user: Floating IP not found for ID 0f65313e-50cd-48b0-9611-034c0bbb240d {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:03:43.851689 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85fbb585-5e75-4c86-ad7b-dc03cabfdde8 tempest-FloatingIPsTestJSON-1446498459 tempest-FloatingIPsTestJSON-1446498459-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/0f65313e-50cd-48b0-9611-034c0bbb240d" status: 404 len: 111 microversion: 2.1 time: 0.167221 Oct 17 13:03:43.855211 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1559/3088] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 13:03:43 2022] DELETE /compute/v2.1/os-floating-ips/0f65313e-50cd-48b0-9611-034c0bbb240d => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:03:43.868742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b24ca226-fd28-4419-b0a0-d42183470694 req-560d0acf-c432-43cb-b791-9d627fbeaff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-deleted", "tag": "549f3f80-1e4f-4580-9a65-68ec0e85d947"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:43.901390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b24ca226-fd28-4419-b0a0-d42183470694 req-560d0acf-c432-43cb-b791-9d627fbeaff2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:43.916076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b24ca226-fd28-4419-b0a0-d42183470694 req-560d0acf-c432-43cb-b791-9d627fbeaff2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:43.916447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b24ca226-fd28-4419-b0a0-d42183470694 req-560d0acf-c432-43cb-b791-9d627fbeaff2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:43.954644 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b24ca226-fd28-4419-b0a0-d42183470694 req-560d0acf-c432-43cb-b791-9d627fbeaff2 service nova] Creating event network-vif-deleted:549f3f80-1e4f-4580-9a65-68ec0e85d947 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:43.975732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b24ca226-fd28-4419-b0a0-d42183470694 req-560d0acf-c432-43cb-b791-9d627fbeaff2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118902 Oct 17 13:03:43.977305 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1560/3089] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:44.095549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:44.098125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:44.118359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:44.118859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:44.119829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:44.120564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:44.124359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:44.124957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:44.396980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:44.411100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:44.414856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:44.418594 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e9c3136-b342-4c86-8a92-21725138a7c7 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2703 microversion: 2.32 time: 1.119577 Oct 17 13:03:44.419450 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1530/3090] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:43 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2703 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:44.715280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:44.721124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:44.746016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:44.749076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:44.757471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:44.759018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:44.763890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:44.766119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:45.575392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:45.591102 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1aa6165d-121e-4e3e-af22-1c745d198d1b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 1.498980 Oct 17 13:03:45.594087 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1561/3091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:44 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:45.610905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6ce79df4-3a6e-4ef7-8840-f83bbad6b4f6 req-ecd3a51c-3f81-427f-9935-df0d6318dafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4d1fab-16d8-4238-b1f5-4d58fa217fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c8643a34-1273-49f5-973a-36a22df2f278"}, {"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-unplugged", "status": "completed", "tag": "b965e48b-1ec7-4ed6-9c05-9c0ab419272f"}, {"server_uuid": "0da2b394-f53d-4cf0-a3d1-fcfb88307986", "name": "network-vif-plugged", "status": "completed", "tag": "bd12cbd3-a84c-4da7-8c9d-71f5c4054fff"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:45.617994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:45.623440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6ce79df4-3a6e-4ef7-8840-f83bbad6b4f6 req-ecd3a51c-3f81-427f-9935-df0d6318dafc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:45.623931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6ce79df4-3a6e-4ef7-8840-f83bbad6b4f6 req-ecd3a51c-3f81-427f-9935-df0d6318dafc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:45.624378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6ce79df4-3a6e-4ef7-8840-f83bbad6b4f6 req-ecd3a51c-3f81-427f-9935-df0d6318dafc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:45.634067 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10ff0b66-933a-4723-a051-c01001fe28e7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 0.927996 Oct 17 13:03:45.648035 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1531/3092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:44 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:45.648035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:45.648035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:45.648467 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6ce79df4-3a6e-4ef7-8840-f83bbad6b4f6 req-ecd3a51c-3f81-427f-9935-df0d6318dafc service nova] Creating event network-vif-plugged:c8643a34-1273-49f5-973a-36a22df2f278 for instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 on n-h2-853316-12 Oct 17 13:03:45.648467 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6ce79df4-3a6e-4ef7-8840-f83bbad6b4f6 req-ecd3a51c-3f81-427f-9935-df0d6318dafc service nova] Creating event network-vif-unplugged:b965e48b-1ec7-4ed6-9c05-9c0ab419272f for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:45.653357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:45.657382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:45.659089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:45.660003 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6ce79df4-3a6e-4ef7-8840-f83bbad6b4f6 req-ecd3a51c-3f81-427f-9935-df0d6318dafc service nova] Creating event network-vif-plugged:bd12cbd3-a84c-4da7-8c9d-71f5c4054fff for instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 on n-h1-853316-12 Oct 17 13:03:45.660967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:45.662710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:45.663477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:45.681021 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6ce79df4-3a6e-4ef7-8840-f83bbad6b4f6 req-ecd3a51c-3f81-427f-9935-df0d6318dafc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.077114 Oct 17 13:03:45.686233 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1562/3093] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:46.031797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8d7d6b71-c7de-499c-99a2-2053bb5e06b9 req-653bfbb0-0a37-478a-9497-b9335b479256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-deleted", "tag": "b965e48b-1ec7-4ed6-9c05-9c0ab419272f"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:46.054704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8d7d6b71-c7de-499c-99a2-2053bb5e06b9 req-653bfbb0-0a37-478a-9497-b9335b479256 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:46.055137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8d7d6b71-c7de-499c-99a2-2053bb5e06b9 req-653bfbb0-0a37-478a-9497-b9335b479256 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:46.055575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8d7d6b71-c7de-499c-99a2-2053bb5e06b9 req-653bfbb0-0a37-478a-9497-b9335b479256 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:46.059696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:46.080177 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8d7d6b71-c7de-499c-99a2-2053bb5e06b9 req-653bfbb0-0a37-478a-9497-b9335b479256 service nova] Creating event network-vif-deleted:b965e48b-1ec7-4ed6-9c05-9c0ab419272f for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:46.094535 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8d7d6b71-c7de-499c-99a2-2053bb5e06b9 req-653bfbb0-0a37-478a-9497-b9335b479256 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067628 Oct 17 13:03:46.095168 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1563/3094] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:46.618708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:46.619416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:46.638119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:46.640954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:46.641416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:46.642232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:46.642648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:46.643590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:46.906521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:46.917055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:46.923497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:46.927769 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7057e62e-00da-4d65-bc36-c066a8b749fe tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2499 microversion: 2.32 time: 1.291512 Oct 17 13:03:46.931064 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1532/3095] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:45 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2499 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:46.946630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:46.947527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:46.954249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:46.958638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:46.959333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:46.960272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:46.960896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:46.961494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:47.001771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:47.011435 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2eb77cd-0e89-4847-ab2f-26fcd5905a09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 0.397804 Oct 17 13:03:47.026898 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1564/3096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:46 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:03:47.931814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:47.942674 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-441c066b-3235-4391-9c47-b46f1e9208ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1307 microversion: 2.1 time: 1.010248 Oct 17 13:03:47.945159 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1533/3097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:46 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1307 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:47.964636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:47.965361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:47.975172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:47.975977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:47.976643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:47.977585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:47.978323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:47.979212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:48.043401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:48.044323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:48.061725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:48.064234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:48.065397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:48.069078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:48.070194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:48.070864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:48.607491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:48.646092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:48.648286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:48.655224 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1f743613-49ca-449b-ae42-d06666242d66 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2339 microversion: 2.32 time: 0.694771 Oct 17 13:03:48.666787 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1565/3098] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:47 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2339 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:48.685602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4c5f3f0b-6b38-491c-9f9d-28def8a89e29 req-6af5f41f-dd75-4f09-9a4b-9ecf6b77e4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-deleted", "tag": "0e3b2a77-e188-4c79-8863-df8a35716569"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:48.714790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c5f3f0b-6b38-491c-9f9d-28def8a89e29 req-6af5f41f-dd75-4f09-9a4b-9ecf6b77e4ab service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:48.715322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c5f3f0b-6b38-491c-9f9d-28def8a89e29 req-6af5f41f-dd75-4f09-9a4b-9ecf6b77e4ab service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:48.715756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c5f3f0b-6b38-491c-9f9d-28def8a89e29 req-6af5f41f-dd75-4f09-9a4b-9ecf6b77e4ab service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:48.746560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4c5f3f0b-6b38-491c-9f9d-28def8a89e29 req-6af5f41f-dd75-4f09-9a4b-9ecf6b77e4ab service nova] Creating event network-vif-deleted:0e3b2a77-e188-4c79-8863-df8a35716569 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:48.757545 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4c5f3f0b-6b38-491c-9f9d-28def8a89e29 req-6af5f41f-dd75-4f09-9a4b-9ecf6b77e4ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073939 Oct 17 13:03:48.761415 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1566/3099] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:48.771619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c246347e-619a-419b-a40f-943f61bf2b7e req-c0cb03c6-d910-46b2-a3f8-f3139fb4bfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0f6a09-8e29-486f-a866-75047d3370ac", "tag": "7dc84daa-ad60-4da6-a960-1cfccaec2339"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:48.796525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c246347e-619a-419b-a40f-943f61bf2b7e req-c0cb03c6-d910-46b2-a3f8-f3139fb4bfcd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:48.797318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c246347e-619a-419b-a40f-943f61bf2b7e req-c0cb03c6-d910-46b2-a3f8-f3139fb4bfcd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:48.797995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c246347e-619a-419b-a40f-943f61bf2b7e req-c0cb03c6-d910-46b2-a3f8-f3139fb4bfcd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:48.811767 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c246347e-619a-419b-a40f-943f61bf2b7e req-c0cb03c6-d910-46b2-a3f8-f3139fb4bfcd service nova] Creating event network-changed:7dc84daa-ad60-4da6-a960-1cfccaec2339 for instance 5d0f6a09-8e29-486f-a866-75047d3370ac on n-h2-853316-12 Oct 17 13:03:48.818259 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c246347e-619a-419b-a40f-943f61bf2b7e req-c0cb03c6-d910-46b2-a3f8-f3139fb4bfcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054953 Oct 17 13:03:48.819594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1567/3100] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:48.970126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:48.972183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:48.987510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:48.990756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:48.991337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:48.992225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:48.993469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:48.995610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:49.103010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:49.115921 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b159dc7d-ca19-428b-af45-953cd8aef6d3 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1199 microversion: 2.1 time: 1.076658 Oct 17 13:03:49.119581 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1534/3101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:48 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1199 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:03:49.686934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:49.687552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:49.701771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:49.702388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:49.702723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:49.703442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:49.703902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:49.704337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:50.092590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:50.107840 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c0ac70ff-2671-4cf9-b45a-3d984d226081 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1487 microversion: 2.1 time: 1.142404 Oct 17 13:03:50.111836 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1568/3102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:48 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1487 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:50.139730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-897222013"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:50.155645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:50.164287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:50.165105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:50.165787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:50.166972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:50.167652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:50.168286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:50.235952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:50.258220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:50.259685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:50.260930 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-94368861-6a76-4812-84d2-192281f6075e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 2158 microversion: 2.32 time: 0.577865 Oct 17 13:03:50.269568 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1535/3103] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:49 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 2158 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:03:50.269568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:50.285482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:50.295419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:50.296274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:50.296535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:50.297260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:50.297722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:50.298152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:50.735125 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-afab4a4d-bcbf-4a8d-86e1-17b8b2a36a92 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "POST /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.601540 Oct 17 13:03:50.758859 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1569/3104] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:03:50 2022] POST /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:03:50.769514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97b5a4d4-76bf-4be3-a08f-576b9b7df73f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820a781f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:50.895445 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97b5a4d4-76bf-4be3-a08f-576b9b7df73f tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923" status: 200 len: 1413 microversion: 2.1 time: 0.130878 Oct 17 13:03:50.896132 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1570/3105] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:03:50 2022] GET /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923 => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:50.909414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c219cbb2-8646-46d3-baac-b9e0272fbe5b req-f7c46f5e-e7b8-4fcd-822d-1c8ee19af53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9f916-f19b-4143-9842-97e5325a2f77", "name": "network-vif-deleted", "tag": "3e96ea21-21b0-4e46-aee5-240154bd8bd8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:50.941169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c219cbb2-8646-46d3-baac-b9e0272fbe5b req-f7c46f5e-e7b8-4fcd-822d-1c8ee19af53d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:50.941706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c219cbb2-8646-46d3-baac-b9e0272fbe5b req-f7c46f5e-e7b8-4fcd-822d-1c8ee19af53d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:50.942191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c219cbb2-8646-46d3-baac-b9e0272fbe5b req-f7c46f5e-e7b8-4fcd-822d-1c8ee19af53d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:50.973341 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c219cbb2-8646-46d3-baac-b9e0272fbe5b req-f7c46f5e-e7b8-4fcd-822d-1c8ee19af53d service nova] Creating event network-vif-deleted:3e96ea21-21b0-4e46-aee5-240154bd8bd8 for instance 88a9f916-f19b-4143-9842-97e5325a2f77 on n-h1-853316-12 Oct 17 13:03:50.984122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c219cbb2-8646-46d3-baac-b9e0272fbe5b req-f7c46f5e-e7b8-4fcd-822d-1c8ee19af53d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079040 Oct 17 13:03:50.985096 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1571/3106] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:50.999167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-39fdc394-aa64-48eb-9750-5e15dcd4a0a4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8209d01f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:51.089727 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-39fdc394-aa64-48eb-9750-5e15dcd4a0a4 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923" status: 200 len: 1413 microversion: 2.1 time: 0.100388 Oct 17 13:03:51.097849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1572/3107] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:03:50 2022] GET /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:51.110815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c4b5108-5018-4c8f-b0ca-f1a5458a18d5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820df2430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:51.339392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:51.348061 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-774c0fce-57ec-4df5-a433-7130560987d5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1383 microversion: 2.1 time: 1.085166 Oct 17 13:03:51.356274 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1536/3108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:50 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1383 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:51.361269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:51.364957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:51.385730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:51.388159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:51.392157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:51.396240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:51.397218 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c4b5108-5018-4c8f-b0ca-f1a5458a18d5 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923" status: 204 len: 0 microversion: 2.1 time: 0.290351 Oct 17 13:03:51.398572 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1573/3109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:51 2022] DELETE /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:03:51.399818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:51.400279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:52.052611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:52.053362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:52.072786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:52.073286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:52.073721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:52.081431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:52.082113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:52.082601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:52.760498 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87914244-4b64-412e-836e-f820ff7c2720 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1536 microversion: 2.1 time: 1.360578 Oct 17 13:03:52.761270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1574/3110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:51 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1536 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:52.782150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bd7b7c4-83cf-42b0-9fd0-91fb3afc9a6e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa82146fe50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:52.801688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:52.813337 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-9bd7b7c4-83cf-42b0-9fd0-91fb3afc9a6e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Image not found. Oct 17 13:03:52.815976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bd7b7c4-83cf-42b0-9fd0-91fb3afc9a6e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923 HTTP/1.1 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '92521285-e8a4-4f77-a021-9361f61f5923'} Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 92521285-e8a4-4f77-a021-9361f61f5923 Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:03:52.817882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 92521285-e8a4-4f77-a021-9361f61f5923 could not be found. Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:03:52.824007 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:52.834513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:52.834728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bd7b7c4-83cf-42b0-9fd0-91fb3afc9a6e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:03:52.834728 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9bd7b7c4-83cf-42b0-9fd0-91fb3afc9a6e tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923" status: 404 len: 62 microversion: 2.1 time: 0.071197 Oct 17 13:03:52.834728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1575/3111] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:03:52 2022] GET /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:03:52.835385 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cde0defc-c491-4216-a92c-1df1fe8e583a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 1.477783 Oct 17 13:03:52.846648 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1537/3112] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:51 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:52.847266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:52.848124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:52.851541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:52.852161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:52.856738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:52.858604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:52.860180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:52.860878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:52.862697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:52.863408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:52.865355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:52.880037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:52.880548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:52.880999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:52.881720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:52.882204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:52.882632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:53.278629 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ec73892-19ef-41bb-9b00-117958929670 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1536 microversion: 2.1 time: 0.442135 Oct 17 13:03:53.281377 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1576/3113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:52 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1536 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:53.312501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d9a4eb4-89e7-45e6-a3ed-c87256490885 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:53.317135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d9a4eb4-89e7-45e6-a3ed-c87256490885 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:53.317402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d9a4eb4-89e7-45e6-a3ed-c87256490885 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:53.317847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d9a4eb4-89e7-45e6-a3ed-c87256490885 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:53.326594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d9a4eb4-89e7-45e6-a3ed-c87256490885 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:53.327308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d9a4eb4-89e7-45e6-a3ed-c87256490885 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:53.327916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d9a4eb4-89e7-45e6-a3ed-c87256490885 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:53.385784 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d9a4eb4-89e7-45e6-a3ed-c87256490885 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.080025 Oct 17 13:03:53.389844 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1577/3114] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 13:03:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:53.402255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853316-12", "block_migration": false, "disk_over_commit": false}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:53.411300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:53.428182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:53.429745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:53.430402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:53.434325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:53.435324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:53.435927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:53.508295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lazy-loading 'flavor' on Instance uuid 0da2b394-f53d-4cf0-a3d1-fcfb88307986 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:03:53.544059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Going to try to live migrate instance to n-h2-853316-12 {{(pid=127540) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:03:54.076078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:54.089483 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d32e0277-d52b-4a07-893b-0ad8c2790d09 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1505 microversion: 2.1 time: 1.239241 Oct 17 13:03:54.092185 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1538/3115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:52 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1505 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:54.106263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:54.111614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:54.143947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:54.144435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:54.144880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:54.145610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:54.146069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:54.153159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:54.308702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:54.329484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:54.334853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:54.343355 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-00c3b5a2-e9f1-4ca4-9f3b-7427cdec0c0c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.250047 Oct 17 13:03:54.363471 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1539/3116] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:54 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:55.116872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:55.117526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:55.124408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:55.136390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:55.137277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:55.137888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:55.138972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:55.139696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:55.140508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:55.994195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:56.039559 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f402103f-b9d4-47a4-8f59-bfc1ead80352 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1487 microversion: 2.1 time: 0.926892 Oct 17 13:03:56.044924 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1540/3117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:55 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1487 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:56.055003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:56.055528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:56.079101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.080160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.116238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:56.117751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.123001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.125093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:56.189597 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25c08c34-2498-4ad7-9774-3e4c2ce5dae9 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986/action" status: 202 len: 0 microversion: 2.1 time: 2.791351 Oct 17 13:03:56.195291 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1578/3118] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:03:53 2022] POST /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986/action => generated 0 bytes in 2798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:03:56.203278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:56.205049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:56.243562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.245888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.247080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:56.250101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.253015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.254358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:56.342455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:03:56.471965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:56.484335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:56.492467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:56.497016 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d66c6565-eb55-4ea9-b79e-6cd5e7d8b4da tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.448392 Oct 17 13:03:56.500303 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1541/3119] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:56 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:56.514195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:56.515191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:56.529829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.533024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.535493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:56.537147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.539121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.541546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:56.556083 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-23c2fe81-1a80-4ba8-bb43-1da662df49ff tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 204 len: 0 microversion: 2.1 time: 0.358622 Oct 17 13:03:56.556678 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1579/3120] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:03:56 2022] DELETE /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:03:56.568596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae6ae091-48f5-49c8-8251-4012e3527f88 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820a78b80>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:56.575224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:56.611496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ae6ae091-48f5-49c8-8251-4012e3527f88 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Image not found. Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae6ae091-48f5-49c8-8251-4012e3527f88 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923 HTTP/1.1 Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '92521285-e8a4-4f77-a021-9361f61f5923'} Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 92521285-e8a4-4f77-a021-9361f61f5923 to delete Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 92521285-e8a4-4f77-a021-9361f61f5923 could not be found. Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:56.616176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:03:56.620843 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:03:56.624826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae6ae091-48f5-49c8-8251-4012e3527f88 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:03:56.626188 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae6ae091-48f5-49c8-8251-4012e3527f88 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923" status: 404 len: 62 microversion: 2.1 time: 0.062809 Oct 17 13:03:56.627938 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1580/3121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:56 2022] DELETE /compute/v2.1/images/92521285-e8a4-4f77-a021-9361f61f5923 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:03:56.641211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:56.642089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:56.660453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.664133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.666850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:56.667870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.669853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.671022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:56.742880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:03:56.917487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:03:56.930770 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.compute.api [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Instance is already in deleting state, ignoring this request Oct 17 13:03:56.931734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31e7bb1e-dc4f-4453-831b-b199231389ce tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 204 len: 0 microversion: 2.1 time: 0.299257 Oct 17 13:03:56.932593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1581/3122] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:03:56 2022] DELETE /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:03:56.944098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-211c2a01-d847-4361-a4ac-666b6aabdfde req-7240dac0-9ec4-4a87-b5f3-97d180643efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4d1fab-16d8-4238-b1f5-4d58fa217fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c8643a34-1273-49f5-973a-36a22df2f278"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:03:56.978216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-211c2a01-d847-4361-a4ac-666b6aabdfde req-7240dac0-9ec4-4a87-b5f3-97d180643efb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:56.978947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-211c2a01-d847-4361-a4ac-666b6aabdfde req-7240dac0-9ec4-4a87-b5f3-97d180643efb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:56.979412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-211c2a01-d847-4361-a4ac-666b6aabdfde req-7240dac0-9ec4-4a87-b5f3-97d180643efb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:57.002925 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-211c2a01-d847-4361-a4ac-666b6aabdfde req-7240dac0-9ec4-4a87-b5f3-97d180643efb service nova] Creating event network-vif-plugged:c8643a34-1273-49f5-973a-36a22df2f278 for instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 on n-h2-853316-12 Oct 17 13:03:57.015247 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-211c2a01-d847-4361-a4ac-666b6aabdfde req-7240dac0-9ec4-4a87-b5f3-97d180643efb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077764 Oct 17 13:03:57.017617 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1582/3123] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:03:57.030774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:57.031493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:57.054470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:57.054967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:57.055412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:57.056128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:57.056586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:57.057025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:57.351586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:57.363265 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3ca9ac1-1138-481c-83ad-acd4637305df tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1493 microversion: 2.1 time: 0.343821 Oct 17 13:03:57.364307 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1583/3124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:57 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1493 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:57.529893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:57.530094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:57.541865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:57.542433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:57.542915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:57.543648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:57.544140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:57.544579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:57.571147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:57.581876 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4924226-e4e2-4c7c-ab95-28cedf8d4791 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.080240 Oct 17 13:03:57.585962 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1542/3125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:56 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:57.716422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:57.731364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:57.733106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:57.734418 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6911db82-6ef4-42cb-aad5-3bc67c73c423 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.209126 Oct 17 13:03:57.738709 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1584/3126] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:57 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:58.389425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:58.390390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:58.411856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:58.412291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:58.413081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:58.413964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:58.414609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:58.415193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:58.609015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:58.609631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:58.629798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:58.632649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:58.633416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:58.637899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:58.638849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:58.640667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:59.095605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:59.107552 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5516fa3f-2670-4afb-9447-057b30653639 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.502428 Oct 17 13:03:59.110934 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1585/3127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:58 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:03:59.124005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:03:59.127717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:03:59.150425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:59.150960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:59.152432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:59.153189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:03:59.153649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:03:59.154080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:03:59.359065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:59.386966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:59.390722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:59.396594 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4661acc2-7129-4fa2-99be-dc27192a82df tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.280075 Oct 17 13:03:59.397236 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1586/3128] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:03:59 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:03:59.764431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:03:59.782027 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ed4c7ea7-5f70-4802-8e37-61d0004f4934 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1493 microversion: 2.1 time: 1.395935 Oct 17 13:03:59.817405 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1543/3129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:03:58 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1493 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:00.136648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:00.137497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:00.156906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:00.159724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:00.161436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:00.163124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:00.167417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:00.169571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:00.430430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:00.431122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:00.447852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:00.457104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:00.461336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:00.463271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:00.466018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:00.466543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:00.795435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:00.805382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c5bf250-a81e-461b-b64f-255eded892b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.673266 Oct 17 13:04:00.809057 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1587/3130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:00 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:00.814873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:00.822110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:00.837138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:00.837882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:00.838600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:00.840003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:00.842849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:00.843572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:01.120312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:01.131957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:01.144177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:01.156692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be1de735-bec6-40b5-8bb7-bfc8ff5ab2c5 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.728377 Oct 17 13:04:01.161169 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1544/3131] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:00 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:04:01.836584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:01.837422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:01.848912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:01.850605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:01.852538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:01.853557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:01.854703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:01.856106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:02.661199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:02.694316 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4e0a3053-b228-4e91-a74d-17d2ee2c0cc9 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.856845 Oct 17 13:04:02.700459 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1545/3132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:01 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:02.718123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:02.738427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:02.761017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:02.766282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:02.767618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:02.771708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:02.772502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:02.775285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:02.929183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:02.965113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:02.969950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:03.011020 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-457c305f-59cd-46a2-8c03-f60376d6131f tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.297303 Oct 17 13:04:03.029884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1546/3133] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:02 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:03.079414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-1d9ca4ac-59b9-4ae9-a5ba-461b438bd95c req-a5ee5e2b-cf91-4fb3-bb2d-08592c0b4437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4d1fab-16d8-4238-b1f5-4d58fa217fa5", "name": "network-vif-deleted", "tag": "c8643a34-1273-49f5-973a-36a22df2f278"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:03.120515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1d9ca4ac-59b9-4ae9-a5ba-461b438bd95c req-a5ee5e2b-cf91-4fb3-bb2d-08592c0b4437 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:03.123251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1d9ca4ac-59b9-4ae9-a5ba-461b438bd95c req-a5ee5e2b-cf91-4fb3-bb2d-08592c0b4437 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:03.125112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1d9ca4ac-59b9-4ae9-a5ba-461b438bd95c req-a5ee5e2b-cf91-4fb3-bb2d-08592c0b4437 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:03.167339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638e5facdbe64d26bf3c4b5c12a33da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4fbca8fe5047cea1f9b2aeee10d54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:03.167906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-1d9ca4ac-59b9-4ae9-a5ba-461b438bd95c req-a5ee5e2b-cf91-4fb3-bb2d-08592c0b4437 service nova] Creating event network-vif-deleted:c8643a34-1273-49f5-973a-36a22df2f278 for instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 on n-h2-853316-12 Oct 17 13:04:03.179826 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-1d9ca4ac-59b9-4ae9-a5ba-461b438bd95c req-a5ee5e2b-cf91-4fb3-bb2d-08592c0b4437 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139170 Oct 17 13:04:03.182593 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1547/3134] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:03.195747 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58e31717-62b6-417f-9484-cf6d61d05c61 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 200 len: 1493 microversion: 2.1 time: 2.381199 Oct 17 13:04:03.198272 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1588/3135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:00 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 1493 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:03.730129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:03.731408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:03.748041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:03.756519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:03.759031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:03.760556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:03.763203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:03.777768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.059777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.060783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:04.071317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:04.079451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.081047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.082476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:04.083077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.084666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.086659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.087422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.101204 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-13220680-3cef-481c-ad9e-b54421507bee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.375312 Oct 17 13:04:04.102118 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1548/3136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:03 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:04.227332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.228269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:04.248345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.250820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.253248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.254399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.255885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.255885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.276247 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 could not be found. Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 HTTP/1.1 Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 could not be found. Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '9b4d1fab-16d8-4238-b1f5-4d58fa217fa5'} Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 could not be found. Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 could not be found. Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.284796 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.290497 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.290497 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.290497 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.290497 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.290497 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 could not be found. Oct 17 13:04:04.290497 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.294627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.296587 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7a3f8b7-8449-4cd1-8184-ba40fb681578 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5" status: 404 len: 111 microversion: 2.1 time: 0.075633 Oct 17 13:04:04.297890 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1549/3137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:04 2022] GET /compute/v2.1/servers/9b4d1fab-16d8-4238-b1f5-4d58fa217fa5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:04.306490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.307414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:04.315576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.316363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.316926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.317760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.321727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.322322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.344705 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 HTTP/1.1 Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '913a78a1-642c-4b41-935c-7f6bd67eb254'} Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:04.348941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.353931 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.358376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.359594 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4aa97876-8661-448a-934f-81fb22e7967b tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 404 len: 111 microversion: 2.1 time: 0.057216 Oct 17 13:04:04.363795 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1550/3138] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:04.385153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.386139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 913a78a1-642c-4b41-935c-7f6bd67eb254] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:04.393141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.394065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.394783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.395781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.396475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.397141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.415462 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 HTTP/1.1 Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '913a78a1-642c-4b41-935c-7f6bd67eb254'} Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.417418 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.421727 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.421727 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.421727 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.421727 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.421727 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. Oct 17 13:04:04.421727 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.426194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 913a78a1-642c-4b41-935c-7f6bd67eb254 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.427397 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-395624bd-c78b-4a5f-bdc6-d4501687b839 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254" status: 404 len: 111 microversion: 2.1 time: 0.062254 Oct 17 13:04:04.438359 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1551/3139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:04 2022] GET /compute/v2.1/servers/913a78a1-642c-4b41-935c-7f6bd67eb254 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:04.540438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:04.557447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:04.570615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:04.576993 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6fb62349-8acb-4f47-8370-3b3e01007a77 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.521220 Oct 17 13:04:04.582935 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1589/3140] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:04 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:04:04.603146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93610be4-1fbc-44c7-9191-5a4cde5e8740 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8213ce280>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.652703 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-93610be4-1fbc-44c7-9191-5a4cde5e8740 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Image not found. Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93610be4-1fbc-44c7-9191-5a4cde5e8740 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 HTTP/1.1 Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'ddc41a0b-e267-4a80-bc8e-89c53bf16209'} Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ddc41a0b-e267-4a80-bc8e-89c53bf16209 to delete Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ddc41a0b-e267-4a80-bc8e-89c53bf16209 could not be found. Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.654636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93610be4-1fbc-44c7-9191-5a4cde5e8740 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-93610be4-1fbc-44c7-9191-5a4cde5e8740 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209" status: 404 len: 62 microversion: 2.1 time: 0.071800 Oct 17 13:04:04.659814 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1590/3141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/images/ddc41a0b-e267-4a80-bc8e-89c53bf16209 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:04.667366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.667869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:04.716655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.717164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.717612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.724901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.726674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.728455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.777217 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.777770 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f9837c01-0be1-4b8d-a155-4f5bf109268b tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.336209 Oct 17 13:04:04.778837 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1552/3142] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 HTTP/1.1 Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '800f7d25-a5d5-415d-b3c3-29fd11e206d6'} Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:04.780059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a1343b87-265f-415e-82f5-508d30af3583 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 404 len: 111 microversion: 2.1 time: 0.122682 Oct 17 13:04:04.786617 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1591/3143] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:04.822652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.823470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 800f7d25-a5d5-415d-b3c3-29fd11e206d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:04.843106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6162ec34-d243-47b1-a5c6-9136ef5b1491 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Calling method '.version_select at 0x7fa8204624c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.850491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.857365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.858449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.859853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:04.860670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:04.861579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:04.893835 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6162ec34-d243-47b1-a5c6-9136ef5b1491 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] HTTP exception thrown: Image not found. Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6162ec34-d243-47b1-a5c6-9136ef5b1491 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Request method failure captured: Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLEMM_VqL3YDHYUspFsgUqF6E5-MC57qtAHDSv2XzwoqQvC6MQiJeToAKNdCffL-n3f_oZ3I6OqBS50vBM-ZO8k5R_PrODaD4VCTLS1fivTWKGwYWdmW_w5M0-Etb62izhLqjmsXq5l0cS0jjj0_pY9FpODMl4d_UeAlA5Zme7b4es Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e14b0c0c7cf47d7a6d1cd8298ce7296", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 64ad4e12898a4af2b13c87a8216ddd75 Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '-1'} Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.895840 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:04.901759 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 HTTP/1.1 Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '800f7d25-a5d5-415d-b3c3-29fd11e206d6'} Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:04.905406 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.916634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 800f7d25-a5d5-415d-b3c3-29fd11e206d6 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.918186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6162ec34-d243-47b1-a5c6-9136ef5b1491 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.918355 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c0c9688b-83d3-4d1a-b8a2-c182e7524869 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6" status: 404 len: 111 microversion: 2.1 time: 0.091852 Oct 17 13:04:04.918510 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6162ec34-d243-47b1-a5c6-9136ef5b1491 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.088283 Oct 17 13:04:04.918510 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1553/3144] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:04.918797 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1592/3145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:04 2022] GET /compute/v2.1/servers/800f7d25-a5d5-415d-b3c3-29fd11e206d6 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:04.925010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21c825f8-8372-4fc6-ab62-38497a236079 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Calling method '.version_select at 0x7fa821291940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.933036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89ea3fd4-65b0-4352-97c5-c263cc3ef318 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa820462160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.963027 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-21c825f8-8372-4fc6-ab62-38497a236079 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] HTTP exception thrown: Image not found. Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21c825f8-8372-4fc6-ab62-38497a236079 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Request method failure captured: Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/images/6470c777-0c68-4943-b167-12617da3cf4j HTTP/1.1 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLEMM_VqL3YDHYUspFsgUqF6E5-MC57qtAHDSv2XzwoqQvC6MQiJeToAKNdCffL-n3f_oZ3I6OqBS50vBM-ZO8k5R_PrODaD4VCTLS1fivTWKGwYWdmW_w5M0-Etb62izhLqjmsXq5l0cS0jjj0_pY9FpODMl4d_UeAlA5Zme7b4es Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e14b0c0c7cf47d7a6d1cd8298ce7296", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 64ad4e12898a4af2b13c87a8216ddd75 Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '6470c777-0c68-4943-b167-12617da3cf4j'} Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6470c777-0c68-4943-b167-12617da3cf4j to delete Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6470c777-0c68-4943-b167-12617da3cf4j could not be found. Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.964792 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21c825f8-8372-4fc6-ab62-38497a236079 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21c825f8-8372-4fc6-ab62-38497a236079 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] 10.222.0.27 "DELETE /compute/v2.1/images/6470c777-0c68-4943-b167-12617da3cf4j" status: 404 len: 62 microversion: 2.1 time: 0.045288 Oct 17 13:04:04.969257 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1593/3146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/images/6470c777-0c68-4943-b167-12617da3cf4j => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:04.978733 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-89ea3fd4-65b0-4352-97c5-c263cc3ef318 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Image not found. Oct 17 13:04:04.978946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a2f56a4-61e0-4565-9fab-2ab52de22e51 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Calling method '.version_select at 0x7fa8213cec10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89ea3fd4-65b0-4352-97c5-c263cc3ef318 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 HTTP/1.1 Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e989c472-14ee-45da-ab8a-3a207f95fc32'} Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e989c472-14ee-45da-ab8a-3a207f95fc32 to delete Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e989c472-14ee-45da-ab8a-3a207f95fc32 could not be found. Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.980853 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:04.986628 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:04.991187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89ea3fd4-65b0-4352-97c5-c263cc3ef318 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:04.991187 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89ea3fd4-65b0-4352-97c5-c263cc3ef318 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32" status: 404 len: 62 microversion: 2.1 time: 0.070283 Oct 17 13:04:04.994882 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1554/3147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/images/e989c472-14ee-45da-ab8a-3a207f95fc32 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:05.014556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.017104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:05.018875 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-7a2f56a4-61e0-4565-9fab-2ab52de22e51 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] HTTP exception thrown: Image not found. Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a2f56a4-61e0-4565-9fab-2ab52de22e51 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Request method failure captured: Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/images/be7858eb-fcac-4576-aa8d-a5b3e7a9248b1 HTTP/1.1 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLEMM_VqL3YDHYUspFsgUqF6E5-MC57qtAHDSv2XzwoqQvC6MQiJeToAKNdCffL-n3f_oZ3I6OqBS50vBM-ZO8k5R_PrODaD4VCTLS1fivTWKGwYWdmW_w5M0-Etb62izhLqjmsXq5l0cS0jjj0_pY9FpODMl4d_UeAlA5Zme7b4es Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e14b0c0c7cf47d7a6d1cd8298ce7296", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 64ad4e12898a4af2b13c87a8216ddd75 Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'be7858eb-fcac-4576-aa8d-a5b3e7a9248b1'} Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image be7858eb-fcac-4576-aa8d-a5b3e7a9248b1 to delete Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image be7858eb-fcac-4576-aa8d-a5b3e7a9248b1 could not be found. Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.023804 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a2f56a4-61e0-4565-9fab-2ab52de22e51 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a2f56a4-61e0-4565-9fab-2ab52de22e51 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] 10.222.0.27 "DELETE /compute/v2.1/images/be7858eb-fcac-4576-aa8d-a5b3e7a9248b1" status: 404 len: 62 microversion: 2.1 time: 0.050748 Oct 17 13:04:05.029652 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1594/3148] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/images/be7858eb-fcac-4576-aa8d-a5b3e7a9248b1 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:05.037674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.037873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eef0ff8f-c6d6-4a9c-89a9-2ba9131a2b3e tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Calling method '.version_select at 0x7fa8209d0af0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.038609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.039270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.040182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.040837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.041509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.057772 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 HTTP/1.1 Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '38fce287-b697-437a-9415-b3326aa662e4'} Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:05.059749 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.064269 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.067847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.069138 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77dcc9e1-9cbe-42e6-9fb9-60a8fa2fa64a tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 404 len: 111 microversion: 2.1 time: 0.072742 Oct 17 13:04:05.069888 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1555/3149] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:04:04 2022] DELETE /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:05.078348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.079253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 38fce287-b697-437a-9415-b3326aa662e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:05.087015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.087822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.088448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.103112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.105330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.106203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.120260 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-eef0ff8f-c6d6-4a9c-89a9-2ba9131a2b3e tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] HTTP exception thrown: Image not found. Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eef0ff8f-c6d6-4a9c-89a9-2ba9131a2b3e tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Request method failure captured: Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/images/tempest-invalid-752029211 HTTP/1.1 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLEMM_VqL3YDHYUspFsgUqF6E5-MC57qtAHDSv2XzwoqQvC6MQiJeToAKNdCffL-n3f_oZ3I6OqBS50vBM-ZO8k5R_PrODaD4VCTLS1fivTWKGwYWdmW_w5M0-Etb62izhLqjmsXq5l0cS0jjj0_pY9FpODMl4d_UeAlA5Zme7b4es Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e14b0c0c7cf47d7a6d1cd8298ce7296", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 64ad4e12898a4af2b13c87a8216ddd75 Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'tempest-invalid-752029211'} Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-752029211 to delete Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-752029211 could not be found. Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.122179 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eef0ff8f-c6d6-4a9c-89a9-2ba9131a2b3e tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eef0ff8f-c6d6-4a9c-89a9-2ba9131a2b3e tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-752029211" status: 404 len: 62 microversion: 2.1 time: 0.091330 Oct 17 13:04:05.128119 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1595/3150] 10.222.0.27 () {58 vars in 1203 bytes} [Mon Oct 17 13:04:05 2022] DELETE /compute/v2.1/images/tempest-invalid-752029211 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:05.131580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.133017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:05.137864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 HTTP/1.1 Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '38fce287-b697-437a-9415-b3326aa662e4'} Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.139667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.145338 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.145338 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.145338 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.145338 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.145338 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. Oct 17 13:04:05.145338 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.148041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 38fce287-b697-437a-9415-b3326aa662e4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.149125 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c3d08545-67b9-403a-862a-0f07b19878a7 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4" status: 404 len: 111 microversion: 2.1 time: 0.075284 Oct 17 13:04:05.150080 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1556/3151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:05 2022] GET /compute/v2.1/servers/38fce287-b697-437a-9415-b3326aa662e4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:05.155421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6772bcf3-9437-401e-96f3-361365ef2112 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Calling method '.version_select at 0x7fa8204749d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.156375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.158659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.159635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.161954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.163627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.164131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.189274 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6772bcf3-9437-401e-96f3-361365ef2112 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] HTTP exception thrown: Image not found. Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6772bcf3-9437-401e-96f3-361365ef2112 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Request method failure captured: Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/images/c49ac2e3-dbdf-4b0c-bba3-cefadc77f1aa HTTP/1.1 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLEMM_VqL3YDHYUspFsgUqF6E5-MC57qtAHDSv2XzwoqQvC6MQiJeToAKNdCffL-n3f_oZ3I6OqBS50vBM-ZO8k5R_PrODaD4VCTLS1fivTWKGwYWdmW_w5M0-Etb62izhLqjmsXq5l0cS0jjj0_pY9FpODMl4d_UeAlA5Zme7b4es Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e14b0c0c7cf47d7a6d1cd8298ce7296", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e14b0c0c7cf47d7a6d1cd8298ce7296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 7e14b0c0c7cf47d7a6d1cd8298ce7296 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 64ad4e12898a4af2b13c87a8216ddd75 Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1488161311-project Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c49ac2e3-dbdf-4b0c-bba3-cefadc77f1aa'} Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c49ac2e3-dbdf-4b0c-bba3-cefadc77f1aa to delete Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c49ac2e3-dbdf-4b0c-bba3-cefadc77f1aa could not be found. Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.192358 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:05.196976 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.200394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6772bcf3-9437-401e-96f3-361365ef2112 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.202481 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6772bcf3-9437-401e-96f3-361365ef2112 tempest-ImagesDeleteNegativeTestJSON-1488161311 tempest-ImagesDeleteNegativeTestJSON-1488161311-project] 10.222.0.27 "DELETE /compute/v2.1/images/c49ac2e3-dbdf-4b0c-bba3-cefadc77f1aa" status: 404 len: 62 microversion: 2.1 time: 0.050406 Oct 17 13:04:05.203263 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1557/3152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:05 2022] DELETE /compute/v2.1/images/c49ac2e3-dbdf-4b0c-bba3-cefadc77f1aa => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:05.208385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d6e1390a-f3f5-499b-bea8-37c4316753db tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8204ce310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.239749 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d6e1390a-f3f5-499b-bea8-37c4316753db tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Image not found. Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d6e1390a-f3f5-499b-bea8-37c4316753db tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 HTTP/1.1 Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '35c2ea41-bc96-464f-ae83-eccf326782b2'} Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 35c2ea41-bc96-464f-ae83-eccf326782b2 to delete Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35c2ea41-bc96-464f-ae83-eccf326782b2 could not be found. Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.243382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:05.249913 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.256126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d6e1390a-f3f5-499b-bea8-37c4316753db tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.257271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d6e1390a-f3f5-499b-bea8-37c4316753db tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2" status: 404 len: 62 microversion: 2.1 time: 0.052843 Oct 17 13:04:05.258529 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1558/3153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:05 2022] DELETE /compute/v2.1/images/35c2ea41-bc96-464f-ae83-eccf326782b2 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:05.267650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.269178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:05.277474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.278435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.279170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.280191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.280933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.281616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.299878 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 HTTP/1.1 Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '918c48fc-3923-40c6-a877-39fd47337f64'} Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:05.301884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.306578 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.314059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.316232 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-488ceafc-9b3f-4a6b-8467-5d6fca1c1681 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 404 len: 111 microversion: 2.1 time: 0.053759 Oct 17 13:04:05.317411 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1559/3154] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:04:05 2022] DELETE /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:05.328643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.332688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 918c48fc-3923-40c6-a877-39fd47337f64] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:05.350756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.352808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.353488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.357321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.359763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.360397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.401612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 HTTP/1.1 Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '918c48fc-3923-40c6-a877-39fd47337f64'} Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.403586 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.410509 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.410509 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.410509 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.410509 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.410509 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. Oct 17 13:04:05.410509 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.413489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 918c48fc-3923-40c6-a877-39fd47337f64 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.414714 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e792a0a-88fa-4d26-9dc3-7d4e3b6aac55 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64" status: 404 len: 111 microversion: 2.1 time: 0.093342 Oct 17 13:04:05.415545 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1560/3155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:05 2022] GET /compute/v2.1/servers/918c48fc-3923-40c6-a877-39fd47337f64 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:05.431819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6dfa874a-08ec-472e-a05c-ca2bfffc8f2d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '.version_select at 0x7fa8204ce5e0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.489767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6dfa874a-08ec-472e-a05c-ca2bfffc8f2d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Image not found. Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6dfa874a-08ec-472e-a05c-ca2bfffc8f2d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af HTTP/1.1 Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'df4d2b32-c40d-4e5d-a7ae-227c780e98af'} Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image df4d2b32-c40d-4e5d-a7ae-227c780e98af to delete Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df4d2b32-c40d-4e5d-a7ae-227c780e98af could not be found. Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.491798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:04:05.496922 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.500390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6dfa874a-08ec-472e-a05c-ca2bfffc8f2d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.501426 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6dfa874a-08ec-472e-a05c-ca2bfffc8f2d tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af" status: 404 len: 62 microversion: 2.1 time: 0.080602 Oct 17 13:04:05.503209 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1561/3156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:05 2022] DELETE /compute/v2.1/images/df4d2b32-c40d-4e5d-a7ae-227c780e98af => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:05.515034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.516678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:05.536665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.537291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.537734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.538545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.543328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.544173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.585094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 HTTP/1.1 Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '93643651-ffe6-4925-ac21-a34be3ab4749'} Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:05.590030 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.595762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.598647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.603439 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-33022e76-136c-436d-aabb-c41347a0cc85 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "DELETE /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 404 len: 111 microversion: 2.1 time: 0.096460 Oct 17 13:04:05.604579 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1562/3157] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:04:05 2022] DELETE /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:05.613218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.618283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:05.634557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.635147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.635588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.637386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.640881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.641712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.739209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:05.751503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:05.754480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:05.755868 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17d1d683-5f2d-4065-82ee-9a1487db9911 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.146699 Oct 17 13:04:05.757364 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1563/3158] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:05 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:05.762640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:05.764678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] [instance: 93643651-ffe6-4925-ac21-a34be3ab4749] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:05.772373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.773508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.774813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.775865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:05.776499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:05.777223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:05.796445 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] HTTP exception thrown: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Request method failure captured: Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 HTTP/1.1 Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFSQsX9FQ7qLxqHhJggUb_WZyBNV6_M_eoCyUH95QrZ8qOAHrluIkRJedlfS_rT0ONMlxBwl840ePAz8Flw1hoYuDxRYnvGB9sjOBIUz2M7iMZIoQLRBtvMMh9wpn2gxJczrpBptsnshnS8QLo7e_mZ5qFVVYKTvT5RM00JtG94SHg Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba4fbca8fe5047cea1f9b2aeee10d54a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba4fbca8fe5047cea1f9b2aeee10d54a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ba4fbca8fe5047cea1f9b2aeee10d54a Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesTestJSON-1675107096 Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 638e5facdbe64d26bf3c4b5c12a33da7 Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesTestJSON-1675107096-project Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '93643651-ffe6-4925-ac21-a34be3ab4749'} Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.798762 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:05.803917 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:05.803917 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:05.803917 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:05.803917 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:05.803917 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. Oct 17 13:04:05.803917 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:05.805875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] Returning 404 to user: Instance 93643651-ffe6-4925-ac21-a34be3ab4749 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:05.806986 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51fe400e-ffd0-474a-bb22-9a7c4c55d967 tempest-ImagesTestJSON-1675107096 tempest-ImagesTestJSON-1675107096-project] 10.222.0.27 "GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749" status: 404 len: 111 microversion: 2.1 time: 0.048491 Oct 17 13:04:05.819780 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1564/3159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:05 2022] GET /compute/v2.1/servers/93643651-ffe6-4925-ac21-a34be3ab4749 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:06.193446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:06.211580 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-95ab2af5-540b-4344-9cd1-0ddc777a0a40 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.085636 Oct 17 13:04:06.212181 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1596/3160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:05 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:06.792064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:06.792915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:06.808920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:06.809678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:06.810278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:06.811123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:06.812325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:06.812981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:07.069522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:07.083046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:07.091018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:07.093962 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-16b9f533-7074-4725-b0f1-3e2d76cc4390 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.307891 Oct 17 13:04:07.098315 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1565/3161] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:06 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:04:07.240250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:07.240962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:07.257084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:07.257625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:07.258083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:07.258840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:07.259464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:07.259905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:07.716454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:07.729447 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9dbcac3d-cb82-4f46-912e-948c08e7fbf2 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.493533 Oct 17 13:04:07.730232 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1597/3162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:07 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:08.133839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:08.135208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:08.148476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:08.151954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:08.154064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:08.155037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:08.158289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:08.159221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:08.331345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:08.352936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:08.355005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:08.356252 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c4d9c2c-d4a7-4e04-a094-4e8a2dcb6337 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.226434 Oct 17 13:04:08.356821 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1566/3163] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:08 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:08.759556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:08.760528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:08.767660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:08.768122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:08.768700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:08.769336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:08.770186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:08.771056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:08.825912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f338deb9-0a51-4ee8-89cb-f4b930f998a0 tempest-AbsoluteLimitsTestJSON-401688468 tempest-AbsoluteLimitsTestJSON-401688468-project] Calling method '.version_select at 0x7fa820f25d30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:08.868198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f338deb9-0a51-4ee8-89cb-f4b930f998a0 tempest-AbsoluteLimitsTestJSON-401688468 tempest-AbsoluteLimitsTestJSON-401688468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:08.869054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f338deb9-0a51-4ee8-89cb-f4b930f998a0 tempest-AbsoluteLimitsTestJSON-401688468 tempest-AbsoluteLimitsTestJSON-401688468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:08.871641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f338deb9-0a51-4ee8-89cb-f4b930f998a0 tempest-AbsoluteLimitsTestJSON-401688468 tempest-AbsoluteLimitsTestJSON-401688468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:08.873268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f338deb9-0a51-4ee8-89cb-f4b930f998a0 tempest-AbsoluteLimitsTestJSON-401688468 tempest-AbsoluteLimitsTestJSON-401688468-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:08.875114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f338deb9-0a51-4ee8-89cb-f4b930f998a0 tempest-AbsoluteLimitsTestJSON-401688468 tempest-AbsoluteLimitsTestJSON-401688468-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:08.875795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f338deb9-0a51-4ee8-89cb-f4b930f998a0 tempest-AbsoluteLimitsTestJSON-401688468 tempest-AbsoluteLimitsTestJSON-401688468-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:08.912721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f338deb9-0a51-4ee8-89cb-f4b930f998a0 tempest-AbsoluteLimitsTestJSON-401688468 tempest-AbsoluteLimitsTestJSON-401688468-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.407061 Oct 17 13:04:08.913982 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1598/3164] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 17 13:04:08 2022] GET /compute/v2.1/limits => generated 511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:09.278195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:09.287668 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35f292ed-c4c8-4956-8670-b23232789871 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.532322 Oct 17 13:04:09.312508 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1567/3165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:08 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:09.396307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:09.398011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:09.413281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:09.414626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:09.416751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:09.417913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:09.419135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:09.420732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:10.341024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:10.342952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:10.357002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:10.360926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:10.363083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:10.366462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:10.367281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:10.367955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:10.455775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:10.472589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:10.503043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:10.507264 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f656f10e-bd48-4681-8283-846e580ae339 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 1.118376 Oct 17 13:04:10.526226 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1599/3166] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:09 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:10.933913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:10.957940 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f730b7f-939b-4e63-9df4-e071592706c7 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.621277 Oct 17 13:04:10.958637 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1568/3167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:10 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:04:11.550986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:11.551794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:11.586195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:11.587905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:11.592806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:11.600231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:11.601593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:11.604673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:12.005558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:12.006442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:12.033298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:12.033819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:12.034296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:12.035034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:12.035554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:12.049548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:12.115725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:12.136106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:12.151659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:12.159838 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e1e016e-1690-4ef2-9a00-b785c9a4a834 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.614471 Oct 17 13:04:12.176326 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1600/3168] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:11 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:13.196751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:13.197414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:13.210490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:13.215130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:13.216269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:13.217284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:13.218120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:13.218748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:13.291571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:13.309682 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6cdb4001-2de4-417b-a886-057f9cb7050f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.304614 Oct 17 13:04:13.312783 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1569/3169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:11 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:13.686410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:13.703788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:13.708660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:13.712795 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e91ac31-5877-4bb5-b31a-bad24c86277c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.518448 Oct 17 13:04:13.730429 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1601/3170] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:13 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:14.346799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:14.346799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:14.370200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:14.371960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:14.372409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:14.377961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:14.378826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:14.379444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:14.743190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:14.744483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:14.757772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:14.758732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:14.761910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:14.765371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:14.765910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:14.767997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:14.947708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:14.979316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:14.985103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:14.990823 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b7ec797-71fe-45fd-a327-3e49b32ecb0a tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.251870 Oct 17 13:04:14.991837 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1602/3171] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:14 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:15.011354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:15.029503 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d782f0eb-70ab-4d65-9be9-8006637d65cb tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.689098 Oct 17 13:04:15.031983 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1570/3172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:14 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:16.021647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:16.022479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:16.034862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:16.035371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:16.035863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:16.036574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:16.037026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:16.037451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:16.061200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:16.062176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:16.083157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:16.083974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:16.090281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:16.091352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:16.092121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:16.092839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:16.136701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:16.755349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:16.769716 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6db904f-c285-4797-b23b-73cf722a7f48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.712886 Oct 17 13:04:16.770051 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1571/3173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:16 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:04:16.802890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:16.813545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:16.816561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:16.819964 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19ccb411-353e-4be4-8d54-01113657faf8 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.804992 Oct 17 13:04:16.824178 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1603/3174] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:16 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:17.798005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:17.800006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:17.821611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:17.828060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:17.828758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:17.829723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:17.830822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:17.833891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:17.873485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:17.874834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:17.899080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:17.900482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:17.902546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:17.903582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:17.906280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:17.907113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:18.210014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:18.226644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:18.230964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:18.235580 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-04347289-f6a7-415d-896a-d5f8af2ade16 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.367315 Oct 17 13:04:18.238650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1604/3175] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:17 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:04:18.485175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:18.503018 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5496fd19-63d1-4dd9-8ec3-658d24a4a20d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.707788 Oct 17 13:04:18.515797 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1572/3176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:17 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:04:18.548015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e708c59d-cdae-4704-9bbd-55afa1d12b28 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Calling method '.version_select at 0x7fa820a49af0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:18.578539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e708c59d-cdae-4704-9bbd-55afa1d12b28 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:18.578968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e708c59d-cdae-4704-9bbd-55afa1d12b28 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:18.579419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e708c59d-cdae-4704-9bbd-55afa1d12b28 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:18.582997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e708c59d-cdae-4704-9bbd-55afa1d12b28 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:18.583767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e708c59d-cdae-4704-9bbd-55afa1d12b28 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:18.584398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e708c59d-cdae-4704-9bbd-55afa1d12b28 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:18.605874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:18.642425 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e708c59d-cdae-4704-9bbd-55afa1d12b28 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.401716 Oct 17 13:04:18.643552 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1605/3177] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 17 13:04:18 2022] GET /compute/v2.1/limits => generated 511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:18.801097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-575b06b1-381d-4efa-919d-8800f1945a13 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1838039676", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:18.881234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-575b06b1-381d-4efa-919d-8800f1945a13 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:04:19.270246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:19.271870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:19.287771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:19.288801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:19.290490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:19.293337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:19.294142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:19.296258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:19.492398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:19.525924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:19.529936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:19.531452 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-854545c2-dd34-4e88-85d6-7cbbd23598cd tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.265680 Oct 17 13:04:19.532208 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1606/3178] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:19 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:04:19.537155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:19.546543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:19.561680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:19.562423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:19.563515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:19.564572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:19.565893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:19.566542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:19.664182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-575b06b1-381d-4efa-919d-8800f1945a13 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Getting quotas for project 1dec11266f074f62a3cd167625a3ad76. Resources: dict_keys(['metadata_items']) {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:04:19.674217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-575b06b1-381d-4efa-919d-8800f1945a13 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Getting quotas for user 539ac2f9ad7f4a419bb68ffa49b60161 and project 1dec11266f074f62a3cd167625a3ad76. Resources: dict_keys(['metadata_items']) {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:04:19.710621 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-575b06b1-381d-4efa-919d-8800f1945a13 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-575b06b1-381d-4efa-919d-8800f1945a13 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Request method failure captured: Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 1752 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLRYGHYykDZxOSMCUk4-4xQ6FeOe3auqz6OEtmWzJj9A0zpS6_m15od9MkU1VWAdW0vnaBsdKoKbsEWRJFT5hl6or8nR2oqb5NGr2Hnvp4J31xxWt-GshW5H55CeQHhoSjBxGjraGbfV1djgfZkdaociHnx_5wIba5wdVEbSuz_lvA Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 1dec11266f074f62a3cd167625a3ad76 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-877339385 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1dec11266f074f62a3cd167625a3ad76", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dec11266f074f62a3cd167625a3ad76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1dec11266f074f62a3cd167625a3ad76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dec11266f074f62a3cd167625a3ad76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-877339385 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 1dec11266f074f62a3cd167625a3ad76 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-877339385 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-877339385-project Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 539ac2f9ad7f4a419bb68ffa49b60161 Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-877339385-project Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1838039676", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:19.716066 n-d-853316-12 devstack@n-api.service[127539]: exception: Maximum number of metadata items exceeds 128 Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1838039676', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:04:19.719653 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 17 13:04:19.726307 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:19.729528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-575b06b1-381d-4efa-919d-8800f1945a13 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:19.732119 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-575b06b1-381d-4efa-919d-8800f1945a13 tempest-AbsoluteLimitsNegativeTestJSON-877339385 tempest-AbsoluteLimitsNegativeTestJSON-877339385-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.936367 Oct 17 13:04:19.737710 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1573/3179] 10.222.0.27 () {60 vars in 1148 bytes} [Mon Oct 17 13:04:18 2022] POST /compute/v2.1/servers => generated 87 bytes in 940 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:04:20.448739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:20.449955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:20.469640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:20.470456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:20.471640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:20.472550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:20.473185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:20.473782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:20.533890 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-255eb92d-cd8e-42bd-91f1-1671399bf3af tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/ips" status: 200 len: 146 microversion: 2.1 time: 0.088597 Oct 17 13:04:20.542708 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1574/3180] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:04:20 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/ips => generated 146 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:20.561088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:20.561717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:20.576267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:20.577031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:20.577535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:20.578313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:20.578783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:20.587861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:20.778962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:20.803265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:20.805741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:20.808143 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5ce11ed5-4dd0-460e-81a5-ff89268b4e3e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.251527 Oct 17 13:04:20.809432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1575/3181] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:20 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:20.880321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:20.889336 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58c4d005-29c8-43e6-951a-b113ac958294 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.355749 Oct 17 13:04:20.890211 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1607/3182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:19 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:21.840770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:21.841734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:21.848959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:21.849451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:21.849885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:21.850733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:21.851184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:21.851611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:21.917795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:21.919208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:21.931940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:21.934022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:21.942619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:21.946423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:21.947358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:21.947991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:22.004913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:22.019916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:22.021389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:22.022676 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-33335f84-a3d3-4493-8880-f22f80c5a738 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.188848 Oct 17 13:04:22.034698 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1576/3183] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:21 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:23.052008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:23.052824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:23.065981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:23.072794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:23.073320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:23.074180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:23.092275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:23.097496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:23.107324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:23.125613 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-80af4fa8-8924-4e03-92e3-68fc21e19316 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.213593 Oct 17 13:04:23.131873 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1608/3184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:21 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:23.300863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:23.317908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:23.326950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:23.330767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cab19a14-9a1a-4085-ac6c-09e693d1599c tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1603 microversion: 2.32 time: 0.282740 Oct 17 13:04:23.331857 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1577/3185] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:23 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1603 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:24.159883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:24.161033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:24.181270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:24.187365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:24.187714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:24.194474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:24.195701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:24.198322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:24.200456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:24.365563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:24.367728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:24.387195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:24.402234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:24.402234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:24.402234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:24.402234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:24.402234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:24.582903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:24.584572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:24.585693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:24.587814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lazy-loading 'fault' on Instance uuid 88a9f916-f19b-4143-9842-97e5325a2f77 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:04:24.749564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:24.761213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:24.769546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca1b49177f8441328c36765b43a918fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed76e939ebc4a828650e77d8695c708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:24.772173 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6db2c5f7-c80f-4f40-86fa-4cbf4b3c22aa tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 200 len: 1370 microversion: 2.32 time: 0.410953 Oct 17 13:04:24.802992 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1578/3186] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:24 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 1370 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:04:25.141586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2930ecca-2d93-4408-a46d-6650de91ef74 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Action: 'create', calling method: .version_select at 0x7fa8204160d0>, body: {"keypair": {"name": "tempest-keypair-2003235581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Kv6GkILDSKS2X696v+W/7HYejzrnjvcEjwH89QP/ZQ51OqG2eUYLJ56nR83EKS4onxFyyA6JzEZd2O1lvk3H9EMPoCYFgGHOtKzbq8yp5E7REf7qD5dsqszcg3olI1Q=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:25.159793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=76 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:25.178047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2930ecca-2d93-4408-a46d-6650de91ef74 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Getting quotas for project b300aade5ad44d6da07d3e59fa90f00c. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:04:25.186741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2930ecca-2d93-4408-a46d-6650de91ef74 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Getting quotas for user e7ca637f607a4d94bb2a079c269b60fc and project b300aade5ad44d6da07d3e59fa90f00c. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:04:25.218372 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2930ecca-2d93-4408-a46d-6650de91ef74 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.406527 Oct 17 13:04:25.226535 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1579/3187] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:04:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:25.499508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:25.520486 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f4567f5-2d44-46c2-9bb7-a4a530507cf4 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.367130 Oct 17 13:04:25.534007 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1609/3188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:24 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:25.809897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:25.811136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:25.828742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:25.829242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:25.830918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:25.833337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:25.834779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:25.835418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:25.895558 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] HTTP exception thrown: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Request method failure captured: Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 HTTP/1.1 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVEG1IzkN5Ud6P5vabcEJiKtjrzOSM6N_CIHHd4MiFQE4l_99LpzSEQNTon2ZItn3tUCXWfXGNZp10ac0O854FJpFvVEHH2GrKGBS2PSYq6sNLzVNebYujJkYa5menxjjlK97JsGIINjmrUlhmo9byVn7pECQt9zIYNcVLffjlbFxSo Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8ed76e939ebc4a828650e77d8695c708 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ed76e939ebc4a828650e77d8695c708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8ed76e939ebc4a828650e77d8695c708 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TaggedBootDevicesTest-2917872-project Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ca1b49177f8441328c36765b43a918fc Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TaggedBootDevicesTest-2917872-project Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '88a9f916-f19b-4143-9842-97e5325a2f77'} Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:25.898557 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Returning 404 to user: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d9310820-db37-45e3-bd7a-7882aa9da435 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 404 len: 111 microversion: 2.32 time: 0.095888 Oct 17 13:04:25.907650 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1580/3189] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:25 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:04:25.910404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-266dfb4c-ddcd-4685-b756-cb3e9c00ea4e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '.version_select at 0x7fa8209b44c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:25.949056 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-266dfb4c-ddcd-4685-b756-cb3e9c00ea4e tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-544563165" status: 204 len: 0 microversion: 2.32 time: 0.042970 Oct 17 13:04:25.951777 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1610/3190] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 17 13:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-544563165 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:04:26.551137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:26.551889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:26.570875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:26.571386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:26.571872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:26.572540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:26.572996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:26.573427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:27.162005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:27.172551 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2cb81fc7-5462-4abb-9fb3-9adf17970cae tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.628235 Oct 17 13:04:27.182452 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1581/3191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:26 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:27.315779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "551aaf93-2452-4220-a831-a9662d7ecc15"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:27.318212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:27.335453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:27.336265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:27.336910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:27.337807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:27.338476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:27.339076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:27.810515 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b30f70a-da04-4636-a96e-6be78d5fc24c tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499062 Oct 17 13:04:27.811427 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1611/3192] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:04:27 2022] POST /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:28.210140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:28.210939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:28.228069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:28.228807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:28.231319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:28.232135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:28.234015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:28.234559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:29.703699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:29.719701 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-08b3d51f-251d-4a6b-85f0-cfa41c60a22f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.514592 Oct 17 13:04:29.725542 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1582/3193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:28 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:30.749745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:30.752030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:30.757499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:30.761573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:30.793307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:30.795700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:30.799662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:30.800441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:30.802832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:30.804803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:32.566982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:32.591499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6061cad2-a2f6-48a1-9588-f159a2462153 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.841724 Oct 17 13:04:32.592493 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1612/3194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:30 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:33.618407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:33.619959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:33.650782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:33.654225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:33.656931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:33.658932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:33.661555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:33.662788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:34.759793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-903076573", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "95d06a80-71d8-4ee9-a81a-cb78e82f117e"}], "security_groups": [{"name": "tempest-securitygroup--1982528629"}], "key_name": "tempest-keypair-2003235581", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:35.091036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:35.102895 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19b153a6-572b-43ad-b6ff-615b07df5700 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.490229 Oct 17 13:04:35.114184 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1583/3195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:33 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:35.629459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] validate_networks() for [('95d06a80-71d8-4ee9-a81a-cb78e82f117e', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:04:36.130778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:36.132034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:36.159509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:36.162861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:36.163352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:36.163793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:36.164508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:36.164963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:36.165390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:36.720462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:36.746407 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f754a378-4e26-4a12-bdae-d866e2fa335a tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.617018 Oct 17 13:04:36.747068 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1584/3196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:36 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:37.681594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2c5e1cce-7dd6-4569-9245-2e9b312ef9d0 req-aeb2eaf9-8281-4df0-bc69-538a03b4c18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da2b394-f53d-4cf0-a3d1-fcfb88307986", "name": "network-vif-unplugged", "status": "completed", "tag": "bd12cbd3-a84c-4da7-8c9d-71f5c4054fff"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:37.708394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2c5e1cce-7dd6-4569-9245-2e9b312ef9d0 req-aeb2eaf9-8281-4df0-bc69-538a03b4c18e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:37.708888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2c5e1cce-7dd6-4569-9245-2e9b312ef9d0 req-aeb2eaf9-8281-4df0-bc69-538a03b4c18e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:37.715694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2c5e1cce-7dd6-4569-9245-2e9b312ef9d0 req-aeb2eaf9-8281-4df0-bc69-538a03b4c18e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:37.756047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2c5e1cce-7dd6-4569-9245-2e9b312ef9d0 req-aeb2eaf9-8281-4df0-bc69-538a03b4c18e service nova] Creating event network-vif-unplugged:bd12cbd3-a84c-4da7-8c9d-71f5c4054fff for instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 on n-h1-853316-12 Oct 17 13:04:37.769017 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2c5e1cce-7dd6-4569-9245-2e9b312ef9d0 req-aeb2eaf9-8281-4df0-bc69-538a03b4c18e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086802 Oct 17 13:04:37.769017 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1585/3197] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:04:37.778724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:37.779615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:37.790804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:37.791659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:37.792445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:37.794279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:37.794916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:37.795632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:38.561863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:38.579095 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-756eb206-476c-4294-a6ce-6e15810a80fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.808307 Oct 17 13:04:38.580816 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1586/3198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:37 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:38.896896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Getting quotas for project b300aade5ad44d6da07d3e59fa90f00c. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:04:38.911203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Getting quotas for user e7ca637f607a4d94bb2a079c269b60fc and project b300aade5ad44d6da07d3e59fa90f00c. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:04:38.952538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:04:38.959243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:04:38.960185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:04:38.962452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:04:38.963138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:04:38.990945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:38.992069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:38.992746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:38.993807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:38.994532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:38.995265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:39.047522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Getting quotas for project b300aade5ad44d6da07d3e59fa90f00c. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:04:39.058365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Getting quotas for user e7ca637f607a4d94bb2a079c269b60fc and project b300aade5ad44d6da07d3e59fa90f00c. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:04:39.073690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:04:39.076845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:04:39.151629 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bb39327f-e2b9-4e20-850b-c823f63b71ba tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.396356 Oct 17 13:04:39.152993 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1613/3199] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:04:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 4399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:04:39.164835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0cab19a-0405-4ad9-b0b5-3727b4937f09 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:39.165457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f0cab19a-0405-4ad9-b0b5-3727b4937f09 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:39.515394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f0cab19a-0405-4ad9-b0b5-3727b4937f09 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:39.540460 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f0cab19a-0405-4ad9-b0b5-3727b4937f09 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1277 microversion: 2.1 time: 0.379271 Oct 17 13:04:39.544439 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1587/3200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:39 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1277 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:04:39.628412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:39.630208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:39.652595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:39.653315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:39.654369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:39.655621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:39.656408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:39.657355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:39.869140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-114d37cb-962d-4f8e-a91f-10f8cd2f75a3 req-e371accc-557c-486a-b1aa-243dd67c7068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da2b394-f53d-4cf0-a3d1-fcfb88307986", "tag": "bd12cbd3-a84c-4da7-8c9d-71f5c4054fff"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:39.886052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-114d37cb-962d-4f8e-a91f-10f8cd2f75a3 req-e371accc-557c-486a-b1aa-243dd67c7068 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:39.886749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-114d37cb-962d-4f8e-a91f-10f8cd2f75a3 req-e371accc-557c-486a-b1aa-243dd67c7068 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:39.887396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-114d37cb-962d-4f8e-a91f-10f8cd2f75a3 req-e371accc-557c-486a-b1aa-243dd67c7068 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:39.900818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-114d37cb-962d-4f8e-a91f-10f8cd2f75a3 req-e371accc-557c-486a-b1aa-243dd67c7068 service nova] Creating event network-changed:bd12cbd3-a84c-4da7-8c9d-71f5c4054fff for instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 on n-h1-853316-12 Oct 17 13:04:39.908676 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-114d37cb-962d-4f8e-a91f-10f8cd2f75a3 req-e371accc-557c-486a-b1aa-243dd67c7068 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044340 Oct 17 13:04:39.909305 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1588/3201] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:04:40.072280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:40.098066 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-836a95b8-034d-4033-8bd8-d7f73d48309e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.475871 Oct 17 13:04:40.116400 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1614/3202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:39 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:40.570498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:40.573300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:40.604808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:40.605318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:40.605769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:40.608941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:40.609420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:40.613902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:40.854658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:40.869442 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1c7beec-d479-4a15-9990-12053c1fd671 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1329 microversion: 2.1 time: 0.303798 Oct 17 13:04:40.884624 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1589/3203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:40 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1329 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:41.124817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:41.127449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:41.146781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:41.147477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:41.148083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:41.149341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:41.158733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:41.161190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:41.899661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:41.900287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:41.928845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:41.928845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:41.928845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:41.928845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:41.928845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:41.928845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:42.410743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:42.446582 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0d3b00d-273b-4095-9659-b3c842886976 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1335 microversion: 2.1 time: 0.551950 Oct 17 13:04:42.459432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1590/3204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:41 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1335 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:04:42.833990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:42.851617 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f850573d-54e5-4e64-9c8f-a2527d99ad48 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.732193 Oct 17 13:04:42.856406 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1615/3205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:41 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:43.478993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:43.479809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:43.496163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:43.500917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:43.503687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:43.505504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:43.513686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:43.514203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:43.880753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:43.881497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:43.897754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:43.903527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:43.905412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:43.909266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:43.913461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:43.914192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:44.463011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:44.473236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d8bdf4f-c430-4cfe-b3b9-32eb858f966b tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.597475 Oct 17 13:04:44.473842 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1616/3206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:43 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:04:44.495967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:44.508618 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b9d1d564-ff2a-40c1-802f-c76b5594c496 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1335 microversion: 2.1 time: 1.035305 Oct 17 13:04:44.513985 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1591/3207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:43 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1335 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:45.298356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:45.302655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:45.323281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:45.327659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:45.328237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:45.330928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:45.331424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:45.331869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:45.422777 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-242fee35-9945-4828-bb77-a5bf2592c0e4 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128675 Oct 17 13:04:45.426771 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1617/3208] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:04:45 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:45.443783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:45.444317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:45.462101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:45.467177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:45.469481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:45.470370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:45.470858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:45.471305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:45.500709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:45.507756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:45.551625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:45.554766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:45.557640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:45.564964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:45.569035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:45.572650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:45.665948 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3f3430f6-ae7f-4a04-a74f-a6bd8da4d798 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/551aaf93-2452-4220-a831-a9662d7ecc15" status: 200 len: 194 microversion: 2.1 time: 0.229460 Oct 17 13:04:45.668797 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1592/3209] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 17 13:04:45 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/551aaf93-2452-4220-a831-a9662d7ecc15 => generated 194 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:45.678832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:45.691241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:45.711588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:45.713554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:45.715602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:45.718331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:45.722814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:45.724877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:45.736523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:46.394248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:46.408242 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c0adf3f7-6fb8-4ae7-b3af-57a3766a59b1 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1335 microversion: 2.1 time: 0.737579 Oct 17 13:04:46.408853 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1593/3210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:45 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1335 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:46.714184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-468f2d4d-b6d7-4941-bc03-0b52b4576bdb tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa820418c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2081055059", "description": "tempest-description-1741948591"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:46.836619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:46.854680 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-77006556-cfa2-4e27-9dd0-25bb800026b5 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 1.358037 Oct 17 13:04:46.855351 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1618/3211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:45 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:46.865923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:46.866455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:46.898317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:46.900577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:46.908345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:46.909297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:46.914053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:46.914575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:46.998505 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] HTTP exception thrown: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Request method failure captured: Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 HTTP/1.1 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVEG1IzkN5Ud6P5vabcEJiKtjrzOSM6N_CIHHd4MiFQE4l_99LpzSEQNTon2ZItn3tUCXWfXGNZp10ac0O854FJpFvVEHH2GrKGBS2PSYq6sNLzVNebYujJkYa5menxjjlK97JsGIINjmrUlhmo9byVn7pECQt9zIYNcVLffjlbFxSo Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 8ed76e939ebc4a828650e77d8695c708 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ed76e939ebc4a828650e77d8695c708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 8ed76e939ebc4a828650e77d8695c708 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TaggedBootDevicesTest-2917872-project Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ca1b49177f8441328c36765b43a918fc Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TaggedBootDevicesTest-2917872-project Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '88a9f916-f19b-4143-9842-97e5325a2f77'} Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:47.003833 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.009397 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.013483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Returning 404 to user: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:47.020513 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25b91452-6e8c-42b8-982f-39396b93e213 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 404 len: 111 microversion: 2.32 time: 0.159866 Oct 17 13:04:47.023587 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1619/3212] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:04:46 2022] DELETE /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:04:47.035768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:47.038185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] [instance: 88a9f916-f19b-4143-9842-97e5325a2f77] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:47.059519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:47.060388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:47.061120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:47.067461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:47.069161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:47.072554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:47.113924 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] HTTP exception thrown: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Request method failure captured: Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 HTTP/1.1 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVEG1IzkN5Ud6P5vabcEJiKtjrzOSM6N_CIHHd4MiFQE4l_99LpzSEQNTon2ZItn3tUCXWfXGNZp10ac0O854FJpFvVEHH2GrKGBS2PSYq6sNLzVNebYujJkYa5menxjjlK97JsGIINjmrUlhmo9byVn7pECQt9zIYNcVLffjlbFxSo Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 8ed76e939ebc4a828650e77d8695c708 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ed76e939ebc4a828650e77d8695c708", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ed76e939ebc4a828650e77d8695c708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 8ed76e939ebc4a828650e77d8695c708 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2917872 Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TaggedBootDevicesTest-2917872-project Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ca1b49177f8441328c36765b43a918fc Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TaggedBootDevicesTest-2917872-project Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '88a9f916-f19b-4143-9842-97e5325a2f77'} Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:47.120306 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.126649 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:47.126649 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:47.126649 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:47.126649 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:47.126649 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:47.126649 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. Oct 17 13:04:47.126649 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:47.130951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] Returning 404 to user: Instance 88a9f916-f19b-4143-9842-97e5325a2f77 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:47.132054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d39a181f-e40a-4086-a841-d34e34fde718 tempest-TaggedBootDevicesTest-2917872 tempest-TaggedBootDevicesTest-2917872-project] 10.222.0.27 "GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77" status: 404 len: 111 microversion: 2.32 time: 0.104147 Oct 17 13:04:47.132904 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1620/3213] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:04:47 2022] GET /compute/v2.1/servers/88a9f916-f19b-4143-9842-97e5325a2f77 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:04:47.443200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:47.443200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:47.472539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:47.473455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:47.473584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:47.478363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:47.481208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:47.484315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:48.133828 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-468f2d4d-b6d7-4941-bc03-0b52b4576bdb tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.723277 Oct 17 13:04:48.144556 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1594/3214] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:04:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:48.150693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:48.151822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:48.168939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:48.169831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:48.170608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:48.171667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:48.172373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:48.173759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:48.277846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:48.292300 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9e25bb1c-82ea-42c9-9b06-b22f1f85b215 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.856225 Oct 17 13:04:48.300124 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1621/3215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:47 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:04:48.305574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46960788-e8be-4c0a-88f1-268078dfcf4a tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa8212910d0>, body: {"security_group_rule": {"parent_group_id": "69d239a3-2762-41ab-90fc-b9af3d94c0fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:49.026614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:49.067873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:49.522801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:50.015130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46960788-e8be-4c0a-88f1-268078dfcf4a tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.713414 Oct 17 13:04:50.016474 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1622/3216] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:04:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:50.021874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad1bbc1b-ba59-42c2-9c42-7cdd88a14cfb"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:50.029137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:50.050588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:50.051357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:50.052056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:50.053038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:50.053733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:50.055094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:50.058243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:50.661587 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8943dd0c-5764-4e0b-9fa8-f02e83ac1153 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "POST /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643329 Oct 17 13:04:50.670354 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1623/3217] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:04:50 2022] POST /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:50.685918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:50.687719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:50.701779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:50.710343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:50.711186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:50.712051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:50.713140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:50.718950 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb355b09-5b35-4aa7-a02f-23c6593c0720 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 2.566237 Oct 17 13:04:50.721021 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1595/3218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:48 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:50.723051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:50.723905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:50.726382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b28c016-a900-490b-b9af-c40b7855839d tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa8204181f0>, body: {"security_group_rule": {"parent_group_id": "69d239a3-2762-41ab-90fc-b9af3d94c0fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:51.495917 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1b28c016-a900-490b-b9af-c40b7855839d tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] HTTP exception thrown: This rule already exists in group 69d239a3-2762-41ab-90fc-b9af3d94c0fd Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b28c016-a900-490b-b9af-c40b7855839d tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Request method failure captured: Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 138 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLtPlwxweUCNJ91_ja8ocZdkSNPexomSgNjgLdDOBdOREPEz4wRhsIadWL7QSUF1OHDQ6mkkmDpO5mhs0pZ50z4uvH58sFGLLS8R4YEWyYYXj1uEXpA8c60KTiOgiYQJWXvbWn81TXtyn9QpZ6NQgPLDqTNJhhUgf0pYQTxC5W7PLg Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb2da0831d2f4d22a516515ee3142ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a2eb0abaf0e94ce2827d10b7bfbead4e Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: {"security_group_rule": {"parent_group_id": "69d239a3-2762-41ab-90fc-b9af3d94c0fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: exception: This rule already exists in group 69d239a3-2762-41ab-90fc-b9af3d94c0fd Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'security_group_rule': {'parent_group_id': '69d239a3-2762-41ab-90fc-b9af3d94c0fd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 69d239a3-2762-41ab-90fc-b9af3d94c0fd Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 69d239a3-2762-41ab-90fc-b9af3d94c0fd Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:51.497694 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:51.503441 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:51.503441 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:51.503441 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 69d239a3-2762-41ab-90fc-b9af3d94c0fd Oct 17 13:04:51.503441 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:51.510574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b28c016-a900-490b-b9af-c40b7855839d tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Returning 400 to user: This rule already exists in group 69d239a3-2762-41ab-90fc-b9af3d94c0fd {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:51.512254 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b28c016-a900-490b-b9af-c40b7855839d tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.789512 Oct 17 13:04:51.513010 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1596/3219] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:04:50 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 791 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:04:51.522788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-12cd506a-068a-4ae3-9377-33b669344604 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Calling method '.version_select at 0x7fa8213af550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:51.719573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:51.743030 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff1fbf31-8c9f-4543-8f89-4519fe0818cf tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 1.069517 Oct 17 13:04:51.747320 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1624/3220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:50 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:51.765183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:51.766447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:51.792164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:51.794694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:51.795350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:51.797670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:51.800063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:51.801054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:52.725316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:52.740064 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7fc4703f-a95e-45ec-b18a-ed45a2259171 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.987179 Oct 17 13:04:52.740827 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1625/3221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:51 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:52.772719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:52.773561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:52.800785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:52.801339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:52.802189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:52.804681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:52.805162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:52.805598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:53.365337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:53.389714 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19eacee3-2174-4d93-9e54-3ba8e2ddef13 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.612669 Oct 17 13:04:53.405102 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1626/3222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:52 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:04:53.504118 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-12cd506a-068a-4ae3-9377-33b669344604 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/16462053-a9a0-4da4-92e3-309fa9895970" status: 202 len: 0 microversion: 2.1 time: 1.986445 Oct 17 13:04:53.505296 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1597/3223] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 17 13:04:51 2022] DELETE /compute/v2.1/os-security-group-rules/16462053-a9a0-4da4-92e3-309fa9895970 => generated 0 bytes in 1988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:04:53.515231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be1eb217-8761-4f2c-a4a0-391f02cfc13b tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa820a493a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1123929655", "description": "tempest-description-118160519"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:53.764992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:53.765618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:53.780625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:53.781127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:53.781570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:53.782849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:53.783315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:53.783750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:54.353034 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be1eb217-8761-4f2c-a4a0-391f02cfc13b tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.842361 Oct 17 13:04:54.354683 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1627/3224] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:04:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:54.371035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3ff5f347-b0c6-42f6-9d01-01ea5d003533 req-c603cf9e-4c31-4881-a7d3-ca164492bae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578ed1c6-a638-4a11-844a-0071032b1738", "tag": "edb67ed6-6fda-41be-bdaf-79a6e08a7bfa"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:54.384569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:54.406200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:54.414706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3ff5f347-b0c6-42f6-9d01-01ea5d003533 req-c603cf9e-4c31-4881-a7d3-ca164492bae3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:54.415234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3ff5f347-b0c6-42f6-9d01-01ea5d003533 req-c603cf9e-4c31-4881-a7d3-ca164492bae3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:54.415688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3ff5f347-b0c6-42f6-9d01-01ea5d003533 req-c603cf9e-4c31-4881-a7d3-ca164492bae3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:54.418918 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-517b6e74-9dc4-4d7f-b964-e0664133f9a6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 0.657801 Oct 17 13:04:54.419747 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1598/3225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:53 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:54.425631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bffa0bb-1c23-4113-aa97-f976cbb76f88 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa82041fe50>, body: {"security_group_rule": {"parent_group_id": "208ce1ec-dc6b-41f0-bad6-830d40f240f9", "ip_protocol": "tcp", "from_port": 1531241697, "to_port": 22}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:54.458901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3ff5f347-b0c6-42f6-9d01-01ea5d003533 req-c603cf9e-4c31-4881-a7d3-ca164492bae3 service nova] Creating event network-changed:edb67ed6-6fda-41be-bdaf-79a6e08a7bfa for instance 578ed1c6-a638-4a11-844a-0071032b1738 on n-h2-853316-12 Oct 17 13:04:54.467979 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3ff5f347-b0c6-42f6-9d01-01ea5d003533 req-c603cf9e-4c31-4881-a7d3-ca164492bae3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111366 Oct 17 13:04:54.468951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1628/3226] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:54.475957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:54.491637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:54.514992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:54.515985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:54.516559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:54.520429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:54.521221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:54.529959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:54.593286 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-9bffa0bb-1c23-4113-aa97-f976cbb76f88 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] HTTP exception thrown: Invalid port range 1531241697:22. Former value cannot be greater than the later Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bffa0bb-1c23-4113-aa97-f976cbb76f88 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Request method failure captured: Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 146 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLtPlwxweUCNJ91_ja8ocZdkSNPexomSgNjgLdDOBdOREPEz4wRhsIadWL7QSUF1OHDQ6mkkmDpO5mhs0pZ50z4uvH58sFGLLS8R4YEWyYYXj1uEXpA8c60KTiOgiYQJWXvbWn81TXtyn9QpZ6NQgPLDqTNJhhUgf0pYQTxC5W7PLg Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb2da0831d2f4d22a516515ee3142ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a2eb0abaf0e94ce2827d10b7bfbead4e Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: {"security_group_rule": {"parent_group_id": "208ce1ec-dc6b-41f0-bad6-830d40f240f9", "ip_protocol": "tcp", "from_port": 1531241697, "to_port": 22}} Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid port range 1531241697:22. Former value cannot be greater than the later Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'security_group_rule': {'parent_group_id': '208ce1ec-dc6b-41f0-bad6-830d40f240f9', 'ip_protocol': 'tcp', 'from_port': 1531241697, 'to_port': 22}}} Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1531241697:22. Former value cannot be greater than the later Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1531241697:22. Former value cannot be greater than the later Oct 17 13:04:54.595308 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1531241697:22. Former value cannot be greater than the later Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bffa0bb-1c23-4113-aa97-f976cbb76f88 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Returning 400 to user: Invalid port range 1531241697:22. Former value cannot be greater than the later {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9bffa0bb-1c23-4113-aa97-f976cbb76f88 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.175578 Oct 17 13:04:54.600371 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1599/3227] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:04:54 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:04:54.606949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b0a3c4d-fc05-4911-a137-bcf8a14353dc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa820412a60>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-112566364", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:54.608990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-5b0a3c4d-fc05-4911-a137-bcf8a14353dc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] HTTP exception thrown: Security group id should be uuid Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b0a3c4d-fc05-4911-a137-bcf8a14353dc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Request method failure captured: Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 130 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLtPlwxweUCNJ91_ja8ocZdkSNPexomSgNjgLdDOBdOREPEz4wRhsIadWL7QSUF1OHDQ6mkkmDpO5mhs0pZ50z4uvH58sFGLLS8R4YEWyYYXj1uEXpA8c60KTiOgiYQJWXvbWn81TXtyn9QpZ6NQgPLDqTNJhhUgf0pYQTxC5W7PLg Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb2da0831d2f4d22a516515ee3142ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a2eb0abaf0e94ce2827d10b7bfbead4e Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-112566364", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group id should be uuid Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-112566364', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:54.610582 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:54.615158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 17 13:04:54.615158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:54.615158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b0a3c4d-fc05-4911-a137-bcf8a14353dc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Returning 400 to user: Security group id should be uuid {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:54.615158 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b0a3c4d-fc05-4911-a137-bcf8a14353dc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009587 Oct 17 13:04:54.618498 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1600/3228] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:04:54 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:04:54.630239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f89fb325-6f0a-43e0-be68-da1ecdd12f98 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa820412430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-957788233", "description": "tempest-description-670751861"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:54.956888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:54.970386 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c1d4606e-c603-4420-9d4c-051c6477b716 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.499102 Oct 17 13:04:54.975181 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1629/3229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:54 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:55.354209 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f89fb325-6f0a-43e0-be68-da1ecdd12f98 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.734511 Oct 17 13:04:55.354808 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1601/3230] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:04:54 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:55.370402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-360f6d59-f490-4b9e-a7cc-f56febb0f822 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa820950f70>, body: {"security_group_rule": {"parent_group_id": "9a7eb088-dd7b-4724-804f-c68f42a1d34d", "ip_protocol": "tempest-999-81088874", "from_port": 22, "to_port": 22}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:55.447532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:55.448540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:55.450938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:04:55.468670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:55.469304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:55.470087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:55.472806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:55.476885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:55.479632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:55.666671 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-360f6d59-f490-4b9e-a7cc-f56febb0f822 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] HTTP exception thrown: Invalid IP protocol tempest-999-81088874. Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-360f6d59-f490-4b9e-a7cc-f56febb0f822 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Request method failure captured: Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 155 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLtPlwxweUCNJ91_ja8ocZdkSNPexomSgNjgLdDOBdOREPEz4wRhsIadWL7QSUF1OHDQ6mkkmDpO5mhs0pZ50z4uvH58sFGLLS8R4YEWyYYXj1uEXpA8c60KTiOgiYQJWXvbWn81TXtyn9QpZ6NQgPLDqTNJhhUgf0pYQTxC5W7PLg Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb2da0831d2f4d22a516515ee3142ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: a2eb0abaf0e94ce2827d10b7bfbead4e Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: {"security_group_rule": {"parent_group_id": "9a7eb088-dd7b-4724-804f-c68f42a1d34d", "ip_protocol": "tempest-999-81088874", "from_port": 22, "to_port": 22}} Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid IP protocol tempest-999-81088874. Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9a7eb088-dd7b-4724-804f-c68f42a1d34d', 'ip_protocol': 'tempest-999-81088874', 'from_port': 22, 'to_port': 22}}} Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-81088874. Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-81088874. Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:55.668815 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:55.673894 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:55.673894 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:55.673894 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:55.673894 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:55.673894 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:55.673894 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:55.673894 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-81088874. Oct 17 13:04:55.673894 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:55.676565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-360f6d59-f490-4b9e-a7cc-f56febb0f822 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Returning 400 to user: Invalid IP protocol tempest-999-81088874. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:55.679282 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-360f6d59-f490-4b9e-a7cc-f56febb0f822 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.313240 Oct 17 13:04:55.680507 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1630/3231] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:04:55 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:04:55.694994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91af5ffa-84f7-448b-b368-b031c2460b25 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa820df2670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1672275624", "description": "tempest-description-1920278616"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:56.578070 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91af5ffa-84f7-448b-b368-b031c2460b25 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.891919 Oct 17 13:04:56.579368 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1631/3232] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:04:55 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:56.584514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:56.585816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:56.614454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:56.615349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:56.617435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:56.618721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:56.619873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:56.620386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:57.056939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:57.065178 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-36710d01-91ea-479a-899d-3186cab70ed5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.484587 Oct 17 13:04:57.065951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1632/3233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:56 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:57.082875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6f31a22-de6e-469d-bbb3-772e2fc6ef16 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa82514cd30>, body: {"security_group_rule": {"parent_group_id": "ac5106a0-e559-4ba8-aec5-5adf937c777e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:57.228301 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a6f31a22-de6e-469d-bbb3-772e2fc6ef16 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6f31a22-de6e-469d-bbb3-772e2fc6ef16 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Request method failure captured: Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 138 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLtPlwxweUCNJ91_ja8ocZdkSNPexomSgNjgLdDOBdOREPEz4wRhsIadWL7QSUF1OHDQ6mkkmDpO5mhs0pZ50z4uvH58sFGLLS8R4YEWyYYXj1uEXpA8c60KTiOgiYQJWXvbWn81TXtyn9QpZ6NQgPLDqTNJhhUgf0pYQTxC5W7PLg Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb2da0831d2f4d22a516515ee3142ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: a2eb0abaf0e94ce2827d10b7bfbead4e Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: {"security_group_rule": {"parent_group_id": "ac5106a0-e559-4ba8-aec5-5adf937c777e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ac5106a0-e559-4ba8-aec5-5adf937c777e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:04:57.229849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6f31a22-de6e-469d-bbb3-772e2fc6ef16 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:57.234287 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6f31a22-de6e-469d-bbb3-772e2fc6ef16 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.164538 Oct 17 13:04:57.238503 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1633/3234] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:04:57 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:04:57.251216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c49ad21-0491-4498-a759-c50d33e40f8f tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa8212311f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-838085555", "description": "tempest-description-1508678802"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:57.569460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:57.581930 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e78519fe-a11c-427e-87d8-e28526ad7e2f tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1393 microversion: 2.1 time: 2.137972 Oct 17 13:04:57.592084 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1602/3235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:55 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1393 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:57.699573 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c49ad21-0491-4498-a759-c50d33e40f8f tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.459474 Oct 17 13:04:57.700713 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1634/3236] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:04:57 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:57.719738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ff7d641-2666-4739-9c15-407c470ad2cc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa82041f9d0>, body: {"security_group_rule": {"parent_group_id": "d1635bcb-d2f7-4409-a239-eb611a1f4629", "ip_protocol": "tcp", "from_port": 22, "to_port": 1794494856}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:58.092362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:58.098196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:58.116369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:58.117164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:58.118206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:58.119385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:58.120039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:58.120632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:58.331969 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-2ff7d641-2666-4739-9c15-407c470ad2cc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] HTTP exception thrown: Invalid port range 22:1794494856. Valid TCP ports should be between 1-65535 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ff7d641-2666-4739-9c15-407c470ad2cc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Request method failure captured: Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 146 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLtPlwxweUCNJ91_ja8ocZdkSNPexomSgNjgLdDOBdOREPEz4wRhsIadWL7QSUF1OHDQ6mkkmDpO5mhs0pZ50z4uvH58sFGLLS8R4YEWyYYXj1uEXpA8c60KTiOgiYQJWXvbWn81TXtyn9QpZ6NQgPLDqTNJhhUgf0pYQTxC5W7PLg Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb2da0831d2f4d22a516515ee3142ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a2eb0abaf0e94ce2827d10b7bfbead4e Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: {"security_group_rule": {"parent_group_id": "d1635bcb-d2f7-4409-a239-eb611a1f4629", "ip_protocol": "tcp", "from_port": 22, "to_port": 1794494856}} Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid port range 22:1794494856. Valid TCP ports should be between 1-65535 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd1635bcb-d2f7-4409-a239-eb611a1f4629', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1794494856}}} Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1794494856. Valid TCP ports should be between 1-65535 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1794494856. Valid TCP ports should be between 1-65535 Oct 17 13:04:58.333801 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1794494856. Valid TCP ports should be between 1-65535 Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.339036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ff7d641-2666-4739-9c15-407c470ad2cc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Returning 400 to user: Invalid port range 22:1794494856. Valid TCP ports should be between 1-65535 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:58.340006 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ff7d641-2666-4739-9c15-407c470ad2cc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.622708 Oct 17 13:04:58.346124 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1603/3237] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:04:57 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 630 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:04:58.356778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99793fb0-6234-476c-83a3-3b2462cbadcc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Action: 'create', calling method: .version_select at 0x7fa8204303a0>, body: {"security_group_rule": {"parent_group_id": "5daed3c7-8090-46b5-95f1-25c0c982b731", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:04:58.433819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-99793fb0-6234-476c-83a3-3b2462cbadcc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5daed3c7-8090-46b5-95f1-25c0c982b731 does not exist", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:04:58.435187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.security_group_api [None req-99793fb0-6234-476c-83a3-3b2462cbadcc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Neutron security group 5daed3c7-8090-46b5-95f1-25c0c982b731 not found {{(pid=127539) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:04:58.435982 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-99793fb0-6234-476c-83a3-3b2462cbadcc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] HTTP exception thrown: Security group 5daed3c7-8090-46b5-95f1-25c0c982b731 does not exist Oct 17 13:04:58.435982 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-19c2a910-6ccf-4c75-b09e-5cbf84c21932'] Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99793fb0-6234-476c-83a3-3b2462cbadcc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Request method failure captured: Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 138 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLtPlwxweUCNJ91_ja8ocZdkSNPexomSgNjgLdDOBdOREPEz4wRhsIadWL7QSUF1OHDQ6mkkmDpO5mhs0pZ50z4uvH58sFGLLS8R4YEWyYYXj1uEXpA8c60KTiOgiYQJWXvbWn81TXtyn9QpZ6NQgPLDqTNJhhUgf0pYQTxC5W7PLg Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb2da0831d2f4d22a516515ee3142ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a2eb0abaf0e94ce2827d10b7bfbead4e Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: {"security_group_rule": {"parent_group_id": "5daed3c7-8090-46b5-95f1-25c0c982b731", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group 5daed3c7-8090-46b5-95f1-25c0c982b731 does not exist Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-19c2a910-6ccf-4c75-b09e-5cbf84c21932'] Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5daed3c7-8090-46b5-95f1-25c0c982b731', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:04:58.441800 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5daed3c7-8090-46b5-95f1-25c0c982b731 does not exist Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19c2a910-6ccf-4c75-b09e-5cbf84c21932'] Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5daed3c7-8090-46b5-95f1-25c0c982b731 does not exist Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19c2a910-6ccf-4c75-b09e-5cbf84c21932'] Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5daed3c7-8090-46b5-95f1-25c0c982b731 does not exist Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19c2a910-6ccf-4c75-b09e-5cbf84c21932'] Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5daed3c7-8090-46b5-95f1-25c0c982b731 does not exist Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19c2a910-6ccf-4c75-b09e-5cbf84c21932'] Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99793fb0-6234-476c-83a3-3b2462cbadcc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Returning 404 to user: Security group 5daed3c7-8090-46b5-95f1-25c0c982b731 does not exist Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-19c2a910-6ccf-4c75-b09e-5cbf84c21932'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:58.448170 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-99793fb0-6234-476c-83a3-3b2462cbadcc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.099726 Oct 17 13:04:58.457292 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1604/3238] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:04:58 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:58.472268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b209dbe0-1a98-44b8-83e2-180602c30aad tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Calling method '.version_select at 0x7fa8213af550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:58.555998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:04:58.564492 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7ab45a5-1f2d-4672-bd63-ae649a6194d7 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.475996 Oct 17 13:04:58.570125 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1635/3239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:58 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:04:58.618993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:58.619625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:58.640734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:58.642143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:58.643238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:58.644364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:58.645057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:58.645768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:58.744571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG neutronclient.v2_0.client [None req-b209dbe0-1a98-44b8-83e2-180602c30aad tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d does not exist", "detail": ""}} {{(pid=127539) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:04:58.745695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.security_group_api [None req-b209dbe0-1a98-44b8-83e2-180602c30aad tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Neutron security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d not found {{(pid=127539) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 17 13:04:58.745695 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b209dbe0-1a98-44b8-83e2-180602c30aad tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] HTTP exception thrown: Security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d does not exist Oct 17 13:04:58.745695 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-3a318ffb-aa06-49ff-8983-e5b30a434896'] Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b209dbe0-1a98-44b8-83e2-180602c30aad tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Request method failure captured: Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-security-group-rules/d857a0c1-985b-4ae1-9c62-7812ecb10b2d HTTP/1.1 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVLtPlwxweUCNJ91_ja8ocZdkSNPexomSgNjgLdDOBdOREPEz4wRhsIadWL7QSUF1OHDQ6mkkmDpO5mhs0pZ50z4uvH58sFGLLS8R4YEWyYYXj1uEXpA8c60KTiOgiYQJWXvbWn81TXtyn9QpZ6NQgPLDqTNJhhUgf0pYQTxC5W7PLg Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb2da0831d2f4d22a516515ee3142ff4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb2da0831d2f4d22a516515ee3142ff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: bb2da0831d2f4d22a516515ee3142ff4 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a2eb0abaf0e94ce2827d10b7bfbead4e Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-376127807-project Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: exception: Security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d does not exist Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-3a318ffb-aa06-49ff-8983-e5b30a434896'] Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'd857a0c1-985b-4ae1-9c62-7812ecb10b2d'} Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:04:58.748194 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d does not exist Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a318ffb-aa06-49ff-8983-e5b30a434896'] Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d does not exist Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a318ffb-aa06-49ff-8983-e5b30a434896'] Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d does not exist Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a318ffb-aa06-49ff-8983-e5b30a434896'] Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d does not exist Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a318ffb-aa06-49ff-8983-e5b30a434896'] Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b209dbe0-1a98-44b8-83e2-180602c30aad tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Returning 404 to user: Security group rule d857a0c1-985b-4ae1-9c62-7812ecb10b2d does not exist Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: Neutron server returns request_ids: ['req-3a318ffb-aa06-49ff-8983-e5b30a434896'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b209dbe0-1a98-44b8-83e2-180602c30aad tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/d857a0c1-985b-4ae1-9c62-7812ecb10b2d" status: 404 len: 199 microversion: 2.1 time: 0.291614 Oct 17 13:04:58.757135 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1605/3240] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 17 13:04:58 2022] DELETE /compute/v2.1/os-security-group-rules/d857a0c1-985b-4ae1-9c62-7812ecb10b2d => generated 199 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:04:58.768796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0bb34d3a-8692-4995-a5a9-dbe4f518cf40 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Calling method '.version_select at 0x7fa82041fca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:59.684065 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0bb34d3a-8692-4995-a5a9-dbe4f518cf40 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d1635bcb-d2f7-4409-a239-eb611a1f4629" status: 202 len: 0 microversion: 2.1 time: 0.928205 Oct 17 13:04:59.684942 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1606/3241] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:04:58 2022] DELETE /compute/v2.1/os-security-groups/d1635bcb-d2f7-4409-a239-eb611a1f4629 => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:04:59.691357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:59.693609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:04:59.722298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:59.722809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:59.723265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:59.723978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:59.724440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:59.724879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:00.383900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:00.398203 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-abc8e1c3-582c-4055-a146-8d81c109fa77 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1383 microversion: 2.1 time: 1.781997 Oct 17 13:05:00.405121 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1636/3242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:58 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1383 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:00.413076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f9c0889-d279-49c8-8159-afc4b44219dc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Calling method '.version_select at 0x7fa820ab6ee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:00.605555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:00.617649 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d719901-ee00-43e4-a2a9-34b47104aa02 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.931456 Oct 17 13:05:00.629394 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1607/3243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:04:59 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:00.644454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bd4fd35-4f79-4ae2-96b2-b93e33dca61c tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '.version_select at 0x7fa820425550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:00.648562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bd4fd35-4f79-4ae2-96b2-b93e33dca61c tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:00.649183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bd4fd35-4f79-4ae2-96b2-b93e33dca61c tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:00.649895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bd4fd35-4f79-4ae2-96b2-b93e33dca61c tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:00.675318 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9bd4fd35-4f79-4ae2-96b2-b93e33dca61c tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.043784 Oct 17 13:05:00.679768 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1608/3244] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 13:05:00 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:00.695796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:00.696792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:00.708573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:00.710451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:00.711011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:00.713158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:00.715434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:00.717123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:01.154998 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f4eff275-b74a-4948-ad05-c529cc5e1815 tempest-LiveMigrationTest-2012601177 tempest-LiveMigrationTest-2012601177-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1536 microversion: 2.1 time: 0.463231 Oct 17 13:05:01.159898 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1609/3245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:00 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1536 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:01.226301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:01.227494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:01.237831 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f9c0889-d279-49c8-8159-afc4b44219dc tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ac5106a0-e559-4ba8-aec5-5adf937c777e" status: 202 len: 0 microversion: 2.1 time: 0.830940 Oct 17 13:05:01.238905 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1637/3246] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:05:00 2022] DELETE /compute/v2.1/os-security-groups/ac5106a0-e559-4ba8-aec5-5adf937c777e => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:01.239525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:01.240809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:01.241522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:01.243732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:01.244430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:01.245085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:01.247315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1a601d3-8794-47e0-9bd0-b239dbecb708 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Calling method '.version_select at 0x7fa820a0fe50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:01.315162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:05:01.547340 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-76a6ca93-d239-4ee7-8a30-dbe5a03e4a61 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 204 len: 0 microversion: 2.1 time: 0.341024 Oct 17 13:05:01.549325 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1610/3247] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:05:01 2022] DELETE /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:05:01.574954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:01.578557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:01.589424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:01.590089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:01.590715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:01.591563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:01.592124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:01.592703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:01.942931 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1a601d3-8794-47e0-9bd0-b239dbecb708 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9a7eb088-dd7b-4724-804f-c68f42a1d34d" status: 202 len: 0 microversion: 2.1 time: 0.700025 Oct 17 13:05:01.947315 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1638/3248] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:05:01 2022] DELETE /compute/v2.1/os-security-groups/9a7eb088-dd7b-4724-804f-c68f42a1d34d => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:01.952654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:01.953607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:01.971099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:01.972039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:01.972732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:01.973707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:01.974713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:01.976005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:02.016160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:02.037911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-010fa485-a593-4bee-9bc1-98514c3a5106 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1389 microversion: 2.1 time: 0.481943 Oct 17 13:05:02.038868 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1611/3249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:01 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1389 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:02.064082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7e59b6d-36c4-4b8c-80b5-63e82afa57f3 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Calling method '.version_select at 0x7fa820476a60>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:02.659184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:02.675563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a0a4d37-b677-4dc7-92b1-01ae6d93bda5 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.726643 Oct 17 13:05:02.696253 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1639/3250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:01 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:02.804627 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7e59b6d-36c4-4b8c-80b5-63e82afa57f3 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/208ce1ec-dc6b-41f0-bad6-830d40f240f9" status: 202 len: 0 microversion: 2.1 time: 0.749251 Oct 17 13:05:02.808556 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1612/3251] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:05:02 2022] DELETE /compute/v2.1/os-security-groups/208ce1ec-dc6b-41f0-bad6-830d40f240f9 => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:02.814520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a018912b-5d85-4b22-9baf-fdd17e30a316 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] Calling method '.version_select at 0x7fa820a0f8b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:03.120675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-bfabece5-faec-48cb-81e2-14d78e9ca968 req-76f45c2d-84bb-4b03-8a07-569082ad9bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578ed1c6-a638-4a11-844a-0071032b1738", "name": "network-vif-plugged", "status": "completed", "tag": "edb67ed6-6fda-41be-bdaf-79a6e08a7bfa"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:03.153716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bfabece5-faec-48cb-81e2-14d78e9ca968 req-76f45c2d-84bb-4b03-8a07-569082ad9bfb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:03.154836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bfabece5-faec-48cb-81e2-14d78e9ca968 req-76f45c2d-84bb-4b03-8a07-569082ad9bfb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:03.156520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bfabece5-faec-48cb-81e2-14d78e9ca968 req-76f45c2d-84bb-4b03-8a07-569082ad9bfb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:03.192387 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-bfabece5-faec-48cb-81e2-14d78e9ca968 req-76f45c2d-84bb-4b03-8a07-569082ad9bfb service nova] Creating event network-vif-plugged:edb67ed6-6fda-41be-bdaf-79a6e08a7bfa for instance 578ed1c6-a638-4a11-844a-0071032b1738 on n-h2-853316-12 Oct 17 13:05:03.210818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-bfabece5-faec-48cb-81e2-14d78e9ca968 req-76f45c2d-84bb-4b03-8a07-569082ad9bfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247208 Oct 17 13:05:03.213418 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1613/3252] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:03.231072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:03.232249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:03.250714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:03.251522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:03.252195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:03.253202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:03.253979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:03.254498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:03.436301 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a018912b-5d85-4b22-9baf-fdd17e30a316 tempest-SecurityGroupRulesNegativeTestJSON-376127807 tempest-SecurityGroupRulesNegativeTestJSON-376127807-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/69d239a3-2762-41ab-90fc-b9af3d94c0fd" status: 202 len: 0 microversion: 2.1 time: 0.626235 Oct 17 13:05:03.437152 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1640/3253] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:05:02 2022] DELETE /compute/v2.1/os-security-groups/69d239a3-2762-41ab-90fc-b9af3d94c0fd => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:03.703701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:03.704995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:03.716010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:03.716714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:03.717414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:03.721863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:03.722654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:03.723327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:03.924185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:03.936489 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43681133-c5af-4503-a8b8-b86bd1582eab tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1347 microversion: 2.1 time: 0.720557 Oct 17 13:05:03.937098 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1614/3254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:03 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1347 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:04.015464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:04.030491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e5152f70-0d60-4507-a49d-4f0a1892b999 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.330396 Oct 17 13:05:04.047159 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1641/3255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:03 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:04.275618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-362f4621-baf9-4feb-bbeb-821b1f5af9e5 req-e471edd5-2e5d-4f99-bafe-df0e0b0f7c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da2b394-f53d-4cf0-a3d1-fcfb88307986", "name": "network-vif-deleted", "tag": "bd12cbd3-a84c-4da7-8c9d-71f5c4054fff"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:04.291633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-362f4621-baf9-4feb-bbeb-821b1f5af9e5 req-e471edd5-2e5d-4f99-bafe-df0e0b0f7c48 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:04.292126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-362f4621-baf9-4feb-bbeb-821b1f5af9e5 req-e471edd5-2e5d-4f99-bafe-df0e0b0f7c48 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:04.292568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-362f4621-baf9-4feb-bbeb-821b1f5af9e5 req-e471edd5-2e5d-4f99-bafe-df0e0b0f7c48 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:04.319974 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-362f4621-baf9-4feb-bbeb-821b1f5af9e5 req-e471edd5-2e5d-4f99-bafe-df0e0b0f7c48 service nova] Creating event network-vif-deleted:bd12cbd3-a84c-4da7-8c9d-71f5c4054fff for instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 on n-h2-853316-12 Oct 17 13:05:04.329259 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-362f4621-baf9-4feb-bbeb-821b1f5af9e5 req-e471edd5-2e5d-4f99-bafe-df0e0b0f7c48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258725 Oct 17 13:05:04.334089 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1615/3256] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:04.967701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:04.969106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:04.984497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:04.986884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:04.989262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:04.990410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:04.994506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:04.995311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:05.055807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:05.059074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:05.076838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:05.079803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:05.082755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:05.087028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:05.087799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:05.089730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:05.306303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:05.325059 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a90e4bca-bd39-4111-8c5e-8082ca377822 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1184 microversion: 2.1 time: 0.363191 Oct 17 13:05:05.339123 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1642/3257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:04 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1184 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:05.655176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:05.679464 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4938b78-35fa-42c8-9dba-16d56ca69f97 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1403 microversion: 2.1 time: 0.629743 Oct 17 13:05:05.683042 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1616/3258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:05 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1403 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:06.353912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:06.354587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:06.366042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:06.367575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:06.368758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:06.371012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:06.371674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:06.373389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:06.652777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:06.668287 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c76ca473-37fa-493f-8f2c-3b95415278f8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1184 microversion: 2.1 time: 0.314297 Oct 17 13:05:06.669074 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1643/3259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:06 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1184 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:06.714004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:06.716080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:06.736820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:06.746498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:06.748315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:06.752122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:06.753006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:06.755049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:07.717699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:07.728938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:07.781127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:07.790385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:07.791185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:07.792172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:07.802997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:07.812312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:07.825891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:07.836818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-570c89cd-b770-4a95-98b2-9f015f655308 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1588 microversion: 2.1 time: 1.132838 Oct 17 13:05:07.877911 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1617/3260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:06 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1588 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:07.894458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:07.894975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:07.913565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:07.915599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:07.916466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:07.925124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:07.929869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:07.931074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:08.472656 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-902a6199-9751-44c1-9111-e0541ffeb156 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.593495 Oct 17 13:05:08.473266 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1618/3261] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:05:07 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738/os-interface => generated 284 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:09.384023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:09.423276 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3fab842-700e-4b27-a686-2df54f689322 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1184 microversion: 2.1 time: 1.720948 Oct 17 13:05:09.434189 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1644/3262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:07 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1184 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:10.456420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:10.457037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:10.474467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:10.474953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:10.475400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:10.476134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:10.476598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:10.477030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:10.826362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:10.834791 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-85359641-d048-4a4e-a6b5-43a2f800afe6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1184 microversion: 2.1 time: 0.384030 Oct 17 13:05:10.835390 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1619/3263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:10 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1184 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:11.865123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:11.865573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:11.879976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:11.880653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:11.882352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:11.883001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:11.883386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:11.884358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:11.885018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:11.885630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:11.916471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:11.916987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:11.917439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:11.918178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:11.930029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:11.930524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:12.043022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c987b8b5-0f4b-489e-afad-c983ef99ab8f tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.159788 Oct 17 13:05:12.043733 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1620/3264] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:05:11 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments => generated 371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:05:12.186691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:12.187521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:12.206400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:12.207734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:12.209705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:12.210493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:12.212842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:12.213309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:12.225113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:12.248625 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc2f4aff-1f41-46de-9e0d-63f8bbb4e39e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1184 microversion: 2.1 time: 0.380628 Oct 17 13:05:12.254448 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1645/3265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:11 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1184 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:12.295872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:12.343888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5712d841-108d-46cd-8a45-46d9e2b9bd46 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/551aaf93-2452-4220-a831-a9662d7ecc15" status: 200 len: 194 microversion: 2.1 time: 0.161882 Oct 17 13:05:12.350017 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1621/3266] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 17 13:05:12 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/551aaf93-2452-4220-a831-a9662d7ecc15 => generated 194 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:12.359073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:12.360623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:12.376484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:12.380858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:12.381697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:12.383321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:12.385614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:12.386620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:12.625264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lazy-loading 'services' on Instance uuid 5d0f6a09-8e29-486f-a866-75047d3370ac {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:05:12.656991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:12.792548 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9796a10-8310-4893-a1d7-96b8bb287c63 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/551aaf93-2452-4220-a831-a9662d7ecc15" status: 202 len: 0 microversion: 2.1 time: 0.438294 Oct 17 13:05:12.798154 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1646/3267] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:05:12 2022] DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/551aaf93-2452-4220-a831-a9662d7ecc15 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:12.820650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:12.825887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:12.840227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:12.841734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-845c6035-8f04-407a-aea6-723e2ed4297b req-5ef67ca3-fec4-4492-8dff-63b697dd1fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578ed1c6-a638-4a11-844a-0071032b1738", "tag": "edb67ed6-6fda-41be-bdaf-79a6e08a7bfa"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:12.844971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:12.845480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:12.846255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:12.858754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:12.859240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:12.899169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-845c6035-8f04-407a-aea6-723e2ed4297b req-5ef67ca3-fec4-4492-8dff-63b697dd1fa9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:12.905301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-845c6035-8f04-407a-aea6-723e2ed4297b req-5ef67ca3-fec4-4492-8dff-63b697dd1fa9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:12.909592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-845c6035-8f04-407a-aea6-723e2ed4297b req-5ef67ca3-fec4-4492-8dff-63b697dd1fa9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:12.957645 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-845c6035-8f04-407a-aea6-723e2ed4297b req-5ef67ca3-fec4-4492-8dff-63b697dd1fa9 service nova] Creating event network-changed:edb67ed6-6fda-41be-bdaf-79a6e08a7bfa for instance 578ed1c6-a638-4a11-844a-0071032b1738 on n-h2-853316-12 Oct 17 13:05:12.981425 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-845c6035-8f04-407a-aea6-723e2ed4297b req-5ef67ca3-fec4-4492-8dff-63b697dd1fa9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150754 Oct 17 13:05:12.990976 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1647/3268] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:13.279516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:13.280577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:13.300272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:13.300981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:13.301515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:13.305151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:13.305782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:13.306372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:13.449537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:13.459972 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc1faf27-76fb-4359-b85a-892652a781e6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1184 microversion: 2.1 time: 0.185495 Oct 17 13:05:13.471245 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1648/3269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:13 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1184 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:14.137621 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:05:14.138111 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 13:05:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 (ip 10.222.0.27) !!! Oct 17 13:05:14.502327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:14.503062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:14.520400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:14.523184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:14.524367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:14.525134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:14.527396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:14.529149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:14.603773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:14.632397 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-47ac3cd6-ffca-4a58-8aaf-df789392a08f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1588 microversion: 2.1 time: 1.817610 Oct 17 13:05:14.634687 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1622/3270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:12 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1588 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:14.749346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:14.764981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ffb9cb8-0745-484b-8934-1a8f471dcf09 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1184 microversion: 2.1 time: 0.267540 Oct 17 13:05:14.765543 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1649/3271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:14 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1184 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:15.789524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:15.790898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:15.814813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:15.815333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:15.816239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:15.817958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:15.832569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:15.833057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:16.103410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:16.121590 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0b12929c-7171-4be8-a703-54e6bdc66b73 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1184 microversion: 2.1 time: 0.336678 Oct 17 13:05:16.124650 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1623/3272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:15 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1184 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:17.175476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:17.176400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:17.217478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:17.230883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:17.234432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:17.236396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:17.238733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:17.239623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:17.367544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:17.375661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:17.376494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:17.377177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lazy-loading 'fault' on Instance uuid 0da2b394-f53d-4cf0-a3d1-fcfb88307986 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:05:17.496865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:17.504971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d6f5f00f-6920-4637-8e35-3b63047c979e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 200 len: 1143 microversion: 2.1 time: 0.359729 Oct 17 13:05:17.505755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1650/3273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:17 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 1143 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:18.532114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:18.537312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 0da2b394-f53d-4cf0-a3d1-fcfb88307986] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:18.553312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:18.557593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:18.562828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:18.564683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:18.565352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:18.566280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:18.607082 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] HTTP exception thrown: Instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 could not be found. Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Request method failure captured: Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 HTTP/1.1 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFDJZV14HL6iAKPWiJSxKaHLb1T32aK88jquDu3e6ZoR-51Bd7E6dy2N3JY-lNOjYxGeVb3KAF6FxHrWi1Xo7feuVMSMEAltlc-EtHl2QEH3qnGgBIo8Q9QUEJE2KojTSbvTSJGM4k1FtmLYN2XAHIe1tRJ598gtll-pduoF-96qJQ Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 6c6509294f164045968c57ff20d25d18 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-LiveMigrationTest-543201802 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c6509294f164045968c57ff20d25d18", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c6509294f164045968c57ff20d25d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c6509294f164045968c57ff20d25d18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c6509294f164045968c57ff20d25d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-LiveMigrationTest-543201802 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 6c6509294f164045968c57ff20d25d18 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-LiveMigrationTest-543201802 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-LiveMigrationTest-543201802-project Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: bd6001af2bfe4fe881afcaaf6cca9962 Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-LiveMigrationTest-543201802-project Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 could not be found. Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '0da2b394-f53d-4cf0-a3d1-fcfb88307986'} Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 could not be found. Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 could not be found. Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:18.614099 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:18.620806 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:18.620806 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:18.620806 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:18.620806 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:05:18.620806 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:05:18.620806 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 could not be found. Oct 17 13:05:18.620806 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:18.622429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Returning 404 to user: Instance 0da2b394-f53d-4cf0-a3d1-fcfb88307986 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:05:18.626618 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-85e2b3b8-3bab-490d-a042-362b89f5eaca tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986" status: 404 len: 111 microversion: 2.1 time: 0.098927 Oct 17 13:05:18.628087 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1624/3274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:18 2022] GET /compute/v2.1/servers/0da2b394-f53d-4cf0-a3d1-fcfb88307986 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:05:18.910064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a29874e6-8dd7-4f9f-87af-9deeacf524f1 tempest-AZV2TestJSON-257167741 tempest-AZV2TestJSON-257167741-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:18.911722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29874e6-8dd7-4f9f-87af-9deeacf524f1 tempest-AZV2TestJSON-257167741 tempest-AZV2TestJSON-257167741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:18.912218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29874e6-8dd7-4f9f-87af-9deeacf524f1 tempest-AZV2TestJSON-257167741 tempest-AZV2TestJSON-257167741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:18.912779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29874e6-8dd7-4f9f-87af-9deeacf524f1 tempest-AZV2TestJSON-257167741 tempest-AZV2TestJSON-257167741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:18.913528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29874e6-8dd7-4f9f-87af-9deeacf524f1 tempest-AZV2TestJSON-257167741 tempest-AZV2TestJSON-257167741-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:18.915264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29874e6-8dd7-4f9f-87af-9deeacf524f1 tempest-AZV2TestJSON-257167741 tempest-AZV2TestJSON-257167741-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:18.915690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29874e6-8dd7-4f9f-87af-9deeacf524f1 tempest-AZV2TestJSON-257167741 tempest-AZV2TestJSON-257167741-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:18.992404 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a29874e6-8dd7-4f9f-87af-9deeacf524f1 tempest-AZV2TestJSON-257167741 tempest-AZV2TestJSON-257167741-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.361838 Oct 17 13:05:18.993016 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1651/3275] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 17 13:05:18 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:05:22.494670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-856d0792-24fe-43f5-816a-6315249b2411 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Action: 'create', calling method: .version_select at 0x7fa8204a3670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1277831846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcLEDd4aDJwtZXdDA9RtiS+b367MWcxX8ji+2v7o9tZKi8fj1JiQGwCgJf20wagI53/bL3VIZHBF0QbUlZHZYcHGhSY1h/wR6tF4ydpBy7B8DsSktzCEqspCmJ4lPGe0g=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:22.531880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-856d0792-24fe-43f5-816a-6315249b2411 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Getting quotas for project 4af0dc362a9d46799be2735e547afd26. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:05:22.557110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-856d0792-24fe-43f5-816a-6315249b2411 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Getting quotas for user cb3d95ff203842ec9ccc96251e9d91f4 and project 4af0dc362a9d46799be2735e547afd26. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:05:22.638244 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-856d0792-24fe-43f5-816a-6315249b2411 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.437653 Oct 17 13:05:22.639121 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1625/3276] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:05:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:25.775415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1054995620", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1277831846", "security_groups": [{"name": "tempest-secgroup-smoke-1837922348"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "9d0a477a-7696-410b-a99a-25eba5337bec"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:25.795381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=37 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:26.068098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:26.068651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:26.087060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:26.090136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:26.090697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:26.091140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:26.095677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:26.098429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:26.102948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:26.168082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] validate_networks() for [('9d0a477a-7696-410b-a99a-25eba5337bec', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:05:26.189897 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2844ff93-84e3-468e-b6fe-54931b28c9a7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/ad1bbc1b-ba59-42c2-9c42-7cdd88a14cfb" status: 200 len: 194 microversion: 2.1 time: 0.130957 Oct 17 13:05:26.193186 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1626/3277] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 17 13:05:26 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/ad1bbc1b-ba59-42c2-9c42-7cdd88a14cfb => generated 194 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:26.210971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:26.212944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:26.229490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:26.232206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:26.232857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:26.237414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:26.238077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:26.238733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:26.461523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lazy-loading 'services' on Instance uuid 5d0f6a09-8e29-486f-a866-75047d3370ac {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:05:26.701038 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1fb15f9e-dbba-4cf2-9bd7-7bca936b8326 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/ad1bbc1b-ba59-42c2-9c42-7cdd88a14cfb" status: 202 len: 0 microversion: 2.1 time: 0.501927 Oct 17 13:05:26.702029 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1627/3278] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:05:26 2022] DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments/ad1bbc1b-ba59-42c2-9c42-7cdd88a14cfb => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:27.828221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Getting quotas for project 4af0dc362a9d46799be2735e547afd26. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:05:27.852249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Getting quotas for user cb3d95ff203842ec9ccc96251e9d91f4 and project 4af0dc362a9d46799be2735e547afd26. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:05:27.909081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:05:27.909709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:05:27.911124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:05:27.911795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:05:27.912931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:05:27.941324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:27.943827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:27.944494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:27.953910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:27.954849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:27.955679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:27.989714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Getting quotas for project 4af0dc362a9d46799be2735e547afd26. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:05:27.996899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Getting quotas for user cb3d95ff203842ec9ccc96251e9d91f4 and project 4af0dc362a9d46799be2735e547afd26. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:05:28.027109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:05:28.029797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:05:28.222135 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-15c98cb5-c98b-441d-add5-fc084da3adca tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.440341 Oct 17 13:05:28.223328 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1652/3279] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:05:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:05:28.238611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-21e42d26-5fc5-496f-a3f9-48a9180d9bd1 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:28.239591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-21e42d26-5fc5-496f-a3f9-48a9180d9bd1 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:28.523620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-21e42d26-5fc5-496f-a3f9-48a9180d9bd1 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:28.542192 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-21e42d26-5fc5-496f-a3f9-48a9180d9bd1 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1303 microversion: 2.1 time: 0.311012 Oct 17 13:05:28.551731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1628/3280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:28 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:29.573581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:29.574300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:29.606056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:29.606690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:29.607151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:29.607973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:29.608438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:29.608874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:29.870069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:29.884799 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9a63d937-da71-4286-ac03-cbb8f2c12591 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1307 microversion: 2.1 time: 0.316454 Oct 17 13:05:29.885392 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1653/3281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:29 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1307 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:30.915233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:30.916508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:30.945444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:30.946392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:30.948777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:30.950226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:30.955060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:30.956309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:31.999190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:32.012741 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9af985da-7c39-49f9-8efd-468ed8545d43 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1363 microversion: 2.1 time: 1.103464 Oct 17 13:05:32.033547 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1629/3282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:30 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1363 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:33.038625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:33.040377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:33.054232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:33.054744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:33.063139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:33.067017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:33.067745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:33.068750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:33.498346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:33.508507 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8661f02-4634-4208-8088-ecb32ef03b20 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1361 microversion: 2.1 time: 0.474759 Oct 17 13:05:33.516717 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1654/3283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:33 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1361 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:34.544263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:34.546753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:34.579660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:34.599557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:34.600913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:34.605245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:34.606055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:34.607479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:35.117251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1207365c-6c22-42f0-ad0b-5c54b7ea8980 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Action: 'create', calling method: .version_select at 0x7fa820907280>, body: {"keypair": {"name": "tempest-keypair-1838335485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFA7mzYIYErv1JQ5TaRvzmLno94P69kTXBraHp1aJWHz6N4wGeq/rlzE7++aOGQg+wJ9Y5jwVIJf5rpLeO53IQiyqdbW15S/fiYQWGLrzQJVR1owPx2qy7sLfyEZgOp1g=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:35.175504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1207365c-6c22-42f0-ad0b-5c54b7ea8980 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Getting quotas for project 074335b65a0d4768b27b04dde3980a8e. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:05:35.199389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1207365c-6c22-42f0-ad0b-5c54b7ea8980 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Getting quotas for user 6da1520345a9449d911e8e50518dc78b and project 074335b65a0d4768b27b04dde3980a8e. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:05:35.254340 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1207365c-6c22-42f0-ad0b-5c54b7ea8980 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.571423 Oct 17 13:05:35.258511 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1655/3284] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:05:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:05:35.761568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:35.777997 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c5c6da9-cdf9-4b4e-8405-69f77c570205 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 1.238487 Oct 17 13:05:35.781737 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1630/3285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:34 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:36.808068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:36.809577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:36.824129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:36.833452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:36.834121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:36.840300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:36.841045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:36.841689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:37.520499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:37.521074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:37.541602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:37.542103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:37.542757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:37.543485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:37.557986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:37.566343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:37.643080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:05:37.884922 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-846f0aa2-898b-4197-b570-ee947c78c7fc tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 204 len: 0 microversion: 2.1 time: 0.370161 Oct 17 13:05:37.885525 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1631/3286] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:05:37 2022] DELETE /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:05:37.897407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:37.897988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:37.927194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:37.927683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:37.931941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:37.932744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:37.933218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:37.933657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:37.970540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:38.096003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:38.104679 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58263f2a-0fcd-4457-b13f-25a10b350de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 1.300416 Oct 17 13:05:38.113536 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1656/3287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:36 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:38.487316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:38.510258 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d5618bcb-f82c-4fbc-8cf3-8e4c29b0cfff tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1669 microversion: 2.1 time: 0.619046 Oct 17 13:05:38.519572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1632/3288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:37 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1669 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:39.137822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:39.138480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:39.166593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:39.168272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:39.170510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:39.171380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:39.172830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:39.173476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:39.547847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:39.548595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:39.560154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:39.566672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:39.567477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:39.568109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:39.572245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:39.572438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:39.573060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:39.986851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:39.998853 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49127342-f775-4aa2-947a-36d9a90dc84e tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 0.865759 Oct 17 13:05:40.010289 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1657/3289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:39 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:40.217679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:40.237140 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0a6e2715-dd75-485b-8d3e-6b872d902e53 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1601 microversion: 2.1 time: 0.693413 Oct 17 13:05:40.251835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1633/3290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:39 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1601 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:40.513292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a5a27f1b-a423-4317-a167-cf35b87bb8d7 req-0c5d3df6-988a-4cd0-a468-05b8979b4ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262ce52d-8aa5-47f0-b4f7-bddcac72af07", "tag": "563cd410-61d3-44cc-a2ec-2685078817a5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:40.549826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a5a27f1b-a423-4317-a167-cf35b87bb8d7 req-0c5d3df6-988a-4cd0-a468-05b8979b4ae1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:40.550425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a5a27f1b-a423-4317-a167-cf35b87bb8d7 req-0c5d3df6-988a-4cd0-a468-05b8979b4ae1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:40.550870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a5a27f1b-a423-4317-a167-cf35b87bb8d7 req-0c5d3df6-988a-4cd0-a468-05b8979b4ae1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:40.596027 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a5a27f1b-a423-4317-a167-cf35b87bb8d7 req-0c5d3df6-988a-4cd0-a468-05b8979b4ae1 service nova] Creating event network-changed:563cd410-61d3-44cc-a2ec-2685078817a5 for instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 on n-h1-853316-12 Oct 17 13:05:40.603872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a5a27f1b-a423-4317-a167-cf35b87bb8d7 req-0c5d3df6-988a-4cd0-a468-05b8979b4ae1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.599070 Oct 17 13:05:40.604850 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1658/3291] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:41.017124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4039cd03-16f3-40d2-b2f2-504b52700c78 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Action: 'create', calling method: .version_select at 0x7fa8204258b0>, body: {"keypair": {"name": "tempest-keypair-2090121720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRxPRZdQV3IkaOcb/P2mqi4/Je3+hbFWXWOop6sft/ZndX8uohj/4SF9nVaFV15ZbTcyp2HgZy3P6jhzCjnsamtygLBqHbKRbvmRSgLYkchmArvL5m/prT/0YvmmKHAng=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:41.025567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:41.027888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:41.058817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:41.059317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:41.059767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:41.060502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:41.060966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:41.061402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:41.117272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-4039cd03-16f3-40d2-b2f2-504b52700c78 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Getting quotas for project 86553345eb00474c9b8322ae23489ade. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:05:41.147193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-4039cd03-16f3-40d2-b2f2-504b52700c78 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Getting quotas for user c4a2a5521caf47859f5e1ad5c30519e8 and project 86553345eb00474c9b8322ae23489ade. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:05:41.269635 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4039cd03-16f3-40d2-b2f2-504b52700c78 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.260237 Oct 17 13:05:41.283982 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1634/3292] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 13:05:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 275 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:05:41.304727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:41.305525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:41.313900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:41.314433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:41.314877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:41.316022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:41.316498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:41.317229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:41.526378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:41.544979 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d9350262-e037-47ae-bb56-26013d6e5ea8 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 200 len: 1601 microversion: 2.1 time: 0.257274 Oct 17 13:05:41.556924 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1635/3293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:41 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 1601 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:41.597353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-92e27b5d-84ac-43b9-8af9-971519e167d3 req-5c59d5cb-70f1-4c18-8162-4c9104626f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651ae713-e756-4012-8bc9-34d9ac55544d", "name": "network-vif-deleted", "tag": "d761a4e4-c380-4593-b615-9914264ed85f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:41.632106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-92e27b5d-84ac-43b9-8af9-971519e167d3 req-5c59d5cb-70f1-4c18-8162-4c9104626f0b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:41.635937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-92e27b5d-84ac-43b9-8af9-971519e167d3 req-5c59d5cb-70f1-4c18-8162-4c9104626f0b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:41.638483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-92e27b5d-84ac-43b9-8af9-971519e167d3 req-5c59d5cb-70f1-4c18-8162-4c9104626f0b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:41.683797 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-92e27b5d-84ac-43b9-8af9-971519e167d3 req-5c59d5cb-70f1-4c18-8162-4c9104626f0b service nova] Creating event network-vif-deleted:d761a4e4-c380-4593-b615-9914264ed85f for instance 651ae713-e756-4012-8bc9-34d9ac55544d on n-h1-853316-12 Oct 17 13:05:41.708231 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-92e27b5d-84ac-43b9-8af9-971519e167d3 req-5c59d5cb-70f1-4c18-8162-4c9104626f0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123986 Oct 17 13:05:41.710419 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1636/3294] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:42.318489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:42.330147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:42.337256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Searching by: {'deleted': False, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:05:42.352100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:42.387034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:42.387276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:42.403899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:42.404498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:42.404963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:42.516367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:42.549884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:05:42.688826 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7525c0c-900c-4367-ba9d-86ad31afc97f tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.374854 Oct 17 13:05:42.691384 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1637/3295] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 13:05:42 2022] GET /compute/v2.1/servers => generated 339 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:42.720683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:42.728220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 651ae713-e756-4012-8bc9-34d9ac55544d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:42.741352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:42.749218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:42.751195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:42.753552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:42.754257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:42.757411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:42.764278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:42.767870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:42.784352 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-71e122d2-7cb2-4d67-99fc-9d639442d4c4 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 1.763553 Oct 17 13:05:42.800902 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1659/3296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:41 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:42.827004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:42.837707 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] HTTP exception thrown: Instance 651ae713-e756-4012-8bc9-34d9ac55544d could not be found. Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Request method failure captured: Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d HTTP/1.1 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVFDJZV14HL6iAKPWiJSxKaHLb1T32aK88jquDu3e6ZoR-51Bd7E6dy2N3JY-lNOjYxGeVb3KAF6FxHrWi1Xo7feuVMSMEAltlc-EtHl2QEH3qnGgBIo8Q9QUEJE2KojTSbvTSJGM4k1FtmLYN2XAHIe1tRJ598gtll-pduoF-96qJQ Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 6c6509294f164045968c57ff20d25d18 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-LiveMigrationTest-543201802 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c6509294f164045968c57ff20d25d18", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c6509294f164045968c57ff20d25d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c6509294f164045968c57ff20d25d18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c6509294f164045968c57ff20d25d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-LiveMigrationTest-543201802 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 6c6509294f164045968c57ff20d25d18 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-LiveMigrationTest-543201802 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-LiveMigrationTest-543201802-project Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: bd6001af2bfe4fe881afcaaf6cca9962 Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-LiveMigrationTest-543201802-project Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 651ae713-e756-4012-8bc9-34d9ac55544d could not be found. Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '651ae713-e756-4012-8bc9-34d9ac55544d'} Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651ae713-e756-4012-8bc9-34d9ac55544d could not be found. Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651ae713-e756-4012-8bc9-34d9ac55544d could not be found. Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:42.849524 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:42.854697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:42.854697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:42.854697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:42.854697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:05:42.854697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:05:42.854697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651ae713-e756-4012-8bc9-34d9ac55544d could not be found. Oct 17 13:05:42.854697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:05:42.858691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Returning 404 to user: Instance 651ae713-e756-4012-8bc9-34d9ac55544d could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:05:42.860262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:42.864522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Searching by: {'deleted': False, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:05:42.867596 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-78c709f8-1067-450c-af2e-bb7162e49908 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d" status: 404 len: 111 microversion: 2.1 time: 0.172275 Oct 17 13:05:42.876606 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1638/3297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:42 2022] GET /compute/v2.1/servers/651ae713-e756-4012-8bc9-34d9ac55544d => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:05:42.892077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ca1d7ff-b6fe-4538-9e43-3ff457afaaa6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '.version_select at 0x7fa820418670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:42.900587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:42.902995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:42.903757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:42.905834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:42.907460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:42.908728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:42.942971 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ca1d7ff-b6fe-4538-9e43-3ff457afaaa6 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701747243" status: 202 len: 0 microversion: 2.1 time: 0.064682 Oct 17 13:05:42.943713 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1639/3298] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 13:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701747243 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:42.982754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:05:43.073275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:43.111149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:43.112062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:43.112688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:43.612950 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13979ecf-7e3a-484d-9a05-79250b5d18cb tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.802861 Oct 17 13:05:43.613549 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1660/3299] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:05:42 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:43.646886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bfafc95f-98c3-4b5a-910d-69e7234579ed tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:43.668484 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bfafc95f-98c3-4b5a-910d-69e7234579ed tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026009 Oct 17 13:05:43.670553 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1640/3300] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:05:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:43.832727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:43.834230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:43.897616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:43.898592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:43.899238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:43.900178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:43.900808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:43.901550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:43.988422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:44.005739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:44.013241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:44.014035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:44.014791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:44.016114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:44.017274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:44.017948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:44.115792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:05:44.289941 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0264de0f-27be-43ed-9df3-73715372e5a2 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "DELETE /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 204 len: 0 microversion: 2.1 time: 0.308538 Oct 17 13:05:44.295117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1641/3301] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:05:43 2022] DELETE /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:05:44.303058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:44.304202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:44.325548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:44.326768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:44.327503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:44.329351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:44.330239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:44.330909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:44.469998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:44.490136 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ebe3a944-4798-4d1b-ae41-ca4503f2e323 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 0.674304 Oct 17 13:05:44.491718 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1661/3302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:43 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:44.507548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:44.509864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:44.524687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:44.525195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:44.527471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:44.530583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:44.531960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:44.532431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:44.610406 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-007dbb67-4701-4c5c-887c-cd46a870d8e0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116437 Oct 17 13:05:44.612810 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1662/3303] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:05:44 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:05:44.948735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:44.957989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:44.965696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:44.966555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:44.967187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:44.968094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:44.968950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:44.974898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:45.054636 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df9d9e6a-d7e9-4e0a-8d6a-e7297f99bd81 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110524 Oct 17 13:05:45.060283 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1663/3304] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:05:44 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:05:45.212531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:45.212902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:45.225980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:45.226845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:45.230095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:45.231383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:45.232113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:45.233575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:45.308342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:05:45.491339 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1606aded-dbed-43b0-9508-93ac16127851 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 204 len: 0 microversion: 2.1 time: 0.282967 Oct 17 13:05:45.492117 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1664/3305] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:05:45 2022] DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:05:45.502061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:45.507072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:45.526459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:45.526962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:45.527408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:45.532311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:45.532814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:45.533259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:45.716225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:45.731345 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17bd7f4d-0b9c-4022-b6f8-f6ed08b9ee70 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1712 microversion: 2.1 time: 1.433094 Oct 17 13:05:45.733073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1642/3306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:44 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1712 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:45.743947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:45.749801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:45.779737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:45.780777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:45.783468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:45.785573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:45.787119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:45.787599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:46.120250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:46.129109 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11c028a5-aef8-4e27-96d3-21272af1d314 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1672 microversion: 2.1 time: 0.631895 Oct 17 13:05:46.142662 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1665/3307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:45 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1672 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:46.657719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:46.672789 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d89383b-795f-4b4a-9a16-297122203ccf tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 0.937700 Oct 17 13:05:46.674347 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1643/3308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:45 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:46.757544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:46.758304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:46.777868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:46.778395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:46.778838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:46.779758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:46.780395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:46.780992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:47.154599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:47.155989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:47.176973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:47.177468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:47.177906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:47.178650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:47.179102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:47.179524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:47.227215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:47.241539 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88ca4af1-65f2-4a10-a443-6ac7f7d5392c tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1712 microversion: 2.1 time: 0.483575 Oct 17 13:05:47.258424 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1666/3309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:46 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1712 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:47.708134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:47.710878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:47.732850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:47.733364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:47.733813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:47.734685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:47.735152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:47.735678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:48.027014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:48.036435 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f32fcb56-d233-4b1b-85cf-7cfe8fa24b2d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 0.342493 Oct 17 13:05:48.037349 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1667/3310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:47 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:48.060603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:48.061327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:48.069998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:48.070776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:48.071426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:48.072306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:48.072929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:48.073655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:48.107117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:05:48.224723 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b4186b15-a6b5-4a27-b0de-5444e48e60ee tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 204 len: 0 microversion: 2.1 time: 0.168101 Oct 17 13:05:48.229760 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1668/3311] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:05:48 2022] DELETE /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:05:48.234854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:48.238849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "30d469c3-0f4e-4ffb-9629-123168cb6d4f"}], "security_groups": [{"name": "tempest-securitygroup--1027838005"}], "key_name": "tempest-keypair-1838335485", "user_data": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:48.251462 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-051fe400-1241-4d3f-89de-4bda501ef3f9 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1672 microversion: 2.1 time: 1.100529 Oct 17 13:05:48.252380 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1644/3312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:47 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1672 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:48.257285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:48.259595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:48.278590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:48.279168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:48.279626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:48.280380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:48.280845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:48.282724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:48.407581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] validate_networks() for [('30d469c3-0f4e-4ffb-9629-123168cb6d4f', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:05:49.567706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:49.592480 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af0490a0-d314-458e-9e16-5b80f112ca5d tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1484 microversion: 2.1 time: 1.338709 Oct 17 13:05:49.593287 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1645/3313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:48 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1484 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:49.613881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:49.616130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:49.625634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:49.626140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:49.626613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:49.627337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:49.627842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:49.628211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:49.805232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:05:49.805797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:05:49.806644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:05:49.809631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:05:49.810298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:05:49.825533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:49.826663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:49.827331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:49.828538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:49.830922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:49.831566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:49.863445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Getting quotas for project 074335b65a0d4768b27b04dde3980a8e. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:05:49.884950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Getting quotas for user 6da1520345a9449d911e8e50518dc78b and project 074335b65a0d4768b27b04dde3980a8e. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:05:49.925712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:05:49.936974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:05:50.020750 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3617fa5-ca63-44cf-9d4e-a5cc2ec053c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.788688 Oct 17 13:05:50.024079 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1669/3314] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:05:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:05:50.036443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:50.037109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:50.055354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:50.064470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.065713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.067190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.068240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.068958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.069556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.270785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:50.295638 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad33800e-0222-45ff-bb6f-30ea276a239d tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 0.268832 Oct 17 13:05:50.323188 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1670/3315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:50 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:50.350455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d51e698b-2f35-4eae-8879-930973f2322e req-d6babdc9-0074-430d-bd78-459f73a2fcfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262ce52d-8aa5-47f0-b4f7-bddcac72af07", "name": "network-vif-plugged", "status": "completed", "tag": "563cd410-61d3-44cc-a2ec-2685078817a5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:50.356258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:50.366500 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ea37e837-724d-4335-b174-0ec6dd40240b tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1712 microversion: 2.1 time: 0.760028 Oct 17 13:05:50.390974 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1646/3316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:49 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1712 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:50.436300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:50.439147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:50.440540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d51e698b-2f35-4eae-8879-930973f2322e req-d6babdc9-0074-430d-bd78-459f73a2fcfc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.443687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d51e698b-2f35-4eae-8879-930973f2322e req-d6babdc9-0074-430d-bd78-459f73a2fcfc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.444857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d51e698b-2f35-4eae-8879-930973f2322e req-d6babdc9-0074-430d-bd78-459f73a2fcfc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.474316 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d51e698b-2f35-4eae-8879-930973f2322e req-d6babdc9-0074-430d-bd78-459f73a2fcfc service nova] Creating event network-vif-plugged:563cd410-61d3-44cc-a2ec-2685078817a5 for instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 on n-h1-853316-12 Oct 17 13:05:50.477133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.480661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.485721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.486983 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d51e698b-2f35-4eae-8879-930973f2322e req-d6babdc9-0074-430d-bd78-459f73a2fcfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158183 Oct 17 13:05:50.489932 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1671/3317] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:50.491112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.491746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.492550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.502967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-09354a11-747a-4c64-880b-fb83ef1feb87 req-434e813f-3d1c-4979-a424-ffb8d559995e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9676af66-f025-4c9a-a558-7e5257e29486", "name": "network-vif-deleted", "tag": "0c622b6f-e4fc-4dbd-b902-8b42944bd3ba"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:50.536192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-09354a11-747a-4c64-880b-fb83ef1feb87 req-434e813f-3d1c-4979-a424-ffb8d559995e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.537796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-09354a11-747a-4c64-880b-fb83ef1feb87 req-434e813f-3d1c-4979-a424-ffb8d559995e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.538603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-09354a11-747a-4c64-880b-fb83ef1feb87 req-434e813f-3d1c-4979-a424-ffb8d559995e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.572109 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-09354a11-747a-4c64-880b-fb83ef1feb87 req-434e813f-3d1c-4979-a424-ffb8d559995e service nova] Creating event network-vif-deleted:0c622b6f-e4fc-4dbd-b902-8b42944bd3ba for instance 9676af66-f025-4c9a-a558-7e5257e29486 on n-h1-853316-12 Oct 17 13:05:50.579085 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-09354a11-747a-4c64-880b-fb83ef1feb87 req-434e813f-3d1c-4979-a424-ffb8d559995e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086648 Oct 17 13:05:50.579668 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1672/3318] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:50.593390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e8b7520-e6db-4d52-9da6-1b809dfbda16 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:50.594567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e8b7520-e6db-4d52-9da6-1b809dfbda16 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:50.715885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:50.730320 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-03f38fc8-4160-4da8-8296-2910409ee1b0 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1606 microversion: 2.1 time: 0.338112 Oct 17 13:05:50.731098 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1647/3319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:50 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1606 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:50.755766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1316157662", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4476dc03-1f51-43f4-a49b-14da86686228"}, {"port": "025f2a1c-bddb-4db6-92ff-a5f29cba7b91", "tag": "port-1"}, {"port": "39b7349e-cc92-45d0-8bb5-ba66f09c36ab", "tag": "port-2"}, {"uuid": "cf88e09a-f1f3-4718-8499-09ecec58bbb4", "tag": "net-1"}, {"uuid": "cf88e09a-f1f3-4718-8499-09ecec58bbb4"}, {"uuid": "97474846-b7fb-4c57-9bdf-42f26b0abb72", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "97474846-b7fb-4c57-9bdf-42f26b0abb72", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1f04d4b6-ec6f-4701-b542-0559794f8104", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "bfc4bddc-5cb8-4426-bbad-b129e8059d06", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "064ef5a4-03ad-484f-b910-649315bf2801", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1011615503"}], "key_name": "tempest-keypair-2090121720", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:50.759801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e8b7520-e6db-4d52-9da6-1b809dfbda16 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:50.778440 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e8b7520-e6db-4d52-9da6-1b809dfbda16 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1226 microversion: 2.1 time: 0.195526 Oct 17 13:05:50.779242 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1673/3320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:50 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1226 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:50.791384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:50.791992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:50.814726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.817846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.819476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.821382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.822723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.823160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.903326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:50.903826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:50.904267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:50.907408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lazy-loading 'fault' on Instance uuid 9676af66-f025-4c9a-a558-7e5257e29486 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:05:51.055530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:51.073309 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db58a7be-419d-4b35-ac6f-310cbd265c0e tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 200 len: 1300 microversion: 2.1 time: 0.285850 Oct 17 13:05:51.076786 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1674/3321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:50 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 1300 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:51.155730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] validate_networks() for [('4476dc03-1f51-43f4-a49b-14da86686228', None, None, None, None, None), (None, None, '025f2a1c-bddb-4db6-92ff-a5f29cba7b91', None, None, None), (None, None, '39b7349e-cc92-45d0-8bb5-ba66f09c36ab', None, None, None), ('cf88e09a-f1f3-4718-8499-09ecec58bbb4', None, None, None, None, None), ('cf88e09a-f1f3-4718-8499-09ecec58bbb4', None, None, None, None, None), ('97474846-b7fb-4c57-9bdf-42f26b0abb72', '10.2.2.100', None, None, None, None), ('97474846-b7fb-4c57-9bdf-42f26b0abb72', '10.2.2.200', None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:05:51.196666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:51.323895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:51.324787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:51.338416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:51.339253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:51.339869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:51.344532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:51.345341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:51.348574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:51.354273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:51.737535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:51.752122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-38555b39-2f4c-47b8-b14b-d6ec53fde05c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1429 microversion: 2.1 time: 0.426996 Oct 17 13:05:51.753497 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1675/3322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:51 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1429 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:51.760909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:51.763794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:51.779030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:51.780432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:51.781037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:51.784878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:51.786202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:51.786202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:51.892339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca637f607a4d94bb2a079c269b60fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b300aade5ad44d6da07d3e59fa90f00c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:51.913814 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-050f01a4-2ec5-4602-93e9-2de39ff406cd tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 200 len: 1644 microversion: 2.1 time: 0.158711 Oct 17 13:05:51.917753 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1676/3323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:51 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 1644 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:51.938365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:51.947076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:51.971888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:51.973480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:51.975405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:51.977213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:51.978992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:51.981128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:52.143379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c24155cc4964f9298aee2c596a79ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdbecfa601e4e76bded1a6b0ff5bf3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:52.157179 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-79369266-af3e-4a4d-a0cb-461cfbbe5d2a tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 200 len: 1606 microversion: 2.1 time: 0.236787 Oct 17 13:05:52.173019 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1677/3324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:51 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 1606 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:52.186814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:52.188672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:52.198563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:52.199263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:52.199835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:52.200913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:52.201586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:52.204496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:52.351860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:52.361695 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2bceecea-47dd-494f-bb44-dd5de6a8e4a6 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1296 microversion: 2.1 time: 0.185331 Oct 17 13:05:52.380444 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1678/3325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:52 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1296 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:52.387726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-acf82a23-e809-43d3-a9e8-a15dd5a85b20 req-20244c99-ad8f-430e-a575-2707090a8fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578ed1c6-a638-4a11-844a-0071032b1738", "name": "network-vif-deleted", "tag": "edb67ed6-6fda-41be-bdaf-79a6e08a7bfa"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:52.402351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-acf82a23-e809-43d3-a9e8-a15dd5a85b20 req-20244c99-ad8f-430e-a575-2707090a8fcc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:52.403106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-acf82a23-e809-43d3-a9e8-a15dd5a85b20 req-20244c99-ad8f-430e-a575-2707090a8fcc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:52.403694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-acf82a23-e809-43d3-a9e8-a15dd5a85b20 req-20244c99-ad8f-430e-a575-2707090a8fcc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:52.447146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:52.455882 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-acf82a23-e809-43d3-a9e8-a15dd5a85b20 req-20244c99-ad8f-430e-a575-2707090a8fcc service nova] Creating event network-vif-deleted:edb67ed6-6fda-41be-bdaf-79a6e08a7bfa for instance 578ed1c6-a638-4a11-844a-0071032b1738 on n-h2-853316-12 Oct 17 13:05:52.464580 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-acf82a23-e809-43d3-a9e8-a15dd5a85b20 req-20244c99-ad8f-430e-a575-2707090a8fcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082769 Oct 17 13:05:52.465702 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1679/3326] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:52.473994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:52.475729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 9676af66-f025-4c9a-a558-7e5257e29486] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:52.483782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:52.484489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:52.485118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:52.486009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:52.486911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:52.487525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:52.529764 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] HTTP exception thrown: Instance 9676af66-f025-4c9a-a558-7e5257e29486 could not be found. Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Request method failure captured: Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 HTTP/1.1 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFDJZV14HL6iAKPWiJSxKaHLb1T32aK88jquDu3e6ZoR-51Bd7E6dy2N3JY-lNOjYxGeVb3KAF6FxHrWi1Xo7feuVMSMEAltlc-EtHl2QEH3qnGgBIo8Q9QUEJE2KojTSbvTSJGM4k1FtmLYN2XAHIe1tRJ598gtll-pduoF-96qJQ Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 6c6509294f164045968c57ff20d25d18 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-LiveMigrationTest-543201802 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c6509294f164045968c57ff20d25d18", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c6509294f164045968c57ff20d25d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c6509294f164045968c57ff20d25d18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c6509294f164045968c57ff20d25d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-LiveMigrationTest-543201802 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 6c6509294f164045968c57ff20d25d18 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-LiveMigrationTest-543201802 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-LiveMigrationTest-543201802-project Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: bd6001af2bfe4fe881afcaaf6cca9962 Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-LiveMigrationTest-543201802-project Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9676af66-f025-4c9a-a558-7e5257e29486 could not be found. Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9676af66-f025-4c9a-a558-7e5257e29486'} Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9676af66-f025-4c9a-a558-7e5257e29486 could not be found. Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9676af66-f025-4c9a-a558-7e5257e29486 could not be found. Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:52.532889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:52.538942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:52.538942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:52.538942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:52.538942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:05:52.538942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:05:52.538942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9676af66-f025-4c9a-a558-7e5257e29486 could not be found. Oct 17 13:05:52.538942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:52.542755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Returning 404 to user: Instance 9676af66-f025-4c9a-a558-7e5257e29486 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:05:52.545336 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bf104b7f-d198-4297-a905-caa824b6643c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486" status: 404 len: 111 microversion: 2.1 time: 0.077993 Oct 17 13:05:52.549492 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1680/3327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:52 2022] GET /compute/v2.1/servers/9676af66-f025-4c9a-a558-7e5257e29486 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:05:52.565351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:52.566450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:52.577229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:52.579519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:52.580172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:52.581245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:52.581943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:52.582786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:52.688379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:05:52.979663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4c1daed5-6cf0-45e0-bc97-ab06be4fa368 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 204 len: 0 microversion: 2.1 time: 0.423015 Oct 17 13:05:52.994520 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1681/3328] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:05:52 2022] DELETE /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:05:53.002850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:53.015167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:53.027335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:53.027833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:53.028373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:53.029185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:53.029608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:53.030032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:53.413577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:53.426232 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d18fd7f-4e14-4478-a7d4-97457c996df2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1609 microversion: 2.1 time: 0.436157 Oct 17 13:05:53.439508 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1682/3329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:52 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1609 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:53.460607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:53.461117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] [instance: 578ed1c6-a638-4a11-844a-0071032b1738] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:53.477918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:53.483090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:53.485723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:53.486713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:53.488844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:53.489722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:53.512425 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] HTTP exception thrown: Instance 578ed1c6-a638-4a11-844a-0071032b1738 could not be found. Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Request method failure captured: Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 HTTP/1.1 Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLYNR6dP9aOzsZUpV7A56HVxWpC1IMvbkSqA0EVtVk23jlrcsjOTBRFynjAAQFm-TjNLPMPUoa_wT1_hErYM_lLaQ_vQSrNfcjagE9AogBIH4jKM6WwZXOV-HVQbEiJio9JipGGhs6sn8uFw4yh-zZY2ZqUDcsj2XGFoLGwXfV6WSU Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b300aade5ad44d6da07d3e59fa90f00c Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestManualDisk-317388681 Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b300aade5ad44d6da07d3e59fa90f00c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b300aade5ad44d6da07d3e59fa90f00c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b300aade5ad44d6da07d3e59fa90f00c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b300aade5ad44d6da07d3e59fa90f00c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestManualDisk-317388681 Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b300aade5ad44d6da07d3e59fa90f00c Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestManualDisk-317388681 Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestManualDisk-317388681-project Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e7ca637f607a4d94bb2a079c269b60fc Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestManualDisk-317388681-project Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 578ed1c6-a638-4a11-844a-0071032b1738 could not be found. Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '578ed1c6-a638-4a11-844a-0071032b1738'} Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 578ed1c6-a638-4a11-844a-0071032b1738 could not be found. Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 578ed1c6-a638-4a11-844a-0071032b1738 could not be found. Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:53.520394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:53.527683 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:53.527683 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:53.527683 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:53.527683 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:05:53.527683 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:05:53.527683 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 578ed1c6-a638-4a11-844a-0071032b1738 could not be found. Oct 17 13:05:53.527683 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:53.530122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Returning 404 to user: Instance 578ed1c6-a638-4a11-844a-0071032b1738 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:05:53.532393 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e4644e72-cb8a-4c9a-9dd2-84418d86fe94 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738" status: 404 len: 111 microversion: 2.1 time: 0.091779 Oct 17 13:05:53.536909 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1683/3330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:53 2022] GET /compute/v2.1/servers/578ed1c6-a638-4a11-844a-0071032b1738 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:05:53.542645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:53.544109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:53.552797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:53.553699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:53.554560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:53.555571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:53.556276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:53.556968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:54.060624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:54.073666 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d34954e-41d5-4efc-99ff-6a51f27bb06c tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1501 microversion: 2.1 time: 0.535300 Oct 17 13:05:54.076208 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1684/3331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:53 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1501 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:54.084498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:54.087250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:54.102350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:54.103343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:54.103906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:54.108529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:54.109769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:54.110648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:54.144091 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] HTTP exception thrown: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Request method failure captured: Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac HTTP/1.1 Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVGukySUZVCaPkT0QeFoX_ncVI_so4gdvev2SVac-69k9kh1wSe_2cwkuvBq3sy5yKPj_eeT8wT2O978Q2btizn1ocWk9tIGzy1tiYZyZo_sv6w454OTFB7KrfHmXim-2gtu8qmzIt3w3I7QErrs6blmvU-JtpMm0qQkTZjCmFuJ7QI Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ebdbecfa601e4e76bded1a6b0ff5bf3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1c24155cc4964f9298aee2c596a79ac7 Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5d0f6a09-8e29-486f-a866-75047d3370ac'} Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:54.145835 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:54.151117 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:54.151117 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:54.151117 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:54.151117 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:05:54.151117 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:05:54.151117 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:05:54.151117 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:54.151117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Returning 404 to user: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:05:54.152406 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11a3f689-71d0-4c5d-9945-442c53a5d4bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 404 len: 111 microversion: 2.1 time: 0.075026 Oct 17 13:05:54.153083 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1685/3332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:54 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:05:54.161132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:54.167587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:54.179032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:54.181087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:54.182058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:54.186927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:54.187606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:54.188274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:54.373731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:54.399051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd062a03-ef44-48df-8563-e11f13a864f1 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1284 microversion: 2.1 time: 0.243908 Oct 17 13:05:54.400412 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1686/3333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:54 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:54.431621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:54.436410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:54.471801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:54.473616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:54.474735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:54.478004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:54.482762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:54.490951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:55.013388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:55.026120 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2a18a25-6b13-4ae9-bf1c-7ae82752a1d7 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1609 microversion: 2.1 time: 0.621007 Oct 17 13:05:55.038190 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1687/3334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:54 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1609 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:55.038190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7229f90-923c-453e-b8cb-68f226249f00 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] Calling method '.version_select at 0x7fa820e08c10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:55.077569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7229f90-923c-453e-b8cb-68f226249f00 tempest-ServersTestManualDisk-317388681 tempest-ServersTestManualDisk-317388681-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003235581" status: 202 len: 0 microversion: 2.1 time: 0.047321 Oct 17 13:05:55.081679 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1688/3335] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003235581 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:55.096084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-59cb5433-c713-4474-926d-2cc03a2566d7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '.version_select at 0x7fa82092adc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:55.136716 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-59cb5433-c713-4474-926d-2cc03a2566d7 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128077013" status: 202 len: 0 microversion: 2.1 time: 0.053792 Oct 17 13:05:55.138077 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1689/3336] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128077013 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:05:55.143394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8565dd09-c1b6-4ae4-b3f7-7bf3ad8fb9ae req-a7f32147-5d85-4c10-82d2-681ff19747d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f6a09-8e29-486f-a866-75047d3370ac", "name": "network-vif-deleted", "tag": "7dc84daa-ad60-4da6-a960-1cfccaec2339"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:55.165420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8565dd09-c1b6-4ae4-b3f7-7bf3ad8fb9ae req-a7f32147-5d85-4c10-82d2-681ff19747d0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:55.166309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8565dd09-c1b6-4ae4-b3f7-7bf3ad8fb9ae req-a7f32147-5d85-4c10-82d2-681ff19747d0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:55.166994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8565dd09-c1b6-4ae4-b3f7-7bf3ad8fb9ae req-a7f32147-5d85-4c10-82d2-681ff19747d0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:55.188610 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8565dd09-c1b6-4ae4-b3f7-7bf3ad8fb9ae req-a7f32147-5d85-4c10-82d2-681ff19747d0 service nova] Creating event network-vif-deleted:7dc84daa-ad60-4da6-a960-1cfccaec2339 for instance 5d0f6a09-8e29-486f-a866-75047d3370ac on n-h2-853316-12 Oct 17 13:05:55.204034 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8565dd09-c1b6-4ae4-b3f7-7bf3ad8fb9ae req-a7f32147-5d85-4c10-82d2-681ff19747d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064197 Oct 17 13:05:55.204831 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1690/3337] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:55.219836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:55.220735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:55.239659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:55.240509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:55.241307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:55.242338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:55.244257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:55.246835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:55.740982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:55.752121 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2cb2e5c6-c27b-444c-91e3-a26b8bb953bc tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1609 microversion: 2.1 time: 0.545890 Oct 17 13:05:55.767271 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1691/3338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:55 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1609 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:55.773440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:55.774494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:55.793352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:55.794991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:55.795573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:55.799816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:55.801529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:55.802833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:56.067257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6001af2bfe4fe881afcaaf6cca9962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6509294f164045968c57ff20d25d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:56.082846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7554168f-30e7-4772-8bad-52584b4ca9ba tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 200 len: 1459 microversion: 2.1 time: 0.308694 Oct 17 13:05:56.083523 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1692/3339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:55 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 1459 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:56.092666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:56.093927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:56.113287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:56.113979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:56.114622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:56.115509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:56.116174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:56.116956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:57.286186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:57.294523 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65684aad-e1e8-42d4-9b37-35d6e113c7da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1352 microversion: 2.1 time: 1.209561 Oct 17 13:05:57.295469 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1693/3340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:56 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1352 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:57.317690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:57.318606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] [instance: 093eddd4-bc84-4fc5-b692-1a986ddcf78a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:57.325163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:57.325921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:57.328781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:57.329716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:57.330457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:57.331073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:57.373422 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] HTTP exception thrown: Instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a could not be found. Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Request method failure captured: Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a HTTP/1.1 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVFDJZV14HL6iAKPWiJSxKaHLb1T32aK88jquDu3e6ZoR-51Bd7E6dy2N3JY-lNOjYxGeVb3KAF6FxHrWi1Xo7feuVMSMEAltlc-EtHl2QEH3qnGgBIo8Q9QUEJE2KojTSbvTSJGM4k1FtmLYN2XAHIe1tRJ598gtll-pduoF-96qJQ Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 6c6509294f164045968c57ff20d25d18 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-LiveMigrationTest-543201802 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c6509294f164045968c57ff20d25d18", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c6509294f164045968c57ff20d25d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c6509294f164045968c57ff20d25d18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c6509294f164045968c57ff20d25d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-LiveMigrationTest-543201802 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 6c6509294f164045968c57ff20d25d18 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-LiveMigrationTest-543201802 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-LiveMigrationTest-543201802-project Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: bd6001af2bfe4fe881afcaaf6cca9962 Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-LiveMigrationTest-543201802-project Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a could not be found. Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '093eddd4-bc84-4fc5-b692-1a986ddcf78a'} Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a could not be found. Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a could not be found. Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:05:57.377346 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:57.382900 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:05:57.382900 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:05:57.382900 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:05:57.382900 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:05:57.382900 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:05:57.382900 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a could not be found. Oct 17 13:05:57.382900 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:05:57.384748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] Returning 404 to user: Instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:05:57.386912 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff9b2168-412d-446e-93a2-df872f7f0810 tempest-LiveMigrationTest-543201802 tempest-LiveMigrationTest-543201802-project] 10.222.0.27 "GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a" status: 404 len: 111 microversion: 2.1 time: 0.078717 Oct 17 13:05:57.388507 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1694/3341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:57 2022] GET /compute/v2.1/servers/093eddd4-bc84-4fc5-b692-1a986ddcf78a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:05:57.397230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9de30e0c-d4ba-4da8-bdeb-2cb50eaef7bc req-383d2125-21c5-4654-acfe-6d147b6f23bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093eddd4-bc84-4fc5-b692-1a986ddcf78a", "name": "network-vif-deleted", "tag": "5a53af6b-06ae-4124-abe0-490e5199838b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:57.409159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9de30e0c-d4ba-4da8-bdeb-2cb50eaef7bc req-383d2125-21c5-4654-acfe-6d147b6f23bd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:57.409628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9de30e0c-d4ba-4da8-bdeb-2cb50eaef7bc req-383d2125-21c5-4654-acfe-6d147b6f23bd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:57.410057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9de30e0c-d4ba-4da8-bdeb-2cb50eaef7bc req-383d2125-21c5-4654-acfe-6d147b6f23bd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:57.425219 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9de30e0c-d4ba-4da8-bdeb-2cb50eaef7bc req-383d2125-21c5-4654-acfe-6d147b6f23bd service nova] Creating event network-vif-deleted:5a53af6b-06ae-4124-abe0-490e5199838b for instance 093eddd4-bc84-4fc5-b692-1a986ddcf78a on n-h2-853316-12 Oct 17 13:05:57.431129 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9de30e0c-d4ba-4da8-bdeb-2cb50eaef7bc req-383d2125-21c5-4654-acfe-6d147b6f23bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040610 Oct 17 13:05:57.431260 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1695/3342] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:58.323042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:58.325188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:05:58.342805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:58.346488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:58.347642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:58.350432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:58.351720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:58.353000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:59.346974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:05:59.353478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:59.355801 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-856afb40-da32-4636-b2c0-5fcf532cc31e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1352 microversion: 2.1 time: 1.038659 Oct 17 13:05:59.370515 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1696/3343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:05:58 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1352 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:05:59.467620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f7dfc720-97ee-4e3e-b823-aa3e062b4243 req-0e7acac2-a72e-4e29-a8fb-a779d7dc6221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b3bb7a-3248-4ec0-872f-881e93899d96", "tag": "93dd9e1e-bf9c-4a1f-b8f3-f36a697d1757"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:59.510745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7dfc720-97ee-4e3e-b823-aa3e062b4243 req-0e7acac2-a72e-4e29-a8fb-a779d7dc6221 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:05:59.511404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7dfc720-97ee-4e3e-b823-aa3e062b4243 req-0e7acac2-a72e-4e29-a8fb-a779d7dc6221 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:05:59.512099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7dfc720-97ee-4e3e-b823-aa3e062b4243 req-0e7acac2-a72e-4e29-a8fb-a779d7dc6221 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:05:59.535554 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f7dfc720-97ee-4e3e-b823-aa3e062b4243 req-0e7acac2-a72e-4e29-a8fb-a779d7dc6221 service nova] Creating event network-changed:93dd9e1e-bf9c-4a1f-b8f3-f36a697d1757 for instance 05b3bb7a-3248-4ec0-872f-881e93899d96 on n-h2-853316-12 Oct 17 13:05:59.556558 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f7dfc720-97ee-4e3e-b823-aa3e062b4243 req-0e7acac2-a72e-4e29-a8fb-a779d7dc6221 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090569 Oct 17 13:05:59.558792 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1697/3344] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:06:00.382602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:00.384389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:00.388779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:00.399277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:00.400517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:00.407161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:00.409060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:00.409835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:00.410549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:00.721997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:00.766203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=24 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:00.815091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:00.830334 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bdb158c1-f4d0-40a0-a503-0df4945d8c4a tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1352 microversion: 2.1 time: 0.451869 Oct 17 13:06:00.855697 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1698/3345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:00 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1352 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:01.793087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:06:01.793546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:06:01.793947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:06:01.797245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:06:01.797245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:06:01.821669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:01.864104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:01.866815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:01.882246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:01.883010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:01.884356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:01.885384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:01.886953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:01.888443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:01.889774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:01.891116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:01.891585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:01.901573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:01.902480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:01.903133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:01.939775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Getting quotas for project 86553345eb00474c9b8322ae23489ade. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:06:01.949666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Getting quotas for user c4a2a5521caf47859f5e1ad5c30519e8 and project 86553345eb00474c9b8322ae23489ade. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:06:02.396347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:06:02.399638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1f04d4b6-ec6f-4701-b542-0559794f8104',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='bfc4bddc-5cb8-4426-bbad-b129e8059d06',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='064ef5a4-03ad-484f-b910-649315bf2801',volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:06:03.175584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:03.186226 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81457286-2381-4991-be27-7a80ef31bf19 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1352 microversion: 2.1 time: 1.326547 Oct 17 13:06:03.203688 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1699/3346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:01 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1352 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:03.379758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-502cf080-7bbb-44e8-a9c1-e743d3bd7e7a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 12.647661 Oct 17 13:06:03.381696 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1648/3347] 10.222.0.27 () {62 vars in 1189 bytes} [Mon Oct 17 13:05:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 12650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:06:03.393886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-12e94d8d-0524-4147-b9f4-87ccacdda8ce tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:03.394795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-12e94d8d-0524-4147-b9f4-87ccacdda8ce tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:03.576030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-12e94d8d-0524-4147-b9f4-87ccacdda8ce tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:03.596130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-12e94d8d-0524-4147-b9f4-87ccacdda8ce tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:03.603454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-12e94d8d-0524-4147-b9f4-87ccacdda8ce tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:03.607617 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-12e94d8d-0524-4147-b9f4-87ccacdda8ce tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1286 microversion: 2.42 time: 0.218807 Oct 17 13:06:03.611236 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1700/3348] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:03 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:04.217446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:04.218077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:04.242968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:04.243552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:04.244198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:04.246353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:04.247398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:04.247853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:04.640588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c998a62f-8bf7-4e68-ad4c-405f5870cf29 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:04.641315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c998a62f-8bf7-4e68-ad4c-405f5870cf29 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:04.780420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c998a62f-8bf7-4e68-ad4c-405f5870cf29 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:04.803397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c998a62f-8bf7-4e68-ad4c-405f5870cf29 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:04.805416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c998a62f-8bf7-4e68-ad4c-405f5870cf29 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:04.815449 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c998a62f-8bf7-4e68-ad4c-405f5870cf29 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1286 microversion: 2.42 time: 0.179167 Oct 17 13:06:04.819202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1701/3349] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:04 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:05.516083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:05.531435 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-24eacfc2-bb54-4dde-ab88-ffeec496b6c2 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1352 microversion: 2.1 time: 1.317763 Oct 17 13:06:05.535451 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1649/3350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:04 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1352 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:05.850115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:05.850998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:05.893383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:05.893896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:05.894386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:05.895115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:05.909444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:05.910121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:06.347640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:06.357438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:06.359574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:06.360772 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e15e8575-be9e-4dc1-9892-250847f3e204 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1528 microversion: 2.42 time: 0.516206 Oct 17 13:06:06.361363 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1702/3351] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:05 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1528 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:06.559895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:06.561433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:06.576169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:06.578434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:06.579301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:06.580631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:06.582676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:06.583989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:06.609818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e5dbbbdd-2579-4516-bfc1-7aa73c2d0a66 req-8db72126-97c4-4165-9c12-6e64f5265c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262ce52d-8aa5-47f0-b4f7-bddcac72af07", "tag": "563cd410-61d3-44cc-a2ec-2685078817a5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:06.635162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e5dbbbdd-2579-4516-bfc1-7aa73c2d0a66 req-8db72126-97c4-4165-9c12-6e64f5265c39 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:06.635646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e5dbbbdd-2579-4516-bfc1-7aa73c2d0a66 req-8db72126-97c4-4165-9c12-6e64f5265c39 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:06.636083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e5dbbbdd-2579-4516-bfc1-7aa73c2d0a66 req-8db72126-97c4-4165-9c12-6e64f5265c39 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:06.678529 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e5dbbbdd-2579-4516-bfc1-7aa73c2d0a66 req-8db72126-97c4-4165-9c12-6e64f5265c39 service nova] Creating event network-changed:563cd410-61d3-44cc-a2ec-2685078817a5 for instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 on n-h1-853316-12 Oct 17 13:06:06.700250 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e5dbbbdd-2579-4516-bfc1-7aa73c2d0a66 req-8db72126-97c4-4165-9c12-6e64f5265c39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094748 Oct 17 13:06:06.700871 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1703/3352] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:06:07.342884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:07.357269 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ca1c0fd-3d69-4931-9c4b-88ce9a62d2e5 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1352 microversion: 2.1 time: 0.797267 Oct 17 13:06:07.360628 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1650/3353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:06 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1352 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:07.399357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:07.400636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:07.430008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:07.438689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:07.439446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:07.440377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:07.441002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:07.450905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:07.707814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:07.718063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:07.731491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:07.732716 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c8f86cb9-1400-4092-b5a2-aa48c527d744 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1594 microversion: 2.42 time: 0.345199 Oct 17 13:06:07.742616 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1704/3354] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:07 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1594 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:08.381857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:08.382535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:08.400752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:08.415347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:08.416082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:08.417031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:08.417659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:08.418302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:08.762860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:08.764735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:08.777978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:08.781122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:08.781870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:08.783120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:08.783837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:08.785120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:09.284602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:09.299291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:09.300766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:09.307907 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-653956cd-6365-47bf-9148-42c2217c96b7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1594 microversion: 2.42 time: 0.549617 Oct 17 13:06:09.322201 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1705/3355] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:08 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1594 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:09.325144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:09.330323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:09.348668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:09.356175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:09.356728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:09.357508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:09.357989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:09.361324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:09.399726 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] HTTP exception thrown: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Request method failure captured: Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac HTTP/1.1 Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVGukySUZVCaPkT0QeFoX_ncVI_so4gdvev2SVac-69k9kh1wSe_2cwkuvBq3sy5yKPj_eeT8wT2O978Q2btizn1ocWk9tIGzy1tiYZyZo_sv6w454OTFB7KrfHmXim-2gtu8qmzIt3w3I7QErrs6blmvU-JtpMm0qQkTZjCmFuJ7QI Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ebdbecfa601e4e76bded1a6b0ff5bf3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1c24155cc4964f9298aee2c596a79ac7 Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5d0f6a09-8e29-486f-a866-75047d3370ac'} Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:06:09.404543 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.412204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Returning 404 to user: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:09.413438 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46e750cf-66de-4d50-b210-67832d5e1c03 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 404 len: 111 microversion: 2.1 time: 0.096542 Oct 17 13:06:09.417313 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1706/3356] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:06:09 2022] DELETE /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:06:09.425247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:09.425881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: 5d0f6a09-8e29-486f-a866-75047d3370ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:09.442807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:09.443309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:09.453392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:09.454673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:09.455071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:09.455516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:09.486228 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] HTTP exception thrown: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Request method failure captured: Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac HTTP/1.1 Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVGukySUZVCaPkT0QeFoX_ncVI_so4gdvev2SVac-69k9kh1wSe_2cwkuvBq3sy5yKPj_eeT8wT2O978Q2btizn1ocWk9tIGzy1tiYZyZo_sv6w454OTFB7KrfHmXim-2gtu8qmzIt3w3I7QErrs6blmvU-JtpMm0qQkTZjCmFuJ7QI Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ebdbecfa601e4e76bded1a6b0ff5bf3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1c24155cc4964f9298aee2c596a79ac7 Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5d0f6a09-8e29-486f-a866-75047d3370ac'} Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:09.487801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Returning 404 to user: Instance 5d0f6a09-8e29-486f-a866-75047d3370ac could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da095dc6-d846-4159-a35d-7bcdf45e4eaf tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac" status: 404 len: 111 microversion: 2.1 time: 0.070880 Oct 17 13:06:09.493079 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1707/3357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:09 2022] GET /compute/v2.1/servers/5d0f6a09-8e29-486f-a866-75047d3370ac => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:06:09.986201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e189f4f9-acfa-4a9b-b280-7ba3d4eb9cc3 req-932de169-eaa2-4327-8116-aae429182222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b3bb7a-3248-4ec0-872f-881e93899d96", "name": "network-vif-plugged", "status": "completed", "tag": "93dd9e1e-bf9c-4a1f-b8f3-f36a697d1757"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:10.008180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e189f4f9-acfa-4a9b-b280-7ba3d4eb9cc3 req-932de169-eaa2-4327-8116-aae429182222 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:10.009090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e189f4f9-acfa-4a9b-b280-7ba3d4eb9cc3 req-932de169-eaa2-4327-8116-aae429182222 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:10.009715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e189f4f9-acfa-4a9b-b280-7ba3d4eb9cc3 req-932de169-eaa2-4327-8116-aae429182222 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:10.040347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e189f4f9-acfa-4a9b-b280-7ba3d4eb9cc3 req-932de169-eaa2-4327-8116-aae429182222 service nova] Creating event network-vif-plugged:93dd9e1e-bf9c-4a1f-b8f3-f36a697d1757 for instance 05b3bb7a-3248-4ec0-872f-881e93899d96 on n-h2-853316-12 Oct 17 13:06:10.051031 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e189f4f9-acfa-4a9b-b280-7ba3d4eb9cc3 req-932de169-eaa2-4327-8116-aae429182222 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069068 Oct 17 13:06:10.059679 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1708/3358] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:10.339030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:10.339673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:10.354576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:10.355074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:10.355874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:10.356760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:10.357403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:10.358004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:10.440046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:10.454843 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ae68eda7-6cd1-481b-9202-ad32f41e29a3 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1352 microversion: 2.1 time: 2.075473 Oct 17 13:06:10.472687 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1651/3359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:08 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1352 bytes in 2096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:10.742825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:10.759733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:10.764727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:10.768692 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e661481b-6b08-4799-ad1e-d0242bcdd9b9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1594 microversion: 2.42 time: 0.431682 Oct 17 13:06:10.770515 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1709/3360] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:10 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1594 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:11.485595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:11.486446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:11.501006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:11.502561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:11.503178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:11.503737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:11.507035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:11.507701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:11.808353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:11.809589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:11.824189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:11.826226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:11.826889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:11.829274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:11.829999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:11.832309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:11.918840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:11.972414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:12.286712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:12.346084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:12.346084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:12.346084 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d6b728e8-8a33-4ef3-b47d-a7c010db7afe tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1662 microversion: 2.42 time: 0.511252 Oct 17 13:06:12.346084 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1710/3361] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:11 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1662 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:12.474764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:12.486990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5f5ba4b-3809-4b0e-ac4d-a4a69373cd92 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1352 microversion: 2.1 time: 1.007916 Oct 17 13:06:12.490952 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1652/3362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:11 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1352 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:13.337850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:13.338657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:13.348020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:13.349438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:13.354975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:13.355789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:13.356824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:13.357625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:13.358063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:13.510120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:13.510772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:13.528534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:13.529033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:13.529476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:13.530224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:13.530754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:13.531690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:13.882933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:13.898477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:13.899953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:13.901153 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-153151ef-426b-47a3-90a7-a5e2cfab76f2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1662 microversion: 2.42 time: 0.568362 Oct 17 13:06:13.912838 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1711/3363] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:13 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1662 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:14.115908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:14.128514 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc0aace9-affb-4ce2-885d-9b1d760f2c90 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1541 microversion: 2.1 time: 0.622181 Oct 17 13:06:14.135370 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1653/3364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:13 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1541 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:14.165073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:14.165581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:14.183188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:14.183692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:14.184142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:14.184949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:14.185434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:14.185869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:14.396124 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-684162bf-3e7f-4c79-a437-29d87df7f073 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236055 Oct 17 13:06:14.406322 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1712/3365] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:06:14 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96/os-interface => generated 285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:14.934437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:14.935738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:14.952067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:14.952067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:14.952067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:14.953232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:14.953886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:14.954359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:15.669235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:15.679120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:15.680582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:15.686565 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-369a6081-6b52-4359-9f20-4192d7d4399c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1709 microversion: 2.42 time: 0.756188 Oct 17 13:06:15.690029 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1654/3366] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:14 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1709 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:16.715311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:16.723534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:16.724339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:16.743710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:16.748435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:16.749273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:16.755568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:16.759679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:16.760307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:18.283706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1778522119", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "bb41f482-78e2-4a16-a978-1b9cd57482f7"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:18.456823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] validate_networks() for [('bb41f482-78e2-4a16-a978-1b9cd57482f7', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:06:18.968342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:18.981537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:18.983052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:18.984864 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-925e9beb-f259-4ce7-973e-aa4bb5b01750 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1709 microversion: 2.42 time: 2.270509 Oct 17 13:06:18.994294 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1713/3367] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:16 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1709 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:19.004880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c1f2fa69-e452-45bd-9dc0-5f6d69c208dd req-c17b6a13-0e6d-4a60-a3af-5fb2e0c1698a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b3bb7a-3248-4ec0-872f-881e93899d96", "tag": "93dd9e1e-bf9c-4a1f-b8f3-f36a697d1757"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:19.032410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1f2fa69-e452-45bd-9dc0-5f6d69c208dd req-c17b6a13-0e6d-4a60-a3af-5fb2e0c1698a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:19.034537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1f2fa69-e452-45bd-9dc0-5f6d69c208dd req-c17b6a13-0e6d-4a60-a3af-5fb2e0c1698a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:19.035331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1f2fa69-e452-45bd-9dc0-5f6d69c208dd req-c17b6a13-0e6d-4a60-a3af-5fb2e0c1698a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:19.080670 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c1f2fa69-e452-45bd-9dc0-5f6d69c208dd req-c17b6a13-0e6d-4a60-a3af-5fb2e0c1698a service nova] Creating event network-changed:93dd9e1e-bf9c-4a1f-b8f3-f36a697d1757 for instance 05b3bb7a-3248-4ec0-872f-881e93899d96 on n-h2-853316-12 Oct 17 13:06:19.094436 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c1f2fa69-e452-45bd-9dc0-5f6d69c208dd req-c17b6a13-0e6d-4a60-a3af-5fb2e0c1698a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096547 Oct 17 13:06:19.098226 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1714/3368] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:20.018901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:20.020621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:20.034624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:20.038000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:20.040248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:20.041434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:20.045602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:20.046757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:20.571787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:20.626473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:20.636607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:20.644920 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e548189-3a15-457b-a4d1-ae0bbac7d97f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1756 microversion: 2.42 time: 0.628170 Oct 17 13:06:20.645572 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1715/3369] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:20 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1756 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:21.257548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:06:21.258031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:06:21.258543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:06:21.258965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:06:21.259385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:06:21.289798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:21.290335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:21.290784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:21.291535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:21.294476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:21.295188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:21.382641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Getting quotas for project 7f9efeec2227498c99ae1763625fd0d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:06:21.412874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Getting quotas for user bc82d08ca8844a98bf2798ce8bcb435e and project 7f9efeec2227498c99ae1763625fd0d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:06:21.476869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:06:21.487397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:06:21.673143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:21.674566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:21.680318 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa9adafe-7cea-4b6f-83b6-7ca15d3191f5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.696766 Oct 17 13:06:21.687182 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1655/3370] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:06:21.706721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:21.706721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:21.716121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:21.716916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:21.720462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:21.721134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:22.043804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-253531402", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "bb41f482-78e2-4a16-a978-1b9cd57482f7"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:22.227653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] validate_networks() for [('bb41f482-78e2-4a16-a978-1b9cd57482f7', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:06:22.746884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:22.771886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:22.773366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:22.787078 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13995cb6-8bf7-4e0e-9e73-5b8bb1f42c0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1756 microversion: 2.42 time: 1.106671 Oct 17 13:06:22.798096 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1716/3371] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:21 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1756 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:22.810981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:22.812385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:22.836280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:22.836864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:22.837330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:22.845030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:22.848088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:22.853886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:22.922545 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] HTTP exception thrown: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Request method failure captured: Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 HTTP/1.1 Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVGukySUZVCaPkT0QeFoX_ncVI_so4gdvev2SVac-69k9kh1wSe_2cwkuvBq3sy5yKPj_eeT8wT2O978Q2btizn1ocWk9tIGzy1tiYZyZo_sv6w454OTFB7KrfHmXim-2gtu8qmzIt3w3I7QErrs6blmvU-JtpMm0qQkTZjCmFuJ7QI Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ebdbecfa601e4e76bded1a6b0ff5bf3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1c24155cc4964f9298aee2c596a79ac7 Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e6c5672f-8586-4476-85ec-81ff1d7400d6'} Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:06:22.931245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:22.934364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Returning 404 to user: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:22.939150 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cfc94750-f3df-434b-89d2-6a7e648bc7bc tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 404 len: 111 microversion: 2.1 time: 0.133319 Oct 17 13:06:22.941199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1717/3372] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:06:22 2022] DELETE /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:06:22.954548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:22.955934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] [instance: e6c5672f-8586-4476-85ec-81ff1d7400d6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:22.994121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:22.994713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:22.999588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:23.006059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:23.006626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:23.007072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:23.092045 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] HTTP exception thrown: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Request method failure captured: Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 HTTP/1.1 Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVGukySUZVCaPkT0QeFoX_ncVI_so4gdvev2SVac-69k9kh1wSe_2cwkuvBq3sy5yKPj_eeT8wT2O978Q2btizn1ocWk9tIGzy1tiYZyZo_sv6w454OTFB7KrfHmXim-2gtu8qmzIt3w3I7QErrs6blmvU-JtpMm0qQkTZjCmFuJ7QI Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ebdbecfa601e4e76bded1a6b0ff5bf3e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ebdbecfa601e4e76bded1a6b0ff5bf3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ebdbecfa601e4e76bded1a6b0ff5bf3e Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1913692531 Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1c24155cc4964f9298aee2c596a79ac7 Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeTestJSON-1913692531-project Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e6c5672f-8586-4476-85ec-81ff1d7400d6'} Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:23.107032 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:23.111705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:23.111705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:23.111705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:23.111705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:23.111705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:23.111705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. Oct 17 13:06:23.111705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:06:23.114781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] Returning 404 to user: Instance e6c5672f-8586-4476-85ec-81ff1d7400d6 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:23.117535 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45404798-84e2-4ed6-a3bb-2ad00db0f313 tempest-AttachVolumeTestJSON-1913692531 tempest-AttachVolumeTestJSON-1913692531-project] 10.222.0.27 "GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6" status: 404 len: 111 microversion: 2.1 time: 0.171748 Oct 17 13:06:23.125147 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1718/3373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:22 2022] GET /compute/v2.1/servers/e6c5672f-8586-4476-85ec-81ff1d7400d6 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:06:23.816568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:23.817164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:23.848229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:23.857847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:23.858348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:23.863141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:23.863931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:23.864538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:24.299107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:06:24.300135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:06:24.301636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:06:24.302266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:06:24.302765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:06:24.337959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:24.340674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:24.342534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:24.347767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:24.351981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:24.352674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:24.430916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Getting quotas for project 7f9efeec2227498c99ae1763625fd0d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:06:24.451509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Getting quotas for user bc82d08ca8844a98bf2798ce8bcb435e and project 7f9efeec2227498c99ae1763625fd0d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:06:24.500071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:06:24.504017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:06:24.559991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:24.600592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:24.604323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:24.605737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d854ea3-11a8-43b3-be39-51f37d61fdac tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1756 microversion: 2.42 time: 0.794485 Oct 17 13:06:24.638455 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1719/3374] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:23 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1756 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:24.693881 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5832e86f-30ec-4207-b798-2ae84f71b40a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.653875 Oct 17 13:06:24.694587 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1656/3375] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:06:24.833349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-692308680", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "451", "networks": [{"uuid": "bb41f482-78e2-4a16-a978-1b9cd57482f7"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:24.971621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] validate_networks() for [('bb41f482-78e2-4a16-a978-1b9cd57482f7', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:06:25.667136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:25.667849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:25.696217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:25.696729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:25.697187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:25.697938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:25.706092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:25.706684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:27.055533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:06:27.064297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:06:27.067765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:06:27.070772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:06:27.072495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:06:27.100533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:27.101164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:27.102127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:27.102961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:27.103430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:27.105393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:27.132520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Getting quotas for project 7f9efeec2227498c99ae1763625fd0d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:06:27.140943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Getting quotas for user bc82d08ca8844a98bf2798ce8bcb435e and project 7f9efeec2227498c99ae1763625fd0d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:06:27.164228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:06:27.168320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:06:27.322206 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ef383c4-20e2-414a-a72a-30c3d3a0d7ce tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.493778 Oct 17 13:06:27.341535 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1720/3376] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:06:27.354483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78cc19b3-77d7-4c60-a93f-37e3d70e1e43 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:27.357587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78cc19b3-77d7-4c60-a93f-37e3d70e1e43 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:27.531372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-78cc19b3-77d7-4c60-a93f-37e3d70e1e43 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:27.546607 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78cc19b3-77d7-4c60-a93f-37e3d70e1e43 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1220 microversion: 2.1 time: 0.199410 Oct 17 13:06:27.548034 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1721/3377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:27 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1220 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:28.281561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:28.311916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:28.316790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:28.324505 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0fa39a89-41b1-4f4c-9cad-a7b8538d54d1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1803 microversion: 2.42 time: 2.690758 Oct 17 13:06:28.326569 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1657/3378] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:25 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1803 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:28.573986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:28.574876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:28.600304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:28.602288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:28.604011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:28.605982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:28.607394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:28.608270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:29.082648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:29.089773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:29.092446 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32f25df5-841b-46c1-bd09-10bd4a3f800b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1216 microversion: 2.1 time: 0.522899 Oct 17 13:06:29.115248 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1722/3379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:28 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1216 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:29.354853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:29.356051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:29.382195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:29.391194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:29.391988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:29.393519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:29.394149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:29.394766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:30.122915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:30.124774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:30.142875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:30.151191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:30.151969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:30.153113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:30.153851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:30.154616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:30.422871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:30.431408 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2159d549-cf40-4111-b048-4501fb0b7c97 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1278 microversion: 2.1 time: 0.312486 Oct 17 13:06:30.458615 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1723/3380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:30 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1278 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:30.927030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:30.936647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=53 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:30.964669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:30.969859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:30.980969 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8f5b9e92-44cb-4652-94b3-c61053a30395 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1803 microversion: 2.42 time: 1.625948 Oct 17 13:06:30.982584 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1658/3381] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:29 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1803 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:31.490304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:31.491866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:31.510078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:31.511560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:31.516637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:31.519157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:31.519682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:31.520341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:31.678349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1091898762", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "397f4528-2d00-40f4-8c69-3ca86c8c5b8c"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:31.800745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] validate_networks() for [('397f4528-2d00-40f4-8c69-3ca86c8c5b8c', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:06:31.873509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:31.885767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb311414-a9e4-4323-b959-456c66934cc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1278 microversion: 2.1 time: 0.417339 Oct 17 13:06:31.894547 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1659/3382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:31 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1278 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:32.011155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:32.012420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:32.026261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=9 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:32.033573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:32.034695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:32.035949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:32.036993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:32.040147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:32.042494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:33.626213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:33.646992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:33.650272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:33.654756 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-013a5695-1af0-40af-a7d1-231d399e3d5f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1850 microversion: 2.42 time: 1.647057 Oct 17 13:06:33.657614 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1660/3383] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:32 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1850 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:33.693591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:33.695916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:33.737038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:33.746468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:33.750885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:33.753550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:33.760351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:33.761874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:34.102684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:34.147165 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ec212372-9487-42ae-ba12-0b18177ccbca tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1278 microversion: 2.1 time: 0.487337 Oct 17 13:06:34.154791 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1661/3384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:33 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1278 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:34.185275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-082bb9fb-dbf1-49e4-9b0d-a3aed4e538fa req-843403a6-82b6-42c7-9e5e-8754b1fe5af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f791b4-5702-4f1d-a75d-01a30855832d", "tag": "e66bfb45-f3fe-4d78-8431-eda75f49b321"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:34.231851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-082bb9fb-dbf1-49e4-9b0d-a3aed4e538fa req-843403a6-82b6-42c7-9e5e-8754b1fe5af1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:34.236313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-082bb9fb-dbf1-49e4-9b0d-a3aed4e538fa req-843403a6-82b6-42c7-9e5e-8754b1fe5af1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:34.239707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-082bb9fb-dbf1-49e4-9b0d-a3aed4e538fa req-843403a6-82b6-42c7-9e5e-8754b1fe5af1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:34.312476 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-082bb9fb-dbf1-49e4-9b0d-a3aed4e538fa req-843403a6-82b6-42c7-9e5e-8754b1fe5af1 service nova] Creating event network-changed:e66bfb45-f3fe-4d78-8431-eda75f49b321 for instance 23f791b4-5702-4f1d-a75d-01a30855832d on n-h2-853316-12 Oct 17 13:06:34.337512 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-082bb9fb-dbf1-49e4-9b0d-a3aed4e538fa req-843403a6-82b6-42c7-9e5e-8754b1fe5af1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178938 Oct 17 13:06:34.339400 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1662/3385] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:34.385952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:34.475752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:34.477941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:06:34.479429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:06:34.480269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:06:34.480888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:06:34.481505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:06:34.507511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:34.511344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:34.512058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:34.513335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:34.515895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:34.518347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:34.592269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Getting quotas for project 95a88114f847460c96faf8a0b3c92f09. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:06:34.610846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Getting quotas for user 28cbc6b9dc024e729dc501e856cb9a34 and project 95a88114f847460c96faf8a0b3c92f09. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:06:34.648564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:06:34.653898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:06:34.661502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-168768562", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:34.758101 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f5fcd05-5543-4c0f-b112-bc45bf46d9c6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.685762 Oct 17 13:06:34.759540 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1724/3386] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:06:34.767980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:34.769599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:34.785636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:34.786599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:34.787284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:34.788450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:34.789261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:34.789695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:06:34.791494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:35.786574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:06:35.787756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:06:35.788597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:06:35.789088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:06:35.789774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:06:35.827795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:35.828301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:35.829256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:35.829493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:35.829952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:35.834746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:35.882184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:06:35.903130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for user bf508fbbaee740548bd6509b3d279b57 and project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:06:35.928951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:06:35.947679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:06:36.078376 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9f3e8d9-fbf3-4eb5-9886-20126339550e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730244 Oct 17 13:06:36.083446 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1663/3387] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:06:36.101933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:36.103345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:36.140919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:36.144723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:36.157564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:36.161900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:36.166137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:36.169000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:36.219572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:36.230337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:36.258432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:36.262276 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2420178e-f221-423e-9ec2-7d2331c0e394 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1850 microversion: 2.42 time: 1.501039 Oct 17 13:06:36.266189 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1725/3388] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:34 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1850 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:36.295984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:36.298290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:36.319332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:36.321804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:36.324339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:36.325243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:36.327402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:36.328220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:36.621120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:36.634763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf04647d-2e44-49a6-98d6-b420ed9ed2e6 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1221 microversion: 2.1 time: 0.548445 Oct 17 13:06:36.636994 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1664/3389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:36 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1221 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:36.649109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abc866f9-50de-439f-af09-685b507debea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:36.651592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-abc866f9-50de-439f-af09-685b507debea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:36.924628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-abc866f9-50de-439f-af09-685b507debea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:36.933041 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-abc866f9-50de-439f-af09-685b507debea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1212 microversion: 2.1 time: 0.291790 Oct 17 13:06:36.933637 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1665/3390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:36 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1212 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:37.294020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:37.295927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:37.325961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:37.327568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:37.328263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:37.329569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:37.330689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:37.331325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:37.622814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:37.638078 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87916d2e-b653-44e9-9f4e-f5770590567d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 1.370677 Oct 17 13:06:37.646996 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1726/3391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:36 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:37.652409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d2fc7e48-4526-475f-b988-c1e82543b877 req-0dee545f-a750-4494-bbfe-21669e425cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "tag": "d42ee3ac-da2f-45ea-ae11-913f70990f8d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:37.672396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d2fc7e48-4526-475f-b988-c1e82543b877 req-0dee545f-a750-4494-bbfe-21669e425cae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:37.682560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d2fc7e48-4526-475f-b988-c1e82543b877 req-0dee545f-a750-4494-bbfe-21669e425cae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:37.683353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d2fc7e48-4526-475f-b988-c1e82543b877 req-0dee545f-a750-4494-bbfe-21669e425cae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:37.708229 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d2fc7e48-4526-475f-b988-c1e82543b877 req-0dee545f-a750-4494-bbfe-21669e425cae service nova] Creating event network-changed:d42ee3ac-da2f-45ea-ae11-913f70990f8d for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:06:37.728079 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d2fc7e48-4526-475f-b988-c1e82543b877 req-0dee545f-a750-4494-bbfe-21669e425cae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079134 Oct 17 13:06:37.729408 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1727/3392] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:37.735543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:37.737096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:37.757218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:37.757967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:37.758656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:37.759588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:37.760436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:37.761082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:37.956152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:37.966893 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f12d9819-40a0-49e6-99b6-f9eadfba62aa tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1287 microversion: 2.1 time: 0.235802 Oct 17 13:06:37.970662 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1728/3393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:37 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1287 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:37.996406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:37.997058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:38.026042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:38.028465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:38.029269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:38.031600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:38.033043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:38.035168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:38.488924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:38.503680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:38.505864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:38.509034 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb7db971-214d-4b8c-9387-98b336fd2a82 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1850 microversion: 2.42 time: 1.219520 Oct 17 13:06:38.510047 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1666/3394] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:37 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1850 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:38.645235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:38.656682 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2acc75ea-e39e-4013-b9e8-1d9db9b155e1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1264 microversion: 2.1 time: 0.684345 Oct 17 13:06:38.658021 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1729/3395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:37 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1264 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:38.672556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:38.673500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:38.684460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:38.687879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:38.688633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:38.689816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:38.691698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:38.692369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:38.878694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-23fe292c-0f1d-442b-abd3-5ed0c79702cd req-aab8c5cc-039b-4961-aaed-f9da48919269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2c1946-4142-49d7-95b3-248adb6b0581", "tag": "8d543292-d1ae-4f9d-879f-7b75fdbdc4ce"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:38.911888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23fe292c-0f1d-442b-abd3-5ed0c79702cd req-aab8c5cc-039b-4961-aaed-f9da48919269 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:38.913681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23fe292c-0f1d-442b-abd3-5ed0c79702cd req-aab8c5cc-039b-4961-aaed-f9da48919269 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:38.914411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23fe292c-0f1d-442b-abd3-5ed0c79702cd req-aab8c5cc-039b-4961-aaed-f9da48919269 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:38.940994 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-23fe292c-0f1d-442b-abd3-5ed0c79702cd req-aab8c5cc-039b-4961-aaed-f9da48919269 service nova] Creating event network-changed:8d543292-d1ae-4f9d-879f-7b75fdbdc4ce for instance ed2c1946-4142-49d7-95b3-248adb6b0581 on n-h1-853316-12 Oct 17 13:06:38.955702 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-23fe292c-0f1d-442b-abd3-5ed0c79702cd req-aab8c5cc-039b-4961-aaed-f9da48919269 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090045 Oct 17 13:06:38.956960 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1730/3396] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:06:38.994343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:38.995742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:39.009434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:39.010426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:39.015957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:39.017055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:39.017745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:39.018453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:39.395965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:39.404404 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7baa272a-f59e-42a6-802f-5282e3b6348f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1275 microversion: 2.1 time: 0.415609 Oct 17 13:06:39.404988 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1731/3397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:38 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1275 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:39.537827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:39.538663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:39.552842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:39.553411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:39.553920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:39.557694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:39.559156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:39.559995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:39.896289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:39.905439 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e2bce28-2207-4a70-9b0a-21741fe810a0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 1.237827 Oct 17 13:06:39.911642 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1667/3398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:38 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:39.932811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:39.934438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:39.950427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:39.951148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:39.953828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:39.954819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:39.957540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:39.958334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:40.142492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:40.157395 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-243b589b-ba24-4121-9632-e047b02d4bf0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1270 microversion: 2.1 time: 0.240885 Oct 17 13:06:40.161635 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1668/3399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:39 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1270 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:40.442921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:40.447602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:40.475999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:40.481608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:40.487005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:40.490312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:40.490557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:40.491778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:40.492702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:40.516169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:40.525377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:40.527901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-826eb63f-8225-456c-8c93-e9ca000b0ccc tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1850 microversion: 2.42 time: 0.995279 Oct 17 13:06:40.528998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1732/3400] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:39 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1850 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:40.721875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-507cc066-7ebf-4fb5-8f8b-861a7679f871 req-cef5cd17-8c46-4200-9ba3-43568545f38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e000143-e33b-4156-bb81-e9b9b757e83e", "tag": "215c67b4-016e-4d4c-9776-d58933da980e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:40.749325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-507cc066-7ebf-4fb5-8f8b-861a7679f871 req-cef5cd17-8c46-4200-9ba3-43568545f38b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:40.750259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-507cc066-7ebf-4fb5-8f8b-861a7679f871 req-cef5cd17-8c46-4200-9ba3-43568545f38b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:40.750926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-507cc066-7ebf-4fb5-8f8b-861a7679f871 req-cef5cd17-8c46-4200-9ba3-43568545f38b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:40.770507 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-507cc066-7ebf-4fb5-8f8b-861a7679f871 req-cef5cd17-8c46-4200-9ba3-43568545f38b service nova] Creating event network-changed:215c67b4-016e-4d4c-9776-d58933da980e for instance 7e000143-e33b-4156-bb81-e9b9b757e83e on n-h2-853316-12 Oct 17 13:06:40.777593 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-507cc066-7ebf-4fb5-8f8b-861a7679f871 req-cef5cd17-8c46-4200-9ba3-43568545f38b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062220 Oct 17 13:06:40.779293 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1733/3401] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:40.927378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:40.939116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:40.939860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:40.947535 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-36a4e0f8-52d8-4b1f-a4d8-c777603b47a7 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.517551 Oct 17 13:06:40.952696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:40.955941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:40.956684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:40.957678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:40.959273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:40.961101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:40.964468 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1669/3402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:40 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:41.182095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:41.182207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:41.201269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:41.205438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:41.205917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:41.208262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:41.208347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:41.208729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:41.488831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:41.501466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b3382fe-82c6-47cd-ac31-44978837bcf7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.568513 Oct 17 13:06:41.518314 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1734/3403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:40 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:41.526087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-ddd058ef-42bc-4753-887f-c6e99e01a744 req-c0a82046-ceaa-4a53-8ad3-50bcdc8f9c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f791b4-5702-4f1d-a75d-01a30855832d", "name": "network-vif-plugged", "status": "completed", "tag": "e66bfb45-f3fe-4d78-8431-eda75f49b321"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:41.556176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ddd058ef-42bc-4753-887f-c6e99e01a744 req-c0a82046-ceaa-4a53-8ad3-50bcdc8f9c01 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:41.556837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ddd058ef-42bc-4753-887f-c6e99e01a744 req-c0a82046-ceaa-4a53-8ad3-50bcdc8f9c01 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:41.561485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ddd058ef-42bc-4753-887f-c6e99e01a744 req-c0a82046-ceaa-4a53-8ad3-50bcdc8f9c01 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:41.591198 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-ddd058ef-42bc-4753-887f-c6e99e01a744 req-c0a82046-ceaa-4a53-8ad3-50bcdc8f9c01 service nova] Creating event network-vif-plugged:e66bfb45-f3fe-4d78-8431-eda75f49b321 for instance 23f791b4-5702-4f1d-a75d-01a30855832d on n-h2-853316-12 Oct 17 13:06:41.598111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-ddd058ef-42bc-4753-887f-c6e99e01a744 req-c0a82046-ceaa-4a53-8ad3-50bcdc8f9c01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087648 Oct 17 13:06:41.599498 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1735/3404] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:41.606723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:41.609527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:41.617264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:41.618126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:41.618674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:41.619633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:41.620324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:41.621720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:41.710520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:41.729688 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7310f209-507b-49cb-b44a-1b82f86690c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1270 microversion: 2.1 time: 0.548857 Oct 17 13:06:41.751967 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1670/3405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:41 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1270 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:41.972591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:41.973658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:41.994407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:41.995403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:41.997769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:41.999265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:42.001065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:42.001594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:42.444346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:42.462003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:42.464537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:42.466821 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-562d4ca4-7dd7-459f-89cc-b61e7acb9c65 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1871 microversion: 2.42 time: 0.865849 Oct 17 13:06:42.468324 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1736/3406] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:41 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1871 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:42.530280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:42.531795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:42.539765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:42.540584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:42.541238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:42.542184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:42.542933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:42.543593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:43.129225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:43.149508 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a9c8afb-18e5-42bf-b4a5-6170b07116a5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.625402 Oct 17 13:06:43.155462 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1737/3407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:42 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:43.175865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:43.188585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:43.220022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:43.229775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:43.230630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:43.234939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:43.237680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:43.238714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:43.530338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:43.538778 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c6460f57-be2c-449b-a4b9-8b19a3c8d088 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 1.570641 Oct 17 13:06:43.544176 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1671/3408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:41 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:43.551797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:43.564686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:43.584605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:43.585104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:43.589635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:43.599229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:43.599745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:43.600192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:43.932671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:43.946331 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4694579e-30bc-4b35-bece-0d8227c01149 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.786919 Oct 17 13:06:43.947870 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1738/3409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:43 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:43.954578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7e4fa22-9893-4da8-b252-5131559140e8 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa820873310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:44.035049 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e7e4fa22-9893-4da8-b252-5131559140e8 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/aaecc111-44ed-4a41-9cfd-f923dd6a602b" status: 200 len: 350 microversion: 2.1 time: 0.085759 Oct 17 13:06:44.036941 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1739/3410] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:06:43 2022] GET /compute/v2.1/os-volumes/aaecc111-44ed-4a41-9cfd-f923dd6a602b => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:44.181896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:44.182594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:44.185635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:44.198114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:44.206633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:44.207339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:44.208309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:44.209264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:44.210007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:44.314740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:44.332824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:44.337063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:44.340865 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d84cbcd2-14ed-48ce-b1df-c75e5a87abea tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1871 microversion: 2.42 time: 0.793141 Oct 17 13:06:44.345105 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1672/3411] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:43 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1871 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:44.543503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:44.568579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:44.570446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:44.589627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:44.593178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:44.594257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:44.595229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:44.604675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:44.605454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:44.633301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=14 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:44.669535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:44.683732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4bbf856f-38bf-4764-ab4b-8c2749c72a2f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.506546 Oct 17 13:06:44.685289 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1740/3412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:44 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:44.838195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7966d548-f9f3-452d-bdcb-d77b35e383b1 req-dc0a963c-e370-4f33-9b94-105b746bf68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "tag": "025f2a1c-bddb-4db6-92ff-a5f29cba7b91"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:44.871344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7966d548-f9f3-452d-bdcb-d77b35e383b1 req-dc0a963c-e370-4f33-9b94-105b746bf68f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:44.872269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7966d548-f9f3-452d-bdcb-d77b35e383b1 req-dc0a963c-e370-4f33-9b94-105b746bf68f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:44.878663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7966d548-f9f3-452d-bdcb-d77b35e383b1 req-dc0a963c-e370-4f33-9b94-105b746bf68f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:44.936093 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7966d548-f9f3-452d-bdcb-d77b35e383b1 req-dc0a963c-e370-4f33-9b94-105b746bf68f service nova] Creating event network-changed:025f2a1c-bddb-4db6-92ff-a5f29cba7b91 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:06:44.943132 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7966d548-f9f3-452d-bdcb-d77b35e383b1 req-dc0a963c-e370-4f33-9b94-105b746bf68f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126693 Oct 17 13:06:44.944277 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1741/3413] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:06:44.976132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:44.977387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:44.988665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:44.989423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:44.990747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:44.992076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:44.993692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:44.995811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:45.320684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:45.331000 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f383fe3-929b-49de-ab49-d5f17ae0fa33 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.770064 Oct 17 13:06:45.334018 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1673/3414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:44 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:45.372162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:45.372791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:45.386607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:45.387120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:45.387577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:45.388312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:45.388764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:45.389193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:45.456042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:45.467144 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cba9ee69-003f-4e28-9e73-4b3f22ecc699 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.495746 Oct 17 13:06:45.474575 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1742/3415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:44 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:45.486034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0dd9df9d-3654-4cb9-b539-60240119693f req-4ed776ad-1528-458d-ba4e-db55d8fe25d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2c1946-4142-49d7-95b3-248adb6b0581", "name": "network-vif-plugged", "status": "completed", "tag": "8d543292-d1ae-4f9d-879f-7b75fdbdc4ce"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:45.532632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0dd9df9d-3654-4cb9-b539-60240119693f req-4ed776ad-1528-458d-ba4e-db55d8fe25d6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:45.533137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0dd9df9d-3654-4cb9-b539-60240119693f req-4ed776ad-1528-458d-ba4e-db55d8fe25d6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:45.533571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0dd9df9d-3654-4cb9-b539-60240119693f req-4ed776ad-1528-458d-ba4e-db55d8fe25d6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:45.611190 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0dd9df9d-3654-4cb9-b539-60240119693f req-4ed776ad-1528-458d-ba4e-db55d8fe25d6 service nova] Creating event network-vif-plugged:8d543292-d1ae-4f9d-879f-7b75fdbdc4ce for instance ed2c1946-4142-49d7-95b3-248adb6b0581 on n-h1-853316-12 Oct 17 13:06:45.618852 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0dd9df9d-3654-4cb9-b539-60240119693f req-4ed776ad-1528-458d-ba4e-db55d8fe25d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139465 Oct 17 13:06:45.621029 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1743/3416] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:45.714084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:45.716051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:45.740053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:45.741879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:45.745959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:45.747183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:45.752226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:45.755403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:45.852750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:46.305030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:46.320797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c147fc61-612c-4057-8a70-d9e7b65a24cc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.613739 Oct 17 13:06:46.333097 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1744/3417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:45 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:46.345796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4b3051a2-83e9-4cbe-bf10-13a7d13ff76c req-399f2b27-ca66-4139-9662-2c7bade10f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e855c4-4ab2-4063-94ff-f8eb397f2762", "tag": "6f579db8-d79a-4fc7-84a4-cd4d062ad343"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:46.355719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:46.359838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4b3051a2-83e9-4cbe-bf10-13a7d13ff76c req-399f2b27-ca66-4139-9662-2c7bade10f68 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:46.360579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4b3051a2-83e9-4cbe-bf10-13a7d13ff76c req-399f2b27-ca66-4139-9662-2c7bade10f68 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:46.361169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4b3051a2-83e9-4cbe-bf10-13a7d13ff76c req-399f2b27-ca66-4139-9662-2c7bade10f68 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:46.366064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:46.375734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4b3051a2-83e9-4cbe-bf10-13a7d13ff76c req-399f2b27-ca66-4139-9662-2c7bade10f68 service nova] Creating event network-changed:6f579db8-d79a-4fc7-84a4-cd4d062ad343 for instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 on n-h1-853316-12 Oct 17 13:06:46.380842 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4b3051a2-83e9-4cbe-bf10-13a7d13ff76c req-399f2b27-ca66-4139-9662-2c7bade10f68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046415 Oct 17 13:06:46.381819 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1745/3418] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:46.389791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:46.390903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:46.391493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:46.395992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:46.398037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:46.398420 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84b51d39-86b3-468c-80d9-f9299fa4c5f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1859 microversion: 2.42 time: 1.029646 Oct 17 13:06:46.398573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:46.399467 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1674/3419] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:45 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1859 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:46.417406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:46.418621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:46.419802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:46.421112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:46.498024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:46.498758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:46.507939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:46.508452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:46.508881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:46.509605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:46.510092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:46.515315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:46.668542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:46.682349 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-125248e2-ee68-49f7-b5d0-2f8ced2f19be tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.298714 Oct 17 13:06:46.682963 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1746/3420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:46 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:46.688243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d639da7-4603-4ac5-860a-efa428790b92 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa82138a4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:46.766358 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d639da7-4603-4ac5-860a-efa428790b92 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1d79c843-c8a6-401e-9b54-12463e9d03f9" status: 200 len: 350 microversion: 2.1 time: 0.082134 Oct 17 13:06:46.767031 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1747/3421] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:06:46 2022] GET /compute/v2.1/os-volumes/1d79c843-c8a6-401e-9b54-12463e9d03f9 => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:46.933206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:46.998365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:47.012530 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75d04c1b-95f7-4740-96d5-2c2cd765b857 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.519000 Oct 17 13:06:47.025743 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1675/3422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:46 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:47.348777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:47.349964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:47.364161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:47.364907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:47.365576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:47.366579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:47.367249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:47.367819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:47.426431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:47.427130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:47.447404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:47.448081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:47.448624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:47.449441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:47.449996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:47.450548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:47.712063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:47.743759 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-06605173-4b97-4363-a24a-107a853187b7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.400438 Oct 17 13:06:47.750591 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1748/3423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:47 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:47.758829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-acd77a4e-fb5f-4c8a-a2bb-79aca3d2fa5c req-fc86468d-20bf-42a5-b2c6-8fae02bfd3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8", "tag": "7b8a1e49-f76d-443e-bb48-2b56a2f21443"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:47.796893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-acd77a4e-fb5f-4c8a-a2bb-79aca3d2fa5c req-fc86468d-20bf-42a5-b2c6-8fae02bfd3ec service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:47.797514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-acd77a4e-fb5f-4c8a-a2bb-79aca3d2fa5c req-fc86468d-20bf-42a5-b2c6-8fae02bfd3ec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:47.798258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-acd77a4e-fb5f-4c8a-a2bb-79aca3d2fa5c req-fc86468d-20bf-42a5-b2c6-8fae02bfd3ec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:47.819417 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-acd77a4e-fb5f-4c8a-a2bb-79aca3d2fa5c req-fc86468d-20bf-42a5-b2c6-8fae02bfd3ec service nova] Creating event network-changed:7b8a1e49-f76d-443e-bb48-2b56a2f21443 for instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 on n-h1-853316-12 Oct 17 13:06:47.826149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-acd77a4e-fb5f-4c8a-a2bb-79aca3d2fa5c req-fc86468d-20bf-42a5-b2c6-8fae02bfd3ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073628 Oct 17 13:06:47.826559 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1749/3424] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:47.832100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:47.832993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:47.841035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:47.841790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:47.843471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:47.844605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:47.845213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:47.846539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:47.907296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:47.931004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:47.932591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:47.936774 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa5102e7-e1a2-4b3e-897d-eeebd5d73f3b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.513108 Oct 17 13:06:47.951075 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1676/3425] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:47 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:48.044910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:48.045854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:48.057704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:48.058407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:48.059495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:48.059698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:48.060644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:48.061361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:48.062486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:48.066358 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d792802-1b9d-4813-bf6b-d1b449873458 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.238559 Oct 17 13:06:48.067212 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1750/3426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:47 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:48.254986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:48.257175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:48.264595 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0e246740-edfc-4b8b-86fe-146e3d80766c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.225682 Oct 17 13:06:48.265492 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1677/3427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:48 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:48.771294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:48.771983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:48.778456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:48.779017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:48.779545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:48.780869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:48.781329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:48.781756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:48.918286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:48.928281 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b112661f-0f92-400d-a085-69a77713fa18 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.161004 Oct 17 13:06:48.928842 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1751/3428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:48 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:48.978592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:48.979394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:48.987709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:48.988192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:48.988627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:48.989352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:48.989802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:48.990248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:49.095947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.105517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:49.115104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:49.116270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:49.116865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:49.118207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:49.118906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:49.119479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:49.193865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:49.205714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:49.207623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:49.208982 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a19c1fa6-30dc-484a-92b8-a5107b11cd26 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.234599 Oct 17 13:06:49.218043 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1678/3429] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:48 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:49.287089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:49.289476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.290387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:49.298417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:49.299274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:49.299995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:49.301416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:49.302268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:49.302789 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2109bb30-d995-4078-9a1c-69078a88ca68 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.211776 Oct 17 13:06:49.303147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:49.304016 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1752/3430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:49.309963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b2d8d429-6015-41e2-8a72-db887e64261d tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa820a780d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.365153 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b2d8d429-6015-41e2-8a72-db887e64261d tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b56814e7-a024-4a9e-bb4f-775aaf04b960" status: 200 len: 350 microversion: 2.1 time: 0.059831 Oct 17 13:06:49.365803 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1753/3431] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/os-volumes/b56814e7-a024-4a9e-bb4f-775aaf04b960 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:49.387664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8aaec251-e565-4a15-bcb0-44039014d571 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa82092aca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.467532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:49.479466 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0094c352-9a5a-441a-a8d7-4ef855e67b36 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.193941 Oct 17 13:06:49.479671 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8aaec251-e565-4a15-bcb0-44039014d571 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.099995 Oct 17 13:06:49.480246 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1754/3432] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:49.489355 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1679/3433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:49.497409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ed13d64-7deb-47fb-b6bf-1658ee4933f2 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa82095f040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.588504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7ed13d64-7deb-47fb-b6bf-1658ee4933f2 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096230 Oct 17 13:06:49.589082 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1755/3434] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:49.604814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8bdaa099-56a0-40e4-87bf-a210cb56c04f tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa82039b8b0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.695140 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8bdaa099-56a0-40e4-87bf-a210cb56c04f tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.094625 Oct 17 13:06:49.695722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1680/3435] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:49.709959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4923e837-0724-47a6-90f0-b3554c382ad1 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa820cbe8b0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.795006 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4923e837-0724-47a6-90f0-b3554c382ad1 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088931 Oct 17 13:06:49.795828 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1756/3436] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:49.813767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-630863a5-0db9-496f-b372-b4fa8e316904 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa8203ec280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.848679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-842f326e-dfd3-4f9e-9c5b-d48fe736db04 req-9450f4e2-7b20-4810-bf79-5d940fcb4e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "tag": "39b7349e-cc92-45d0-8bb5-ba66f09c36ab"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:49.858973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-842f326e-dfd3-4f9e-9c5b-d48fe736db04 req-9450f4e2-7b20-4810-bf79-5d940fcb4e7c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:49.859390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-842f326e-dfd3-4f9e-9c5b-d48fe736db04 req-9450f4e2-7b20-4810-bf79-5d940fcb4e7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:49.859824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-842f326e-dfd3-4f9e-9c5b-d48fe736db04 req-9450f4e2-7b20-4810-bf79-5d940fcb4e7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:49.870482 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-842f326e-dfd3-4f9e-9c5b-d48fe736db04 req-9450f4e2-7b20-4810-bf79-5d940fcb4e7c service nova] Creating event network-changed:39b7349e-cc92-45d0-8bb5-ba66f09c36ab for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:06:49.876347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-842f326e-dfd3-4f9e-9c5b-d48fe736db04 req-9450f4e2-7b20-4810-bf79-5d940fcb4e7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031261 Oct 17 13:06:49.877400 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1757/3437] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:49.898199 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-630863a5-0db9-496f-b372-b4fa8e316904 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088946 Oct 17 13:06:49.898877 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1681/3438] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:49.913375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d6846e6-064b-474b-8bc6-888ae69ae89b tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa82091bf70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.951657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.952963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:49.960457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:49.960964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:49.961478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:49.962283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:49.962952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:49.963451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:49.999404 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d6846e6-064b-474b-8bc6-888ae69ae89b tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089633 Oct 17 13:06:50.001707 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1758/3439] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:50.016633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-38fd806d-ff10-4ab4-b0b7-e6e2d03fe015 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa8209134c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.116626 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-38fd806d-ff10-4ab4-b0b7-e6e2d03fe015 tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105271 Oct 17 13:06:50.117958 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1759/3440] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:06:50.119551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:50.129760 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0b5115bc-9767-43fb-85e0-1ee9c59fac90 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.181954 Oct 17 13:06:50.130613 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1682/3441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:50.137955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d4be52d-5f9c-4bd9-a36d-812d97cc818b tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] Calling method '.version_select at 0x7fa8204cdf70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.138445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.140990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:50.148861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:50.150048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:50.150954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:50.152117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:50.152676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:50.153314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:50.182125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:06:50.237126 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d4be52d-5f9c-4bd9-a36d-812d97cc818b tempest-VolumesTestJSON-676021464 tempest-VolumesTestJSON-676021464-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.102633 Oct 17 13:06:50.237899 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1683/3442] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:50.247270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.247932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:50.277000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:50.280679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:50.284018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:50.286770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:50.288826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:50.304837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:50.346153 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3a78efa5-bb38-4d2c-b839-b98735330d23 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 204 len: 0 microversion: 2.1 time: 0.210362 Oct 17 13:06:50.346469 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1760/3443] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:06:50 2022] DELETE /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:06:50.355023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.356203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:50.367774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:50.368288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:50.369150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:50.369935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:50.370393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:50.370751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:50.784207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:50.794506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1239df0c-1d5d-4808-8813-3bf3778c774d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.446437 Oct 17 13:06:50.795112 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1761/3444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:50.810541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.811945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:50.819063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:50.819653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:50.820167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:50.827066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:50.827066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:50.827066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:50.993239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:51.004627 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8c18347e-10de-4482-b50b-7628c1e74d4e tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1666 microversion: 2.1 time: 0.202629 Oct 17 13:06:51.005750 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1762/3445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1666 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:51.012359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:51.012737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:51.020478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:51.021253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:51.022638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:51.023461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:51.024022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:51.024555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:51.407029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:51.419410 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fa022ac-ad41-458f-9b66-d50c687d621f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.412445 Oct 17 13:06:51.434740 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1763/3446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:51 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:51.434740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:51.434740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:51.449002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:51.449767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:51.449874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:51.450661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:51.451123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:51.459197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:51.526731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:51.538531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:51.539909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:51.541091 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-304a003a-19de-45aa-a1b1-b9de3ae5b15d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 1.302438 Oct 17 13:06:51.555313 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1684/3447] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:51.674301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9cf8a30f-a9a4-43cc-aae8-8cfb7e7b390c req-07397b53-d8fe-4d05-bac2-3ff39b0ee474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e000143-e33b-4156-bb81-e9b9b757e83e", "name": "network-vif-plugged", "status": "completed", "tag": "215c67b4-016e-4d4c-9776-d58933da980e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:51.698553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9cf8a30f-a9a4-43cc-aae8-8cfb7e7b390c req-07397b53-d8fe-4d05-bac2-3ff39b0ee474 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:51.702916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9cf8a30f-a9a4-43cc-aae8-8cfb7e7b390c req-07397b53-d8fe-4d05-bac2-3ff39b0ee474 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:51.705468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9cf8a30f-a9a4-43cc-aae8-8cfb7e7b390c req-07397b53-d8fe-4d05-bac2-3ff39b0ee474 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:51.751095 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9cf8a30f-a9a4-43cc-aae8-8cfb7e7b390c req-07397b53-d8fe-4d05-bac2-3ff39b0ee474 service nova] Creating event network-vif-plugged:215c67b4-016e-4d4c-9776-d58933da980e for instance 7e000143-e33b-4156-bb81-e9b9b757e83e on n-h2-853316-12 Oct 17 13:06:51.763270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9cf8a30f-a9a4-43cc-aae8-8cfb7e7b390c req-07397b53-d8fe-4d05-bac2-3ff39b0ee474 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094394 Oct 17 13:06:51.764579 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1685/3448] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:06:51.831109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:51.832020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:51.846437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:51.847189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:51.847790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:51.848661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:51.849311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:51.849886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:52.046847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:52.059018 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1cbd7ca6-0dc7-4462-9e8d-8e66dfa9cca3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.636292 Oct 17 13:06:52.059930 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1764/3449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:51 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:52.072674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:52.073593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:52.082508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:52.083137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:52.083754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:52.084539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:52.085108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:52.085657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:52.284880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:52.296774 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50f17941-d0c7-4196-91ac-8ac628b7c2da tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1666 microversion: 2.1 time: 0.228437 Oct 17 13:06:52.310190 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1765/3450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:52 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1666 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:52.447812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:52.448789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:52.462398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:52.462896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:52.463350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:52.464073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:52.464540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:52.464976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:52.503794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:52.519585 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd4cbfee-a967-4763-a85e-876402f4ca7f tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.700453 Oct 17 13:06:52.521295 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1686/3451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:51 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:52.574743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:52.576134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:52.588427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:52.590913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:52.591581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:52.593759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:52.596930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:52.597738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:52.757585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:52.769048 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0668666c-8bcf-4aba-9c5f-bf0136bde717 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.325231 Oct 17 13:06:52.772063 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1766/3452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:52 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:53.086800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:53.088395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:53.102819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.104047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.106904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.107899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.108653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.109294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.273408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:53.289301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:53.294655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:53.297553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02761b37-eb1b-4b95-880d-c539b0431713 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.727526 Oct 17 13:06:53.298875 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1687/3453] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:52 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:53.327304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:53.328541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:53.344660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.346129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.347973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.349547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.350959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.352761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.408327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:53.424325 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad12851f-9c73-4d69-84af-f4cb10daa027 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1320 microversion: 2.1 time: 0.341685 Oct 17 13:06:53.426800 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1767/3454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:53 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:53.547124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:53.547473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:53.565777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.568508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.569167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.570119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.573000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.573665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.760494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:53.775360 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-61470e4c-e26d-4189-98e0-2b8ddf6491f9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1666 microversion: 2.1 time: 0.455544 Oct 17 13:06:53.795094 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1688/3455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:53 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1666 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:53.802067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:53.803886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:53.810735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.814138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.814819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.815702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.816303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.817418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.915239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:53.927372 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6224e8a2-4965-42d6-b3f2-70668d0311e0 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.386109 Oct 17 13:06:53.929162 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1768/3456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:53 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:53.957309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4ad9b4fe-27cd-4248-a0ed-f7651f2b7638 req-3fb35d20-4672-4dc6-8932-026420a23854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e855c4-4ab2-4063-94ff-f8eb397f2762", "name": "network-vif-plugged", "status": "completed", "tag": "6f579db8-d79a-4fc7-84a4-cd4d062ad343"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:53.973564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ad9b4fe-27cd-4248-a0ed-f7651f2b7638 req-3fb35d20-4672-4dc6-8932-026420a23854 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:53.974232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ad9b4fe-27cd-4248-a0ed-f7651f2b7638 req-3fb35d20-4672-4dc6-8932-026420a23854 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:53.974783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4ad9b4fe-27cd-4248-a0ed-f7651f2b7638 req-3fb35d20-4672-4dc6-8932-026420a23854 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:53.997672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:54.034495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4ad9b4fe-27cd-4248-a0ed-f7651f2b7638 req-3fb35d20-4672-4dc6-8932-026420a23854 service nova] Creating event network-vif-plugged:6f579db8-d79a-4fc7-84a4-cd4d062ad343 for instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 on n-h1-853316-12 Oct 17 13:06:54.046035 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4ad9b4fe-27cd-4248-a0ed-f7651f2b7638 req-3fb35d20-4672-4dc6-8932-026420a23854 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101475 Oct 17 13:06:54.053049 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1769/3457] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:54.082179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1d56c83b-138d-44ff-ac63-953bbc10dcbf req-cc16324d-d8ca-49f3-aa8a-f5721ddad96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "tag": "b6d1e2b2-34a9-4cea-a23e-66a20792cbc9"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:54.107722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1d56c83b-138d-44ff-ac63-953bbc10dcbf req-cc16324d-d8ca-49f3-aa8a-f5721ddad96d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:54.109425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1d56c83b-138d-44ff-ac63-953bbc10dcbf req-cc16324d-d8ca-49f3-aa8a-f5721ddad96d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:54.110030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1d56c83b-138d-44ff-ac63-953bbc10dcbf req-cc16324d-d8ca-49f3-aa8a-f5721ddad96d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:54.127273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1d56c83b-138d-44ff-ac63-953bbc10dcbf req-cc16324d-d8ca-49f3-aa8a-f5721ddad96d service nova] Creating event network-changed:b6d1e2b2-34a9-4cea-a23e-66a20792cbc9 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:06:54.132492 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1d56c83b-138d-44ff-ac63-953bbc10dcbf req-cc16324d-d8ca-49f3-aa8a-f5721ddad96d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056251 Oct 17 13:06:54.133041 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1770/3458] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:06:54.292519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:54.303756 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e3291f6-a21c-4100-93c3-618ae65ce380 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.505493 Oct 17 13:06:54.319850 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1689/3459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:53 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:54.324933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:54.325850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:54.334461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:54.335152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:54.335596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:54.336304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:54.336765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:54.337191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:54.454108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:54.454749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:54.471270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:54.474094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:54.474581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:54.475695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:54.482873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:54.485209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:54.909395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:54.919914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:54.932152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:54.933828 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2a0b075e-a1fd-475b-8646-79c90ee5964e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.612702 Oct 17 13:06:54.938220 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1771/3460] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:54 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:54.943580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:54.944193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:54.965065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:54.965573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:54.966025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:54.969707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:54.971526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:54.972064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.037091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.037777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.038533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.039105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lazy-loading 'fault' on Instance uuid 05b3bb7a-3248-4ec0-872f-881e93899d96 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:06:55.117706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1520345a9449d911e8e50518dc78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074335b65a0d4768b27b04dde3980a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:55.146794 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60dab9cc-c9cd-4cc1-9191-7a8506ff8ebc tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 200 len: 1316 microversion: 2.1 time: 0.205376 Oct 17 13:06:55.149695 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1772/3461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:54 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:55.155336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:55.155975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:55.199301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.199832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.210331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.212275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.213041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.213624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.490140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:55.499368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c1d7234c-ce3f-4a53-9984-1f3a6826a534 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1511 microversion: 2.1 time: 1.050158 Oct 17 13:06:55.503287 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1690/3462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:54 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1511 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:55.517322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:55.528905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:55.543092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.543973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.544621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.545685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.546495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.549196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.550595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:55.562499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81bb39b0-6ebb-42dd-91e6-8b1e45cbf4fb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1317 microversion: 2.1 time: 0.411340 Oct 17 13:06:55.562919 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1773/3463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:55 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:55.581955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:55.582660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:55.600887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.601402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.601850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.602810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.603713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.603857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.860502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:55.871106 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd2b0c9f-f748-408d-84c5-4461048b68a1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1511 microversion: 2.1 time: 0.306876 Oct 17 13:06:55.888003 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1774/3464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:55 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:55.897805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:55.898449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:55.905712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.906238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.907154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:55.908506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:55.908999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:55.909432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.150788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:56.166028 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90a0f4a2-3a95-428e-857c-21fa3f083265 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581" status: 200 len: 1511 microversion: 2.1 time: 0.271446 Oct 17 13:06:56.180690 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1775/3465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:55 2022] GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:56.196915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:56.197541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:56.205275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:56.212566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.214743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.215252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.217808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.218365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.218867 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5df7643-a2e0-4fda-930b-547dd512088d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.711619 Oct 17 13:06:56.220036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.221513 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1691/3466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:55 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:56.252151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:56.254378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] [instance: 05b3bb7a-3248-4ec0-872f-881e93899d96] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:56.267050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.267552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.272118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.272933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.273411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.273851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.315927 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] HTTP exception thrown: Instance 05b3bb7a-3248-4ec0-872f-881e93899d96 could not be found. Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Request method failure captured: Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 HTTP/1.1 Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVMenLu05f3SeVTrEgQL2xcNuhJLc1SRWIRpqY5v0BTmCHYJ1FzSlDt7Ok7MZ7Oma57giESvSxY6nXUnx2NjofJX35wO9uv2j-rTZxVDuD2AkzGhiev4y7joUXbVwAktrjP0Lp49irgC4wgvzgD_dgqiUXxDvhvmCmjC_0io8RWgwIM Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 074335b65a0d4768b27b04dde3980a8e Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestFqdnHostnames-1204306934 Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_074335b65a0d4768b27b04dde3980a8e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/074335b65a0d4768b27b04dde3980a8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/074335b65a0d4768b27b04dde3980a8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/074335b65a0d4768b27b04dde3980a8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestFqdnHostnames-1204306934 Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 074335b65a0d4768b27b04dde3980a8e Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1204306934 Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestFqdnHostnames-1204306934-project Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6da1520345a9449d911e8e50518dc78b Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestFqdnHostnames-1204306934-project Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 05b3bb7a-3248-4ec0-872f-881e93899d96 could not be found. Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '05b3bb7a-3248-4ec0-872f-881e93899d96'} Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b3bb7a-3248-4ec0-872f-881e93899d96 could not be found. Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b3bb7a-3248-4ec0-872f-881e93899d96 could not be found. Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:56.319213 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:06:56.322619 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:56.322619 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:56.322619 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:56.322619 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:56.322619 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:56.322619 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b3bb7a-3248-4ec0-872f-881e93899d96 could not be found. Oct 17 13:06:56.322619 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:06:56.324112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Returning 404 to user: Instance 05b3bb7a-3248-4ec0-872f-881e93899d96 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:56.325005 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-526490e6-6c69-4073-8569-5b0c155200c9 tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96" status: 404 len: 111 microversion: 2.1 time: 0.101499 Oct 17 13:06:56.325584 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1692/3467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:56 2022] GET /compute/v2.1/servers/05b3bb7a-3248-4ec0-872f-881e93899d96 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:06:56.331941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-af95a314-d81f-43cd-bfe1-145fcc0688bc req-db691726-fb0a-4e3c-aace-f9dced17d33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b3bb7a-3248-4ec0-872f-881e93899d96", "name": "network-vif-deleted", "tag": "93dd9e1e-bf9c-4a1f-b8f3-f36a697d1757"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:56.343738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-af95a314-d81f-43cd-bfe1-145fcc0688bc req-db691726-fb0a-4e3c-aace-f9dced17d33d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.344544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-af95a314-d81f-43cd-bfe1-145fcc0688bc req-db691726-fb0a-4e3c-aace-f9dced17d33d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.345166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-af95a314-d81f-43cd-bfe1-145fcc0688bc req-db691726-fb0a-4e3c-aace-f9dced17d33d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.384187 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-af95a314-d81f-43cd-bfe1-145fcc0688bc req-db691726-fb0a-4e3c-aace-f9dced17d33d service nova] Creating event network-vif-deleted:93dd9e1e-bf9c-4a1f-b8f3-f36a697d1757 for instance 05b3bb7a-3248-4ec0-872f-881e93899d96 on n-h2-853316-12 Oct 17 13:06:56.395062 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-af95a314-d81f-43cd-bfe1-145fcc0688bc req-db691726-fb0a-4e3c-aace-f9dced17d33d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066450 Oct 17 13:06:56.395908 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1693/3468] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:56.413174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:56.429196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:56.430095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:06:56.475444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.475923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.476390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.477218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.477660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.478094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.648545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:06:56.662393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:56.676711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:56.680859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:56.684591 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69696c93-d926-40bb-b3b1-d551d0acb9d7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.502714 Oct 17 13:06:56.686849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1776/3469] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:56 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:56.697676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c679a7e-1459-43a1-a634-3c6888396cab tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] Calling method '.version_select at 0x7fa82086dd30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:56.737960 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c679a7e-1459-43a1-a634-3c6888396cab tempest-ServersTestFqdnHostnames-1204306934 tempest-ServersTestFqdnHostnames-1204306934-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838335485" status: 202 len: 0 microversion: 2.1 time: 0.049801 Oct 17 13:06:56.738921 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1777/3470] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838335485 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:06:56.761748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:56.762954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:56.777369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:56.782599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.783338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.783968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.809951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.814042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.817636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:56.818507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:56.819110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:56.824049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.102534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:57.119110 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-64546d46-a992-4ae1-b3e3-7634a5ef2022 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1506 microversion: 2.1 time: 0.379027 Oct 17 13:06:57.122537 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1778/3471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:56 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:57.148687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:57.149189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:57.159296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.159900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.160215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.163503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.164132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.164716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.231527 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-efc59beb-875a-4ffc-8c87-975712f61e2c tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762/ips" status: 200 len: 109 microversion: 2.1 time: 0.086871 Oct 17 13:06:57.240837 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1779/3472] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:06:57 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762/ips => generated 109 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:06:57.245733 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ee5ca1c-850a-4122-96c7-b4d805f9c48f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.848394 Oct 17 13:06:57.246204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:57.246695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:57.247024 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1694/3473] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 17 13:06:56 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:57.252457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:57.253188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:57.268393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.268896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.269479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.270087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.270583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.271012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.271131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.271620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.272059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.272761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.273368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.279035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.314849 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-76167352-5d03-41f8-b59a-ce6da2aa2b0d tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762/ips" status: 200 len: 109 microversion: 2.1 time: 0.072577 Oct 17 13:06:57.326893 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1780/3474] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:06:57 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762/ips => generated 109 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:57.331778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:57.347011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:57.348106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1778522119', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:06:57.360153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.364176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.364711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.365542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.366760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.367507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.533432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:06:57.623107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:57.633961 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ab86dda-7501-45b2-890a-2cfc45bc9274 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.385812 Oct 17 13:06:57.645740 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1695/3475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:57 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:57.650782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:57.651381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:57.663543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.664133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.664659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.671606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.672374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.672970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.713391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:57.717569 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9bfd1f3-b9fd-439d-8e77-77f786526ce5 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762/ips/tempest-ServerAddressesTestJSON-1762937505-network" status: 200 len: 94 microversion: 2.1 time: 0.070376 Oct 17 13:06:57.725783 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1696/3476] 10.222.0.27 () {58 vars in 1401 bytes} [Mon Oct 17 13:06:57 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762/ips/tempest-ServerAddressesTestJSON-1762937505-network => generated 94 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:06:57.731105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:57.731960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:57.736686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.737194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.737660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.739790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.740494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.741136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:57.742060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:57.742753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:57.748984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.096652 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9cbf505-58b5-461f-be3f-213f5cef973f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1778522119" status: 200 len: 1514 microversion: 2.1 time: 0.768438 Oct 17 13:06:58.111021 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1781/3477] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 13:06:57 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1778522119 => generated 1514 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:58.124523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:58.126457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:58.153626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.156867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.157526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.158373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.161028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.161591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.216855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:06:58.315297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:58.326927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:58.336384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:58.337912 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c49ff3c-4b1b-4118-bc2d-59ca6a9a1d6b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.610880 Oct 17 13:06:58.340543 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1697/3478] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:57 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:58.347227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:58.360045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:58.367735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:06:58.388610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.392471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.393325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.394900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.399664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.400418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.421739 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-22a82f43-2de5-40b1-b8d7-6b65c14a09f2 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 204 len: 0 microversion: 2.1 time: 0.308205 Oct 17 13:06:58.423135 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1782/3479] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:06:58 2022] DELETE /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:06:58.429775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7b2f3e16-2461-4521-ba1d-8283b43304d8 req-4f83fff0-310f-4958-8871-fbefa388b420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8", "name": "network-vif-plugged", "status": "completed", "tag": "7b8a1e49-f76d-443e-bb48-2b56a2f21443"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:58.447709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7b2f3e16-2461-4521-ba1d-8283b43304d8 req-4f83fff0-310f-4958-8871-fbefa388b420 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.448323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7b2f3e16-2461-4521-ba1d-8283b43304d8 req-4f83fff0-310f-4958-8871-fbefa388b420 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.451142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7b2f3e16-2461-4521-ba1d-8283b43304d8 req-4f83fff0-310f-4958-8871-fbefa388b420 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.488731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7b2f3e16-2461-4521-ba1d-8283b43304d8 req-4f83fff0-310f-4958-8871-fbefa388b420 service nova] Creating event network-vif-plugged:7b8a1e49-f76d-443e-bb48-2b56a2f21443 for instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 on n-h1-853316-12 Oct 17 13:06:58.502182 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7b2f3e16-2461-4521-ba1d-8283b43304d8 req-4f83fff0-310f-4958-8871-fbefa388b420 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077414 Oct 17 13:06:58.505143 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1783/3480] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:58.517900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:58.519846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:58.533305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.534816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.535763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.536807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.537385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.537992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.567527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:06:58.703130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:58.731464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:58.740045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.740525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.740979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.766419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:58.774796 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c8e06b4-56c2-4930-8f6b-648ba1990b52 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1512 microversion: 2.1 time: 0.264102 Oct 17 13:06:58.780839 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1784/3481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:58 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:58.787063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-882f667e-c31a-44b0-af8f-7407fa0cea1b req-92d2eb8c-9c2c-420d-a605-149ee85d20e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "tag": "037a67ef-17b4-4934-9932-ff5de09b20a1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:58.796922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-882f667e-c31a-44b0-af8f-7407fa0cea1b req-92d2eb8c-9c2c-420d-a605-149ee85d20e9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.797502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-882f667e-c31a-44b0-af8f-7407fa0cea1b req-92d2eb8c-9c2c-420d-a605-149ee85d20e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.798062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-882f667e-c31a-44b0-af8f-7407fa0cea1b req-92d2eb8c-9c2c-420d-a605-149ee85d20e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.814432 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-882f667e-c31a-44b0-af8f-7407fa0cea1b req-92d2eb8c-9c2c-420d-a605-149ee85d20e9 service nova] Creating event network-changed:037a67ef-17b4-4934-9932-ff5de09b20a1 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:06:58.821661 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-882f667e-c31a-44b0-af8f-7407fa0cea1b req-92d2eb8c-9c2c-420d-a605-149ee85d20e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039186 Oct 17 13:06:58.823677 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1785/3482] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:58.830623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:58.831518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:58.839575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.840529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.841125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:58.842020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:58.844017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:58.844821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:59.144964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:59.165729 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af604471-fef2-40be-9687-ab377e70b19a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.332455 Oct 17 13:06:59.166704 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1786/3483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:58 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:59.374261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:59.381043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:59.391814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:59.398629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:59.399169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:59.400048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:59.400523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:59.400949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:59.438925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:59.467987 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-409e8545-f54a-4e87-bce9-471fe8c84f3a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 1.125610 Oct 17 13:06:59.468761 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1698/3484] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 17 13:06:58 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:59.500326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:59.505349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:59.505803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.compute.servers [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Removing options 'limit' from query {{(pid=127539) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:06:59.506620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:06:59.522573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:59.523327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:59.523916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:59.524825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:59.525432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:59.526011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:59.603012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:59.623325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:59.624800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:59.625399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:59.758323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:59.770994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:59.772403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:06:59.773560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8f11adca-443d-4e92-af4b-da593358009b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.404232 Oct 17 13:06:59.775804 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1787/3485] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:06:59 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:59.803451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:59.808424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:06:59.817357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:59.819879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:59.820433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:59.826792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:06:59.826792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:06:59.826792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:06:59.826792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:00.072920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:00.082294 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-293271c1-29f1-446b-a70f-39fde306d373 tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1512 microversion: 2.1 time: 0.283454 Oct 17 13:07:00.083563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1788/3486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:06:59 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:00.191643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:00.192712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:00.206005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:00.207753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:00.207753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:00.209620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:00.213159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:00.213341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:00.305495 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-05d54d54-d8cb-4742-8e93-8ffbedae15c1 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.809018 Oct 17 13:07:00.322400 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1699/3487] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 13:06:59 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:00.341486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:00.348057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:00.351789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:00.368122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:00.368619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:00.369061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:00.369797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:00.370283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:00.370714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:00.502141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:00.811451 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-508abf7b-441f-4a50-bc17-8e4e292a5c84 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.474637 Oct 17 13:07:00.812274 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1700/3488] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 13:07:00 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:00.817734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:00.819715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:00.829254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:00.831895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:00.833068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:00.833630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:00.834484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:00.835179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:00.835562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.035368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.043549 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85e53d51-354b-4ff9-9951-1ed06b321fab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1312 microversion: 2.1 time: 0.856054 Oct 17 13:07:01.044339 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1789/3489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:00 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1312 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:01.054793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:01.069373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.069844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.servers [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Removing options 'limit' from query {{(pid=127540) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:07:01.070704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:01.084272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.085222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.085857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.086809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.087448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.088094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.134015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:01.215912 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5e40e4ed-2c89-472a-bd1e-c2da85c004b5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.168043 Oct 17 13:07:01.220504 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1790/3490] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 17 13:07:01 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:01.227610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d0d63fa7-d4b1-4fa8-a834-26368bce4991 req-e48e3f2c-163f-4e9e-950f-faa52ce8f255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e855c4-4ab2-4063-94ff-f8eb397f2762", "name": "network-vif-deleted", "tag": "6f579db8-d79a-4fc7-84a4-cd4d062ad343"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:01.243111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d0d63fa7-d4b1-4fa8-a834-26368bce4991 req-e48e3f2c-163f-4e9e-950f-faa52ce8f255 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.243969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d0d63fa7-d4b1-4fa8-a834-26368bce4991 req-e48e3f2c-163f-4e9e-950f-faa52ce8f255 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.244680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d0d63fa7-d4b1-4fa8-a834-26368bce4991 req-e48e3f2c-163f-4e9e-950f-faa52ce8f255 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.258724 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d0d63fa7-d4b1-4fa8-a834-26368bce4991 req-e48e3f2c-163f-4e9e-950f-faa52ce8f255 service nova] Creating event network-vif-deleted:6f579db8-d79a-4fc7-84a4-cd4d062ad343 for instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 on n-h1-853316-12 Oct 17 13:07:01.264295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d0d63fa7-d4b1-4fa8-a834-26368bce4991 req-e48e3f2c-163f-4e9e-950f-faa52ce8f255 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042023 Oct 17 13:07:01.265144 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1791/3491] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:01.272443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:01.273365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:01.282464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.283328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.284282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.285740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.286746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.287421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.391298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.404282 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2aa5a1dd-66f5-4dc9-86ab-946d40dcd59a tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1302 microversion: 2.1 time: 0.137163 Oct 17 13:07:01.406181 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1792/3492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:01 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:01.411478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:01.418039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.419459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:01.427869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.428451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.429191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.430132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.430953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.432908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.454033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.468529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.473117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.474339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:01.476502 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b973c47-0e55-468d-89d7-ca9e83241d6e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.663221 Oct 17 13:07:01.477205 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1701/3493] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:00 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:01.489851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b993c960-18fa-428b-834d-8472f2cc5a61 req-d6a8fe49-13b5-4168-8c65-0f4ee4e7a8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "tag": "3796462d-86a6-4308-9740-cc052a3080f5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:01.513815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b993c960-18fa-428b-834d-8472f2cc5a61 req-d6a8fe49-13b5-4168-8c65-0f4ee4e7a8db service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.514934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b993c960-18fa-428b-834d-8472f2cc5a61 req-d6a8fe49-13b5-4168-8c65-0f4ee4e7a8db service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.515381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b993c960-18fa-428b-834d-8472f2cc5a61 req-d6a8fe49-13b5-4168-8c65-0f4ee4e7a8db service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.537129 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55b63712-45a4-44d9-a8a0-c5beeda1bd04 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.130090 Oct 17 13:07:01.537945 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1793/3494] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 13:07:01 2022] GET /compute/v2.1/servers => generated 1010 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:01.540903 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b993c960-18fa-428b-834d-8472f2cc5a61 req-d6a8fe49-13b5-4168-8c65-0f4ee4e7a8db service nova] Creating event network-changed:3796462d-86a6-4308-9740-cc052a3080f5 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:01.551417 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b993c960-18fa-428b-834d-8472f2cc5a61 req-d6a8fe49-13b5-4168-8c65-0f4ee4e7a8db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070284 Oct 17 13:07:01.554692 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1702/3495] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:01.580453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:01.586278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.586958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:01.608633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.609267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.609661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.610502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.611036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.616892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.727100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:01.876007 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b4d1eac3-b76d-47f1-9d7a-6e77f66d12b0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.325414 Oct 17 13:07:01.877191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1794/3496] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:07:01 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:01.895071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:01.916310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:01.916932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.compute.servers [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Removing options 'limit' from query {{(pid=127539) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:07:01.918224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:01.926537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.927370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.927864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.929346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:01.930755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:01.931677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:01.997853 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d77d794-b316-486f-818d-6733757485cd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.111079 Oct 17 13:07:02.007220 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1703/3497] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 17 13:07:01 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:02.012684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:02.027115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:02.029212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1778522119', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:02.041892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.043752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.045137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.047084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.048067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.048695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.072255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:02.073349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:02.083849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.090093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.090794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.091629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.092634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.093141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.198900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:02.267491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1fc5295e-2bd2-4a34-bead-16a4d4ed8e59 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1778522119" status: 200 len: 346 microversion: 2.1 time: 0.259178 Oct 17 13:07:02.269140 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1795/3498] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 13:07:02 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1778522119 => generated 346 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:02.283774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b5fb28f1-90d7-4e08-9419-707eaea5c4a3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:02.293907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fb28f1-90d7-4e08-9419-707eaea5c4a3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.294639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fb28f1-90d7-4e08-9419-707eaea5c4a3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.296188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fb28f1-90d7-4e08-9419-707eaea5c4a3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.390894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b5fb28f1-90d7-4e08-9419-707eaea5c4a3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Going to try to stop instance {{(pid=127540) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:07:02.458055 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b5fb28f1-90d7-4e08-9419-707eaea5c4a3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "POST /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d/action" status: 202 len: 0 microversion: 2.1 time: 0.179653 Oct 17 13:07:02.459389 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1796/3499] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:07:02 2022] POST /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:07:02.467459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:02.470205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:02.477366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.478384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.479031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.480516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.481450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.482105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.574013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.576249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.576823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.577651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lazy-loading 'fault' on Instance uuid a3e855c4-4ab2-4063-94ff-f8eb397f2762 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:07:02.638911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cbc6b9dc024e729dc501e856cb9a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a88114f847460c96faf8a0b3c92f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:02.649129 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f1d7707f-8bfb-4099-810e-ac58c42d81bb tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 200 len: 1307 microversion: 2.1 time: 0.187488 Oct 17 13:07:02.650143 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1797/3500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:02 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 1307 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:02.655695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:02.656288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:02.663114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.663833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.664040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.665302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.665772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.666276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.670855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:02.687466 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f76e31bc-c51b-41a9-aae9-ec3ad2ab074d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1460 microversion: 2.1 time: 0.620183 Oct 17 13:07:02.688372 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1704/3501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:02 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1460 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:02.693436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:02.694048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:02.706033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.710693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.711703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.712589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:02.715033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:02.715653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:02.921302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:02.933745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bed36b24-fee2-4aec-a2fa-04d3fcf5786b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1521 microversion: 2.1 time: 0.282189 Oct 17 13:07:02.934729 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1798/3502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:02 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:03.487566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:03.490120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:03.515174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:03.516731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:03.517634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:03.519149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:03.520056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:03.521250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:03.945606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:03.969176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:03.970691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:03.971898 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0851c415-8018-4219-ab81-467f49905f4f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 1.282500 Oct 17 13:07:03.972452 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1705/3503] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:02 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:03.995547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:03.996638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] [instance: a3e855c4-4ab2-4063-94ff-f8eb397f2762] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:04.015672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:04.016410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:04.017223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:04.023073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:04.023776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:04.024394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:04.066490 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] HTTP exception thrown: Instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 could not be found. Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Request method failure captured: Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 HTTP/1.1 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVNWJ7TBOfo62nvwd4X5jS6tkggpAlX64Vuoaf30cst_vD5om8o7YF9s18qpI5k_n51wAlxuMkxz7ZW1urr6QLZdPDRMbRNB2lp7cOBNwC7Cb0HpK4ZnzAgrq367p-ycqDBkQzsEPPGimJFnZLK-bWgQOqgAz5gJElaNde-k0lnx5pc Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 95a88114f847460c96faf8a0b3c92f09 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerAddressesTestJSON-499740590 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95a88114f847460c96faf8a0b3c92f09", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95a88114f847460c96faf8a0b3c92f09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95a88114f847460c96faf8a0b3c92f09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95a88114f847460c96faf8a0b3c92f09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerAddressesTestJSON-499740590 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 95a88114f847460c96faf8a0b3c92f09 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerAddressesTestJSON-499740590 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerAddressesTestJSON-499740590-project Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 28cbc6b9dc024e729dc501e856cb9a34 Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerAddressesTestJSON-499740590-project Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 could not be found. Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a3e855c4-4ab2-4063-94ff-f8eb397f2762'} Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 could not be found. Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 could not be found. Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:07:04.068482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 could not be found. Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] Returning 404 to user: Instance a3e855c4-4ab2-4063-94ff-f8eb397f2762 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:07:04.072523 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b1dd0a5a-4753-4ca4-beab-82f0b3e3555e tempest-ServerAddressesTestJSON-499740590 tempest-ServerAddressesTestJSON-499740590-project] 10.222.0.27 "GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762" status: 404 len: 111 microversion: 2.1 time: 0.090815 Oct 17 13:07:04.077651 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1706/3504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:03 2022] GET /compute/v2.1/servers/a3e855c4-4ab2-4063-94ff-f8eb397f2762 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:07:04.090801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:04.091437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:04.096539 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4861a9a1-a110-4879-b00a-90d0efdf3ac0 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1613 microversion: 2.1 time: 1.132434 Oct 17 13:07:04.097512 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1799/3505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:02 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1613 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:04.127315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:04.127826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:04.128273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:04.128990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:04.129448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:04.129875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:04.137363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:04.139749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:04.163154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:04.167018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:04.167524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:04.168392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:04.168755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:04.169184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:04.274012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1706bfe90cd844d185fa7dab5710aeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc3a31ede2646df90496d5ecf55b835', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:04.274679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] flavor_id is None. Assuming migration. {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 13:07:04.275362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:07:04.594141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:04.631377 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d488d8aa-2c2b-4eff-9a3a-178ef9a58232 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8/action" status: 202 len: 0 microversion: 2.1 time: 0.508588 Oct 17 13:07:04.632912 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1800/3506] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:07:04 2022] POST /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:07:04.641333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:04.642371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:04.651819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:04.652862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:04.654233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:04.656523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:04.657383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:04.658249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:04.719482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:04.729950 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff26f40f-ff8f-4c70-b1b9-6fdbc408cdd7 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1521 microversion: 2.1 time: 0.654349 Oct 17 13:07:04.741281 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1707/3507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:04 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1521 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:04.970199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:04.984168 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0db9df28-f53e-4854-a386-8faeac93b076 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1469 microversion: 2.1 time: 0.346051 Oct 17 13:07:04.986196 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1801/3508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:04 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:05.009613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:05.010835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:05.017896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:05.018686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:05.019282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:05.020223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:05.020891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:05.021552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:05.273374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-46d5df3d-ae8e-491d-a531-f669a910c8a0 req-44654440-980b-4770-9b28-b0ad3377eb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "tag": "800b13ad-79c1-429e-ab7f-36ad171e6e50"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:05.294285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-46d5df3d-ae8e-491d-a531-f669a910c8a0 req-44654440-980b-4770-9b28-b0ad3377eb4a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:05.294830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-46d5df3d-ae8e-491d-a531-f669a910c8a0 req-44654440-980b-4770-9b28-b0ad3377eb4a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:05.311336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-46d5df3d-ae8e-491d-a531-f669a910c8a0 req-44654440-980b-4770-9b28-b0ad3377eb4a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:05.335529 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-46d5df3d-ae8e-491d-a531-f669a910c8a0 req-44654440-980b-4770-9b28-b0ad3377eb4a service nova] Creating event network-changed:800b13ad-79c1-429e-ab7f-36ad171e6e50 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:05.346203 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-46d5df3d-ae8e-491d-a531-f669a910c8a0 req-44654440-980b-4770-9b28-b0ad3377eb4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078238 Oct 17 13:07:05.347677 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1802/3509] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:07:05.760453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:05.767163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:05.777662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:05.778713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:05.791493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:05.800664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:05.801802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:05.811393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:05.976218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:05.995593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:05.999073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:06.005324 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c49003a1-d5f3-414f-93d6-c5b37e694b88 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 1.002698 Oct 17 13:07:06.007110 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1708/3510] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:04 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:06.037352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:06.040005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:06.060872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:06.061931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:06.062742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:06.064389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:06.064990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:06.065585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:06.461233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:06.472661 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e0bcd912-0a07-41ad-8ff5-fd989a8fa86b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1521 microversion: 2.1 time: 0.720249 Oct 17 13:07:06.473738 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1803/3511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:05 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1521 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:06.489292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:06.501675 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a1299c6d-4dd9-4f13-8467-8d22ff2d7fb3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1469 microversion: 2.1 time: 0.492500 Oct 17 13:07:06.504187 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1709/3512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:06 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1469 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:07.036858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:07.037220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:07.050324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:07.051064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:07.051686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:07.052548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:07.053151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:07.055579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:07.470652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:07.481570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:07.485067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:07.491609 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2fdcf8f-6297-4a48-a800-d8f2965ffb2f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.458901 Oct 17 13:07:07.492733 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1804/3513] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:07 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:07.511843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:07.513146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:07.528746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:07.529781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:07.534985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:07.535968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:07.537692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:07.538195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:07.538650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:07.539353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:07.539806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:07.540441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:07.541331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:07.541961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:07.542568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:07.544545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:07.968662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:08.283805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:08.297355 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e82be4cf-798c-480f-a81c-bc713d34dd8a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1469 microversion: 2.1 time: 0.772376 Oct 17 13:07:08.298467 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1805/3514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:07 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1469 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:08.527791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:08.528413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:08.539426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:08.543965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:08.545592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:08.547089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:08.547817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:08.548501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:08.728731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:08.762603 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7b0dc6f-deb9-44f2-84eb-c146ed6c1cd3 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1521 microversion: 2.1 time: 1.248208 Oct 17 13:07:08.762603 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1710/3515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:07 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1521 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:09.323413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:09.324228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:09.336779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:09.337281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:09.343669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:09.349071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:09.349587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:09.350045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:09.356985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:09.370889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:09.372517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:09.375345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a4b31791-9cd3-458c-bd56-8be98ea8077d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.850846 Oct 17 13:07:09.393352 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1806/3516] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:08 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:07:09.601284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:09.779099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:09.786780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:09.793545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:09.794283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:09.794870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:09.796524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:09.797270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:09.797865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:10.018142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:10.042837 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-253bbf98-98f5-4e75-a4d9-013d6b72e6b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1521 microversion: 2.1 time: 0.267560 Oct 17 13:07:10.045970 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1807/3517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:09 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:10.198079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:10.209468 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d31a675e-c218-4e25-b6de-255149c4e76c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1469 microversion: 2.1 time: 0.892194 Oct 17 13:07:10.215454 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1711/3518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:09 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1469 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:10.411011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:10.412493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:10.424401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:10.431365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:10.434502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:10.439553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:10.440704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:10.443658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:11.012977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:11.027527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:11.030075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:11.032479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-330eee51-aaf4-4a88-81ff-902e16bfe986 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.626792 Oct 17 13:07:11.033808 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1808/3519] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:10 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:07:11.074722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:11.075882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:11.094782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:11.095835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:11.098183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:11.099878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:11.101941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:11.102753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:11.157933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:11.158976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:11.168764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:11.171692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:11.173738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:11.174910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:11.176581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:11.177949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:11.220268 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad08f075-a787-4bc5-a218-05e9b07594f8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.066838 Oct 17 13:07:11.221482 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1809/3520] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 17 13:07:11 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07/os-server-password => generated 116 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:07:11.241233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:11.242230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:11.252979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:11.253821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:11.256080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:11.256910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:11.258418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:11.259088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:11.497786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:11.526302 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8c361bf-1586-42e6-9608-9ea52c78ab95 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1521 microversion: 2.1 time: 0.455202 Oct 17 13:07:11.527273 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1712/3521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:11 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:11.721468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:11.739091 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d0dd60c-685b-473b-a313-817dc6e95b0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.503706 Oct 17 13:07:11.739894 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1810/3522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:11 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:12.062861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:12.063836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:12.065859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:12.079075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:12.080388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:12.082712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:12.083688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:12.086930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:12.089380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:12.551979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:12.553516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:12.562356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:12.569857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:12.570837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:12.571591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:12.572623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:12.573664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:12.574484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:12.606560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:12.628344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:12.633263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:12.638003 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0d2fddc9-ddd4-492e-a82c-a08a0015ab95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.580163 Oct 17 13:07:12.645146 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1713/3523] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:12 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:12.767274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:12.768187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:12.781221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:12.790957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:12.791647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:12.792664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:12.793277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:12.793858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:12.885719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:12.912184 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6676a00-e33a-4c05-a550-fdd35f5ed989 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1521 microversion: 2.1 time: 0.364796 Oct 17 13:07:12.921083 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1811/3524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:12 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:13.668897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:13.669511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:13.684387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:13.684896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:13.685346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:13.686355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:13.686824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:13.691342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:13.935747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:13.948029 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa7d81d7-2827-49cc-a299-88c2f2399b63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 1.186810 Oct 17 13:07:13.951188 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1714/3525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:12 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:13.967513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:13.968490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:13.980468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:13.981048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:13.985941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:13.989355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:13.990051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:13.992013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:14.091304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:14.108234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:14.110949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:14.116075 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50cd9e6c-5acf-4b07-96c0-259f6708d8e6 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.451097 Oct 17 13:07:14.119125 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1812/3526] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:13 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:07:14.549370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:14.564486 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67e60408-1897-4303-afc6-14e2bc40b85a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1498 microversion: 2.1 time: 0.610425 Oct 17 13:07:14.567515 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1715/3527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:13 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1498 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:14.593517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:14.600592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:14.608171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:14.620568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:14.621623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:14.622519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:14.624899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:14.625572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:14.626363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:14.677245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:14.730592 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c6e6853-d086-474b-9bb8-d7642274376b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.143499 Oct 17 13:07:14.731831 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1813/3528] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Oct 17 13:07:14 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:14.744858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62cde2fa-e4b7-40c4-94e6-36d9ec1c986b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:14.756001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cde2fa-e4b7-40c4-94e6-36d9ec1c986b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:14.756510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cde2fa-e4b7-40c4-94e6-36d9ec1c986b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:14.757000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cde2fa-e4b7-40c4-94e6-36d9ec1c986b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:14.815597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62cde2fa-e4b7-40c4-94e6-36d9ec1c986b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Going to try to start instance {{(pid=127539) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:07:14.893987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:14.949968 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62cde2fa-e4b7-40c4-94e6-36d9ec1c986b tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "POST /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d/action" status: 202 len: 0 microversion: 2.1 time: 0.209033 Oct 17 13:07:14.955658 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1716/3529] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:07:14 2022] POST /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:07:14.965968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:14.966758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:14.981981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:14.985226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:14.985702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:14.986609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:14.987087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:14.987531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:14.997138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:15.002800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:15.024165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:15.024800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:15.025375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:15.026333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:15.028114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:15.028698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:15.415899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:15.426051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c9318a8f-a719-4a45-ad08-e7fb8e1fecbd tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1507 microversion: 2.1 time: 0.465191 Oct 17 13:07:15.426680 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1814/3530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:14 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:15.434433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:15.435048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:15.444934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:15.445908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:15.446686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:15.447793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:15.449012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:15.449915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:15.679570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:15.690395 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-778a9d92-79f8-489e-8a86-29ded57daf07 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.714104 Oct 17 13:07:15.696772 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1717/3531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:14 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:15.873032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:15.890018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:15.891582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:15.897852 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a527e523-1e9b-4fbe-a64b-04558e4a11f4 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.465098 Oct 17 13:07:15.899162 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1815/3532] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:15 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:16.454085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:16.455455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:16.463162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:16.464107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:16.464758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:16.479721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:16.480551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:16.481453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:16.726368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:16.727109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:16.744929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:16.750948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:16.752706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:16.753905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:16.753905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:16.756317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:17.066806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:17.089685 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd13a9f7-4f71-4c3e-969e-6541c54dc448 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.367323 Oct 17 13:07:17.091735 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1816/3533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:16 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:17.102032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:17.104490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:17.120862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:17.123571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:17.125355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:17.127708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:17.128923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:17.129803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:17.130957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:17.143962 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-88abd9d0-c7e5-4c61-8ec5-b292cc35b314 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1507 microversion: 2.1 time: 0.694705 Oct 17 13:07:17.147646 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1718/3534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:16 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1507 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:17.515263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:17.517945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:17.526972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:17.539688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:17.541267 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00854588-e302-44bf-8258-e97ca7ef50f0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.447224 Oct 17 13:07:17.542267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1817/3535] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:17 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:18.114406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:18.115099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:18.126390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:18.127146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:18.135391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:18.136420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:18.137311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:18.138362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:18.181051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:18.181677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:18.206802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:18.207340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:18.208139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:18.209184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:18.209648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:18.210079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:18.585875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:18.600238 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec22f040-f128-4eb7-ac60-ea8aebd85397 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1507 microversion: 2.1 time: 0.429888 Oct 17 13:07:18.617633 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1818/3536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:18 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1507 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:18.625338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:18.627502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:18.652743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:18.653668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:18.656328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:18.659170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:18.662144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:18.662904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:19.070377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:19.083274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:19.085687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:19.087277 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee7d38ba-8e75-4f83-8cfa-84a891098c5a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.467651 Oct 17 13:07:19.088033 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1819/3537] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:18 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:19.181699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:19.196636 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a07c4a67-caa0-414c-af59-cef52cb177d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 1.086222 Oct 17 13:07:19.211829 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1719/3538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:18 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:19.631990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:19.632614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:19.645546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:19.646381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:19.646832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:19.650628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:19.651480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:19.651877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:19.954516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:19.971812 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e10ef022-425a-4f84-b1eb-a9f3043a0547 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1511 microversion: 2.1 time: 0.340342 Oct 17 13:07:19.973067 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1820/3539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:19 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:20.000300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:20.020703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:20.024861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.compute.servers [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Removing options 'limit' from query {{(pid=127539) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:07:20.027213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:20.031841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.032349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.032798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.039595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.040089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.040535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.042990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c8b13a8-4448-49e4-a21f-d6bcc1df66d6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.049820 Oct 17 13:07:20.052028 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1720/3540] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 17 13:07:19 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:07:20.057237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:20.058061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:20.078470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.079256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.087229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.088312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.089207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.089741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.114801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:20.115778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:20.130105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.130633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.131071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.131780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.132320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.134741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.330045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:20.344244 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0dbc2e6b-7b53-4473-b8d6-d5c0ad990910 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1511 microversion: 2.1 time: 0.290978 Oct 17 13:07:20.344849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1821/3541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:20 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1511 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:20.356250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:20.357065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:20.375024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.375522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.376125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.377017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.377650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.378086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.747226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:20.760744 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-068d3ee0-4f1f-48a8-9fd2-0096c321a258 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.414645 Oct 17 13:07:20.776303 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1822/3542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:20 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:20.776859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:20.777334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:20.795364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.798261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.799067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.801601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:20.802712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:20.803969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:20.804977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:20.814933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:20.829419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:20.841000 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fef777eb-41f0-4b28-88b9-0423dd321b59 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.729913 Oct 17 13:07:20.858196 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1721/3543] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:20 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:07:21.261694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:21.273731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65c85349-9ff4-4ef1-99e3-6d985825032f tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581" status: 200 len: 1511 microversion: 2.1 time: 0.511346 Oct 17 13:07:21.274345 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1823/3544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:20 2022] GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 => generated 1511 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:21.298731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:21.299857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:21.309951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:21.310836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:21.311470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:21.321109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:21.321604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:21.322054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:21.687345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:21.705782 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-154766d3-27c6-4deb-a3ab-3bb4b7365045 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1511 microversion: 2.1 time: 0.411673 Oct 17 13:07:21.718931 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1722/3545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:21 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:21.731821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:21.738426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:21.743101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:21.783931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:21.784772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:21.801842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:21.804666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:21.807082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:21.808056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:21.809524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:21.811246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:22.019773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:22.020861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:22.021522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:22.022489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:22.023732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:22.024648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:22.055490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:22.068611 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c08efdc3-48f7-4738-82af-a9112b43988c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.289219 Oct 17 13:07:22.069217 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1723/3546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:21 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:22.089854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:22.090718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:22.112486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:22.116452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:22.117113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:22.119248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:22.123658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:22.124429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:22.180917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:22.299996 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b6054a9-6245-4c70-8fef-4fb369eae576 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.571762 Oct 17 13:07:22.301537 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1824/3547] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Oct 17 13:07:21 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:22.319143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:22.321782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:22.329520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:22.330467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:22.331661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:22.332155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:22.332802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:22.333450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:22.651673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:22.669040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:22.671585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:22.673022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5df20f7a-9178-4e56-9402-37b38eb0000e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.598200 Oct 17 13:07:22.674997 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1724/3548] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:22 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:22.762318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:22.776900 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bfb22817-a237-4bb7-b7f9-bfdae6b5b3ea tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1511 microversion: 2.1 time: 0.463909 Oct 17 13:07:22.777816 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1825/3549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:22 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:22.807455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:22.808080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:22.815141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:22.815639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:22.816085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:22.816800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:22.817527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:22.817959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.102348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:23.119061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:23.135281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:23.136198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:23.155373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.157539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:23.160057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:23.161210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.186006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:23.200036 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4d2c50ea-e620-49b7-bf71-28271d962c51 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581" status: 200 len: 1511 microversion: 2.1 time: 0.396482 Oct 17 13:07:23.202842 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1725/3550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:22 2022] GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:23.228300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:23.229800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:23.244348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:23.244856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:23.245312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.246036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:23.246524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:23.246955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.592999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:23.610029 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cdaa4a7a-61d6-4cbe-ad3e-583af04463c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.512595 Oct 17 13:07:23.611321 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1826/3551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:23 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:23.673192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:23.701423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:23.702230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:23.702802 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ea1daf49-c8c5-4b62-8920-cdc0122fddc6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1511 microversion: 2.1 time: 0.478406 Oct 17 13:07:23.710366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:23.715947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:23.716513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.717879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:23.718330 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1726/3552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:23 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:23.720585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:23.721562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.736998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:23.753076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:23.754082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:23.762548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:23.777338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:23.777883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.781840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:23.782393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:23.782845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:23.892360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:24.017192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:24.040703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:24.041208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:24.041658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:24.462248 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b2872d30-ed82-467d-ba57-f32d7d04fe69 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.727752 Oct 17 13:07:24.462248 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1727/3553] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:07:23 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:24.480614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:24.485796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:24.490008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:24.676867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:24.683593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:24.684074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:24.684904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:24.685390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:24.685957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:24.889769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:24.906193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:24.909349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:24.911129 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6e3b1d00-320c-4398-8a55-f7cce57117e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 1.213576 Oct 17 13:07:24.912870 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1827/3554] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:23 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:07:24.923626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:24.924452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:24.944559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:24.945405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:24.946018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:24.947024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:24.947630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:24.948277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:24.950309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:25.089492 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8f80c43b-b92c-44ac-8c25-bc913c83f1c5 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.612583 Oct 17 13:07:25.090501 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1728/3555] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 17 13:07:24 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:25.108619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:25.119729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:25.120928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:25.135615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:25.136522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:25.137165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:25.138145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:25.138798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:25.139339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:25.331945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:25.340780 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f315f2d-bdbc-4d50-8863-6c185330085e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.426103 Oct 17 13:07:25.345111 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1828/3556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:24 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:25.362439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:25.455952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ad34ca3-d5df-4bc4-baad-959e0dc184a9 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.354480 Oct 17 13:07:25.457211 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1729/3557] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 17 13:07:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:25.469839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:25.480827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:25.481561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:25.499033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:25.499460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:25.499904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:25.500804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:25.501267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:25.502676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:25.685916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:25.848622 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a98f03d1-6847-44bc-ac60-f2ce2c3f2985 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.383127 Oct 17 13:07:25.850355 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1829/3558] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Oct 17 13:07:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:25.861770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:25.867148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:25.869645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'name': '1778522119', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:25.893322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:25.894216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:25.894679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:25.895672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:25.896084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:25.896546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:25.945117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:25.946436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:25.957034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:25.967003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:25.969542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:25.970613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:25.974746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:25.975441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:26.088329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:26.173433 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-33782c35-e37f-4d6f-a70b-2925683fbf0d tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?name=1778522119" status: 200 len: 346 microversion: 2.1 time: 0.315029 Oct 17 13:07:26.176081 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1730/3559] 10.222.0.27 () {58 vars in 1156 bytes} [Mon Oct 17 13:07:25 2022] GET /compute/v2.1/servers?name=1778522119 => generated 346 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:26.190193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:26.201872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:26.204881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:26.218207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:26.220679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:26.221150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:26.224004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:26.224496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:26.224934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:26.436929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:26.442250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:26.502624 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3567e56c-ffc7-41ad-a0f1-7e5fc136c1b6 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.316620 Oct 17 13:07:26.513192 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1731/3560] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Oct 17 13:07:26 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:26.519579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:26.521057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:26.527781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:26.528445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:26.529089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:26.530524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:26.531230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:26.531815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:26.829956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:26.848455 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-11e13ae3-1072-4d40-a0fd-d5d764aafdb4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.330862 Oct 17 13:07:26.849575 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1732/3561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:26 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:26.863834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:26.874440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:26.881363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:26.883040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-177852211', 'deleted': False, 'project_id': '7f9efeec2227498c99ae1763625fd0d9'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:07:26.892886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:26.899191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:26.899191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:26.899191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:26.900737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:26.901516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:26.902965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:26.903195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:26.904639 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af08167b-4e65-45fe-9dc7-b78743a3e5bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.963686 Oct 17 13:07:26.907613 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1830/3562] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:25 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:07:27.174374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:07:27.383903 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5a3140b7-4738-4255-a462-efc59fcabeff tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-177852211" status: 200 len: 346 microversion: 2.1 time: 0.532701 Oct 17 13:07:27.384512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1733/3563] 10.222.0.27 () {58 vars in 1228 bytes} [Mon Oct 17 13:07:26 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-177852211 => generated 346 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:27.403380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:27.405028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:27.420458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:27.420977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:27.421417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:27.422138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:27.427714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:27.428791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:27.537859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:07:27.718063 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2a3245cc-a031-4c50-b2ea-e84d6ba9987a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 204 len: 0 microversion: 2.1 time: 0.321755 Oct 17 13:07:27.722811 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1831/3564] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:07:27 2022] DELETE /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:07:27.727069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:27.727700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:27.747281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:27.747788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:27.748310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:27.749135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:27.749581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:27.750040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:27.881205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:27.882767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:27.920941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:27.921761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:27.922945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:27.925448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:27.926971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:27.927635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:28.024292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:28.459954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:28.474350 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-027472f3-ab47-43c3-b689-ca39776c5070 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1517 microversion: 2.1 time: 0.747041 Oct 17 13:07:28.475208 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1734/3565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:27 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1517 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:28.492112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:28.494629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:28.503470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:28.513414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:28.514473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:28.520194 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46ef1ddc-bba1-4794-97d2-3f68a189632d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.645565 Oct 17 13:07:28.521045 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1832/3566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:27 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:28.521664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:28.530756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:28.531487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:28.534789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:29.442771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2035357228", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "d7db6174-aa9e-476a-b373-6acd5b5ac92d"}, {"uuid": "2142e55a-5f7f-47db-83cb-d3aba6674cba"}, {"uuid": "d7db6174-aa9e-476a-b373-6acd5b5ac92d"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:29.513415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:29.563403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] validate_networks() for [('d7db6174-aa9e-476a-b373-6acd5b5ac92d', None, None, None, None, None), ('2142e55a-5f7f-47db-83cb-d3aba6674cba', None, None, None, None, None), ('d7db6174-aa9e-476a-b373-6acd5b5ac92d', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:07:29.922583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:29.958048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:29.968680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:29.977789 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6dd9613c-51e5-4f2a-9777-f053804088ec tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 1.492155 Oct 17 13:07:29.979961 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1735/3567] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:28 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:30.002630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:30.003747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:30.011344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:30.012025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:30.012773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:30.015258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:30.015878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:30.017190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:30.676634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:30.700916 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a279ca3e-e5d1-49e7-a476-c1aa79e132f4 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1517 microversion: 2.1 time: 0.713403 Oct 17 13:07:30.702068 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1736/3568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:29 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1517 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:30.715414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:30.719004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:30.744280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:30.745016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:30.745618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:30.746549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:30.747162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:30.747748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:31.169116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:31.179139 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b4b4f1e-9e39-46e2-ae76-3ab175272eb8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.475884 Oct 17 13:07:31.183112 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1737/3569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:30 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:31.207849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:31.208484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:31.210391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=72 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:31.223499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:31.224006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:31.224461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:31.225192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:31.225649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:31.226083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:31.377572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:07:31.378102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:07:31.378756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:07:31.379295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:07:31.379763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:07:31.393643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:31.394679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:31.395393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:31.396177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:31.396827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:31.397694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:31.434535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Getting quotas for project 09be9f1c4cc643eeb22541372cdd8b50. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:07:31.441561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Getting quotas for user aef5a5a23c3349ef8648e287a5273ba2 and project 09be9f1c4cc643eeb22541372cdd8b50. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:07:31.458534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:07:31.460942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:07:31.529432 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3225a714-92d2-4759-8d27-c193b93b7476 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.090970 Oct 17 13:07:31.530306 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1833/3570] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:07:31.752070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1240638955", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:31.890843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] validate_networks() for [('1d760fe5-8b19-4915-b55f-a2b619082439', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:07:31.930257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:31.949714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:31.952334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:31.954936 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f7b779bd-e7ba-4c4b-becd-17efa28eb767 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.755006 Oct 17 13:07:31.972111 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1738/3571] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:31 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:31.987357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89092337-b06e-4a93-b1c5-4502e7f5553a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:31.988367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89092337-b06e-4a93-b1c5-4502e7f5553a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:32.130258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89092337-b06e-4a93-b1c5-4502e7f5553a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:32.139917 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89092337-b06e-4a93-b1c5-4502e7f5553a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1213 microversion: 2.1 time: 0.166431 Oct 17 13:07:32.142759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1739/3572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:31 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:32.154393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e4a16cef-c435-42d5-8da6-66c65e5b3490 req-45bce084-620c-47b6-a12a-c2658c4003ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e000143-e33b-4156-bb81-e9b9b757e83e", "name": "network-vif-deleted", "tag": "215c67b4-016e-4d4c-9776-d58933da980e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:32.185719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e4a16cef-c435-42d5-8da6-66c65e5b3490 req-45bce084-620c-47b6-a12a-c2658c4003ac service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:32.187315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e4a16cef-c435-42d5-8da6-66c65e5b3490 req-45bce084-620c-47b6-a12a-c2658c4003ac service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:32.188265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e4a16cef-c435-42d5-8da6-66c65e5b3490 req-45bce084-620c-47b6-a12a-c2658c4003ac service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:32.235581 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e4a16cef-c435-42d5-8da6-66c65e5b3490 req-45bce084-620c-47b6-a12a-c2658c4003ac service nova] Creating event network-vif-deleted:215c67b4-016e-4d4c-9776-d58933da980e for instance 7e000143-e33b-4156-bb81-e9b9b757e83e on n-h2-853316-12 Oct 17 13:07:32.244441 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e4a16cef-c435-42d5-8da6-66c65e5b3490 req-45bce084-620c-47b6-a12a-c2658c4003ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098826 Oct 17 13:07:32.245694 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1740/3573] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:32.252204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:32.253152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:32.262677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:32.263383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:32.265986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:32.266947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:32.267566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:32.268150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:32.374193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:32.384924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:32.403381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:32.404962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lazy-loading 'fault' on Instance uuid 7e000143-e33b-4156-bb81-e9b9b757e83e {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:07:32.682888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:32.696579 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-33409c65-8fda-4adb-b679-19e4fedd3e1a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 200 len: 1310 microversion: 2.1 time: 0.447145 Oct 17 13:07:32.697416 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1741/3574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:32 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 1310 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:32.703503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:32.704107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:32.722484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:32.722824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:32.727970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:32.730131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:32.735600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:32.736158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.071753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:33.088975 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51299ffb-811f-4675-8eb0-cd88a94738ee tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.390479 Oct 17 13:07:33.090537 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1742/3575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:32 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:33.101206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:33.105605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:33.127067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.127722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.128790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.130331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.130966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.133194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.431527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:07:33.432045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:07:33.432894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:07:33.433518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:07:33.434260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:07:33.446586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.447466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.448233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.449229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.449908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.450581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.470557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Getting quotas for project b989a5a80d6d47199a138daaed2a4545. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:07:33.477827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Getting quotas for user b8c3cd271b444c38ae62d241e9bcd0da and project b989a5a80d6d47199a138daaed2a4545. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:07:33.492946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:07:33.496991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:07:33.570145 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1868f012-235a-4f84-9151-efd272615c62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.035696 Oct 17 13:07:33.581029 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1834/3576] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:07:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:07:33.594346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:33.611189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:33.619906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:33.622051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.623782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.625320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.626568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.627046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.627481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.644854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:33.647971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:33.654716 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c1f3c7c-b907-47a9-887b-8460b2f6d3fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.562763 Oct 17 13:07:33.655679 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1743/3577] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:33 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:33.663028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b9705c24-64e2-4cb6-9aa1-0e519c700dd6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:33.663683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b9705c24-64e2-4cb6-9aa1-0e519c700dd6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:33.734827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:33.744536 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da6e1299-ca1c-48af-bb76-c3270fc95abb tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1283 microversion: 2.1 time: 0.161846 Oct 17 13:07:33.745310 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1835/3578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:33 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1283 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:33.770933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:33.782081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 7e000143-e33b-4156-bb81-e9b9b757e83e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:33.789637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.791482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.793910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.796808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.797436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.798509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.850471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] HTTP exception thrown: Instance 7e000143-e33b-4156-bb81-e9b9b757e83e could not be found. Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Request method failure captured: Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e HTTP/1.1 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVNJ4J1k3183Px8SHoIFHu5pVzmIWazyjYmLjz521ah5WmJHe2fTvrGTrXSeVGZeKHQPetOptYE3S8hWwuMzkZ21K2CLOBoog20K6rkMYwBu_JQmWf44O7I0FMaoKUCeKYNCdVTrLZmtL5pzT7wSvI8wMnQcIYOdhGA3gr3yT-Z6iLQ Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7f9efeec2227498c99ae1763625fd0d9 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f9efeec2227498c99ae1763625fd0d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7f9efeec2227498c99ae1763625fd0d9 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServerFiltersTestJSON-1321131610-project Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: bc82d08ca8844a98bf2798ce8bcb435e Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServerFiltersTestJSON-1321131610-project Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 7e000143-e33b-4156-bb81-e9b9b757e83e could not be found. Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7e000143-e33b-4156-bb81-e9b9b757e83e'} Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e000143-e33b-4156-bb81-e9b9b757e83e could not be found. Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e000143-e33b-4156-bb81-e9b9b757e83e could not be found. Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:07:33.854040 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:33.858197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:33.858197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:07:33.858197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:07:33.858197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:07:33.858197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:07:33.858197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e000143-e33b-4156-bb81-e9b9b757e83e could not be found. Oct 17 13:07:33.858197 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:33.863555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Returning 404 to user: Instance 7e000143-e33b-4156-bb81-e9b9b757e83e could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:07:33.864546 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ddf03a3a-7c27-472a-a279-899fd7e3eacc tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e" status: 404 len: 111 microversion: 2.1 time: 0.098792 Oct 17 13:07:33.866251 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1836/3579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:33 2022] GET /compute/v2.1/servers/7e000143-e33b-4156-bb81-e9b9b757e83e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:07:33.895438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:33.897309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:33.912721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.913507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.916711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.917776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:33.919460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:33.921058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:33.980223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:07:34.139608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b9705c24-64e2-4cb6-9aa1-0e519c700dd6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:34.154903 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b9705c24-64e2-4cb6-9aa1-0e519c700dd6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1223 microversion: 2.1 time: 0.494803 Oct 17 13:07:34.169216 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1744/3580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:33 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1223 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:34.176235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:34.176875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:34.200289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:34.200794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:34.201305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:34.202095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:34.202739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:34.203219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:34.222203 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf3de74a-73ae-49a4-9f9a-aca80bdda72a tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581" status: 204 len: 0 microversion: 2.1 time: 0.342458 Oct 17 13:07:34.226405 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1837/3581] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:07:33 2022] DELETE /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:07:34.250330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:34.256383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:34.275804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:34.276340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:34.284575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:34.285342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:34.285826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:34.286284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:34.613255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:34.628210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-54f7ae07-10f3-4ec8-b7ee-d0ca98ad590b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1474 microversion: 2.1 time: 0.470798 Oct 17 13:07:34.645634 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1745/3582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:34 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1474 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:34.652949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:34.666453 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97c5dca8-aadd-4bcf-b3f1-a9d0b7932bd0 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581" status: 200 len: 1517 microversion: 2.1 time: 0.437191 Oct 17 13:07:34.682937 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1838/3583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:34 2022] GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:34.683031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:34.683031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:34.694422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:34.694985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:34.702332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:34.703144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:34.706925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:34.708918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:34.768584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:34.769505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:34.780672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:34.784561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:34.785273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:34.786220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:34.786863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:34.789925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:35.002328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:35.013384 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-63234f59-d86f-47f5-a53c-5b676a3c8086 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1271 microversion: 2.1 time: 0.248376 Oct 17 13:07:35.014719 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1839/3584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:34 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1271 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:35.193184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:35.195296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:35.219047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:35.227180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:35.228402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:35.232093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:35.236513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:35.238938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:35.502716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:35.512566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca80fca4-441c-4a47-9783-a84924520356 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1275 microversion: 2.1 time: 0.333988 Oct 17 13:07:35.520239 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1840/3585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:35 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1275 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:35.652918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:35.653535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:35.665859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:35.666436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:35.667667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:35.668427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:35.672563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:35.673026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:35.737787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:35.754631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:35.756586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:35.758237 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-56c02264-c160-4a88-9eb8-3f8057b1bb0b tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 1.081247 Oct 17 13:07:35.779149 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1746/3586] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:34 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:35.795763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:35.796785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:35.832066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:35.835378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:35.837383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:35.840848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:35.842125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:35.845494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:36.337875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:36.352818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-04efc32e-37e6-49af-a195-c55f0673eb35 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1473 microversion: 2.1 time: 0.703061 Oct 17 13:07:36.355423 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1841/3587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:35 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1473 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:36.373394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:36.377504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:36.398900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:36.406600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:36.407125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:36.407887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:36.408362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:36.408793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:36.564517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:36.588741 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2161a77-af15-4fbd-86c6-ec7db73942bf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581" status: 200 len: 1517 microversion: 2.1 time: 0.807386 Oct 17 13:07:36.590910 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1747/3588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:35 2022] GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 => generated 1517 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:36.599018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:36.599637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:36.621016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:36.621782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:36.622421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:36.624123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:36.624786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:36.625415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:36.880076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:36.892143 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04495506-fa37-46d3-8b4d-d05e00c9c82f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1281 microversion: 2.1 time: 0.297711 Oct 17 13:07:36.912544 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1748/3589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:36 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1281 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:36.932375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:36.933132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:36.946925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:36.950759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:36.951808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:36.959397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:36.960008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:36.960469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:36.997318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:37.295555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:37.320753 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1933b56-71b4-4044-ac93-e719cad1297d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1313 microversion: 2.1 time: 0.963987 Oct 17 13:07:37.347923 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1842/3590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:36 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1313 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:37.371144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:37.380742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:37.382442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:37.398720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:37.400315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:37.403608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:37.406285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:37.406998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:37.409037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:37.410241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:37.410924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:37.417149 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8319b668-e00d-4077-846c-ad0ba7d2f968 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.513047 Oct 17 13:07:37.421317 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1749/3591] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:36 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:37.624699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:37.625786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:37.644421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:37.644928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:37.648676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:37.650004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:37.650766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:37.652042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:37.698105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:37.855849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:37.870821 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72254fee-5f8d-4045-a33e-a18922f97c96 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581" status: 200 len: 1475 microversion: 2.1 time: 0.254869 Oct 17 13:07:37.872189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1750/3592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:37 2022] GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:37.897284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3dbbbd35-1c0a-45c5-9811-bc27fc183a98 req-39fbd3ab-9f9d-4b54-bd07-b87e4a7caf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2c1946-4142-49d7-95b3-248adb6b0581", "name": "network-vif-deleted", "tag": "8d543292-d1ae-4f9d-879f-7b75fdbdc4ce"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:37.936691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3dbbbd35-1c0a-45c5-9811-bc27fc183a98 req-39fbd3ab-9f9d-4b54-bd07-b87e4a7caf55 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:37.940350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3dbbbd35-1c0a-45c5-9811-bc27fc183a98 req-39fbd3ab-9f9d-4b54-bd07-b87e4a7caf55 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:37.946842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3dbbbd35-1c0a-45c5-9811-bc27fc183a98 req-39fbd3ab-9f9d-4b54-bd07-b87e4a7caf55 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:37.994914 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3dbbbd35-1c0a-45c5-9811-bc27fc183a98 req-39fbd3ab-9f9d-4b54-bd07-b87e4a7caf55 service nova] Creating event network-vif-deleted:8d543292-d1ae-4f9d-879f-7b75fdbdc4ce for instance ed2c1946-4142-49d7-95b3-248adb6b0581 on n-h1-853316-12 Oct 17 13:07:38.008969 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3dbbbd35-1c0a-45c5-9811-bc27fc183a98 req-39fbd3ab-9f9d-4b54-bd07-b87e4a7caf55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134355 Oct 17 13:07:38.011440 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1751/3593] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:38.026697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:38.037843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:38.059475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.059987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.060515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:38.061252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.070507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.070982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:38.269269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:38.277590 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5525defb-23ec-4ace-a4ba-e2fac073e332 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1473 microversion: 2.1 time: 0.900972 Oct 17 13:07:38.282502 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1843/3594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:37 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1473 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:38.287305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f1773b67-633a-456b-badd-67a59df532f2 req-fc7f3e6d-f81d-45b2-bea4-adcd5213497a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8", "name": "network-vif-unplugged", "status": "completed", "tag": "7b8a1e49-f76d-443e-bb48-2b56a2f21443"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:38.304516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:38.325690 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b3d95a1-779d-4aae-9ce5-234aa137676c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1281 microversion: 2.1 time: 0.299338 Oct 17 13:07:38.325690 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1752/3595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:38 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1281 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:38.337623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f1773b67-633a-456b-badd-67a59df532f2 req-fc7f3e6d-f81d-45b2-bea4-adcd5213497a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.338331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f1773b67-633a-456b-badd-67a59df532f2 req-fc7f3e6d-f81d-45b2-bea4-adcd5213497a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.338602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f1773b67-633a-456b-badd-67a59df532f2 req-fc7f3e6d-f81d-45b2-bea4-adcd5213497a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:38.358454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:38.359447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:38.366250 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f1773b67-633a-456b-badd-67a59df532f2 req-fc7f3e6d-f81d-45b2-bea4-adcd5213497a service nova] Creating event network-vif-unplugged:7b8a1e49-f76d-443e-bb48-2b56a2f21443 for instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 on n-h2-853316-12 Oct 17 13:07:38.369823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.372499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.373634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:38.375276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.375946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.376718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:38.394141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-f1773b67-633a-456b-badd-67a59df532f2 req-fc7f3e6d-f81d-45b2-bea4-adcd5213497a service nova] Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:07:38.438383 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f1773b67-633a-456b-badd-67a59df532f2 req-fc7f3e6d-f81d-45b2-bea4-adcd5213497a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152677 Oct 17 13:07:38.442405 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1844/3596] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:38.461961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:38.465620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:38.487888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.490595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.491087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:38.492911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.494103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.494860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:38.916013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:38.929703 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3a13c9e3-5f03-49fe-a815-e793f7e944f0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1313 microversion: 2.1 time: 0.579281 Oct 17 13:07:38.933255 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1753/3597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:38 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:38.940394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:38.945487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: ed2c1946-4142-49d7-95b3-248adb6b0581] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:38.984315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.985811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.988309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:38.993000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:38.993658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:38.994122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:39.037941 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] HTTP exception thrown: Instance ed2c1946-4142-49d7-95b3-248adb6b0581 could not be found. Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Request method failure captured: Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 HTTP/1.1 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVNJ4J1k3183Px8SHoIFHu5pVzmIWazyjYmLjz521ah5WmJHe2fTvrGTrXSeVGZeKHQPetOptYE3S8hWwuMzkZ21K2CLOBoog20K6rkMYwBu_JQmWf44O7I0FMaoKUCeKYNCdVTrLZmtL5pzT7wSvI8wMnQcIYOdhGA3gr3yT-Z6iLQ Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 7f9efeec2227498c99ae1763625fd0d9 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f9efeec2227498c99ae1763625fd0d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 7f9efeec2227498c99ae1763625fd0d9 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ListServerFiltersTestJSON-1321131610-project Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: bc82d08ca8844a98bf2798ce8bcb435e Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ListServerFiltersTestJSON-1321131610-project Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance ed2c1946-4142-49d7-95b3-248adb6b0581 could not be found. Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'ed2c1946-4142-49d7-95b3-248adb6b0581'} Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2c1946-4142-49d7-95b3-248adb6b0581 could not be found. Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2c1946-4142-49d7-95b3-248adb6b0581 could not be found. Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:07:39.040496 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2c1946-4142-49d7-95b3-248adb6b0581 could not be found. Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Returning 404 to user: Instance ed2c1946-4142-49d7-95b3-248adb6b0581 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:07:39.044114 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-39147a88-6c83-4ab0-a7f4-a8aad29ecb48 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581" status: 404 len: 111 microversion: 2.1 time: 0.107982 Oct 17 13:07:39.049035 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1754/3598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:38 2022] GET /compute/v2.1/servers/ed2c1946-4142-49d7-95b3-248adb6b0581 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:07:39.054418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:39.054873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:39.064509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:39.066722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:39.067605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:39.068562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:39.070648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:39.071253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:39.161519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:07:39.279773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:39.299515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:39.308272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:39.314052 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6493d5a-337d-4703-90f4-0ec9c15228e9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.865143 Oct 17 13:07:39.317593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1845/3599] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:38 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:39.330556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:39.331572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:39.377539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:39.379366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:39.381674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:39.383859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:39.387022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:39.396839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:39.480008 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b93f6c0-960c-4037-9778-41569bdaf5be tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 204 len: 0 microversion: 2.1 time: 0.429535 Oct 17 13:07:39.481057 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1755/3600] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:07:39 2022] DELETE /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:07:39.505537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:39.506304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:39.532034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:39.533704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:39.534578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:39.535866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:39.536365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:39.536808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:40.062180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:40.091446 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1ef1c626-6799-4d02-b0d7-ca9de3b85a42 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 0.597067 Oct 17 13:07:40.094193 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1756/3601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:39 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:40.105793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:40.106812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:40.127490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:40.128158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:40.128809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:40.130577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:40.131820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:40.133182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:40.234755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:40.245281 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b8a94a2f-6591-4c1e-a737-b00fbff3acdd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1473 microversion: 2.1 time: 0.926487 Oct 17 13:07:40.248505 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1846/3602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:39 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1473 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:40.262421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:40.263038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:40.304741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:40.307768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:40.308253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:40.309001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:40.309461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:40.313539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:40.589248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:40.606038 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5cfe81c8-9e2a-442e-8faf-f8f12d02455f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1334 microversion: 2.1 time: 0.349609 Oct 17 13:07:40.606842 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1847/3603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:40 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1334 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:40.611820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:40.628887 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-502cda52-45b4-48d9-a09f-70ad5c101ddf tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1517 microversion: 2.1 time: 0.532547 Oct 17 13:07:40.629781 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1757/3604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:40 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1517 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:40.637682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-5076579b-9fc7-47cd-b4e2-9dba508d04ca req-7d0d2451-2915-46a5-a088-48e4fd8e569d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8", "tag": "7b8a1e49-f76d-443e-bb48-2b56a2f21443"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:40.643296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:40.643925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:40.683302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5076579b-9fc7-47cd-b4e2-9dba508d04ca req-7d0d2451-2915-46a5-a088-48e4fd8e569d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:40.685763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5076579b-9fc7-47cd-b4e2-9dba508d04ca req-7d0d2451-2915-46a5-a088-48e4fd8e569d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:40.687220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5076579b-9fc7-47cd-b4e2-9dba508d04ca req-7d0d2451-2915-46a5-a088-48e4fd8e569d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:40.724407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:40.727321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:40.728353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:40.731721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:40.734137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:40.734931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:40.738218 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-5076579b-9fc7-47cd-b4e2-9dba508d04ca req-7d0d2451-2915-46a5-a088-48e4fd8e569d service nova] Creating event network-changed:7b8a1e49-f76d-443e-bb48-2b56a2f21443 for instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 on n-h2-853316-12 Oct 17 13:07:40.772392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-5076579b-9fc7-47cd-b4e2-9dba508d04ca req-7d0d2451-2915-46a5-a088-48e4fd8e569d service nova] Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:07:40.835532 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-5076579b-9fc7-47cd-b4e2-9dba508d04ca req-7d0d2451-2915-46a5-a088-48e4fd8e569d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204308 Oct 17 13:07:40.836725 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1758/3605] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:41.123833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:41.124530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:41.138209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:41.140488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:41.143357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:41.144153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:41.146894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:41.147310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:41.720801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:41.730883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:41.732398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:41.733706 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7664675e-666e-414c-9e1d-ae8d636ec991 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 1.124961 Oct 17 13:07:41.746781 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1848/3606] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:40 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:41.773521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:41.774476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:41.789952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:41.790780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:41.791374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:41.792310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:41.792974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:41.793612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:41.831788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:42.454103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:42.470752 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9651cd1f-a059-432c-8aa7-a7602c19c0a2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1473 microversion: 2.1 time: 0.709661 Oct 17 13:07:42.490981 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1849/3607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:41 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1473 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:42.507386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:42.508018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:42.526639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:42.527134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:42.527573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:42.528280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:42.528730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:42.531335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:42.668971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:42.679758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a31cea23-bdc2-4f01-9b45-67ed82b006b7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 1.565730 Oct 17 13:07:42.690238 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1759/3608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:41 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:42.705400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:42.706035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:42.725386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:42.732139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:42.732890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:42.733820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:42.740501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:42.740957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:43.007913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:43.023903 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c1fdd1b-f383-4c83-82b3-1194036fa061 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.530361 Oct 17 13:07:43.024083 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1850/3609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:42 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:43.043320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:43.043940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:43.062373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:43.063603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:43.069060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:43.070113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:43.071546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:43.072287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:43.357303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:43.370498 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d35c4ed-28c7-4e18-a163-b4a7ce140786 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1517 microversion: 2.1 time: 0.679030 Oct 17 13:07:43.371420 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1760/3610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:42 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1517 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:43.458676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:43.486331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=12 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:43.496586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:43.497269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:43.506984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:43.511240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:43.511873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:43.512848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:43.514240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:43.520064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.021344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:44.034906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-647b74d0-fd5c-40b6-be60-241202abd04f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1473 microversion: 2.1 time: 0.542470 Oct 17 13:07:44.037333 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1761/3611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:43 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1473 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:44.053667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:44.055832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:44.082248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.082832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.083990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.084756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.085227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.088091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.157479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:44.288901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:44.304949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:44.311823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:44.318888 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fdec1c65-ce11-4639-ad39-a93f9d58fa73 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 1.291579 Oct 17 13:07:44.319980 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1851/3612] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:43 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:44.333988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-15549da7-12ba-4a13-b5d0-678c832054bb req-40977b33-0365-4508-bd7e-97c3e4ed16ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-plugged", "status": "completed", "tag": "39b7349e-cc92-45d0-8bb5-ba66f09c36ab"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:44.366668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-15549da7-12ba-4a13-b5d0-678c832054bb req-40977b33-0365-4508-bd7e-97c3e4ed16ba service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.367311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-15549da7-12ba-4a13-b5d0-678c832054bb req-40977b33-0365-4508-bd7e-97c3e4ed16ba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.367840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-15549da7-12ba-4a13-b5d0-678c832054bb req-40977b33-0365-4508-bd7e-97c3e4ed16ba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.408442 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-15549da7-12ba-4a13-b5d0-678c832054bb req-40977b33-0365-4508-bd7e-97c3e4ed16ba service nova] Creating event network-vif-plugged:39b7349e-cc92-45d0-8bb5-ba66f09c36ab for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:44.414431 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-15549da7-12ba-4a13-b5d0-678c832054bb req-40977b33-0365-4508-bd7e-97c3e4ed16ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090506 Oct 17 13:07:44.417210 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1852/3613] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:44.444622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:44.453884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:44.505331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.518490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.519268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.520215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.522045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.523535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.712487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:44.722112 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1f1b6b0b-a318-4507-b500-e4e76ba70bea tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 0.683352 Oct 17 13:07:44.722651 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1762/3614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:44 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:44.730631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:44.739397 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-288b0770-fb4a-4d0a-ae07-0e54ae2b1619 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.320407 Oct 17 13:07:44.743896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6e406e76-f800-46f7-901c-a70e9f284a8d req-5dde3972-3ad4-4be2-ac1f-780a50e826ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f791b4-5702-4f1d-a75d-01a30855832d", "name": "network-vif-deleted", "tag": "e66bfb45-f3fe-4d78-8431-eda75f49b321"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:44.761235 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1853/3615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:44 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:44.762871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6e406e76-f800-46f7-901c-a70e9f284a8d req-5dde3972-3ad4-4be2-ac1f-780a50e826ac service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.767270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6e406e76-f800-46f7-901c-a70e9f284a8d req-5dde3972-3ad4-4be2-ac1f-780a50e826ac service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.767807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:44.768225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6e406e76-f800-46f7-901c-a70e9f284a8d req-5dde3972-3ad4-4be2-ac1f-780a50e826ac service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.768414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:44.790657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.804353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.805296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.806435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.807141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.807790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.831953 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6e406e76-f800-46f7-901c-a70e9f284a8d req-5dde3972-3ad4-4be2-ac1f-780a50e826ac service nova] Creating event network-vif-deleted:e66bfb45-f3fe-4d78-8431-eda75f49b321 for instance 23f791b4-5702-4f1d-a75d-01a30855832d on n-h2-853316-12 Oct 17 13:07:44.858864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6e406e76-f800-46f7-901c-a70e9f284a8d req-5dde3972-3ad4-4be2-ac1f-780a50e826ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122591 Oct 17 13:07:44.860388 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1763/3616] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:44.880182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-20ca6c5c-b72f-4849-813e-5b80d3937c20 req-c42470b6-fb4f-4eb1-b100-5fb0c92dcbb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0d03c6-2fe0-49bf-a32f-21ec17574681", "tag": "c820f63b-5bf0-492b-bafd-24b6331716e1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:44.912777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20ca6c5c-b72f-4849-813e-5b80d3937c20 req-c42470b6-fb4f-4eb1-b100-5fb0c92dcbb3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:44.913466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20ca6c5c-b72f-4849-813e-5b80d3937c20 req-c42470b6-fb4f-4eb1-b100-5fb0c92dcbb3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:44.918426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-20ca6c5c-b72f-4849-813e-5b80d3937c20 req-c42470b6-fb4f-4eb1-b100-5fb0c92dcbb3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:44.939795 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-20ca6c5c-b72f-4849-813e-5b80d3937c20 req-c42470b6-fb4f-4eb1-b100-5fb0c92dcbb3 service nova] Creating event network-changed:c820f63b-5bf0-492b-bafd-24b6331716e1 for instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 on n-h2-853316-12 Oct 17 13:07:44.949886 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-20ca6c5c-b72f-4849-813e-5b80d3937c20 req-c42470b6-fb4f-4eb1-b100-5fb0c92dcbb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084908 Oct 17 13:07:44.951989 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1764/3617] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:45.036004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc82d08ca8844a98bf2798ce8bcb435e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9efeec2227498c99ae1763625fd0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:45.050759 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b56985f-eb87-4f4f-84cd-65625084ae08 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 200 len: 1475 microversion: 2.1 time: 0.288242 Oct 17 13:07:45.062189 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1854/3618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:44 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 1475 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:45.075251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:45.076886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:45.104875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:45.105397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:45.107360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:45.109175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:45.109952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:45.110427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:45.351192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:45.352527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:45.367388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:45.371115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:45.372397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:45.373896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:45.377403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:45.380305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:45.768702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:45.781834 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4556f7aa-ba5a-4b7a-ba34-f9c617a134a9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1471 microversion: 2.1 time: 0.720309 Oct 17 13:07:45.784459 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1765/3619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:45 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1471 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:45.789351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:45.795669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:45.834260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:45.834961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:45.835600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:45.836478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:45.837095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:45.839679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:46.000758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:46.018406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:46.028392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:46.032159 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-277dd25e-5a5f-4db3-a54b-218d8798c3e2 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.684780 Oct 17 13:07:46.035044 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1855/3620] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:45 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:46.055891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:46.056863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:46.071206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:46.073990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:46.074888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:46.077790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:46.079807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:46.082309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:46.470740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:46.480883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:46.493122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6aa3ad4b-dc6b-4402-82e4-450ff1cf405c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.456530 Oct 17 13:07:46.493737 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1856/3621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:46 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:46.498936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:46.499553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] [instance: 23f791b4-5702-4f1d-a75d-01a30855832d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:46.511445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:46.512768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:46.514396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:46.516062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:46.517409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:46.517532 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34ff7563-3039-42d4-b267-6c261f405252 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 0.731203 Oct 17 13:07:46.517855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:46.519031 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1766/3622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:45 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:46.541614 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] HTTP exception thrown: Instance 23f791b4-5702-4f1d-a75d-01a30855832d could not be found. Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Request method failure captured: Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d HTTP/1.1 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVNJ4J1k3183Px8SHoIFHu5pVzmIWazyjYmLjz521ah5WmJHe2fTvrGTrXSeVGZeKHQPetOptYE3S8hWwuMzkZ21K2CLOBoog20K6rkMYwBu_JQmWf44O7I0FMaoKUCeKYNCdVTrLZmtL5pzT7wSvI8wMnQcIYOdhGA3gr3yT-Z6iLQ Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7f9efeec2227498c99ae1763625fd0d9 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f9efeec2227498c99ae1763625fd0d9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f9efeec2227498c99ae1763625fd0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7f9efeec2227498c99ae1763625fd0d9 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1321131610 Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServerFiltersTestJSON-1321131610-project Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: bc82d08ca8844a98bf2798ce8bcb435e Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServerFiltersTestJSON-1321131610-project Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 23f791b4-5702-4f1d-a75d-01a30855832d could not be found. Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '23f791b4-5702-4f1d-a75d-01a30855832d'} Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f791b4-5702-4f1d-a75d-01a30855832d could not be found. Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f791b4-5702-4f1d-a75d-01a30855832d could not be found. Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:07:46.543570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:46.548637 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:07:46.548637 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:07:46.548637 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:07:46.548637 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:07:46.548637 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:07:46.548637 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f791b4-5702-4f1d-a75d-01a30855832d could not be found. Oct 17 13:07:46.548637 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:07:46.550959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] Returning 404 to user: Instance 23f791b4-5702-4f1d-a75d-01a30855832d could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:07:46.551986 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-34d8197e-e308-4e16-9e13-dedeb3211c13 tempest-ListServerFiltersTestJSON-1321131610 tempest-ListServerFiltersTestJSON-1321131610-project] 10.222.0.27 "GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d" status: 404 len: 111 microversion: 2.1 time: 0.057298 Oct 17 13:07:46.552706 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1857/3623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:46 2022] GET /compute/v2.1/servers/23f791b4-5702-4f1d-a75d-01a30855832d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:07:46.556014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e945678f-ab24-465d-9bc8-2304438a058c req-da4cc7db-a408-4423-bcd5-4b490cd4a203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-plugged", "status": "completed", "tag": "025f2a1c-bddb-4db6-92ff-a5f29cba7b91"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-plugged", "status": "completed", "tag": "d42ee3ac-da2f-45ea-ae11-913f70990f8d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:46.570630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e945678f-ab24-465d-9bc8-2304438a058c req-da4cc7db-a408-4423-bcd5-4b490cd4a203 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:46.571371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e945678f-ab24-465d-9bc8-2304438a058c req-da4cc7db-a408-4423-bcd5-4b490cd4a203 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:46.571972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e945678f-ab24-465d-9bc8-2304438a058c req-da4cc7db-a408-4423-bcd5-4b490cd4a203 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:46.591665 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e945678f-ab24-465d-9bc8-2304438a058c req-da4cc7db-a408-4423-bcd5-4b490cd4a203 service nova] Creating event network-vif-plugged:025f2a1c-bddb-4db6-92ff-a5f29cba7b91 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:46.593133 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e945678f-ab24-465d-9bc8-2304438a058c req-da4cc7db-a408-4423-bcd5-4b490cd4a203 service nova] Creating event network-vif-plugged:d42ee3ac-da2f-45ea-ae11-913f70990f8d for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:46.601352 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e945678f-ab24-465d-9bc8-2304438a058c req-da4cc7db-a408-4423-bcd5-4b490cd4a203 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049671 Oct 17 13:07:46.602635 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1767/3624] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:46.813195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:46.814672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:46.836065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:46.836626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:46.837156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:46.838275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:46.839181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:46.839702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:47.064130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fff74943-fce6-47d5-b748-7215d08ad0e9 req-2f85bf05-c8e6-48fe-9c69-cb31e7548431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "tag": "50d9fcc4-0f70-41cb-b15e-19e2fd56ba8f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:47.094191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fff74943-fce6-47d5-b748-7215d08ad0e9 req-2f85bf05-c8e6-48fe-9c69-cb31e7548431 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:47.102411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fff74943-fce6-47d5-b748-7215d08ad0e9 req-2f85bf05-c8e6-48fe-9c69-cb31e7548431 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:47.103678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fff74943-fce6-47d5-b748-7215d08ad0e9 req-2f85bf05-c8e6-48fe-9c69-cb31e7548431 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:47.118667 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fff74943-fce6-47d5-b748-7215d08ad0e9 req-2f85bf05-c8e6-48fe-9c69-cb31e7548431 service nova] Creating event network-changed:50d9fcc4-0f70-41cb-b15e-19e2fd56ba8f for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:07:47.125118 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fff74943-fce6-47d5-b748-7215d08ad0e9 req-2f85bf05-c8e6-48fe-9c69-cb31e7548431 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066145 Oct 17 13:07:47.126339 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1768/3625] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:47.132345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:47.134231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:47.145589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:47.146512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:47.147214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:47.149161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:47.149816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:47.150659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:47.180314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:47.534051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:47.553727 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b504ed4d-3a05-4c84-a55d-5e31f0f453ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1468 microversion: 2.1 time: 0.744898 Oct 17 13:07:47.572824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1858/3626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:46 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1468 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:47.581973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:47.599643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:47.622120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:47.632202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:47.648915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:47.656056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:47.659558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:47.665239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:47.761663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:47.785732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:47.793319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:47.798263 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d160119a-aa64-4f7d-9bc2-ba13716494f7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.670475 Oct 17 13:07:47.818660 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1769/3627] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:47 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:47.839285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:47.840073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:47.867173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:47.871120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:47.871679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:47.872526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:47.873871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:47.881151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:48.582527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:48.605382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-586edbac-2d8c-4dda-bd5a-c184512f254f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 1.022426 Oct 17 13:07:48.607819 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1859/3628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:47 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:48.634355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:48.636332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:48.658519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:48.664397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:48.665280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:48.673193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:48.676309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:48.677600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:48.758589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:48.776465 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3bdf0a4e-0125-437e-8eb7-40b0a4dd7d45 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 0.943728 Oct 17 13:07:48.797011 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1770/3629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:47 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:48.835410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:48.836648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:48.841078 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0bd36115-97cc-453d-abb5-7b1fd30b1d6a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8/action" status: 204 len: 0 microversion: 2.1 time: 0.230179 Oct 17 13:07:48.845742 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1860/3630] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:07:48 2022] POST /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8/action => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:07:48.852761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:48.853384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:48.855655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:48.856567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:48.860289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:48.861072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:48.863524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:48.864312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:48.880927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:48.881444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:48.881897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:48.885984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:48.887976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:48.897658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:49.345242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:49.359422 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-660c0d30-7bfd-402b-b6fd-e7bf6765e5f1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1468 microversion: 2.1 time: 0.506430 Oct 17 13:07:49.361031 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1861/3631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:48 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1468 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:49.368591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d9a0880f-3da8-4151-b43d-46b0b2d4e03f req-2d5847a1-768f-4805-a710-331bc76fc838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-plugged", "status": "completed", "tag": "3796462d-86a6-4308-9740-cc052a3080f5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:49.391246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9a0880f-3da8-4151-b43d-46b0b2d4e03f req-2d5847a1-768f-4805-a710-331bc76fc838 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:49.392020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9a0880f-3da8-4151-b43d-46b0b2d4e03f req-2d5847a1-768f-4805-a710-331bc76fc838 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:49.392832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9a0880f-3da8-4151-b43d-46b0b2d4e03f req-2d5847a1-768f-4805-a710-331bc76fc838 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:49.422038 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d9a0880f-3da8-4151-b43d-46b0b2d4e03f req-2d5847a1-768f-4805-a710-331bc76fc838 service nova] Creating event network-vif-plugged:3796462d-86a6-4308-9740-cc052a3080f5 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:49.432099 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d9a0880f-3da8-4151-b43d-46b0b2d4e03f req-2d5847a1-768f-4805-a710-331bc76fc838 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068244 Oct 17 13:07:49.433328 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1862/3632] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:49.582026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-29645989-a414-4231-8e57-4130ea94b720 req-8848171a-fe39-48ae-aa75-e9bb3a82e9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "tag": "5c00c940-c3e1-40aa-a816-adf26363cd21"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:49.605664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-29645989-a414-4231-8e57-4130ea94b720 req-8848171a-fe39-48ae-aa75-e9bb3a82e9f3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:49.608029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-29645989-a414-4231-8e57-4130ea94b720 req-8848171a-fe39-48ae-aa75-e9bb3a82e9f3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:49.609260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-29645989-a414-4231-8e57-4130ea94b720 req-8848171a-fe39-48ae-aa75-e9bb3a82e9f3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:49.629549 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-29645989-a414-4231-8e57-4130ea94b720 req-8848171a-fe39-48ae-aa75-e9bb3a82e9f3 service nova] Creating event network-changed:5c00c940-c3e1-40aa-a816-adf26363cd21 for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:07:49.639046 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-29645989-a414-4231-8e57-4130ea94b720 req-8848171a-fe39-48ae-aa75-e9bb3a82e9f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064390 Oct 17 13:07:49.651681 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1863/3633] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:07:49.661572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:49.663891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:49.679083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:49.679925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:49.680569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:49.682146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:49.682793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:49.683452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:49.702522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:49.717959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:49.719933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:49.724202 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e19f8604-b2e3-4dca-aa3e-8b298e79b85e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.893001 Oct 17 13:07:49.742991 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1771/3634] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:48 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:49.801356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:49.802042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:49.818007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:49.818514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:49.819148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:49.820011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:49.820616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:49.821191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:50.155788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:50.176342 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f9596b77-446d-4686-8445-a11f1e4cb61e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.522370 Oct 17 13:07:50.179375 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1864/3635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:49 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:50.391359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:50.393304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:50.428447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:50.429310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:50.430618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:50.434098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:50.434638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:50.435189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:50.705534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:50.717350 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aa3f7d59-abce-407f-b416-c2e6d95f484a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1468 microversion: 2.1 time: 0.333268 Oct 17 13:07:50.719457 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1865/3636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:50 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:50.763252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:50.764516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:50.800752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:50.819688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:50.820460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:50.821130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:50.824204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:50.829306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:50.833195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:50.954772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:50.968197 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b00c482b-9f1b-4dd1-9678-a5b4c17703d8 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 1.169897 Oct 17 13:07:50.971032 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1772/3637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:49 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:51.205105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:51.205642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:51.215076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:51.215575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:51.216019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:51.216843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:51.217305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:51.217736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:51.313867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:51.329329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:51.331488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:51.333578 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe0bd1cf-6b77-4f28-83d0-8f9a436b927e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.577277 Oct 17 13:07:51.334981 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1866/3638] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:50 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:51.461301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-plugged", "status": "completed", "tag": "b6d1e2b2-34a9-4cea-a23e-66a20792cbc9"}, {"server_uuid": "4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8", "name": "network-vif-plugged", "status": "completed", "tag": "7b8a1e49-f76d-443e-bb48-2b56a2f21443"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-plugged", "status": "completed", "tag": "037a67ef-17b4-4934-9932-ff5de09b20a1"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-plugged", "status": "completed", "tag": "800b13ad-79c1-429e-ab7f-36ad171e6e50"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:51.496700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:51.497251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:51.499991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:51.523127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Creating event network-vif-plugged:b6d1e2b2-34a9-4cea-a23e-66a20792cbc9 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:51.523127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Creating event network-vif-plugged:7b8a1e49-f76d-443e-bb48-2b56a2f21443 for instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 on n-h2-853316-12 Oct 17 13:07:51.523127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Creating event network-vif-plugged:037a67ef-17b4-4934-9932-ff5de09b20a1 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:51.524160 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Creating event network-vif-plugged:800b13ad-79c1-429e-ab7f-36ad171e6e50 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:51.532428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:51.539667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:07:51.568321 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0bf98c3d-59bf-4278-ba04-a5ca718ee92d req-ddd58176-aa29-446c-8f68-3dcc0fd61b7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.110694 Oct 17 13:07:51.569563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1867/3639] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:07:51.694467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:51.712198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb927e44-02a3-49eb-a1eb-417e8929f642 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.512954 Oct 17 13:07:51.713419 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1773/3640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:51 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:51.748649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:51.749425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:51.773307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:51.774114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:51.774637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:51.775706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:51.776205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:51.776689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:51.994657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:51.995251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:52.008532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:52.009668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:52.010353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:52.011862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:52.013585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:52.014788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:52.212861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:52.228596 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19ab4cfd-7425-4279-a544-2590019d39b4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1468 microversion: 2.1 time: 0.486017 Oct 17 13:07:52.229909 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1868/3641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:51 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1468 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:52.371392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:52.371993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:52.388094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:52.395105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:52.395629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:52.396382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:52.396847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:52.397272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:52.435339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:52.448394 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-925c7511-3b17-42b7-8396-4b67fdb904f5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 0.456316 Oct 17 13:07:52.449253 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1774/3642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:51 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:52.594786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-86606310-b587-45be-b24b-0200ce5c00f8 req-ae8458e3-2747-4678-8962-c897f5ed3a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "tag": "d5fe2f24-d8ea-4b1e-b386-b583508468ef"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:52.616943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-86606310-b587-45be-b24b-0200ce5c00f8 req-ae8458e3-2747-4678-8962-c897f5ed3a67 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:52.617430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-86606310-b587-45be-b24b-0200ce5c00f8 req-ae8458e3-2747-4678-8962-c897f5ed3a67 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:52.618064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-86606310-b587-45be-b24b-0200ce5c00f8 req-ae8458e3-2747-4678-8962-c897f5ed3a67 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:52.636707 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-86606310-b587-45be-b24b-0200ce5c00f8 req-ae8458e3-2747-4678-8962-c897f5ed3a67 service nova] Creating event network-changed:d5fe2f24-d8ea-4b1e-b386-b583508468ef for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:07:52.658402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-86606310-b587-45be-b24b-0200ce5c00f8 req-ae8458e3-2747-4678-8962-c897f5ed3a67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067752 Oct 17 13:07:52.659572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1775/3643] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:52.741021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:52.741908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:52.749027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:52.749709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:52.750384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:52.751621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:52.752220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:52.752847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:52.756929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:52.772574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:52.775863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:52.783042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a39ea925-8299-4773-aec3-4345eb1c59bd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1880 microversion: 2.42 time: 0.425968 Oct 17 13:07:52.786275 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1869/3644] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:52 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1880 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:53.069501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:53.078068 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ce12420-42e2-405c-b2de-da19f75c556b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.341467 Oct 17 13:07:53.104076 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1776/3645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:52 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:53.254486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:53.255106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:53.273743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:53.274265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:53.274705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:53.275464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:53.275852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:53.276283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:53.472110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:53.472749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:53.491149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:53.491660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:53.492118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:53.492823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:53.493281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:53.493706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:53.551137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:53.560589 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b066ca22-b143-439b-b8b0-4918d515f6a1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1468 microversion: 2.1 time: 0.309603 Oct 17 13:07:53.561382 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1870/3646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:53 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1468 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:53.607383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9cf09b13-7ab1-4045-a958-0df7bdc0bf21 req-ebd46a8d-65ce-4918-a7fd-01e1fe308dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0d03c6-2fe0-49bf-a32f-21ec17574681", "name": "network-vif-plugged", "status": "completed", "tag": "c820f63b-5bf0-492b-bafd-24b6331716e1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:53.625208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9cf09b13-7ab1-4045-a958-0df7bdc0bf21 req-ebd46a8d-65ce-4918-a7fd-01e1fe308dc6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:53.625759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9cf09b13-7ab1-4045-a958-0df7bdc0bf21 req-ebd46a8d-65ce-4918-a7fd-01e1fe308dc6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:53.626212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9cf09b13-7ab1-4045-a958-0df7bdc0bf21 req-ebd46a8d-65ce-4918-a7fd-01e1fe308dc6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:53.649683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9cf09b13-7ab1-4045-a958-0df7bdc0bf21 req-ebd46a8d-65ce-4918-a7fd-01e1fe308dc6 service nova] Creating event network-vif-plugged:c820f63b-5bf0-492b-bafd-24b6331716e1 for instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 on n-h2-853316-12 Oct 17 13:07:53.656427 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9cf09b13-7ab1-4045-a958-0df7bdc0bf21 req-ebd46a8d-65ce-4918-a7fd-01e1fe308dc6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052737 Oct 17 13:07:53.665958 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1871/3647] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:53.830973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:53.831436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:53.845163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:53.845667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:53.846113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:53.854107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:53.854639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:53.855167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:54.088325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:54.098730 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f4736ce-7f81-49f0-a074-69d9a0f59c4f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 0.630162 Oct 17 13:07:54.100309 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1777/3648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:53 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:54.126633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:54.128406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:54.152910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:54.154576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:54.155255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:54.156281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:54.156918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:54.158092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:54.504138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:54.513359 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68960b5f-d04f-42cd-96f8-5d132394c7a6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.398326 Oct 17 13:07:54.529409 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1778/3649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:54 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:54.585523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:54.586142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:54.596127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:54.599762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:54.600663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:54.604065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:54.605189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:54.606373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:54.652559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:54.682771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:54.692646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:54.703855 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a77ba343-a4df-4c56-823f-f330227e7331 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2835 microversion: 2.42 time: 0.882396 Oct 17 13:07:54.705184 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1872/3650] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:07:53 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2835 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:07:54.735222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:54.736047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:54.744362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:54.745130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:54.746259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:54.747189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:54.748198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:54.748977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:54.937453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:54.955046 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c20ef5e3-a8d9-4fb7-ae7c-88d6f7ef6905 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1460 microversion: 2.1 time: 0.366418 Oct 17 13:07:54.957084 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1779/3651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:54 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1460 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:54.990784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:54.991504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:55.005687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:55.008518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:55.009223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:55.010124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:55.010616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:55.011045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:55.019529 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-57c80aed-34e6-46e3-a79e-47cbafed0603 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.289020 Oct 17 13:07:55.021618 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1873/3652] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 13:07:54 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda/os-interface => generated 1829 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:07:55.127863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:55.128487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:55.141261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:55.141891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:55.143452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:55.144365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:55.145137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:55.145804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:55.558934 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e92c3b11-4e6b-4d9e-89f9-3b53d956f973 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1613 microversion: 2.1 time: 0.582146 Oct 17 13:07:55.559842 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1780/3653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:54 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1613 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:07:55.570095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:55.571031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:55.592051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:55.593517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:55.594815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:55.596342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:55.597170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:55.597900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:55.734051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:55.749311 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3509ee06-726e-44b6-aa27-9b6c7d27d0d2 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1323 microversion: 2.1 time: 0.625119 Oct 17 13:07:55.769047 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1874/3654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:55 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1323 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:55.780276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c7928f2d-08e2-4807-abb1-382e5c6f68da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '.version_select at 0x7fa82095fd30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:55.799183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7928f2d-08e2-4807-abb1-382e5c6f68da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:55.799677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7928f2d-08e2-4807-abb1-382e5c6f68da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:55.800122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7928f2d-08e2-4807-abb1-382e5c6f68da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:55.827673 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c7928f2d-08e2-4807-abb1-382e5c6f68da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.057190 Oct 17 13:07:55.828521 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1875/3655] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 13:07:55 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:56.015665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1787168128", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:56.110058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:07:56.448894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:56.457903 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f7d9e7e-f4b8-4010-9a6d-b9d4b3b88211 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.896250 Oct 17 13:07:56.459599 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1781/3656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:55 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:56.776424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:56.777642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:56.781318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:56.791928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:56.792678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:56.793441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:56.794686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:56.795747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:56.796417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:56.851091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:07:56.852062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:07:56.852831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:07:56.853525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:07:56.854049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:07:56.875260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:56.876277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:56.877152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:56.878395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:56.879194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:56.880048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:56.907097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:07:56.916740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for user bf508fbbaee740548bd6509b3d279b57 and project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:07:56.935383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:07:56.938483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:07:57.022102 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-014cc4e2-e085-482a-a9f3-97edc3886f52 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011039 Oct 17 13:07:57.023420 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1876/3657] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:07:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:07:57.038340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6eb01ab2-5167-41ae-bd14-4d9b97f2a9c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:57.039148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6eb01ab2-5167-41ae-bd14-4d9b97f2a9c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:57.264734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6eb01ab2-5167-41ae-bd14-4d9b97f2a9c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:57.276354 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6eb01ab2-5167-41ae-bd14-4d9b97f2a9c9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1213 microversion: 2.1 time: 0.244062 Oct 17 13:07:57.277379 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1877/3658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:57 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1213 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:57.366450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:57.387194 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cbce7c6f-9667-495e-9d0c-dbbd2f4373e5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1519 microversion: 2.1 time: 0.617005 Oct 17 13:07:57.395209 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1782/3659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:56 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1519 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:57.422416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:57.425265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:57.440199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:57.443720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:57.448727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:57.449717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:57.451684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:57.453709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:57.485419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:57.486260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:57.493161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lazy-loading 'flavor' on Instance uuid 6a0d03c6-2fe0-49bf-a32f-21ec17574681 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:07:57.499507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:57.500163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:57.501174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:57.501972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:57.502555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:57.502992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:57.647649 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-410138a6-d410-4284-ac70-470f8c141a58 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action" status: 200 len: 32 microversion: 2.1 time: 0.229714 Oct 17 13:07:57.652922 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1878/3660] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:07:57 2022] POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:07:57.660017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:57.660739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:57.676995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:57.677697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:57.678061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:57.678803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:57.679268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:57.679696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:57.911651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:57.922353 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6c7b9568-34f6-4967-9339-d2fa52aadc03 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.442048 Oct 17 13:07:57.930035 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1783/3661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:57 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:58.123219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:58.131365 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-665d3e2a-dad6-4261-b90d-57f4a2af719a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.476887 Oct 17 13:07:58.132583 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1879/3662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:57 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:58.306883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:58.308239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:58.321979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:58.323020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:58.324571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:58.325514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:58.327504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:58.328135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:58.528332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:58.537411 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-363e585f-d4d1-4665-89b2-616015376888 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1265 microversion: 2.1 time: 0.237073 Oct 17 13:07:58.538034 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1784/3663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:58 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:58.955881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:58.956691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:58.965890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:58.967236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:58.967775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:58.968746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:58.969427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:58.969955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:59.169808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:59.171895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:59.201324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:59.205155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:59.206695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:59.207778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:59.209274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:59.209909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:59.345768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:59.361449 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8127db7b-acbb-45ab-965e-0c842123431e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.410811 Oct 17 13:07:59.364221 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1880/3664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:58 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:59.370042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-058971db-c93f-4076-a93d-f66bdfd3b2c3 req-d8a2107a-5d6f-4d59-88d8-25fb6f5d1de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "tag": "d42ee3ac-da2f-45ea-ae11-913f70990f8d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:07:59.389196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-058971db-c93f-4076-a93d-f66bdfd3b2c3 req-d8a2107a-5d6f-4d59-88d8-25fb6f5d1de7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:59.390744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-058971db-c93f-4076-a93d-f66bdfd3b2c3 req-d8a2107a-5d6f-4d59-88d8-25fb6f5d1de7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:59.392860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-058971db-c93f-4076-a93d-f66bdfd3b2c3 req-d8a2107a-5d6f-4d59-88d8-25fb6f5d1de7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:59.429673 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-058971db-c93f-4076-a93d-f66bdfd3b2c3 req-d8a2107a-5d6f-4d59-88d8-25fb6f5d1de7 service nova] Creating event network-changed:d42ee3ac-da2f-45ea-ae11-913f70990f8d for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:07:59.439473 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-058971db-c93f-4076-a93d-f66bdfd3b2c3 req-d8a2107a-5d6f-4d59-88d8-25fb6f5d1de7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072880 Oct 17 13:07:59.441261 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1881/3665] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:59.571724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:59.574504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:07:59.596629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:59.597810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:59.598852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:59.602066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:07:59.604422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:07:59.607777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:07:59.836047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:59.847572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad9ea3f8-9d96-4fa0-9249-b982bc87bf0d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1271 microversion: 2.1 time: 0.289001 Oct 17 13:07:59.848161 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1882/3666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:59 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:59.885176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:07:59.893426 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-165a2cc7-37dc-4fbc-bb4e-c789e0b9620f tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.742148 Oct 17 13:07:59.906632 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1785/3667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:07:59 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:00.395721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:00.397595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:00.417368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:00.422583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:00.424016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:00.427798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:00.428859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:00.432857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:00.799256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:00.833100 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aae6890a-832f-4571-87e9-a0fed4756776 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.445108 Oct 17 13:08:00.833737 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1883/3668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:00 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:00.873994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:00.875373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:00.887467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:00.891766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:00.892461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:00.893376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:00.894089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:00.894730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:00.922240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:00.923040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:00.936221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:00.939926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:00.940564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:00.941459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:00.942072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:00.946316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:01.357632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:01.379222 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-84da6a23-b134-40db-89ae-bbd2c87d2944 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.462780 Oct 17 13:08:01.380563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1884/3669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:00 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:01.433518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:01.439662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:01.453722 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af8e0850-9c0d-478a-a2dd-5b8a8a549e62 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1313 microversion: 2.1 time: 0.583319 Oct 17 13:08:01.455818 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1786/3670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:00 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:01.860261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:01.861424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:01.875197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:01.875894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:01.883917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:01.884982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:01.885614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:01.886257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:02.258408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:02.267705 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5612391f-1ee6-4434-821a-4d063c04bf8e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.411306 Oct 17 13:08:02.268199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1885/3671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:01 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:02.408785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:02.409510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:02.432022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:02.437948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:02.439914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:02.444369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:02.446077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:02.447215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:02.476792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:02.477406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:02.489525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:02.498515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:02.499226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:02.499998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:02.500474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:02.500896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:02.565992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:02.995263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:03.022964 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d32549e6-3449-430f-844c-d70cf860201a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.619447 Oct 17 13:08:03.027548 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1787/3672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:02 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:03.048347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f532a78b-3935-49f0-b9e6-444b8f94f06f req-f2f0ae93-f157-4f75-8f2b-4c4c6a3dea02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9472cc-309e-4a00-b88c-15b2a9e5a65a", "tag": "29d4af6b-d4aa-4ef7-90ba-99895fa78c62"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:03.073448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f532a78b-3935-49f0-b9e6-444b8f94f06f req-f2f0ae93-f157-4f75-8f2b-4c4c6a3dea02 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:03.075223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f532a78b-3935-49f0-b9e6-444b8f94f06f req-f2f0ae93-f157-4f75-8f2b-4c4c6a3dea02 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:03.076824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f532a78b-3935-49f0-b9e6-444b8f94f06f req-f2f0ae93-f157-4f75-8f2b-4c4c6a3dea02 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:03.100407 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f532a78b-3935-49f0-b9e6-444b8f94f06f req-f2f0ae93-f157-4f75-8f2b-4c4c6a3dea02 service nova] Creating event network-changed:29d4af6b-d4aa-4ef7-90ba-99895fa78c62 for instance de9472cc-309e-4a00-b88c-15b2a9e5a65a on n-h1-853316-12 Oct 17 13:08:03.115189 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f532a78b-3935-49f0-b9e6-444b8f94f06f req-f2f0ae93-f157-4f75-8f2b-4c4c6a3dea02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086268 Oct 17 13:08:03.117923 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1788/3673] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:03.175475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:03.189941 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46a386ea-3945-4599-8dba-6995ef70d4a5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1313 microversion: 2.1 time: 0.714859 Oct 17 13:08:03.192182 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1886/3674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:02 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:03.295118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:03.295954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:03.306807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:03.307312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:03.307776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:03.313045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:03.313626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:03.314359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:03.652352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:03.660997 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-63164e55-c229-4fdf-ba4b-c16089ff3963 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.370661 Oct 17 13:08:03.666425 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1789/3675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:03 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:04.050213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:04.051058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:04.065349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:04.065838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:04.070840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:04.072535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:04.073279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:04.073838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:04.216999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:04.219361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:04.234480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:04.235465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:04.236194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:04.237386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:04.238038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:04.238504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:04.328709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:04.340006 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5726efec-a13d-4c18-83e0-7050930f84a5 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.294354 Oct 17 13:08:04.345026 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1887/3676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:04 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:04.472085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:04.483799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0a3d60f0-abdd-4c97-be04-ce3ac2e2be5d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1313 microversion: 2.1 time: 0.271189 Oct 17 13:08:04.490404 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1790/3677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:04 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:04.694950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:04.695918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:04.714736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:04.715683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:04.719201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:04.720305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:04.723335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:04.724724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:04.735687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c2a5495-0419-4251-b70a-a71d51a01bd3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'create', calling method: .version_select at 0x7fa820a493a0>, body: {"keypair": {"name": "tempest-keypair-2609902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2FtE9fYwsE2SlvBpVdEJevm6cO0x5+bciE442gPKcoz1yFGjodae0FxLS73OVfLxPw/kG7rxKVDo747qUPhAK7NYCz9gyWFMp/sDXRT2rmDMBwugdV9anmcL5Bhi1HwQ=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:04.770984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-9c2a5495-0419-4251-b70a-a71d51a01bd3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:08:04.786320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-9c2a5495-0419-4251-b70a-a71d51a01bd3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for user c71ac2b898f649cdaa99fbace633e738 and project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:08:04.878812 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c2a5495-0419-4251-b70a-a71d51a01bd3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.532643 Oct 17 13:08:04.879422 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1888/3678] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:08:04 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:05.064369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3b8c15a4-635d-48a0-9bd1-1f3a1a706c56 req-8a5d080c-c5fb-421f-a985-3730026af741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "name": "network-vif-plugged", "status": "completed", "tag": "d5fe2f24-d8ea-4b1e-b386-b583508468ef"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:05.083035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:05.102992 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-afa887d1-7628-4311-b067-54dab4843240 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.413344 Oct 17 13:08:05.105249 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1791/3679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:04 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:05.120574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3b8c15a4-635d-48a0-9bd1-1f3a1a706c56 req-8a5d080c-c5fb-421f-a985-3730026af741 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:05.121799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3b8c15a4-635d-48a0-9bd1-1f3a1a706c56 req-8a5d080c-c5fb-421f-a985-3730026af741 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:05.123132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3b8c15a4-635d-48a0-9bd1-1f3a1a706c56 req-8a5d080c-c5fb-421f-a985-3730026af741 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:05.151600 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3b8c15a4-635d-48a0-9bd1-1f3a1a706c56 req-8a5d080c-c5fb-421f-a985-3730026af741 service nova] Creating event network-vif-plugged:d5fe2f24-d8ea-4b1e-b386-b583508468ef for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:08:05.168305 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3b8c15a4-635d-48a0-9bd1-1f3a1a706c56 req-8a5d080c-c5fb-421f-a985-3730026af741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112299 Oct 17 13:08:05.179031 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1889/3680] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:05.365095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:05.366046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:05.378468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:05.385309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:05.386371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:05.387583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:05.389458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:05.390299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:05.509025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:05.509861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:05.527735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:05.529713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:05.530421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:05.533422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:05.535195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:05.536054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:05.712559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:05.728342 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2685e692-62cd-4c7b-85ee-440e672f0ecf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.366453 Oct 17 13:08:05.730140 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1792/3681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:05 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:05.980230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:06.005864 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-100e280a-5ab8-461e-8d45-6e9d3f94a65e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1313 microversion: 2.1 time: 0.501419 Oct 17 13:08:06.014465 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1890/3682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:05 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:06.135176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:06.136196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:06.177187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:06.177716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:06.178206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:06.179075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:06.179826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:06.180445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:06.657291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:06.683196 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7fd9d274-a476-439d-afae-21307dc2083e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.552101 Oct 17 13:08:06.686476 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1793/3683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:06 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:06.758814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:06.760318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:06.768305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:06.769007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:06.769680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:06.770634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:06.771277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:06.772382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:06.892842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:06.956825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:06.969704 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31be2718-fbb7-403f-b965-568d995ab57b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.217936 Oct 17 13:08:06.982495 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1891/3684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:06 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:07.036041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:07.037534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:07.046405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:07.047327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:07.047911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:07.048806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:07.050075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:07.050693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:07.236638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-16db951f-b2ed-42c3-a9ef-ebb1c45f331a req-302d4ae5-098e-4117-a2e1-a857eaff08f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "name": "network-vif-plugged", "status": "completed", "tag": "5c00c940-c3e1-40aa-a816-adf26363cd21"}, {"server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "name": "network-vif-plugged", "status": "completed", "tag": "50d9fcc4-0f70-41cb-b15e-19e2fd56ba8f"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:07.254644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16db951f-b2ed-42c3-a9ef-ebb1c45f331a req-302d4ae5-098e-4117-a2e1-a857eaff08f7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:07.260835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16db951f-b2ed-42c3-a9ef-ebb1c45f331a req-302d4ae5-098e-4117-a2e1-a857eaff08f7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:07.261878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16db951f-b2ed-42c3-a9ef-ebb1c45f331a req-302d4ae5-098e-4117-a2e1-a857eaff08f7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:07.288868 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-16db951f-b2ed-42c3-a9ef-ebb1c45f331a req-302d4ae5-098e-4117-a2e1-a857eaff08f7 service nova] Creating event network-vif-plugged:5c00c940-c3e1-40aa-a816-adf26363cd21 for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:08:07.295978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-16db951f-b2ed-42c3-a9ef-ebb1c45f331a req-302d4ae5-098e-4117-a2e1-a857eaff08f7 service nova] Creating event network-vif-plugged:50d9fcc4-0f70-41cb-b15e-19e2fd56ba8f for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:08:07.307860 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-16db951f-b2ed-42c3-a9ef-ebb1c45f331a req-302d4ae5-098e-4117-a2e1-a857eaff08f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075397 Oct 17 13:08:07.312273 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1892/3685] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:07.657479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:07.670565 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5ad4be46-4f29-483d-8846-f671122d1829 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1313 microversion: 2.1 time: 0.641824 Oct 17 13:08:07.671288 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1794/3686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:07 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:07.713661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:07.714667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:07.727811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:07.728325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:07.728771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:07.730482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:07.735041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:07.735736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:07.998861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:08.001662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:08.024394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:08.024814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:08.025286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:08.026028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:08.026563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:08.026951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:08.104056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:08.113053 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-446dfed8-f6c4-47c3-a040-49f36c1e8b71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1355 microversion: 2.1 time: 0.403638 Oct 17 13:08:08.123531 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1893/3687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:07 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1355 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:08.218067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2060700577", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525"}], "security_groups": [{"name": "tempest-securitygroup--1455352944"}], "key_name": "tempest-keypair-2609902", "user_data": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:08.288138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:08.313927 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e06cef9-b560-4a4e-aebc-d60131bfa72c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.321918 Oct 17 13:08:08.317431 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1795/3688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:07 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:08.385103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] validate_networks() for [('24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:08:08.698261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:08.698941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:08.717215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:08.718774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:08.721657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:08.724620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:08.725996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:08.729460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:08.971689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:08:08.972493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:08:08.973596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:08:08.974444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:08:08.975355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:08:09.003985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.018974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.019506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.020325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.021395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.021395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.032995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:09.050884 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-773f26ad-b0f3-4880-9457-e74946c89994 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1313 microversion: 2.1 time: 0.356820 Oct 17 13:08:09.051822 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1796/3689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:08 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:09.074255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:08:09.082333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for user c71ac2b898f649cdaa99fbace633e738 and project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:08:09.113718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:08:09.119959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:08:09.140643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:09.141407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:09.158581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.159546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.161869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.162808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.163420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.165170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.248447 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2bcbdba-80bb-42ce-b5b2-34164d1197ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.032934 Oct 17 13:08:09.251525 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1894/3690] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:08:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:08:09.266857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-884a5199-bba4-49f1-81bd-29e606952af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:09.267982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-884a5199-bba4-49f1-81bd-29e606952af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:09.300134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:09.430784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-884a5199-bba4-49f1-81bd-29e606952af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:09.441638 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-884a5199-bba4-49f1-81bd-29e606952af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1236 microversion: 2.1 time: 0.182939 Oct 17 13:08:09.453343 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1895/3691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:09 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1236 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:09.488042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:09.489656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:09.491382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:09.500198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.501049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.501208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.502054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.502539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.502974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.515004 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b263e6a1-ef87-4b6a-ae00-cdb9c865f31e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1804 microversion: 2.1 time: 0.377571 Oct 17 13:08:09.530202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1797/3692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:09 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1804 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:09.542139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:09.542940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:09.550411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.551142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.551736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.552756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.553367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.554099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.582390 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d0cc01b-8e5a-4b43-8737-a871403152b7 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca/ips" status: 200 len: 217 microversion: 2.1 time: 0.044949 Oct 17 13:08:09.590862 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1798/3693] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:08:09 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca/ips => generated 217 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:08:09.596911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:09.597859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:09.605937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.606939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.607844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.609013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.609780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.610395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.666526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:08:09.853163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:09.883487 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4c8f013e-eeab-4585-9cd4-9c37f353a5c3 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "DELETE /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 204 len: 0 microversion: 2.1 time: 0.288559 Oct 17 13:08:09.889131 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f964534c-34d0-4a3b-9a33-03acc24114a0 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.430412 Oct 17 13:08:09.889359 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1799/3694] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:08:09 2022] DELETE /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:08:09.889454 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1896/3695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:09 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:09.896900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cd7d6614-fdf9-453f-a157-cf680fd668e3 req-55839929-89c2-4915-aebf-7461ab296d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9472cc-309e-4a00-b88c-15b2a9e5a65a", "name": "network-vif-plugged", "status": "completed", "tag": "29d4af6b-d4aa-4ef7-90ba-99895fa78c62"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:09.912738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:09.913281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:09.926934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.931920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.933936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.935510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.935998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.936329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd7d6614-fdf9-453f-a157-cf680fd668e3 req-55839929-89c2-4915-aebf-7461ab296d0c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:09.936993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd7d6614-fdf9-453f-a157-cf680fd668e3 req-55839929-89c2-4915-aebf-7461ab296d0c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:09.937624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd7d6614-fdf9-453f-a157-cf680fd668e3 req-55839929-89c2-4915-aebf-7461ab296d0c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.938588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:09.977048 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cd7d6614-fdf9-453f-a157-cf680fd668e3 req-55839929-89c2-4915-aebf-7461ab296d0c service nova] Creating event network-vif-plugged:29d4af6b-d4aa-4ef7-90ba-99895fa78c62 for instance de9472cc-309e-4a00-b88c-15b2a9e5a65a on n-h1-853316-12 Oct 17 13:08:09.995380 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cd7d6614-fdf9-453f-a157-cf680fd668e3 req-55839929-89c2-4915-aebf-7461ab296d0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105035 Oct 17 13:08:09.997144 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1800/3696] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:10.080640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:10.081784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:10.109597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:10.110757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:10.111715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:10.113015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:10.115848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:10.116814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:10.331427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:10.343745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-360c7274-b598-4d3f-96cf-4d3890baaa3c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1810 microversion: 2.1 time: 0.452354 Oct 17 13:08:10.349265 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1897/3697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:09 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1810 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:10.485963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:10.486618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:10.515198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:10.515787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:10.518784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:10.523538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:10.524998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:10.526730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:10.549082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:10.557999 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71da795e-8782-4bf3-89b2-4a2b538ed8e9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1313 microversion: 2.1 time: 0.483119 Oct 17 13:08:10.570192 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1801/3698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:10 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:10.676231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:10.713932 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-987ccd8c-709a-4018-ad40-fabcca372fde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1232 microversion: 2.1 time: 0.234533 Oct 17 13:08:10.715127 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1898/3699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:10 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1232 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:10.940064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:10.941187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:10.956438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:10.958833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:10.959536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:10.960464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:10.961715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:10.962593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:11.337573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:11.354521 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-399940d8-7230-4667-89f0-d5bdcb5309ce tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.444629 Oct 17 13:08:11.355105 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1802/3700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:10 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:11.386419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:11.392100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:11.423063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:11.424067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:11.424516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:11.425309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:11.425893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:11.426564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:11.599660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:11.602805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:11.616596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:11.617458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:11.618103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:11.619073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:11.620098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:11.621013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:11.642006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:11.691246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:11.712143 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-053a017e-0d55-4247-9847-8e349cd398ed tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1810 microversion: 2.1 time: 0.336548 Oct 17 13:08:11.726186 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1899/3701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:11 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1810 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:11.739003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:11.744373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:11.759880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:11.760696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:11.761328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:11.762309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:11.763684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:11.764282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:11.859148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:11.870602 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ecf60844-d21e-429f-a3c8-37775ec96340 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1288 microversion: 2.1 time: 0.136079 Oct 17 13:08:11.871182 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1900/3702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:11 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1288 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:11.944732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:11.960771 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84d8a4e8-5161-49ec-977c-d253d2d59d20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1313 microversion: 2.1 time: 0.377195 Oct 17 13:08:11.961914 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1803/3703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:11 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:12.384136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:12.385915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:12.398817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:12.400156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:12.401010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:12.402287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:12.402992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:12.406539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:12.425577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-99bbc6b8-d028-4e51-bffb-4777d18eb1aa req-1b27842e-a9d6-4368-bdaa-df95592db6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "name": "network-vif-deleted", "tag": "5c00c940-c3e1-40aa-a816-adf26363cd21"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:12.458010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-99bbc6b8-d028-4e51-bffb-4777d18eb1aa req-1b27842e-a9d6-4368-bdaa-df95592db6aa service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:12.461150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-99bbc6b8-d028-4e51-bffb-4777d18eb1aa req-1b27842e-a9d6-4368-bdaa-df95592db6aa service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:12.465203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-99bbc6b8-d028-4e51-bffb-4777d18eb1aa req-1b27842e-a9d6-4368-bdaa-df95592db6aa service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:12.507814 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-99bbc6b8-d028-4e51-bffb-4777d18eb1aa req-1b27842e-a9d6-4368-bdaa-df95592db6aa service nova] Creating event network-vif-deleted:5c00c940-c3e1-40aa-a816-adf26363cd21 for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:08:12.517066 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-99bbc6b8-d028-4e51-bffb-4777d18eb1aa req-1b27842e-a9d6-4368-bdaa-df95592db6aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097213 Oct 17 13:08:12.518214 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1804/3704] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:08:12.710070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:12.723294 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9fbf3342-3854-42b5-b9ce-53ccca84fb9d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.345840 Oct 17 13:08:12.724896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1901/3705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:12 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:12.747366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:12.747366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:12.770878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:12.772810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:12.781684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:12.782992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:12.783856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:12.785239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:12.898153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:12.899127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:12.915607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:12.915833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:12.920111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:12.920780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:12.922951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:12.926506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:13.062682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:13.073622 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe4a759e-7c2f-4ea5-9194-9dc56d3db492 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1294 microversion: 2.1 time: 0.182193 Oct 17 13:08:13.075003 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1902/3706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:12 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1294 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:13.084361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:13.085429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:13.093898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:13.094485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:13.095272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:13.096364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:13.097042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:13.097649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:13.302362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:13.311477 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a12ed10e-e755-426f-b3a5-9535b1686a5a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1462 microversion: 2.1 time: 0.234766 Oct 17 13:08:13.323466 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1903/3707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:13 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1462 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:13.337577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:13.342792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:13.351431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:13.352246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:13.352920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:13.353966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:13.354735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:13.355527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:13.480712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:13.488730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Old instance type m1.heat2, new instance type m1.heat {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:08:13.500083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:08:13.501409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:08:13.502135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:08:13.502816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:08:13.503413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:08:13.531288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:13.553122 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c33369cd-351a-4ec9-b116-6ad7f633f317 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1631 microversion: 2.1 time: 0.816384 Oct 17 13:08:13.554625 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1805/3708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:12 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1631 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:13.683715 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6420503f-d7b1-4c36-9ae4-34c0d6331ec8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a/action" status: 202 len: 0 microversion: 2.1 time: 0.350578 Oct 17 13:08:13.685934 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1904/3709] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:08:13 2022] POST /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:08:13.720044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:13.723819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:13.747363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:13.748713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:13.749770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:13.750861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:13.754221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:13.754895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:13.755832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:13.758461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:13.767418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:13.769262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:13.769977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:13.770499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:13.770963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:13.771394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:14.008492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:14.013015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:14.028908 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-34a4f8b8-9c7c-4581-9f3f-0eec10d87a02 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.275808 Oct 17 13:08:14.030408 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1905/3710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:13 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:14.238313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:14.251960 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-33704c94-83b3-4ede-82c6-84388916e140 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1471 microversion: 2.1 time: 0.561726 Oct 17 13:08:14.253311 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1806/3711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:13 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1471 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:14.260140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:14.261052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:14.269150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:14.269939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:14.270407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:14.271262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:14.272022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:14.272487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:14.372510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3539c1a8-54b4-41bf-8542-601967a0a417 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'create', calling method: .version_select at 0x7fa8208f0e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1781650193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAn73wVyEquoBKIsIJCOoCnR7SILIsmNQ72X66lKuj5fjodj+vE/bFekuUNmJYLDX4Sz44U8zCTjOufTAEGQpqOxKah3rSO0RPAKtD+1UIUe0ZYNaT8Vbby5luqvnwwgw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:14.394820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3539c1a8-54b4-41bf-8542-601967a0a417 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for project e5d16284093341d980341f1dce38f68b. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:08:14.404088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3539c1a8-54b4-41bf-8542-601967a0a417 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for user 0cee3a8479444aa3a00b2c29407931d9 and project e5d16284093341d980341f1dce38f68b. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:08:14.445304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3539c1a8-54b4-41bf-8542-601967a0a417 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.413533 Oct 17 13:08:14.463917 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1906/3712] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:08:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:14.576717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a7bb4afb-052a-4fc3-9160-a0436caac406 req-9c4f54d7-8e47-49f0-8389-9e985ddc972c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "name": "network-vif-deleted", "tag": "50d9fcc4-0f70-41cb-b15e-19e2fd56ba8f"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:14.608595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a7bb4afb-052a-4fc3-9160-a0436caac406 req-9c4f54d7-8e47-49f0-8389-9e985ddc972c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:14.609124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a7bb4afb-052a-4fc3-9160-a0436caac406 req-9c4f54d7-8e47-49f0-8389-9e985ddc972c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:14.609611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a7bb4afb-052a-4fc3-9160-a0436caac406 req-9c4f54d7-8e47-49f0-8389-9e985ddc972c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:14.672532 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a7bb4afb-052a-4fc3-9160-a0436caac406 req-9c4f54d7-8e47-49f0-8389-9e985ddc972c service nova] Creating event network-vif-deleted:50d9fcc4-0f70-41cb-b15e-19e2fd56ba8f for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:08:14.689248 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a7bb4afb-052a-4fc3-9160-a0436caac406 req-9c4f54d7-8e47-49f0-8389-9e985ddc972c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121044 Oct 17 13:08:14.689248 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1907/3713] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:08:14.717986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:14.719315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:14.735026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:14.736606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:14.737986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:14.739004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:14.741946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:14.742674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:14.774426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:14.786368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b0f31d9-6cb3-4a4b-a636-555db99708ec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.531744 Oct 17 13:08:14.789463 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1807/3714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:14 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:15.052560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:15.053181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:15.070468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:15.070973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:15.071419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:15.072423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:15.073064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:15.073651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:15.185121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:15.198050 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-365c3444-fc04-41e8-9c4d-02efcd026b27 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1495 microversion: 2.1 time: 0.499796 Oct 17 13:08:15.216627 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1908/3715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:14 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1495 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:15.282890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:15.283646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:15.301388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:15.301963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:15.302451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:15.303189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:15.303801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:15.304262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:15.622746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:15.649451 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d75a6d36-ea43-410a-b7fc-f72a7e25192e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1471 microversion: 2.1 time: 0.372813 Oct 17 13:08:15.656718 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1909/3716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:15 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:15.745644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:15.779493 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ec647f7-1489-4ad8-aa32-3c84031f62e6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.729254 Oct 17 13:08:15.782961 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1808/3717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:15 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:15.818325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:15.820008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:15.828977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:15.829770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:15.830500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:15.833628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:15.834988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:15.835776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.227537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:16.228171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:16.235554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:16.236044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:16.236487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.237199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:16.237652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:16.238080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.272267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:16.272938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:16.273523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.274197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lazy-loading 'fault' on Instance uuid afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:08:16.303389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:16.313495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2026f50f-0dea-4460-8439-1199001a4ec7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.505263 Oct 17 13:08:16.314466 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1910/3718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:15 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:16.378911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:16.387462 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72c74dc7-49a3-4b92-af8b-5296eed5343f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 200 len: 1303 microversion: 2.1 time: 0.163849 Oct 17 13:08:16.388791 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1809/3719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:16 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:16.672497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:16.673142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:16.680278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:16.681038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:16.681607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.682524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:16.682980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:16.683439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.739317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b4ef4ad3-47bf-468d-b36e-d02c8d03ebb2 req-b7b15f76-8a94-4d2c-942e-c4506fedc9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca", "name": "network-vif-deleted", "tag": "d5fe2f24-d8ea-4b1e-b386-b583508468ef"}, {"name": "network-changed", "server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:16.762655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b4ef4ad3-47bf-468d-b36e-d02c8d03ebb2 req-b7b15f76-8a94-4d2c-942e-c4506fedc9bc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:16.763198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b4ef4ad3-47bf-468d-b36e-d02c8d03ebb2 req-b7b15f76-8a94-4d2c-942e-c4506fedc9bc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:16.763632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b4ef4ad3-47bf-468d-b36e-d02c8d03ebb2 req-b7b15f76-8a94-4d2c-942e-c4506fedc9bc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.784112 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b4ef4ad3-47bf-468d-b36e-d02c8d03ebb2 req-b7b15f76-8a94-4d2c-942e-c4506fedc9bc service nova] Creating event network-vif-deleted:d5fe2f24-d8ea-4b1e-b386-b583508468ef for instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca on n-h2-853316-12 Oct 17 13:08:16.787713 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b4ef4ad3-47bf-468d-b36e-d02c8d03ebb2 req-b7b15f76-8a94-4d2c-942e-c4506fedc9bc service nova] Creating event network-changed:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:08:16.804823 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b4ef4ad3-47bf-468d-b36e-d02c8d03ebb2 req-b7b15f76-8a94-4d2c-942e-c4506fedc9bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068787 Oct 17 13:08:16.806112 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1810/3720] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:16.815911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:16.816939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:16.826497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:16.826999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:16.827448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.828405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:16.828867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:16.829316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:16.937195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:16.950537 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a88746e5-a468-434a-b2a9-3caae4c526db tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1471 microversion: 2.1 time: 0.281367 Oct 17 13:08:16.966530 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1911/3721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:16 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:17.259563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:17.271033 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5866ba29-2651-45cf-9702-914da0358c87 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.463732 Oct 17 13:08:17.291364 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1811/3722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:16 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:17.338749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:17.339624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:17.348846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:17.349537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:17.350175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:17.351089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:17.351773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:17.352427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:17.422742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:17.424123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:17.443751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:17.446913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:17.447720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:17.451385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:17.454954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:17.455935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:17.480846 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] HTTP exception thrown: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Request method failure captured: Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca HTTP/1.1 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVOMU9XBPBBZtUyGahh4b0WmNNCaZyBYvwTx_Byqp1pwCpfzOArgwXzzHlQoWE0V2IkWe_Vjig9bui4uJxHcLDOfLYjkZ8tp8bxjW1V-Nb22VZMEJrlMG3wjZSBn6X65X4BMXyE9MKF8kRXtDGSU_qq30LR8be_SYeFeknRaQs4SeoU Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09be9f1c4cc643eeb22541372cdd8b50", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestMultiNic-545421640 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestMultiNic-545421640-project Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: aef5a5a23c3349ef8648e287a5273ba2 Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestMultiNic-545421640-project Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca'} Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:08:17.484199 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:17.489422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:17.489422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:08:17.489422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:08:17.489422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:08:17.489422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:08:17.489422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:08:17.489422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:17.491354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Returning 404 to user: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:08:17.492715 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d617c1d-7393-4c1f-8eda-c564fee0d7d2 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 404 len: 111 microversion: 2.1 time: 0.083275 Oct 17 13:08:17.493445 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1812/3723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:17 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:08:17.624009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:17.639587 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-608f3686-91e5-4e0f-aeba-8171313776b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.305764 Oct 17 13:08:17.641421 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1912/3724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:17 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:17.975196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:17.975837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:17.983067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:17.984054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:17.984673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:17.986205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:17.986963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:17.987408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:18.305578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:18.307027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:18.317970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:18.318774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:18.319452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:18.320391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:18.321048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:18.321675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:18.569173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:18.581888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1f1dc81-2257-4343-9dcf-1565bf48b7bd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1471 microversion: 2.1 time: 0.610683 Oct 17 13:08:18.582514 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1813/3725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:17 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1471 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:18.670511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:18.671322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:18.682755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:18.683483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:18.684566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:18.686887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:18.688661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:18.689306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:18.802581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:18.837917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1f47bdde-5d37-41ed-a5ce-fadfd00cad73 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.537930 Oct 17 13:08:18.842660 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1913/3726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:18 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:19.034526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:19.046025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-364362c2-83cb-41dc-aa2c-5ddd22baa42d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.380561 Oct 17 13:08:19.046937 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1814/3727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:18 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:19.621000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:19.624570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:19.627994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:19.637114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:19.639817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:19.640419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:19.641417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:19.641980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:19.642677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:19.867334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:19.868283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:19.885873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:19.886747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:19.887553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:19.889331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:19.890020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:19.890692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:20.008120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:20.029483 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55d9a61d-a9f3-44b4-87f6-80ad179d09c1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1471 microversion: 2.1 time: 0.415264 Oct 17 13:08:20.031686 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1914/3728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:19 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:20.079118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:20.081160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:20.097438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:20.098259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:20.098883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:20.100652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:20.101287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:20.101949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:20.493739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:20.507251 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-834b6d84-77f9-463f-9832-4b1bfea76eaf tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.643119 Oct 17 13:08:20.523719 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1815/3729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:19 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:20.729525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:20.741726 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-772035b9-9887-4c5b-b60a-eed052b5276e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.670760 Oct 17 13:08:20.750670 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1915/3730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:20 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:21.057960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:21.058678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:21.073721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:21.074797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:21.078250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:21.079238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:21.079742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:21.080170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:21.547781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:21.548437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:21.560631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:21.561636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:21.562305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:21.565255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:21.565942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:21.567046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:21.603715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:21.624898 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-423dc060-83d6-426a-b42f-b887e69c44ff tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.571235 Oct 17 13:08:21.626419 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1816/3731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:21 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:21.778635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:21.779667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:21.790057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:21.791589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:21.793165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:21.795438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:21.796416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:21.797068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:21.998685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:22.011429 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56aaab29-19c5-476f-87af-152d78ae38f6 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.468991 Oct 17 13:08:22.012380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1916/3732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:21 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:22.293547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:22.311485 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9df31975-a142-43fa-b78e-f279e5a4f48f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.531374 Oct 17 13:08:22.312589 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1817/3733] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:21 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:22.658293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:22.659035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:22.673198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:22.673987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:22.674782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:22.677705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:22.681797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:22.682553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:23.039301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:23.040532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:23.051335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:23.061047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:23.061516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:23.065771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:23.066286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:23.066726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:23.127380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:23.140865 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-beba0512-a81b-432b-824e-0f64999488fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.487457 Oct 17 13:08:23.141769 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1917/3734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:22 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:23.339562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:23.340391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:23.354328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:23.355175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:23.355925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:23.357505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:23.359874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:23.361168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:23.423639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:23.437290 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6541d3d0-f5d2-4ef1-854f-ff7c97896593 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.401845 Oct 17 13:08:23.446962 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1818/3735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:23 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:23.741926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:23.792775 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-523e5c93-d906-44e1-8be5-fc9d49da33fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.457338 Oct 17 13:08:23.796362 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1918/3736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:23 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:24.165553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:24.166909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:24.180811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:24.181701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:24.182146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:24.182888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:24.186362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:24.187002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:24.361671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-452e42b6-e92e-44ea-8093-0720c09691d6 req-2151ec35-25d2-4a6c-8ff4-8c8e8921e759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "name": "network-vif-plugged", "status": "completed", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:24.378317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-452e42b6-e92e-44ea-8093-0720c09691d6 req-2151ec35-25d2-4a6c-8ff4-8c8e8921e759 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:24.379008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-452e42b6-e92e-44ea-8093-0720c09691d6 req-2151ec35-25d2-4a6c-8ff4-8c8e8921e759 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:24.380145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-452e42b6-e92e-44ea-8093-0720c09691d6 req-2151ec35-25d2-4a6c-8ff4-8c8e8921e759 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:24.404875 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-452e42b6-e92e-44ea-8093-0720c09691d6 req-2151ec35-25d2-4a6c-8ff4-8c8e8921e759 service nova] Creating event network-vif-plugged:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:08:24.419836 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-452e42b6-e92e-44ea-8093-0720c09691d6 req-2151ec35-25d2-4a6c-8ff4-8c8e8921e759 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055089 Oct 17 13:08:24.419836 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1919/3737] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:24.470029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:24.474976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:24.478814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=24 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:24.491873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:24.492616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:24.493221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:24.496141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:24.498350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:24.498999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:24.574994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:24.584612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b277094-5ae3-49c5-9e00-9573b97cd771 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.424574 Oct 17 13:08:24.585793 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1819/3738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:24 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:24.590685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-275959896", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "de75a828-8b2f-48f8-a3d7-c5609eb4cd00"}, {"uuid": "4f455131-30e8-4ca2-a0e5-7de2e02a3e80"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:24.667088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] validate_networks() for [('de75a828-8b2f-48f8-a3d7-c5609eb4cd00', None, None, None, None, None), ('4f455131-30e8-4ca2-a0e5-7de2e02a3e80', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:08:24.863986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:24.873744 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c4a6496c-be97-4fda-b58d-6069ff38bb36 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.408041 Oct 17 13:08:24.875109 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1920/3739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:24 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:24.881783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:24.882684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:24.890618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:24.891371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:24.892111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:24.893417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:24.894347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:24.894984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:25.052334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:25.070122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ed4c2bb-9c98-45f2-b5d4-7a1fff3a3743 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.193664 Oct 17 13:08:25.071833 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1921/3740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:24 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:25.612821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:25.613554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:25.624530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:25.625050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:25.625539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:25.628697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:25.629365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:25.629797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:25.832654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:25.844302 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0e4dd914-e39d-4562-91c3-394619fec45f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.236306 Oct 17 13:08:25.846176 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1922/3741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:25 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:25.900712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:25.901337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:25.914266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:25.914769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:25.915211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:25.916074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:25.916540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:25.916971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:26.106734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:08:26.107735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:08:26.108381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:08:26.108990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:08:26.109732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:08:26.123008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:26.123496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:26.123948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:26.124697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:26.125163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:26.125591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:26.137366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:26.147378 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-66b24346-c819-456e-987b-2e7712d2cd62 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.250433 Oct 17 13:08:26.148694 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1923/3742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:25 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:26.154125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:26.155215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:26.176863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:26.177364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:26.177807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:26.178530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Getting quotas for project 09be9f1c4cc643eeb22541372cdd8b50. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:08:26.178684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:26.179002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:26.179437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:26.186036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Getting quotas for user aef5a5a23c3349ef8648e287a5273ba2 and project 09be9f1c4cc643eeb22541372cdd8b50. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:08:26.205197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:08:26.208169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:08:26.266225 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d4f96cf-ff13-480a-8474-1de3b5bb3cbd tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679073 Oct 17 13:08:26.267324 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1820/3743] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:08:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:08:26.281397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83d828fe-b297-4ec2-a344-58992043b58b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:26.282472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83d828fe-b297-4ec2-a344-58992043b58b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:26.289431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:26.529254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:26.535422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83d828fe-b297-4ec2-a344-58992043b58b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:26.536460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:26.552418 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca55ada9-07f3-4bca-8d48-821d59e0373b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1362 microversion: 2.1 time: 0.392298 Oct 17 13:08:26.553488 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1924/3744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:26 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:26.560224 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-83d828fe-b297-4ec2-a344-58992043b58b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1212 microversion: 2.1 time: 0.282633 Oct 17 13:08:26.564711 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1821/3745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:26 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1212 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:26.882723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:26.883991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:26.896307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:26.897573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:26.904919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:26.906296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:26.906967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:26.907796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:27.173138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:27.174868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:27.197179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:27.197673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:27.198114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:27.198882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:27.199334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:27.212196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:27.315066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:27.329035 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-390b2171-9649-40f5-b109-4d5f9463e13d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.464595 Oct 17 13:08:27.332177 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1925/3746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:26 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:27.583349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:27.584334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:27.598493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:27.599822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:27.600527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:27.609343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:27.610054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:27.610765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:27.781145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:27.791557 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-36629fcb-a72f-4d80-8f76-1b26b93b0233 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.624201 Oct 17 13:08:27.792164 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1822/3747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:27 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:27.812199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:27.813091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:27.823717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:27.824432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:27.825583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:27.826495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:27.829811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:27.830454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:27.874457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:27.936795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:27.947748 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-389b9104-555b-4219-ba8a-b043dd9bba24 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1548 microversion: 2.1 time: 0.369555 Oct 17 13:08:27.948425 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1926/3748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:27 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1548 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:27.972718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:27.973618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:27.980506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:27.981820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:27.982457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:27.983936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:27.984581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:27.985182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:28.187573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:28.193325 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62b52a54-8e5b-4bea-9a1a-e8e55b9994d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.224762 Oct 17 13:08:28.194276 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1927/3749] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:08:27 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:08:28.202307 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-03a6b860-cbaa-41e4-b6ef-244b361388ee tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1264 microversion: 2.1 time: 0.404961 Oct 17 13:08:28.202908 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1823/3750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:27 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1264 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:28.359174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:28.360007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:28.373185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:28.376269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:28.376856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:28.377893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:28.381148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:28.381743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:28.819783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:28.820395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:28.829065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:28.829819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:28.829973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:28.839699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:28.840405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:28.842328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:28.863156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:28.875942 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3557332-5f1e-47c0-a6a9-393284985a63 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.523594 Oct 17 13:08:28.881330 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1928/3751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:28 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:28.895914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1088477339", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "82d7a487-5820-40e4-b3c6-5ce362bbc070"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1781650193", "security_groups": [{"name": "tempest-secgroup-smoke-1336859759"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:29.286898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:29.301774 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb2c6707-2c87-4998-a7bd-621c60c5422e tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1525 microversion: 2.1 time: 0.484928 Oct 17 13:08:29.303914 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1824/3752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:28 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1525 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:29.314809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:29.318998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:29.338287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:29.339185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:29.339919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:29.344616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:29.345494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:29.346182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:29.616174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] validate_networks() for [('82d7a487-5820-40e4-b3c6-5ce362bbc070', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:08:29.710485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:29.732690 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6ec1f8c-42ef-48b6-b882-9dd9b946bf01 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1270 microversion: 2.1 time: 0.424618 Oct 17 13:08:29.746756 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1825/3753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:29 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1270 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:29.907191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:29.908217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:29.917860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:29.922967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:29.925925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:29.927030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:29.927951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:29.929608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:30.475020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:30.489712 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c20d6077-7b90-4787-b57c-eebb7bdef242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.587967 Oct 17 13:08:30.493276 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1826/3754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:29 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:30.511468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:30.512278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:30.531177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:30.532069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:30.532692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:30.533755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:30.534411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:30.535070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:31.009762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:31.030419 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f6cf1136-8c23-4b31-a8f6-236eaa78486c tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1505 microversion: 2.1 time: 0.530341 Oct 17 13:08:31.031068 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1827/3755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:30 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:31.035726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:31.043176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:31.070076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:31.070935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:31.071597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:31.072526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:31.073158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:31.073768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:31.330012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:08:31.330742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:08:31.332090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:08:31.332659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:08:31.333989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:08:31.351102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:31.351843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:31.352366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:31.361749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:31.362792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:31.363413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:31.413409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for project e5d16284093341d980341f1dce38f68b. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:08:31.429331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for user 0cee3a8479444aa3a00b2c29407931d9 and project e5d16284093341d980341f1dce38f68b. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:08:31.475117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:08:31.483026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:08:31.531023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:31.547528 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-59c80394-30aa-47f1-88a2-7a9d496c03ff tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1312 microversion: 2.1 time: 0.513019 Oct 17 13:08:31.551179 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1828/3756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:31 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1312 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:31.567605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0af21d18-4d92-4e70-a16a-b6c6d95e75dd tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Action: 'create', calling method: .version_select at 0x7fa8251351f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1135448545", "description": "tempest-description-1418794589"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:31.620789 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2be2f41-dffa-4493-966a-1f7e28659c4e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.736969 Oct 17 13:08:31.621462 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1929/3757] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:08:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:08:31.647540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:31.648128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:31.650066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:31.683440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:31.683929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:31.684628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:31.685907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:31.686398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:31.686827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:32.035090 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0af21d18-4d92-4e70-a16a-b6c6d95e75dd tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.479672 Oct 17 13:08:32.036062 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1829/3758] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:08:31 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:32.052047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b920f5b0-c713-489a-9192-7f44ca46eb53 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:32.058080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b920f5b0-c713-489a-9192-7f44ca46eb53 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:32.088431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:32.127760 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de4fbd66-4531-4ac0-821d-6d65253d29b9 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.492181 Oct 17 13:08:32.130823 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1930/3759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:31 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:32.156411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d7990d61-671a-4ddf-bfe4-c68e2b9e2837 req-a709f7a7-3f06-427f-a867-0864ebf1325a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:32.191625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d7990d61-671a-4ddf-bfe4-c68e2b9e2837 req-a709f7a7-3f06-427f-a867-0864ebf1325a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:32.193358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d7990d61-671a-4ddf-bfe4-c68e2b9e2837 req-a709f7a7-3f06-427f-a867-0864ebf1325a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:32.195189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d7990d61-671a-4ddf-bfe4-c68e2b9e2837 req-a709f7a7-3f06-427f-a867-0864ebf1325a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:32.225433 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d7990d61-671a-4ddf-bfe4-c68e2b9e2837 req-a709f7a7-3f06-427f-a867-0864ebf1325a service nova] Creating event network-changed:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:08:32.238226 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d7990d61-671a-4ddf-bfe4-c68e2b9e2837 req-a709f7a7-3f06-427f-a867-0864ebf1325a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103003 Oct 17 13:08:32.245864 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1931/3760] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:32.256310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1135448545"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:32.257306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:32.268362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:32.272586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:32.273442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:32.274813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:32.275748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:32.276448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:32.451867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b920f5b0-c713-489a-9192-7f44ca46eb53 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:32.469294 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b920f5b0-c713-489a-9192-7f44ca46eb53 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1267 microversion: 2.1 time: 0.429935 Oct 17 13:08:32.470773 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1830/3761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:32 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1267 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:32.576037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:32.576891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:32.595315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:32.595540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:32.595994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:32.596723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:32.597187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:32.597622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:32.682931 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.network.security_group_api [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Adding security group 5650b0ec-8f1d-41cb-911a-60e3a9e49753 to port c820f63b-5bf0-492b-bafd-24b6331716e1 Oct 17 13:08:33.283247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:33.305917 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-01ec8647-179d-4e7b-b4bd-ea86159adaa6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.730832 Oct 17 13:08:33.312753 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1831/3762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:32 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:33.342045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:33.342934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:33.351789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:33.352573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:33.354825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:33.356627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:33.357770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:33.359446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:33.619252 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f80374d-2d7f-4f0e-9006-2562965eea39 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action" status: 202 len: 0 microversion: 2.1 time: 1.369502 Oct 17 13:08:33.620127 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1932/3763] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:08:32 2022] POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:08:33.657262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:33.658102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:33.680387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:33.681119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:33.681960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:33.682978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:33.684286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:33.685435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:33.851145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:33.879088 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd88e425-68d3-4a80-9678-d56dfd9bce70 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1319 microversion: 2.1 time: 0.251980 Oct 17 13:08:33.880058 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1933/3764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:33 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:33.912389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1135448545"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:33.913846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:33.925394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:33.926434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:33.927469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:33.929215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:33.930283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:33.931349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:34.148549 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:08:34.149195 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 13:08:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a (ip 10.222.0.27) !!! Oct 17 13:08:34.238406 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.network.security_group_api [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Removing security group 5650b0ec-8f1d-41cb-911a-60e3a9e49753 from port c820f63b-5bf0-492b-bafd-24b6331716e1 Oct 17 13:08:34.776985 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c573420b-cde7-4cbd-a3bb-48e06e72853a tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action" status: 202 len: 0 microversion: 2.1 time: 0.876683 Oct 17 13:08:34.777766 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1934/3765] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:08:33 2022] POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:08:34.789949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4c9ca76a-7571-4932-a4f7-46f1177e4a98 req-c5060bb4-3239-4a5e-8ca5-e8ed6dcaeeee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0d03c6-2fe0-49bf-a32f-21ec17574681", "tag": "c820f63b-5bf0-492b-bafd-24b6331716e1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:34.815830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c9ca76a-7571-4932-a4f7-46f1177e4a98 req-c5060bb4-3239-4a5e-8ca5-e8ed6dcaeeee service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:34.818691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c9ca76a-7571-4932-a4f7-46f1177e4a98 req-c5060bb4-3239-4a5e-8ca5-e8ed6dcaeeee service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:34.819321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c9ca76a-7571-4932-a4f7-46f1177e4a98 req-c5060bb4-3239-4a5e-8ca5-e8ed6dcaeeee service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:34.855269 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4c9ca76a-7571-4932-a4f7-46f1177e4a98 req-c5060bb4-3239-4a5e-8ca5-e8ed6dcaeeee service nova] Creating event network-changed:c820f63b-5bf0-492b-bafd-24b6331716e1 for instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 on n-h2-853316-12 Oct 17 13:08:34.867717 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4c9ca76a-7571-4932-a4f7-46f1177e4a98 req-c5060bb4-3239-4a5e-8ca5-e8ed6dcaeeee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082456 Oct 17 13:08:34.868686 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1935/3766] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:34.883242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:34.891866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:34.913317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:34.915972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:34.922098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:34.926372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:34.926372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:34.926372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:35.072336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:35.091346 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b54901f2-3dc6-420b-b484-18c9d93f8c6d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 1.774691 Oct 17 13:08:35.092430 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1832/3767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:33 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:35.100453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-975cae18-0077-43bc-872c-73729a8de87b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Action: 'create', calling method: .version_select at 0x7fa8204c43a0>, body: {"pool": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:35.351583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:35.364028 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07f2a925-f3aa-4aac-8086-4c0c5da72e99 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.493829 Oct 17 13:08:35.364752 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1936/3768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:34 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:35.383210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:35.384095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:35.399406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:35.399908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:35.400340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:35.410396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:35.411030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:35.411482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:35.540510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:35.550208 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd1ddb39-e7ce-44b9-bec5-77199934feb4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1325 microversion: 2.1 time: 0.182615 Oct 17 13:08:35.553876 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1937/3769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:35 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:36.139002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:36.139784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:36.143712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:36.151087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:36.151677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:36.152361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:36.153196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:36.154575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:36.155132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:36.361664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:36.377497 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-265200b3-123f-432f-ae86-7fb865f132c3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.244308 Oct 17 13:08:36.390891 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1938/3770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:36 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:36.400560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:36.401601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:36.414310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:36.415191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:36.415821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:36.416712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:36.417340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:36.417960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:36.672313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:36.681382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-195e1023-cbb8-441a-9d15-1e2db1c4a45f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.287595 Oct 17 13:08:36.682265 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1939/3771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:36 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:36.700565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:36.701726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:36.708848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:36.709643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:36.710352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:36.711261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:36.711867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:36.712447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:36.817180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:36.836528 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f507402-2159-4add-904f-e6989f23a086 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1325 microversion: 2.1 time: 0.152925 Oct 17 13:08:36.848259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1940/3772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:36 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:36.861815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e2937311-076e-4874-8f09-340bec9c7ccf req-6f69d328-b1da-4d65-a963-6527ca2a85a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9074f1e3-b07e-4a30-80f4-2b6e1a63185c", "tag": "1f46bce9-c42b-408e-a4cd-fea1159a6801"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:36.880889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e2937311-076e-4874-8f09-340bec9c7ccf req-6f69d328-b1da-4d65-a963-6527ca2a85a7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:36.881675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e2937311-076e-4874-8f09-340bec9c7ccf req-6f69d328-b1da-4d65-a963-6527ca2a85a7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:36.881675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e2937311-076e-4874-8f09-340bec9c7ccf req-6f69d328-b1da-4d65-a963-6527ca2a85a7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:36.894684 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e2937311-076e-4874-8f09-340bec9c7ccf req-6f69d328-b1da-4d65-a963-6527ca2a85a7 service nova] Creating event network-changed:1f46bce9-c42b-408e-a4cd-fea1159a6801 for instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c on n-h2-853316-12 Oct 17 13:08:36.901094 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e2937311-076e-4874-8f09-340bec9c7ccf req-6f69d328-b1da-4d65-a963-6527ca2a85a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050549 Oct 17 13:08:36.901877 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1941/3773] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:36.907349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-37d3e238-a90e-43c3-9d6d-47dae59dc71a req-662dab0f-82fc-407a-b7a8-519a996bfaab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0d03c6-2fe0-49bf-a32f-21ec17574681", "tag": "c820f63b-5bf0-492b-bafd-24b6331716e1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:36.923809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-37d3e238-a90e-43c3-9d6d-47dae59dc71a req-662dab0f-82fc-407a-b7a8-519a996bfaab service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:36.924305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-37d3e238-a90e-43c3-9d6d-47dae59dc71a req-662dab0f-82fc-407a-b7a8-519a996bfaab service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:36.924736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-37d3e238-a90e-43c3-9d6d-47dae59dc71a req-662dab0f-82fc-407a-b7a8-519a996bfaab service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:36.939697 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-37d3e238-a90e-43c3-9d6d-47dae59dc71a req-662dab0f-82fc-407a-b7a8-519a996bfaab service nova] Creating event network-changed:c820f63b-5bf0-492b-bafd-24b6331716e1 for instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 on n-h2-853316-12 Oct 17 13:08:36.946304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-37d3e238-a90e-43c3-9d6d-47dae59dc71a req-662dab0f-82fc-407a-b7a8-519a996bfaab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042851 Oct 17 13:08:36.947233 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1942/3774] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:37.406646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:37.408122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:37.416267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:37.417081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:37.417711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:37.419687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:37.420476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:37.421244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:37.599160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:37.608288 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b782d50-4dbb-48b4-b873-cb2d429faf14 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.205883 Oct 17 13:08:37.624136 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1943/3775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:37 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:37.705888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:37.706738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:37.730349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:37.731667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:37.732385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:37.733807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:37.734590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:37.735371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:38.491861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:38.500555 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5ced8ab4-e50b-4877-803f-e5bf67e6c9de tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.798994 Oct 17 13:08:38.501176 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1944/3776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:37 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:38.513350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:38.513997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:38.521118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:38.521641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:38.522124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:38.522891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:38.523351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:38.523782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:38.665461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:38.669767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:38.675908 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c733781b-c540-4b22-a948-cb3cb81ec7b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.173506 Oct 17 13:08:38.676488 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1945/3777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:38 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:38.681111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:38.681721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:38.698989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:38.699497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:38.700534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:38.701250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:38.701713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:38.702313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:38.853551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:38.862111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3d88bc8-8e10-4561-829d-4a2157b78ef7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.184550 Oct 17 13:08:38.862807 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1946/3778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:38 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:39.524660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:39.525466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:39.535059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:39.535807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:39.536397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:39.537447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:39.538078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:39.538722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:39.788542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:39.799709 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-427e2249-a674-46c1-9e02-fb332a78ad9a tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.279598 Oct 17 13:08:39.800653 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1947/3779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:39 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:39.809929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-984028e2-becb-47c3-865f-7268e7969268 req-4b43d2f2-ff85-4387-b802-a267f854b581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9074f1e3-b07e-4a30-80f4-2b6e1a63185c", "tag": "fd4dac6b-8387-436b-9c1a-73ddc9a3f9c7"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:39.824610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-984028e2-becb-47c3-865f-7268e7969268 req-4b43d2f2-ff85-4387-b802-a267f854b581 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:39.826078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-984028e2-becb-47c3-865f-7268e7969268 req-4b43d2f2-ff85-4387-b802-a267f854b581 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:39.826747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-984028e2-becb-47c3-865f-7268e7969268 req-4b43d2f2-ff85-4387-b802-a267f854b581 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:39.838655 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-984028e2-becb-47c3-865f-7268e7969268 req-4b43d2f2-ff85-4387-b802-a267f854b581 service nova] Creating event network-changed:fd4dac6b-8387-436b-9c1a-73ddc9a3f9c7 for instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c on n-h2-853316-12 Oct 17 13:08:39.843710 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-984028e2-becb-47c3-865f-7268e7969268 req-4b43d2f2-ff85-4387-b802-a267f854b581 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038718 Oct 17 13:08:39.844564 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1948/3780] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:39.849426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:39.850232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:39.856871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:39.857479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:39.857997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:39.858792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:39.859318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:39.859813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:39.985732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-975cae18-0077-43bc-872c-73729a8de87b tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.891385 Oct 17 13:08:39.988020 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1833/3781] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 17 13:08:35 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:39.994251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:39.999063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:40.008481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:40.009186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:40.009900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:40.011143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:40.011825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:40.012455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:40.017115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:40.029973 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d2ebc8f-8ee1-496b-af2b-239a3b5e9228 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.184304 Oct 17 13:08:40.037815 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1949/3782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:39 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:40.042963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.57"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:40.047701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:40.055418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:40.056532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:40.057149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:40.058032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:40.058674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:40.059336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:40.089937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "refresh_cache-6a0d03c6-2fe0-49bf-a32f-21ec17574681" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:08:40.090365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquired lock "refresh_cache-6a0d03c6-2fe0-49bf-a32f-21ec17574681" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:08:40.360551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:40.376563 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72b425bd-2a9b-4212-a6c2-f2c901860ab1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.387124 Oct 17 13:08:40.377703 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1834/3783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:39 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:40.832982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:40.833908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:40.842052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:40.842963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:40.843630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:40.844598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:40.845246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:40.845986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:41.276891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:41.295742 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17ef452a-357a-4979-a7b9-c40ae01aaf71 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.473089 Oct 17 13:08:41.296589 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1835/3784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:40 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:41.301347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:41.302127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:41.318536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:41.319268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:41.319959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:41.320863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:41.321478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:41.322066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:41.383544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:41.456328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:41.511270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Building network info cache for instance {{(pid=127540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:08:41.563227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:41.572720 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a0eb0e47-bc1d-4aca-a3ff-bae43ca4bb21 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.274837 Oct 17 13:08:41.593501 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1836/3785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:41 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:41.596768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:41.598214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:41.604628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:41.605723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:41.611125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:41.612325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:41.612795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:41.613395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:41.856923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:41.869753 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d0b4273-d6db-4bb7-acda-d4bfb8cb3ade tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1476 microversion: 2.1 time: 0.282559 Oct 17 13:08:41.872655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1837/3786] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:41 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:41.880778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d4fe42dd-95b0-46c4-835d-cb5196c3e345 req-d7db35f9-2653-42e6-987c-5bc48b5e15ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0d03c6-2fe0-49bf-a32f-21ec17574681", "tag": "c820f63b-5bf0-492b-bafd-24b6331716e1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:41.899732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d4fe42dd-95b0-46c4-835d-cb5196c3e345 req-d7db35f9-2653-42e6-987c-5bc48b5e15ac service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:41.904287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d4fe42dd-95b0-46c4-835d-cb5196c3e345 req-d7db35f9-2653-42e6-987c-5bc48b5e15ac service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:41.907772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d4fe42dd-95b0-46c4-835d-cb5196c3e345 req-d7db35f9-2653-42e6-987c-5bc48b5e15ac service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:41.934265 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d4fe42dd-95b0-46c4-835d-cb5196c3e345 req-d7db35f9-2653-42e6-987c-5bc48b5e15ac service nova] Creating event network-changed:c820f63b-5bf0-492b-bafd-24b6331716e1 for instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 on n-h2-853316-12 Oct 17 13:08:41.943998 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d4fe42dd-95b0-46c4-835d-cb5196c3e345 req-d7db35f9-2653-42e6-987c-5bc48b5e15ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069046 Oct 17 13:08:41.945575 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1838/3787] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:41.954455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-decdafcd-4795-42ac-b548-5fade75b28f7 req-c9a77752-6c21-46ac-a4b8-f3335a683ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586fd663-8db0-4d14-bf90-b3871f6374b5", "tag": "3d6515c3-5c35-4518-9d9e-63d08da1216b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:41.966028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-decdafcd-4795-42ac-b548-5fade75b28f7 req-c9a77752-6c21-46ac-a4b8-f3335a683ba3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:41.966466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-decdafcd-4795-42ac-b548-5fade75b28f7 req-c9a77752-6c21-46ac-a4b8-f3335a683ba3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:41.966908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-decdafcd-4795-42ac-b548-5fade75b28f7 req-c9a77752-6c21-46ac-a4b8-f3335a683ba3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:41.980562 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-decdafcd-4795-42ac-b548-5fade75b28f7 req-c9a77752-6c21-46ac-a4b8-f3335a683ba3 service nova] Creating event network-changed:3d6515c3-5c35-4518-9d9e-63d08da1216b for instance 586fd663-8db0-4d14-bf90-b3871f6374b5 on n-h2-853316-12 Oct 17 13:08:41.990631 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-decdafcd-4795-42ac-b548-5fade75b28f7 req-c9a77752-6c21-46ac-a4b8-f3335a683ba3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043099 Oct 17 13:08:41.991999 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1839/3788] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:42.329887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:42.333119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:42.344831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Updating instance_info_cache with network_info: [{"id": "c820f63b-5bf0-492b-bafd-24b6331716e1", "address": "fa:16:3e:77:f3:ed", "network": {"id": "1d760fe5-8b19-4915-b55f-a2b619082439", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2056929747-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b989a5a80d6d47199a138daaed2a4545", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc820f63b-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:08:42.357600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:42.363313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:42.364165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:42.365450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:42.366141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:42.366917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:42.368996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Releasing lock "refresh_cache-6a0d03c6-2fe0-49bf-a32f-21ec17574681" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:08:42.369960 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d992c698-cd59-4698-84f1-eb30f0110c65 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action" status: 202 len: 0 microversion: 2.1 time: 2.330726 Oct 17 13:08:42.374076 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1950/3789] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:08:40 2022] POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action => generated 0 bytes in 2334 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:08:42.393397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.57"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:42.468213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:42.614189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:42.624683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:42.625201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:42.625712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:42.627079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:42.627569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:42.628010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:42.675438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:42.685983 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9c8277be-0efb-4042-9c68-ad9c05e42c3f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.365299 Oct 17 13:08:42.687408 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1840/3790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:42 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:42.694147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:42.695245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:42.711388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:42.712211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:42.713067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:42.714244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:42.714956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:42.716119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:42.961463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:42.971007 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aff41778-5793-4616-abee-21730b81c5e1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.282373 Oct 17 13:08:42.983073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1841/3791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:42 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:42.993278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:42.993927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:43.001203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:43.001750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:43.002568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:43.003645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:43.004063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:43.004649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:43.128601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "refresh_cache-6a0d03c6-2fe0-49bf-a32f-21ec17574681" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:08:43.129116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquired lock "refresh_cache-6a0d03c6-2fe0-49bf-a32f-21ec17574681" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:08:43.185249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:43.194704 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31e976c8-261a-4754-81af-8ad40d96dfb1 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1475 microversion: 2.1 time: 0.210420 Oct 17 13:08:43.197221 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1842/3792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:42 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1475 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:43.368174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:43.369197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:43.381176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:43.381666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:43.389480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:43.396926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:43.399699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:43.408401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:44.358592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:44.374646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:44.376109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:44.377415 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43cabd56-b24d-45e8-a2f3-d9f069ee51c0 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2954 microversion: 2.42 time: 1.014397 Oct 17 13:08:44.377994 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1843/3793] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:08:43 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2954 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:08:44.395123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:44.395123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:44.400152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:44.400902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:44.401495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:44.402424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:44.403240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:44.403975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:44.469168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:45.024933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:45.035523 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e8611589-baa4-4b07-be8d-c1cd946a2bb6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.647632 Oct 17 13:08:45.036486 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1844/3794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:44 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:45.045409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-93b8d83a-5b88-45fe-b4f9-d17b5db02eae req-2f78b297-24b6-4a4b-ab87-c30c9f1405b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9472cc-309e-4a00-b88c-15b2a9e5a65a", "name": "network-vif-unplugged", "status": "completed", "tag": "29d4af6b-d4aa-4ef7-90ba-99895fa78c62"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:45.056911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-93b8d83a-5b88-45fe-b4f9-d17b5db02eae req-2f78b297-24b6-4a4b-ab87-c30c9f1405b9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:45.058410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-93b8d83a-5b88-45fe-b4f9-d17b5db02eae req-2f78b297-24b6-4a4b-ab87-c30c9f1405b9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:45.060012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-93b8d83a-5b88-45fe-b4f9-d17b5db02eae req-2f78b297-24b6-4a4b-ab87-c30c9f1405b9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:45.076657 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-93b8d83a-5b88-45fe-b4f9-d17b5db02eae req-2f78b297-24b6-4a4b-ab87-c30c9f1405b9 service nova] Creating event network-vif-unplugged:29d4af6b-d4aa-4ef7-90ba-99895fa78c62 for instance de9472cc-309e-4a00-b88c-15b2a9e5a65a on n-h2-853316-12 Oct 17 13:08:45.083321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-93b8d83a-5b88-45fe-b4f9-d17b5db02eae req-2f78b297-24b6-4a4b-ab87-c30c9f1405b9 service nova] Instance de9472cc-309e-4a00-b88c-15b2a9e5a65a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:08:45.098776 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-93b8d83a-5b88-45fe-b4f9-d17b5db02eae req-2f78b297-24b6-4a4b-ab87-c30c9f1405b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060170 Oct 17 13:08:45.100217 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1845/3795] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:45.107807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:45.109124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:45.117427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:45.118452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:45.119146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:45.120549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:45.121278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:45.122241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:45.545547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Building network info cache for instance {{(pid=127540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:08:45.655345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:45.673047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d4becaa7-6f04-4e32-b72a-841bef581259 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.570882 Oct 17 13:08:45.673728 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1846/3796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:45 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:45.690374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:45.690374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:45.716575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:45.719236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:45.720091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:45.722466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:45.722932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:45.725249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:46.057926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:46.071534 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93c9e746-a94d-4b25-857e-6e062dbe0aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1475 microversion: 2.1 time: 0.396644 Oct 17 13:08:46.072313 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1847/3797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:45 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1475 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:46.089246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:46.091357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:46.105892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:46.108855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:46.110910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:46.112342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:46.115158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:46.115810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:46.327587 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-23aef796-9a70-47c3-925a-8193c0f2b341 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.253728 Oct 17 13:08:46.328195 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1848/3798] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 13:08:46 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda/os-interface => generated 1829 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:08:46.333192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-68008fa5-389a-4a73-92e9-7c4c50b81e9b req-c54ba045-37da-462d-9947-b8e21056aecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9074f1e3-b07e-4a30-80f4-2b6e1a63185c", "name": "network-vif-plugged", "status": "completed", "tag": "1f46bce9-c42b-408e-a4cd-fea1159a6801"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:46.354117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-68008fa5-389a-4a73-92e9-7c4c50b81e9b req-c54ba045-37da-462d-9947-b8e21056aecf service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:46.358357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-68008fa5-389a-4a73-92e9-7c4c50b81e9b req-c54ba045-37da-462d-9947-b8e21056aecf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:46.359065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-68008fa5-389a-4a73-92e9-7c4c50b81e9b req-c54ba045-37da-462d-9947-b8e21056aecf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:46.376973 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-68008fa5-389a-4a73-92e9-7c4c50b81e9b req-c54ba045-37da-462d-9947-b8e21056aecf service nova] Creating event network-vif-plugged:1f46bce9-c42b-408e-a4cd-fea1159a6801 for instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c on n-h2-853316-12 Oct 17 13:08:46.397125 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-68008fa5-389a-4a73-92e9-7c4c50b81e9b req-c54ba045-37da-462d-9947-b8e21056aecf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066210 Oct 17 13:08:46.406781 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1849/3799] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:46.420299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:46.421481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:46.429287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:46.429985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:46.430448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:46.431180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:46.431689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:46.432051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:46.547888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Updating instance_info_cache with network_info: [{"id": "c820f63b-5bf0-492b-bafd-24b6331716e1", "address": "fa:16:3e:77:f3:ed", "network": {"id": "1d760fe5-8b19-4915-b55f-a2b619082439", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2056929747-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b989a5a80d6d47199a138daaed2a4545", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc820f63b-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:08:46.578859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Releasing lock "refresh_cache-6a0d03c6-2fe0-49bf-a32f-21ec17574681" {{(pid=127540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:08:46.580168 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-493722c2-fb81-4cd6-98db-cf201337cdba tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action" status: 202 len: 0 microversion: 2.1 time: 4.204131 Oct 17 13:08:46.581382 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1951/3800] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:08:42 2022] POST /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681/action => generated 0 bytes in 4206 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:08:46.589872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:46.593775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6140335d-701a-43b0-9624-b992f222ac69 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '.version_select at 0x7fa820f25430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:46.603651 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-38f549df-30ff-44f3-b4b4-d9ef6beea2c6 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.193869 Oct 17 13:08:46.604941 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1850/3801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:46 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:46.729399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:46.731758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:46.740680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:46.742545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:46.744820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:46.746541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:46.747347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:46.748900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:47.007529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:47.019024 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6724871-b03b-4e13-9ac0-490f8b8c434f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.294396 Oct 17 13:08:47.036539 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1851/3802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:46 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:47.100665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:47.101595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:47.112792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:47.114117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:47.118376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:47.120129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:47.122406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:47.123053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:47.517302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:47.526026 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b982b7d3-af27-41e0-bc1f-7ae407db690b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1473 microversion: 2.1 time: 0.429447 Oct 17 13:08:47.535081 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1852/3803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:47 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1473 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:47.540025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-80526333-f6e6-4aa8-bf99-dc015df9a77c req-4d8423d1-6bae-4a93-b8fa-498ba53c32cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9472cc-309e-4a00-b88c-15b2a9e5a65a", "tag": "29d4af6b-d4aa-4ef7-90ba-99895fa78c62"}, {"name": "network-changed", "server_uuid": "6a0d03c6-2fe0-49bf-a32f-21ec17574681", "tag": "c820f63b-5bf0-492b-bafd-24b6331716e1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:47.563818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-80526333-f6e6-4aa8-bf99-dc015df9a77c req-4d8423d1-6bae-4a93-b8fa-498ba53c32cb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:47.564521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-80526333-f6e6-4aa8-bf99-dc015df9a77c req-4d8423d1-6bae-4a93-b8fa-498ba53c32cb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:47.571697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-80526333-f6e6-4aa8-bf99-dc015df9a77c req-4d8423d1-6bae-4a93-b8fa-498ba53c32cb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:47.610615 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-80526333-f6e6-4aa8-bf99-dc015df9a77c req-4d8423d1-6bae-4a93-b8fa-498ba53c32cb service nova] Creating event network-changed:29d4af6b-d4aa-4ef7-90ba-99895fa78c62 for instance de9472cc-309e-4a00-b88c-15b2a9e5a65a on n-h2-853316-12 Oct 17 13:08:47.611473 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-80526333-f6e6-4aa8-bf99-dc015df9a77c req-4d8423d1-6bae-4a93-b8fa-498ba53c32cb service nova] Creating event network-changed:c820f63b-5bf0-492b-bafd-24b6331716e1 for instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 on n-h2-853316-12 Oct 17 13:08:47.623454 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6140335d-701a-43b0-9624-b992f222ac69 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/27d941dc-324d-403f-aaf0-fd90613e7a55" status: 202 len: 0 microversion: 2.1 time: 1.037395 Oct 17 13:08:47.624418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-80526333-f6e6-4aa8-bf99-dc015df9a77c req-4d8423d1-6bae-4a93-b8fa-498ba53c32cb service nova] Instance de9472cc-309e-4a00-b88c-15b2a9e5a65a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:08:47.624703 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1952/3804] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 13:08:46 2022] DELETE /compute/v2.1/os-floating-ips/27d941dc-324d-403f-aaf0-fd90613e7a55 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:08:47.629641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:47.630287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:47.642119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:47.643085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:47.644075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:47.645127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:47.645727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:47.646337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:47.650449 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-80526333-f6e6-4aa8-bf99-dc015df9a77c req-4d8423d1-6bae-4a93-b8fa-498ba53c32cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.111485 Oct 17 13:08:47.651294 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1853/3805] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:47.659274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b5fd68b-3788-49c3-af28-7761b248b5d7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '.version_select at 0x7fa825104790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:48.032765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:48.048115 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fd4cd26-42f9-45d3-88a1-f659c79bed8c tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.421264 Oct 17 13:08:48.050800 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1953/3806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:47 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:48.058498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:48.059688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:48.069163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.069935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.070555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.071595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.072051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.072475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.431636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:48.445174 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-09ee5690-9c2c-4077-9ce5-e85a4bd5307b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.392320 Oct 17 13:08:48.446526 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1954/3807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:48 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:48.461795 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b5fd68b-3788-49c3-af28-7761b248b5d7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5650b0ec-8f1d-41cb-911a-60e3a9e49753" status: 202 len: 0 microversion: 2.1 time: 0.798097 Oct 17 13:08:48.461795 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1854/3808] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:08:47 2022] DELETE /compute/v2.1/os-security-groups/5650b0ec-8f1d-41cb-911a-60e3a9e49753 => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:08:48.461795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-00f39a93-8c04-4f60-8af5-f5e24fe006fc req-57e35eb3-0bd5-42fe-84b5-949a8f04381e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9074f1e3-b07e-4a30-80f4-2b6e1a63185c", "name": "network-vif-plugged", "status": "completed", "tag": "fd4dac6b-8387-436b-9c1a-73ddc9a3f9c7"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:48.477161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:48.479623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:48.485700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00f39a93-8c04-4f60-8af5-f5e24fe006fc req-57e35eb3-0bd5-42fe-84b5-949a8f04381e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.486375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00f39a93-8c04-4f60-8af5-f5e24fe006fc req-57e35eb3-0bd5-42fe-84b5-949a8f04381e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.486883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-00f39a93-8c04-4f60-8af5-f5e24fe006fc req-57e35eb3-0bd5-42fe-84b5-949a8f04381e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.489392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.490282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.490892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.491779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.492474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.493137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.504703 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-00f39a93-8c04-4f60-8af5-f5e24fe006fc req-57e35eb3-0bd5-42fe-84b5-949a8f04381e service nova] Creating event network-vif-plugged:fd4dac6b-8387-436b-9c1a-73ddc9a3f9c7 for instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c on n-h2-853316-12 Oct 17 13:08:48.519300 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-00f39a93-8c04-4f60-8af5-f5e24fe006fc req-57e35eb3-0bd5-42fe-84b5-949a8f04381e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062100 Oct 17 13:08:48.520528 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1855/3809] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:48.530184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:08:48.575093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:48.576285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:48.593663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.594318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.594975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.595845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.596453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.597030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.667288 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0e703b9-18f6-451e-81fb-61f3dfd35cee tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 204 len: 0 microversion: 2.1 time: 0.202326 Oct 17 13:08:48.667999 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1955/3810] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:08:48 2022] DELETE /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:08:48.679647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:48.680342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:48.688141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.688402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.688805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.689495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:48.689948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:48.690398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:48.868583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:48.880737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9a40e6fd-614e-4cdf-9e8e-057d82ebe38d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1511 microversion: 2.1 time: 0.204527 Oct 17 13:08:48.881531 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1956/3811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:48 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:49.077652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:49.078614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:49.093414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.094418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.095128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.096197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.097517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.098215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.244190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:49.254429 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4601861e-39d7-41c0-83e9-50836f5ac847 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1470 microversion: 2.1 time: 0.692602 Oct 17 13:08:49.257490 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1856/3812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:48 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1470 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:49.284418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:49.285245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:49.293801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.294606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.295086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.297145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.298604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.299202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.375289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:49.399196 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f6b35c59-6bfb-449e-b7ff-343f3ee529ab tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.329416 Oct 17 13:08:49.402482 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1957/3813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:49 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:49.404732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6781d4c6-9183-4ad2-95c1-33022a4cce77 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a/action" status: 204 len: 0 microversion: 2.1 time: 0.123866 Oct 17 13:08:49.406226 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1857/3814] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:08:49 2022] POST /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a/action => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:08:49.416282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:49.416943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:49.433227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.433928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.434678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.435599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.436270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.436858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.469778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:49.470513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:49.485922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.486516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.486959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.488018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.488482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.490464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.593949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:49.601917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-39be2dcf-d775-4d05-8a65-42c90a4832d4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1470 microversion: 2.1 time: 0.190946 Oct 17 13:08:49.602538 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1958/3815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:49 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:49.760448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:49.769888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2bcd9e8a-4d42-434e-a4ca-8b2c6b5d71c6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.304627 Oct 17 13:08:49.770581 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1858/3816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:49 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:49.906754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:49.907655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:49.915569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.916069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.916611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:49.917765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:49.918249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:49.918681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:50.078612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:50.086959 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ae42812-3f95-40ee-8e40-c010247e9410 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1511 microversion: 2.1 time: 0.185467 Oct 17 13:08:50.087567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1959/3817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:49 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:50.424717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:50.425656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:50.446343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:50.447929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:50.449021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:50.453819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:50.454523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:50.455207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:50.541976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-16e41d6d-f67a-4d2b-9798-86fb768f7748 req-645c68f7-2dd4-4f12-8a55-f1d8604eaa20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586fd663-8db0-4d14-bf90-b3871f6374b5", "name": "network-vif-plugged", "status": "completed", "tag": "3d6515c3-5c35-4518-9d9e-63d08da1216b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:50.553257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16e41d6d-f67a-4d2b-9798-86fb768f7748 req-645c68f7-2dd4-4f12-8a55-f1d8604eaa20 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:50.554047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16e41d6d-f67a-4d2b-9798-86fb768f7748 req-645c68f7-2dd4-4f12-8a55-f1d8604eaa20 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:50.554516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16e41d6d-f67a-4d2b-9798-86fb768f7748 req-645c68f7-2dd4-4f12-8a55-f1d8604eaa20 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:50.567973 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-16e41d6d-f67a-4d2b-9798-86fb768f7748 req-645c68f7-2dd4-4f12-8a55-f1d8604eaa20 service nova] Creating event network-vif-plugged:3d6515c3-5c35-4518-9d9e-63d08da1216b for instance 586fd663-8db0-4d14-bf90-b3871f6374b5 on n-h2-853316-12 Oct 17 13:08:50.574683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-16e41d6d-f67a-4d2b-9798-86fb768f7748 req-645c68f7-2dd4-4f12-8a55-f1d8604eaa20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036516 Oct 17 13:08:50.578813 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1960/3818] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:08:50.632421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:50.634912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:50.645072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:50.646810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:50.647338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:50.648406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:50.649309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:50.649696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:50.683518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:50.720747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:50.732283 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f79a660-52d4-4727-ae65-2f4708702635 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.311946 Oct 17 13:08:50.733044 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1859/3819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:50 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:50.793103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:50.794266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:50.800811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:50.801536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:50.802213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:50.803090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:50.803598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:50.804030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:50.835897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:50.846737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c8b6f765-820d-4d47-8962-379e14f79f7e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1470 microversion: 2.1 time: 0.221255 Oct 17 13:08:50.865288 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1961/3820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:50 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:51.113207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:51.113933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:51.130432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:51.133372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:51.134124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:51.135103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:51.135744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:51.140255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:51.164902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:51.176575 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f9c9b5ba-3376-4b00-9d6f-dc9cd3c7e46d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.387384 Oct 17 13:08:51.178193 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1860/3821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:50 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:51.396090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:51.404577 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7073069-c14c-469f-8622-1b8c300ab101 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1511 microversion: 2.1 time: 0.297204 Oct 17 13:08:51.405504 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1962/3822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:51 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:51.757579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:51.759202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:51.766849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:51.767614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:51.768276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:51.769473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:51.770657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:51.771442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:51.871138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:51.872175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:51.879193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:51.879931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:51.880563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:51.881475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:51.882288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:51.882883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.008632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:52.018063 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2c7c12d-aa87-41fe-9e1f-b7741e40344f tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1333 microversion: 2.1 time: 0.265869 Oct 17 13:08:52.018922 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1861/3823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:51 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1333 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:52.205293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:52.205928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:52.215934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:52.216914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:52.217367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.218498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:52.219189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:52.220807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.327973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:52.335822 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc94e895-b222-4cd8-a56a-ed9bb48c4b1a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1462 microversion: 2.1 time: 0.468477 Oct 17 13:08:52.336397 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1963/3824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:51 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1462 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:52.341369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-638abb60-2aa9-45ca-a1a3-f508ebbcb403 req-87c50483-8fc3-4f72-9808-0bf82b9d00b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0d03c6-2fe0-49bf-a32f-21ec17574681", "name": "network-vif-deleted", "tag": "c820f63b-5bf0-492b-bafd-24b6331716e1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:52.355306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-638abb60-2aa9-45ca-a1a3-f508ebbcb403 req-87c50483-8fc3-4f72-9808-0bf82b9d00b4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:52.356137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-638abb60-2aa9-45ca-a1a3-f508ebbcb403 req-87c50483-8fc3-4f72-9808-0bf82b9d00b4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:52.356605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-638abb60-2aa9-45ca-a1a3-f508ebbcb403 req-87c50483-8fc3-4f72-9808-0bf82b9d00b4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.372169 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-638abb60-2aa9-45ca-a1a3-f508ebbcb403 req-87c50483-8fc3-4f72-9808-0bf82b9d00b4 service nova] Creating event network-vif-deleted:c820f63b-5bf0-492b-bafd-24b6331716e1 for instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 on n-h2-853316-12 Oct 17 13:08:52.378062 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-638abb60-2aa9-45ca-a1a3-f508ebbcb403 req-87c50483-8fc3-4f72-9808-0bf82b9d00b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039804 Oct 17 13:08:52.378942 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1964/3825] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:52.385205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:52.385916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:52.391776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:52.402271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-32d7110c-8ae2-4918-b2c9-a524364969ae tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1393 microversion: 2.1 time: 0.202920 Oct 17 13:08:52.403028 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1862/3826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:52 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1393 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:52.407266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:52.407817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:52.408265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.409025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:52.409657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:52.410280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.433139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:52.434022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:52.451230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:52.451774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:52.452490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.456191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:52.458089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:52.458803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.466657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:52.548458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c3cd271b444c38ae62d241e9bcd0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b989a5a80d6d47199a138daaed2a4545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:52.556502 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89b9aa50-6609-4d59-832e-07281127edf7 tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 200 len: 1294 microversion: 2.1 time: 0.132091 Oct 17 13:08:52.557091 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1863/3827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:52 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 1294 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:52.598665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7816173d-2971-433f-8762-978091a2b06b req-698998bd-60e4-4c7a-acd8-f6e797f8e983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9472cc-309e-4a00-b88c-15b2a9e5a65a", "name": "network-vif-plugged", "status": "completed", "tag": "29d4af6b-d4aa-4ef7-90ba-99895fa78c62"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:52.611742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7816173d-2971-433f-8762-978091a2b06b req-698998bd-60e4-4c7a-acd8-f6e797f8e983 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:52.612582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7816173d-2971-433f-8762-978091a2b06b req-698998bd-60e4-4c7a-acd8-f6e797f8e983 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:52.613198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7816173d-2971-433f-8762-978091a2b06b req-698998bd-60e4-4c7a-acd8-f6e797f8e983 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:52.627346 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7816173d-2971-433f-8762-978091a2b06b req-698998bd-60e4-4c7a-acd8-f6e797f8e983 service nova] Creating event network-vif-plugged:29d4af6b-d4aa-4ef7-90ba-99895fa78c62 for instance de9472cc-309e-4a00-b88c-15b2a9e5a65a on n-h2-853316-12 Oct 17 13:08:52.632804 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7816173d-2971-433f-8762-978091a2b06b req-698998bd-60e4-4c7a-acd8-f6e797f8e983 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043705 Oct 17 13:08:52.633606 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1864/3828] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:52.679590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:52.679590 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e345a202-b3c0-4501-b445-4b438d2c21df tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1462 microversion: 2.1 time: 0.293254 Oct 17 13:08:52.679590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1965/3829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:52 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1462 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:52.700969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40d01ec3-95a5-4c5c-8b59-734641034aa2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'create', calling method: .version_select at 0x7fa8251040d0>, body: {"keypair": {"name": "tempest-keypair-701652201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQy5VuCI+ZIM/xhx6Ks1sRzpxwqjzHs70vMRww7Qzsp8Cyb9vFQeI9X7uQzKAVlYjqBt60OOGPOXRN1bGqUtjDwiTWmQ7sgbjUoOiE0UJVHjm25bO3+xBTRvnQ/yr595w=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:52.723398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-40d01ec3-95a5-4c5c-8b59-734641034aa2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:08:52.734152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-40d01ec3-95a5-4c5c-8b59-734641034aa2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for user bf508fbbaee740548bd6509b3d279b57 and project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:08:52.794180 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-40d01ec3-95a5-4c5c-8b59-734641034aa2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098426 Oct 17 13:08:52.795424 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1865/3830] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:08:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:53.045955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:53.046921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:53.054138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.054856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.055330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.056093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.056554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.057038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.265058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:53.273160 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4f9d3f75-8696-4ffc-b752-ac669f5b1a18 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1667 microversion: 2.1 time: 0.235261 Oct 17 13:08:53.273746 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1966/3831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:53 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1667 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:53.301184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:53.302120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:53.312622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.313347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.313998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.315099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.315747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.316364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.352527 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7179deb-9715-45cc-bfb7-d10ecb9d353e tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c/ips" status: 200 len: 178 microversion: 2.1 time: 0.058287 Oct 17 13:08:53.353115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1866/3832] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:08:53 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c/ips => generated 178 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:53.365246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:53.365996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:53.373616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.374254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.374877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.376112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.376746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.377329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.424408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:08:53.431683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:53.432533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:53.435106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:53.448683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.449198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.450191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.453248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.453794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.454247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.544873 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97b86f9a-b090-4b83-a7b1-331232cad69b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 204 len: 0 microversion: 2.1 time: 0.181283 Oct 17 13:08:53.548968 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1967/3833] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:08:53 2022] DELETE /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:08:53.554559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:53.555269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:53.561996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.562535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.562982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.563985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.564482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.564915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.719975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:53.730845 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-731bea30-fb55-40ee-b923-088978108354 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1565 microversion: 2.1 time: 0.303858 Oct 17 13:08:53.746396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:53.749528 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1867/3834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:53 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1565 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:53.755707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:53.756746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] [instance: 6a0d03c6-2fe0-49bf-a32f-21ec17574681] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:53.759844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c150406-24fa-4b29-a2d5-7d77582c449b tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1673 microversion: 2.1 time: 0.209363 Oct 17 13:08:53.774195 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1968/3835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:53 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:53.774195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:53.774195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:53.781688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.782686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.783332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.784265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.785056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.785688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.785841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.786899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.787513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.788420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:53.789038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:53.789786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:53.810968 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] HTTP exception thrown: Instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 could not be found. Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Request method failure captured: Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 HTTP/1.1 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVOStKt7H6Xun30LgrqIAzdLfST210IYQPF1uaV5XkwE3vZCzR7Sc_X5O9OCMUPCG13nVoi-sLJZV7PFpCJrPT4fwrfxLCBzCeXJvTJjgregL4HmlH9F0hCH5swCnsDXp9bj5qVYBWsdMwLK01tuF4Cy4GGNq8qyynnrppg7nOgwg54 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: b989a5a80d6d47199a138daaed2a4545 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-803479159 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b989a5a80d6d47199a138daaed2a4545", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b989a5a80d6d47199a138daaed2a4545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b989a5a80d6d47199a138daaed2a4545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b989a5a80d6d47199a138daaed2a4545"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-803479159 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: b989a5a80d6d47199a138daaed2a4545 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-803479159 Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerRescueTestJSONUnderV235-803479159-project Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: b8c3cd271b444c38ae62d241e9bcd0da Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-803479159-project Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 could not be found. Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '6a0d03c6-2fe0-49bf-a32f-21ec17574681'} Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 could not be found. Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 could not be found. Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:53.812924 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 could not be found. Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] Returning 404 to user: Instance 6a0d03c6-2fe0-49bf-a32f-21ec17574681 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c476b0e3-1b24-4b5f-be87-f62f9c2f0a5d tempest-ServerRescueTestJSONUnderV235-803479159 tempest-ServerRescueTestJSONUnderV235-803479159-project] 10.222.0.27 "GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681" status: 404 len: 111 microversion: 2.1 time: 0.062958 Oct 17 13:08:53.817673 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1868/3836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:53 2022] GET /compute/v2.1/servers/6a0d03c6-2fe0-49bf-a32f-21ec17574681 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:08:53.978141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:53.986797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c9156c27-539c-448d-9522-53ddbf7c6b2c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1565 microversion: 2.1 time: 0.224643 Oct 17 13:08:53.987380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1969/3837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:53 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1565 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:54.791284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:54.791900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:54.799889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:54.800381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:54.801012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:54.801726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:54.802257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:54.803283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:55.374248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f5684ae2-0a5b-4570-a53c-645ae7158bb5 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '.version_select at 0x7fa821291dc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:55.378348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5684ae2-0a5b-4570-a53c-645ae7158bb5 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:55.378839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5684ae2-0a5b-4570-a53c-645ae7158bb5 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:55.379290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5684ae2-0a5b-4570-a53c-645ae7158bb5 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:55.396273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f5684ae2-0a5b-4570-a53c-645ae7158bb5 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.026530 Oct 17 13:08:55.416091 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1970/3838] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 13:08:55 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:55.422601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c498c4af-8a87-448b-adf1-73d29536b06b tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:55.430825 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c498c4af-8a87-448b-adf1-73d29536b06b tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013224 Oct 17 13:08:55.431947 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1971/3839] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:08:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:55.446770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-007b1e98-c831-46c3-80db-e5cbd8aa5967 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1215866392", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:55.481474 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-007b1e98-c831-46c3-80db-e5cbd8aa5967 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.039905 Oct 17 13:08:55.483208 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1972/3840] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Oct 17 13:08:55 2022] POST /compute/v2.1/flavors => generated 499 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:08:55.495467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-629d7d53-4375-4583-8614-15960c3b425e tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:55.505538 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-629d7d53-4375-4583-8614-15960c3b425e tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013476 Oct 17 13:08:55.505538 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1973/3841] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 17 13:08:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:08:55.633923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:55.655606 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43a855c0-3a6c-4db8-8785-38acbce5b871 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1673 microversion: 2.1 time: 0.865752 Oct 17 13:08:55.661559 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1869/3842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:54 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1673 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:55.709271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-445444935", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "9f07ca7e-cebd-4d4b-9898-67c2147f4610"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:55.816782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:08:55.820128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-72938243-2348-494d-be23-420433abe2b6 req-7c18b680-7627-4363-805d-dd5c587c2c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9074f1e3-b07e-4a30-80f4-2b6e1a63185c", "name": "network-vif-deleted", "tag": "fd4dac6b-8387-436b-9c1a-73ddc9a3f9c7"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:55.839748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-72938243-2348-494d-be23-420433abe2b6 req-7c18b680-7627-4363-805d-dd5c587c2c16 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:55.841105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-72938243-2348-494d-be23-420433abe2b6 req-7c18b680-7627-4363-805d-dd5c587c2c16 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:55.841757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-72938243-2348-494d-be23-420433abe2b6 req-7c18b680-7627-4363-805d-dd5c587c2c16 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:55.869037 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-72938243-2348-494d-be23-420433abe2b6 req-7c18b680-7627-4363-805d-dd5c587c2c16 service nova] Creating event network-vif-deleted:fd4dac6b-8387-436b-9c1a-73ddc9a3f9c7 for instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c on n-h2-853316-12 Oct 17 13:08:55.882620 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-72938243-2348-494d-be23-420433abe2b6 req-7c18b680-7627-4363-805d-dd5c587c2c16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066274 Oct 17 13:08:55.883840 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1870/3843] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:08:56.444988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:08:56.446696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:08:56.447072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:08:56.447487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:08:56.447902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:08:56.459140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:08:56.489280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:56.491959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:56.492631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:56.496347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:56.498859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:56.500136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:56.528675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:08:56.536033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for user bf508fbbaee740548bd6509b3d279b57 and project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:08:56.553348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:08:56.559951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:08:56.639460 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d7afc3c-1fd3-4211-b41b-933c250d212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944464 Oct 17 13:08:56.647820 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1974/3844] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:08:56.655477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-749dacc2-be41-4752-89f1-1be076f0a3f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:56.656195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-749dacc2-be41-4752-89f1-1be076f0a3f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:56.685502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:56.686634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:56.695440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:56.696313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:56.696967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:56.698083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:56.698981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:56.699988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:56.888763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-749dacc2-be41-4752-89f1-1be076f0a3f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:56.932384 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-749dacc2-be41-4752-89f1-1be076f0a3f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1278 microversion: 2.1 time: 0.283149 Oct 17 13:08:56.933381 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1871/3845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:56 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:57.254636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef5a5a23c3349ef8648e287a5273ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be9f1c4cc643eeb22541372cdd8b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:57.278490 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5bcac013-4356-41a6-8583-4c5fea08c3cf tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 200 len: 1494 microversion: 2.1 time: 0.596834 Oct 17 13:08:57.279309 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1975/3846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:56 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 1494 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:08:57.523089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:57.523976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:57.537758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:57.540063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:57.545898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:57.548338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:57.549886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:57.550941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:57.911412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:57.920020 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f26ffd1e-3c9f-4d71-a101-d258af057f7c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1565 microversion: 2.1 time: 0.401529 Oct 17 13:08:57.920606 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1872/3847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:57 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1565 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:57.924303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-131a65e5-ab86-4159-b8ce-4dfcebb06950 req-f77b9dc4-97c4-408f-82e9-c93116c62e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9074f1e3-b07e-4a30-80f4-2b6e1a63185c", "name": "network-vif-deleted", "tag": "1f46bce9-c42b-408e-a4cd-fea1159a6801"}, {"name": "network-changed", "server_uuid": "586fd663-8db0-4d14-bf90-b3871f6374b5", "tag": "3d6515c3-5c35-4518-9d9e-63d08da1216b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:08:57.941551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-131a65e5-ab86-4159-b8ce-4dfcebb06950 req-f77b9dc4-97c4-408f-82e9-c93116c62e90 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:57.942021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-131a65e5-ab86-4159-b8ce-4dfcebb06950 req-f77b9dc4-97c4-408f-82e9-c93116c62e90 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:57.942704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-131a65e5-ab86-4159-b8ce-4dfcebb06950 req-f77b9dc4-97c4-408f-82e9-c93116c62e90 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:57.961307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:57.962305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:57.970761 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-131a65e5-ab86-4159-b8ce-4dfcebb06950 req-f77b9dc4-97c4-408f-82e9-c93116c62e90 service nova] Creating event network-vif-deleted:1f46bce9-c42b-408e-a4cd-fea1159a6801 for instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c on n-h2-853316-12 Oct 17 13:08:57.971564 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-131a65e5-ab86-4159-b8ce-4dfcebb06950 req-f77b9dc4-97c4-408f-82e9-c93116c62e90 service nova] Creating event network-changed:3d6515c3-5c35-4518-9d9e-63d08da1216b for instance 586fd663-8db0-4d14-bf90-b3871f6374b5 on n-h2-853316-12 Oct 17 13:08:57.978816 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-131a65e5-ab86-4159-b8ce-4dfcebb06950 req-f77b9dc4-97c4-408f-82e9-c93116c62e90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058628 Oct 17 13:08:57.979651 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1976/3848] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:08:57.983009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:57.983982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:57.984584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:57.985471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:57.986084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:57.986859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:58.134765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:58.154300 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f4aeb7ae-5f79-4cdc-8b58-85d615387957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1330 microversion: 2.1 time: 0.198305 Oct 17 13:08:58.154902 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1873/3849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:57 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1330 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:08:58.310447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:58.311294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:58.341993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:58.342859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:58.343418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:58.345264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:58.357174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:58.359340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:58.408590 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] HTTP exception thrown: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Request method failure captured: Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c HTTP/1.1 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVOMU9XBPBBZtUyGahh4b0WmNNCaZyBYvwTx_Byqp1pwCpfzOArgwXzzHlQoWE0V2IkWe_Vjig9bui4uJxHcLDOfLYjkZ8tp8bxjW1V-Nb22VZMEJrlMG3wjZSBn6X65X4BMXyE9MKF8kRXtDGSU_qq30LR8be_SYeFeknRaQs4SeoU Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09be9f1c4cc643eeb22541372cdd8b50", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestMultiNic-545421640 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestMultiNic-545421640-project Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: aef5a5a23c3349ef8648e287a5273ba2 Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestMultiNic-545421640-project Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9074f1e3-b07e-4a30-80f4-2b6e1a63185c'} Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:08:58.413733 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:08:58.418244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:08:58.418244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:08:58.418244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:08:58.418244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:08:58.418244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:08:58.418244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:08:58.418244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:08:58.418244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Returning 404 to user: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:08:58.419691 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-80948554-b3e4-4e0e-948d-1cbb7dc47d5d tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 404 len: 111 microversion: 2.1 time: 0.113975 Oct 17 13:08:58.423167 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1977/3850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:58 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:08:59.181376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:08:59.182874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:08:59.192283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:59.193785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:59.194712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:59.195910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:08:59.197821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:08:59.198982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:08:59.303099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:08:59.330847 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2bf6149-57c7-4227-9c1e-b63497cfefae tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1336 microversion: 2.1 time: 0.137140 Oct 17 13:08:59.333211 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1874/3851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:08:59 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:00.363999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:00.366129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:00.375146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:00.375930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:00.376549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:00.377462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:00.378272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:00.378882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:00.748251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:00.763780 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65d26ab9-3817-4e61-8288-5c8150479897 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1378 microversion: 2.1 time: 0.406826 Oct 17 13:09:00.764464 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1978/3852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:00 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1378 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:01.771493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6792010c-32a1-410d-b435-876f20751686 req-0f9b8cfc-fc7b-441d-8bef-f096f58276af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:01.792451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6792010c-32a1-410d-b435-876f20751686 req-0f9b8cfc-fc7b-441d-8bef-f096f58276af service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:01.792957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6792010c-32a1-410d-b435-876f20751686 req-0f9b8cfc-fc7b-441d-8bef-f096f58276af service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:01.793506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6792010c-32a1-410d-b435-876f20751686 req-0f9b8cfc-fc7b-441d-8bef-f096f58276af service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:01.794707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:01.795187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:01.805527 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6792010c-32a1-410d-b435-876f20751686 req-0f9b8cfc-fc7b-441d-8bef-f096f58276af service nova] Creating event network-changed:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h1-853316-12 Oct 17 13:09:01.808414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:01.811134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:01.813649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:01.814900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:01.815484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:01.816952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6792010c-32a1-410d-b435-876f20751686 req-0f9b8cfc-fc7b-441d-8bef-f096f58276af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052131 Oct 17 13:09:01.817364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:01.819068 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1875/3853] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:02.217109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:02.229531 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1044c0a0-d80e-454a-aaf0-f7f6cb325d61 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1378 microversion: 2.1 time: 0.440778 Oct 17 13:09:02.230034 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1979/3854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:01 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1378 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:02.451310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:02.452311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:02.460061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:02.469360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:02.472385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:02.474358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:02.475722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:02.477385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:02.520231 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] HTTP exception thrown: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Request method failure captured: Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c HTTP/1.1 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVOMU9XBPBBZtUyGahh4b0WmNNCaZyBYvwTx_Byqp1pwCpfzOArgwXzzHlQoWE0V2IkWe_Vjig9bui4uJxHcLDOfLYjkZ8tp8bxjW1V-Nb22VZMEJrlMG3wjZSBn6X65X4BMXyE9MKF8kRXtDGSU_qq30LR8be_SYeFeknRaQs4SeoU Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09be9f1c4cc643eeb22541372cdd8b50", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestMultiNic-545421640-project Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: aef5a5a23c3349ef8648e287a5273ba2 Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestMultiNic-545421640-project Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '9074f1e3-b07e-4a30-80f4-2b6e1a63185c'} Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:09:02.522013 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.527158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Returning 404 to user: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:09:02.528754 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f30f8601-03be-47ba-bc04-4827ff31c065 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 404 len: 111 microversion: 2.1 time: 0.081879 Oct 17 13:09:02.529903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1876/3855] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:09:02 2022] DELETE /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:09:02.537802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:02.544658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: 9074f1e3-b07e-4a30-80f4-2b6e1a63185c] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:02.560554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:02.561165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:02.561670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:02.562669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:02.563379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:02.564023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:02.579191 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] HTTP exception thrown: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Request method failure captured: Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c HTTP/1.1 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVOMU9XBPBBZtUyGahh4b0WmNNCaZyBYvwTx_Byqp1pwCpfzOArgwXzzHlQoWE0V2IkWe_Vjig9bui4uJxHcLDOfLYjkZ8tp8bxjW1V-Nb22VZMEJrlMG3wjZSBn6X65X4BMXyE9MKF8kRXtDGSU_qq30LR8be_SYeFeknRaQs4SeoU Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09be9f1c4cc643eeb22541372cdd8b50", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestMultiNic-545421640-project Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: aef5a5a23c3349ef8648e287a5273ba2 Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestMultiNic-545421640-project Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9074f1e3-b07e-4a30-80f4-2b6e1a63185c'} Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:09:02.581140 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.584727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.584727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:09:02.584727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:09:02.584727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:09:02.584727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:09:02.584727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. Oct 17 13:09:02.584727 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.586858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Returning 404 to user: Instance 9074f1e3-b07e-4a30-80f4-2b6e1a63185c could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:09:02.588466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08c4a533-b8af-40d5-8fb6-3b6e09baf029 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c" status: 404 len: 111 microversion: 2.1 time: 0.054425 Oct 17 13:09:02.593311 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1980/3856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:02 2022] GET /compute/v2.1/servers/9074f1e3-b07e-4a30-80f4-2b6e1a63185c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:09:02.603461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:02.604288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:02.613221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:02.613884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:02.614288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:02.615138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:02.615559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:02.616061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:02.631410 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] HTTP exception thrown: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Request method failure captured: Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca HTTP/1.1 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVOMU9XBPBBZtUyGahh4b0WmNNCaZyBYvwTx_Byqp1pwCpfzOArgwXzzHlQoWE0V2IkWe_Vjig9bui4uJxHcLDOfLYjkZ8tp8bxjW1V-Nb22VZMEJrlMG3wjZSBn6X65X4BMXyE9MKF8kRXtDGSU_qq30LR8be_SYeFeknRaQs4SeoU Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09be9f1c4cc643eeb22541372cdd8b50", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestMultiNic-545421640-project Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: aef5a5a23c3349ef8648e287a5273ba2 Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestMultiNic-545421640-project Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca'} Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:09:02.633141 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Returning 404 to user: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c36fb894-f0de-4523-a6c1-19663dd9a305 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "DELETE /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 404 len: 111 microversion: 2.1 time: 0.040354 Oct 17 13:09:02.638660 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1877/3857] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:09:02 2022] DELETE /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:09:02.643493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:02.644410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] [instance: afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:02.651140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:02.652031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:02.653330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:02.654438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:02.655134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:02.655662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:02.670707 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] HTTP exception thrown: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Request method failure captured: Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca HTTP/1.1 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVOMU9XBPBBZtUyGahh4b0WmNNCaZyBYvwTx_Byqp1pwCpfzOArgwXzzHlQoWE0V2IkWe_Vjig9bui4uJxHcLDOfLYjkZ8tp8bxjW1V-Nb22VZMEJrlMG3wjZSBn6X65X4BMXyE9MKF8kRXtDGSU_qq30LR8be_SYeFeknRaQs4SeoU Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09be9f1c4cc643eeb22541372cdd8b50", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09be9f1c4cc643eeb22541372cdd8b50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 09be9f1c4cc643eeb22541372cdd8b50 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestMultiNic-545421640 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestMultiNic-545421640-project Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: aef5a5a23c3349ef8648e287a5273ba2 Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestMultiNic-545421640-project Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca'} Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:09:02.672252 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.676837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:09:02.676837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:09:02.676837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:09:02.676837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:09:02.676837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:09:02.676837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. Oct 17 13:09:02.676837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:09:02.678232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] Returning 404 to user: Instance afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:09:02.679096 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a23cd53-7962-4a22-b821-53f5034429c0 tempest-ServersTestMultiNic-545421640 tempest-ServersTestMultiNic-545421640-project] 10.222.0.27 "GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca" status: 404 len: 111 microversion: 2.1 time: 0.039548 Oct 17 13:09:02.679655 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1981/3858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:02 2022] GET /compute/v2.1/servers/afe56c0d-ed0f-43f5-89bf-4c47cba5b9ca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:09:03.255212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:03.255843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:03.269753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:03.270358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:03.270912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:03.271711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:03.272227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:03.272721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:03.595154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:03.612374 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac8ee63c-56ab-4c59-b17f-6a805c8e255b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1378 microversion: 2.1 time: 0.360614 Oct 17 13:09:03.614264 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1878/3859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:03 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1378 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:04.640112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:04.642608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:04.651733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:04.652422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:04.653875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:04.655024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:04.655643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:04.656211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:04.952853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:04.964974 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc1f4774-679b-46ff-99fa-39ed27d77aec tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1378 microversion: 2.1 time: 0.327819 Oct 17 13:09:04.982290 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1982/3860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:04 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1378 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:05.999689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:06.001873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:06.023308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:06.024166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:06.024776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:06.026528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:06.027753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:06.031365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:06.327119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:06.354992 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9c55a2a-129d-45d7-a674-458542303ae6 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1378 microversion: 2.1 time: 0.369278 Oct 17 13:09:06.362723 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1879/3861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:05 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1378 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:07.392637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:07.397830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:07.411609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:07.415618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:07.422002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:07.422810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:07.423409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:07.424297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:07.427098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:07.427741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:07.903905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:07.919415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-67ae8cf5-ee1b-4b90-881a-05b616acd0e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1378 microversion: 2.1 time: 0.537462 Oct 17 13:09:07.938388 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1983/3862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:07 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1378 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:08.951690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:08.952898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:08.955566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:08.974619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:08.975530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:08.976903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:08.979484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:08.982756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:08.983394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:09.133314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-be62aaf8-94d1-423e-b4a7-6803425548f7 req-51115ef4-786f-4285-b9d0-5fe1cd62f463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "name": "network-vif-plugged", "status": "completed", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:09.148772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-be62aaf8-94d1-423e-b4a7-6803425548f7 req-51115ef4-786f-4285-b9d0-5fe1cd62f463 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:09.152987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-be62aaf8-94d1-423e-b4a7-6803425548f7 req-51115ef4-786f-4285-b9d0-5fe1cd62f463 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:09.153781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-be62aaf8-94d1-423e-b4a7-6803425548f7 req-51115ef4-786f-4285-b9d0-5fe1cd62f463 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:09.163462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:09.188054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-be62aaf8-94d1-423e-b4a7-6803425548f7 req-51115ef4-786f-4285-b9d0-5fe1cd62f463 service nova] Creating event network-vif-plugged:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h1-853316-12 Oct 17 13:09:09.203054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-be62aaf8-94d1-423e-b4a7-6803425548f7 req-51115ef4-786f-4285-b9d0-5fe1cd62f463 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068679 Oct 17 13:09:09.205760 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1984/3863] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:09.273347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:09.283995 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d4af17e-e0c0-45a4-909d-214966c4e267 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1378 microversion: 2.1 time: 0.342196 Oct 17 13:09:09.294299 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1880/3864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:08 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1378 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:09.991388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1009992516", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:10.064030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] validate_networks() for [('2bbfbbe9-4ab2-4b95-a68f-5e8ba7706545', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:09:10.307867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:10.309897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:10.318022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:10.319265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:10.319940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:10.320989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:10.321629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:10.322532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:10.555452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:09:10.556427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:09:10.557066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:09:10.557685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:09:10.558105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:09:10.569060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:10.569812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:10.570523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:10.571750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:10.572664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:10.573314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:10.594024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Getting quotas for project 15d82cd61ac94563ab7bd8b9c13a0a06. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:09:10.600857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Getting quotas for user 3e452d90f659446db23827a290a819f1 and project 15d82cd61ac94563ab7bd8b9c13a0a06. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:09:10.616315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:10.627616 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-885eeb12-8c56-4eb0-bb9c-2b3b8ab6a665 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1378 microversion: 2.1 time: 0.323380 Oct 17 13:09:10.630102 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1881/3865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:10 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1378 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:10.645361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:09:10.647876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:09:10.702043 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-744d158c-21b1-4d98-9681-daeb73b0e440 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.853938 Oct 17 13:09:10.702734 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1985/3866] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:09:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:09:10.714399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-541c6063-e418-4d8c-bbbd-2a9a0368f04a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:10.715345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-541c6063-e418-4d8c-bbbd-2a9a0368f04a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:10.825267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-541c6063-e418-4d8c-bbbd-2a9a0368f04a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:10.837545 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-541c6063-e418-4d8c-bbbd-2a9a0368f04a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1222 microversion: 2.1 time: 0.127375 Oct 17 13:09:10.841792 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1882/3867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:10 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:11.046711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1810714990", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:11.139644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] validate_networks() for [('2bbfbbe9-4ab2-4b95-a68f-5e8ba7706545', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:09:11.660385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:11.661011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:11.688757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:11.694651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:11.695390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:11.696319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:11.698104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:11.704506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:12.201222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:12.211747 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d52bdb5e-a1e5-4f25-a077-d6ce6e46b730 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1527 microversion: 2.1 time: 0.563567 Oct 17 13:09:12.214499 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1883/3868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:11 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1527 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:12.242403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:12.243208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:12.259099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:12.260306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:12.265050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:12.266545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:12.267085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:12.267544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:12.410103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:09:12.410592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:09:12.411165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:09:12.411583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:09:12.412002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:09:12.429227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:12.430001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:12.430653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:12.431677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:12.432404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:12.433070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:12.454258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Getting quotas for project 15d82cd61ac94563ab7bd8b9c13a0a06. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:09:12.460711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Getting quotas for user 3e452d90f659446db23827a290a819f1 and project 15d82cd61ac94563ab7bd8b9c13a0a06. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:09:12.476133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:09:12.478950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:09:12.547423 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af4e6d32-eae9-426d-b7a1-b91249765717 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.506279 Oct 17 13:09:12.548728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1986/3869] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:09:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:09:12.562914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe320442-ff5a-4cc9-af5d-9167467c976f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:12.564327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe320442-ff5a-4cc9-af5d-9167467c976f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:12.733996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe320442-ff5a-4cc9-af5d-9167467c976f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:12.744817 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe320442-ff5a-4cc9-af5d-9167467c976f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1222 microversion: 2.1 time: 0.188954 Oct 17 13:09:12.745460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1987/3870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:12 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1222 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:12.813125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:12.823792 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb5c4c9c-c36f-4c46-ba9e-6976894f600f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1527 microversion: 2.1 time: 0.585766 Oct 17 13:09:12.824923 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1884/3871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:12 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1527 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:12.852624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-683ce2ad-39f7-4d79-9483-876d697f51ac tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:12.889973 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-683ce2ad-39f7-4d79-9483-876d697f51ac tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/9f07ca7e-cebd-4d4b-9898-67c2147f4610" status: 202 len: 0 microversion: 2.1 time: 0.041767 Oct 17 13:09:12.892402 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1988/3872] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:09:12 2022] DELETE /compute/v2.1/flavors/9f07ca7e-cebd-4d4b-9898-67c2147f4610 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:09:12.900626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5a0f4c7d-199b-4e33-a66a-5718251b0234 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:12.973858 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5a0f4c7d-199b-4e33-a66a-5718251b0234 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077680 Oct 17 13:09:12.974494 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1885/3873] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:09:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:12.995096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:12.999114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:13.005893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:13.006518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:13.007049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:13.007868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:13.008411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:13.008952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:13.042087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:13.049391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Old instance type tempest-test_resize_flavor_-1215866392, new instance type m1.heat {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:09:13.057491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:09:13.058333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:09:13.059067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:09:13.059698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:09:13.060351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:09:13.168283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1dcc3b17-957d-4ba7-ba2d-a6d38cf50a4d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a/action" status: 202 len: 0 microversion: 2.1 time: 0.176700 Oct 17 13:09:13.177955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:13.179643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:13.185307 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1989/3874] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:09:12 2022] POST /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:09:13.190613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:13.191386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:13.193130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:13.195293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:13.196667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:13.197648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:13.485147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:13.499628 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab6f814e-e9c8-4c5b-9ccf-e73c20c34621 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1536 microversion: 2.1 time: 0.325855 Oct 17 13:09:13.500763 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1886/3875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:13 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1536 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:13.770065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:13.771520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:13.785535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:13.786030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:13.793745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:13.794579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:13.795064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:13.795499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:13.951237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:13.967285 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e82e9029-fb46-4069-8d8e-545464feb8e8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1218 microversion: 2.1 time: 0.200578 Oct 17 13:09:13.968094 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1990/3876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:13 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:14.530067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:14.531396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:14.578874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:14.579665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:14.580187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:14.583155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:14.585928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:14.587190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:15.008090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:15.008708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:15.035423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:15.035933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:15.036379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:15.044108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:15.053804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:15.054752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:15.389932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:15.418075 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6555985c-698a-4cb9-9085-3b16b9155e9d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1292 microversion: 2.1 time: 0.427713 Oct 17 13:09:15.419498 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1991/3877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:14 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1292 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:15.551508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:15.576343 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1fcc95b-367e-47ed-8b41-446ba5ed6094 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1536 microversion: 2.1 time: 1.044991 Oct 17 13:09:15.577008 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1887/3878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:14 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1536 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:16.176777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-cec78a84-6926-4262-8d97-56816974f517 req-5ea5ad26-7d56-4250-9ae4-4a7a776ee815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27ca706-6340-4995-a586-b1ee6276bece", "tag": "6027d840-b7f7-4bf8-b272-66db08cf031f"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:16.219472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cec78a84-6926-4262-8d97-56816974f517 req-5ea5ad26-7d56-4250-9ae4-4a7a776ee815 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:16.222773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cec78a84-6926-4262-8d97-56816974f517 req-5ea5ad26-7d56-4250-9ae4-4a7a776ee815 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:16.223752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cec78a84-6926-4262-8d97-56816974f517 req-5ea5ad26-7d56-4250-9ae4-4a7a776ee815 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:16.243702 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-cec78a84-6926-4262-8d97-56816974f517 req-5ea5ad26-7d56-4250-9ae4-4a7a776ee815 service nova] Creating event network-changed:6027d840-b7f7-4bf8-b272-66db08cf031f for instance b27ca706-6340-4995-a586-b1ee6276bece on n-h2-853316-12 Oct 17 13:09:16.263149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-cec78a84-6926-4262-8d97-56816974f517 req-5ea5ad26-7d56-4250-9ae4-4a7a776ee815 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090107 Oct 17 13:09:16.266329 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1992/3879] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:16.443157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:16.444166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:16.455282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:16.458784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:16.470004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:16.474006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:16.474939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:16.477687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:16.493357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:16.601887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:16.603010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:16.618777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:16.619609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:16.622444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:16.626571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:16.629690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:16.631697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:16.848386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:16.863579 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09758199-c180-4d3a-a54e-360192058e40 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1280 microversion: 2.1 time: 0.424701 Oct 17 13:09:16.872226 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1888/3880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:16 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1280 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:17.127901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:17.140441 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b1b70745-2603-44fa-8744-a676749b881e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1536 microversion: 2.1 time: 0.543477 Oct 17 13:09:17.141352 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1993/3881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:16 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1536 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:17.892220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:17.894054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:17.908755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:17.913426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:17.917645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:17.919654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:17.930430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:17.931152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:18.165336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:18.165958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:18.178673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:18.179165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:18.179870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:18.187372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:18.188524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:18.188973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:18.372931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:18.385635 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff2d3438-6ea5-4318-97cb-0b6fa51e289a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1322 microversion: 2.1 time: 0.499973 Oct 17 13:09:18.388687 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1889/3882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:17 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:18.667134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:18.680644 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-42bfe4db-71cf-4178-b6b0-871d25871933 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1536 microversion: 2.1 time: 0.519073 Oct 17 13:09:18.684638 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1994/3883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:18 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1536 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:19.331663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d756dae4-2f5b-40f4-97e1-91ebff864340 req-0ceedc20-00e0-40d9-b437-6d1c2f9c846f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e865e2-5b1d-4c6c-81c7-d099f6ef45da", "tag": "11832097-8c07-471c-8b03-630fac07e882"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:19.354047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d756dae4-2f5b-40f4-97e1-91ebff864340 req-0ceedc20-00e0-40d9-b437-6d1c2f9c846f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:19.354701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d756dae4-2f5b-40f4-97e1-91ebff864340 req-0ceedc20-00e0-40d9-b437-6d1c2f9c846f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:19.355249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d756dae4-2f5b-40f4-97e1-91ebff864340 req-0ceedc20-00e0-40d9-b437-6d1c2f9c846f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:19.395624 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d756dae4-2f5b-40f4-97e1-91ebff864340 req-0ceedc20-00e0-40d9-b437-6d1c2f9c846f service nova] Creating event network-changed:11832097-8c07-471c-8b03-630fac07e882 for instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da on n-h1-853316-12 Oct 17 13:09:19.405407 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d756dae4-2f5b-40f4-97e1-91ebff864340 req-0ceedc20-00e0-40d9-b437-6d1c2f9c846f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077440 Oct 17 13:09:19.406576 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1890/3884] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:19.416251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:19.418779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:19.430185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:19.430793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:19.431145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:19.431861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:19.432817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:19.433304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:19.711715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:19.712948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:19.731868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:19.732904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:19.733518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:19.735260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:19.736083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:19.736794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:19.897921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:19.921958 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e42f606-eb1c-4d85-933d-b320d3857041 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1322 microversion: 2.1 time: 0.509396 Oct 17 13:09:19.923932 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1995/3885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:19 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:20.078066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:20.097354 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-58586eab-a45c-4a37-83c9-99577f0fa87a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.391981 Oct 17 13:09:20.098222 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1891/3886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:19 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:20.466585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:20.468848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:20.482081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:20.488615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:20.489070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:20.489822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:20.490488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:20.491114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:20.566339 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e48f2b7-1a82-465f-b544-9f4b821ca53f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action" status: 200 len: 24564 microversion: 2.1 time: 0.104393 Oct 17 13:09:20.567807 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1996/3887] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:09:20 2022] POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action => generated 24564 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:09:20.948374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:20.948980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:20.951833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:20.960721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:20.961208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:20.961648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:20.962387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:20.962841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:20.963261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:21.127414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:21.128314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:21.165043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:21.174918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:21.175423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:21.176183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:21.176657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:21.177130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:21.192888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:21.210391 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e87d5fa-f886-48a3-a76f-31a1d575a32f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1322 microversion: 2.1 time: 0.264055 Oct 17 13:09:21.212149 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1892/3888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:20 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:21.417618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:21.431340 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac9ad172-522f-408c-b4c4-ffe276442979 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.309075 Oct 17 13:09:21.445632 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1997/3889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:21 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:21.498252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4797348c-7a6d-4e9d-bfed-877c1f3d82ce req-7a3ce553-88d5-46c0-bd63-357da4177f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27ca706-6340-4995-a586-b1ee6276bece", "name": "network-vif-plugged", "status": "completed", "tag": "6027d840-b7f7-4bf8-b272-66db08cf031f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:21.508405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4797348c-7a6d-4e9d-bfed-877c1f3d82ce req-7a3ce553-88d5-46c0-bd63-357da4177f56 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:21.508884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4797348c-7a6d-4e9d-bfed-877c1f3d82ce req-7a3ce553-88d5-46c0-bd63-357da4177f56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:21.509317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4797348c-7a6d-4e9d-bfed-877c1f3d82ce req-7a3ce553-88d5-46c0-bd63-357da4177f56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:21.531174 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4797348c-7a6d-4e9d-bfed-877c1f3d82ce req-7a3ce553-88d5-46c0-bd63-357da4177f56 service nova] Creating event network-vif-plugged:6027d840-b7f7-4bf8-b272-66db08cf031f for instance b27ca706-6340-4995-a586-b1ee6276bece on n-h2-853316-12 Oct 17 13:09:21.536881 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4797348c-7a6d-4e9d-bfed-877c1f3d82ce req-7a3ce553-88d5-46c0-bd63-357da4177f56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043020 Oct 17 13:09:21.538059 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1893/3890] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:21.697572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1125123355", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e53d95a2-0561-4745-a443-7230dc4fc44a"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:21.713645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:21.771120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] validate_networks() for [('e53d95a2-0561-4745-a443-7230dc4fc44a', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:09:22.186672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:09:22.187107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:09:22.187726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:09:22.188271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:09:22.188689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:09:22.198310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:22.198801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:22.199558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:22.200308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:22.200770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:22.201200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:22.223401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Getting quotas for project 7a7fe0bfe98b4320be690d525152f6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:09:22.228636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Getting quotas for user f2af8096ed394d02bdf6c285e17df1f7 and project 7a7fe0bfe98b4320be690d525152f6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:09:22.236183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:22.237502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:22.241762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:09:22.244140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:09:22.244684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:22.245360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:22.246615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:22.247564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:22.248289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:22.248921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:22.296407 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43c2e191-72ba-426a-8fbb-909d2038d359 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779916 Oct 17 13:09:22.297694 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1998/3891] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:09:22.311582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee1a9322-48bc-4744-b05d-d6aef624cb43 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:22.312561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee1a9322-48bc-4744-b05d-d6aef624cb43 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:22.411376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee1a9322-48bc-4744-b05d-d6aef624cb43 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:22.420394 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee1a9322-48bc-4744-b05d-d6aef624cb43 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1218 microversion: 2.1 time: 0.114402 Oct 17 13:09:22.420981 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 1999/3892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:22 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:22.457317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:22.458011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:22.469947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:22.471743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:22.474141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:22.474973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:22.475459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:22.475888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:22.510109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:22.541875 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90addf9a-7e87-4a2d-9e5d-3d841e55ae36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1322 microversion: 2.1 time: 0.310682 Oct 17 13:09:22.544867 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1894/3893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:22 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:22.725547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:22.741570 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0d69a24-d046-44bd-b87a-85c11e2d3d23 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.287676 Oct 17 13:09:22.755097 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2000/3894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:22 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:23.454189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:23.454914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:23.471453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=61 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:23.475088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:23.475404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:23.475834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:23.478132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:23.481108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:23.483760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:23.568888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:23.569497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:23.584812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:23.585933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:23.587320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:23.589429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:23.592729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:23.593376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:23.736164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:23.756257 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d370cb9-f1d9-4ded-a0db-40244973a296 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1214 microversion: 2.1 time: 0.311116 Oct 17 13:09:23.759972 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1895/3895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:23 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1214 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:23.790802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:23.791918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:23.822283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:23.823214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:23.823884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:23.826356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:23.827109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:23.827908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:23.884975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:23.894738 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e2196afc-c120-46ee-b2d3-b396bc0a3dab tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1322 microversion: 2.1 time: 0.331335 Oct 17 13:09:23.898073 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2001/3896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:23 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:24.033704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:24.042852 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ffd0c8a-1b9c-4cc8-9695-7f005d0804d8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.277585 Oct 17 13:09:24.043800 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1896/3897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:23 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:24.788564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:24.789018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:24.799400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:24.799904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:24.800346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:24.801061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:24.801523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:24.801953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:24.919301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:24.921771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:24.923177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:24.936894 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d9cb57f7-88e5-4e17-85ce-7b39483b9955 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1276 microversion: 2.1 time: 0.151050 Oct 17 13:09:24.939453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2002/3898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:24 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:24.941232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:24.947606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:24.948582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:24.950126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:24.950997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:24.951646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:25.067174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:25.068131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:25.088345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:25.092972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:25.094870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:25.100237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:25.101252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:25.106235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:25.207206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:25.220756 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f580233f-bf97-4384-8dab-e70f4757d4d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1322 microversion: 2.1 time: 0.302268 Oct 17 13:09:25.223171 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1897/3899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:24 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:25.499508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:25.514560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ba46b6d1-01db-4253-b720-ad86201f1590 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.451655 Oct 17 13:09:25.530976 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2003/3900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:25 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:25.974663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:25.975825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:25.989423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:25.989928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:25.990402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:25.991118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:25.991582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:25.992118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:26.199410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:26.207779 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67cc81ca-325d-4741-be52-0368ef89d6d3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1318 microversion: 2.1 time: 0.244019 Oct 17 13:09:26.222237 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1898/3901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:25 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:26.247818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:26.248425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:26.257212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:26.257773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:26.258363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:26.259152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:26.259837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:26.260465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:26.499036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:26.509499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68a6bc24-97cf-46c2-b038-63fbcd90dc87 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1322 microversion: 2.1 time: 0.267262 Oct 17 13:09:26.510466 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2004/3902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:26 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:26.543360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:26.544815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:26.554614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:26.557454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:26.560391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:26.561585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:26.561848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:26.564697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:26.627311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a2d0d748-c83e-41c2-bb76-dce2ff4da8c0 req-2dd66ac9-e3fa-4615-8cc8-a42609de4dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad23758-40e8-46a3-9c04-2f14d26d6226", "tag": "dea17f7e-76dc-466a-b6f0-ecb7a0515eb5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:26.646099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a2d0d748-c83e-41c2-bb76-dce2ff4da8c0 req-2dd66ac9-e3fa-4615-8cc8-a42609de4dcd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:26.660987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a2d0d748-c83e-41c2-bb76-dce2ff4da8c0 req-2dd66ac9-e3fa-4615-8cc8-a42609de4dcd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:26.661840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a2d0d748-c83e-41c2-bb76-dce2ff4da8c0 req-2dd66ac9-e3fa-4615-8cc8-a42609de4dcd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:26.695500 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a2d0d748-c83e-41c2-bb76-dce2ff4da8c0 req-2dd66ac9-e3fa-4615-8cc8-a42609de4dcd service nova] Creating event network-changed:dea17f7e-76dc-466a-b6f0-ecb7a0515eb5 for instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 on n-h2-853316-12 Oct 17 13:09:26.703236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a2d0d748-c83e-41c2-bb76-dce2ff4da8c0 req-2dd66ac9-e3fa-4615-8cc8-a42609de4dcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080621 Oct 17 13:09:26.706347 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2005/3903] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:26.715837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c7387085-176e-4082-a653-867129c0004d req-97203b39-a0b5-457b-980e-273f25d39242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e865e2-5b1d-4c6c-81c7-d099f6ef45da", "name": "network-vif-plugged", "status": "completed", "tag": "11832097-8c07-471c-8b03-630fac07e882"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:26.742939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c7387085-176e-4082-a653-867129c0004d req-97203b39-a0b5-457b-980e-273f25d39242 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:26.743444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c7387085-176e-4082-a653-867129c0004d req-97203b39-a0b5-457b-980e-273f25d39242 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:26.745100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c7387085-176e-4082-a653-867129c0004d req-97203b39-a0b5-457b-980e-273f25d39242 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:26.801864 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c7387085-176e-4082-a653-867129c0004d req-97203b39-a0b5-457b-980e-273f25d39242 service nova] Creating event network-vif-plugged:11832097-8c07-471c-8b03-630fac07e882 for instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da on n-h1-853316-12 Oct 17 13:09:26.807047 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c7387085-176e-4082-a653-867129c0004d req-97203b39-a0b5-457b-980e-273f25d39242 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095055 Oct 17 13:09:26.807654 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2006/3904] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:26.878921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:26.901944 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f427f778-e60d-41b7-b18d-74ae2aa11185 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.363548 Oct 17 13:09:26.903741 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1899/3905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:26 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:27.243433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:27.246565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:27.255638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:27.256270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:27.256540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:27.257237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:27.257687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:27.258460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:27.279354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:27.406902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:27.415351 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e7551c0-644c-4513-b093-4c376ffd58f8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1318 microversion: 2.1 time: 0.177353 Oct 17 13:09:27.426186 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2007/3906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:27 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:27.535160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:27.535666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:27.542730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:27.543533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:27.544177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:27.545062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:27.545688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:27.546120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:27.681938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:27.690949 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b4b91545-d98e-45a2-9308-dfbaa34f73a1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1322 microversion: 2.1 time: 0.159949 Oct 17 13:09:27.691507 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1900/3907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:27 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:27.926152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:27.926839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:27.933412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:27.934117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:27.934623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:27.935342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:27.935835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:27.936273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:28.084252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:28.092463 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e003b111-9eef-4c01-b88a-7c3825b7e6f3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.170820 Oct 17 13:09:28.093067 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2008/3908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:27 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:28.443096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:28.444371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:28.455631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:28.456919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:28.458850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:28.460077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:28.460677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:28.461122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:28.632891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:28.642414 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-76a1009a-c624-4d2b-85b9-1bf81ec0747d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1318 microversion: 2.1 time: 0.206328 Oct 17 13:09:28.643289 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1901/3909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:28 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:28.715907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:28.716687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:28.723771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:28.724329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:28.724831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:28.725593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:28.726136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:28.726668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:28.856990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:28.864897 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8cdef565-e91e-4180-9201-ecb987e9c2ce tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1516 microversion: 2.1 time: 0.153961 Oct 17 13:09:28.865466 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2009/3910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:28 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:28.887701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:28.890105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:28.896147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:28.896576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:28.897018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:28.897706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:28.898185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:28.898616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:28.921896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lazy-loading 'flavor' on Instance uuid 95e865e2-5b1d-4c6c-81c7-d099f6ef45da {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:09:28.993312 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4bdbbe17-ebc8-41f4-9425-929f47ea67c3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da/action" status: 200 len: 32 microversion: 2.1 time: 0.110178 Oct 17 13:09:28.994044 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1902/3911] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:09:28 2022] POST /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:09:29.004106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:29.004714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:29.010738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:29.011209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:29.011642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:29.012384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:29.012842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:29.013383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:29.116596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:29.117369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:29.125544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:29.126038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:29.126502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:29.127505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:29.128165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:29.128780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:29.169833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:29.177694 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6860315d-9e42-47aa-8a89-b4e0ee50f621 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.177431 Oct 17 13:09:29.179006 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2010/3912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:28 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:29.366859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:29.393002 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-adf8cc61-8119-4c77-ab56-d88a51618882 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.274546 Oct 17 13:09:29.397380 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1903/3913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:29 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:29.666807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:29.667332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:29.674370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:29.674862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:29.675298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:29.676289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:29.676872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:29.677304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:29.832472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:29.847663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-799f2406-992b-49bf-a029-291b5d5b8a0d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1318 microversion: 2.1 time: 0.184874 Oct 17 13:09:29.848254 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2011/3914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:29 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:30.201495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:30.202134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:30.208821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:30.209312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:30.209752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:30.210477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:30.210935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:30.211365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:30.215474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:30.352644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:30.360850 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7b0e144-5e79-41a1-9025-6a1c9764c702 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.163830 Oct 17 13:09:30.361539 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1904/3915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:30 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:30.421051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:30.421662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:30.427836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:30.428533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:30.429135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:30.429999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:30.430989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:30.431421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:30.574049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:30.582557 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e8048a3-ca7a-4daa-8635-7c384f91f846 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.165363 Oct 17 13:09:30.583005 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2012/3916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:30 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:30.871029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:30.872490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:30.878370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:30.878862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:30.879300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:30.880000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:30.880451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:30.880877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.014702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:31.022623 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ceae5078-5d0c-49f5-9b83-9cce8aa82f59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1318 microversion: 2.1 time: 0.155582 Oct 17 13:09:31.023250 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1905/3917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:30 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:31.320991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e6f8f487-47a5-4a9f-9d42-707b63cb54eb req-87bca3ce-af4d-43a7-a188-3443146f0d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad23758-40e8-46a3-9c04-2f14d26d6226", "name": "network-vif-plugged", "status": "completed", "tag": "dea17f7e-76dc-466a-b6f0-ecb7a0515eb5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:31.334569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e6f8f487-47a5-4a9f-9d42-707b63cb54eb req-87bca3ce-af4d-43a7-a188-3443146f0d86 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.335267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e6f8f487-47a5-4a9f-9d42-707b63cb54eb req-87bca3ce-af4d-43a7-a188-3443146f0d86 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.335867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e6f8f487-47a5-4a9f-9d42-707b63cb54eb req-87bca3ce-af4d-43a7-a188-3443146f0d86 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.356478 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e6f8f487-47a5-4a9f-9d42-707b63cb54eb req-87bca3ce-af4d-43a7-a188-3443146f0d86 service nova] Creating event network-vif-plugged:dea17f7e-76dc-466a-b6f0-ecb7a0515eb5 for instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 on n-h2-853316-12 Oct 17 13:09:31.362647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e6f8f487-47a5-4a9f-9d42-707b63cb54eb req-87bca3ce-af4d-43a7-a188-3443146f0d86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045937 Oct 17 13:09:31.363707 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2013/3918] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:09:31.384820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:31.387976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:31.404768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.405125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.405572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.406389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.406854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.407461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.523681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:31.524479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:31.531942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.532743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.533386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.534787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.536276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.536910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.572764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:31.592027 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-737c0a80-e62c-47b7-8810-e7e70779a012 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.210804 Oct 17 13:09:31.592655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1906/3919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:31 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:31.608576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:31.609362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:31.617846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.618521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.619232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.620110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.620676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.622097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.777190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:31.785859 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b87bc17b-efc5-44f4-a66b-9bd43569850d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.181759 Oct 17 13:09:31.787116 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1907/3920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:31 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:31.806502 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9fdb57e4-6a37-41c3-83a6-5f0b17b7ec71 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1837 microversion: 2.1 time: 0.286964 Oct 17 13:09:31.807268 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2014/3921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:31 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1837 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:31.831403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:31.832127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:31.838678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.839274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.839782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.840766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:31.841196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:31.841695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:31.974304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:31.983534 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a5138d23-10fb-4f9d-8530-db96ff9cf26d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1684 microversion: 2.1 time: 0.155926 Oct 17 13:09:31.984128 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1908/3922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:31 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:32.046943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:32.047664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:32.053627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.054208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.054721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.055483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.056033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.056528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.085127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:32.087569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:32.094910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.095411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.095858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.096589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.097060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.097496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.196661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:32.205230 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4081f1b2-aa5f-4ddd-859a-1eb6ebb1b48c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1318 microversion: 2.1 time: 0.163000 Oct 17 13:09:32.205882 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2015/3923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:32 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:32.314508 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-88bb465a-2b97-4934-8efa-490e9839c5e4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action" status: 200 len: 32638 microversion: 2.1 time: 0.233089 Oct 17 13:09:32.321889 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1909/3924] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:09:32 2022] POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action => generated 32638 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:09:32.518266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:32.518846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:32.520837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:32.522359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=22 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:32.528276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.528765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.529209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.529906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.530407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.530840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.559716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e7ac72f0a40c48a2aee2a029d0235012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712e443870d344e29d86b6a14cfb887c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:32.560306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] flavor_id is None. Assuming migration. {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 13:09:32.560745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:09:32.616702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:32.618291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:32.639032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.639527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.639972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.640905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.641642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.642283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.682434 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6135411-6ab5-4c65-91f2-e9c66edb74d7 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action" status: 202 len: 0 microversion: 2.1 time: 0.167907 Oct 17 13:09:32.686885 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2016/3925] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:09:32 2022] POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:09:32.692049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:32.692674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:32.703923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.704041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.704465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.705400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.705879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.706359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.863282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:32.879034 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-017946bc-b7f7-42b4-b64b-5002b0e30df1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.267270 Oct 17 13:09:32.883756 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1910/3926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:32 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:32.899334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:32.900620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:32.908913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.909553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.910003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.911359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:32.911359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:32.911708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:32.932963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:32.944721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bb56f188-5879-48fe-a78d-2c659923aba5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1693 microversion: 2.1 time: 0.256723 Oct 17 13:09:32.946863 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2017/3927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:32 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1693 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:33.082356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:33.093134 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7fb7929d-82a6-4620-94be-26375561de79 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.208020 Oct 17 13:09:33.094038 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1911/3928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:32 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:33.232734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:33.234573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:33.243542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.244306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.245472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.251628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.252297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.257753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.404498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:33.413079 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21fbb890-fdb9-494c-a904-0972ec91b452 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1508 microversion: 2.1 time: 0.188126 Oct 17 13:09:33.413644 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2018/3929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:33 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:33.437944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:33.438688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:33.448608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.449197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.456263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.457148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.457630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.458067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.651769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:33.669387 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d713522-836b-4239-b720-42f1440ed27c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1508 microversion: 2.1 time: 0.236081 Oct 17 13:09:33.670609 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1912/3930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:33 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:33.692169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:33.696475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:33.703782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.704449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.705075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.705775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.706420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.706850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.820148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:09:33.820871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:09:33.821544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:09:33.822203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:09:33.822922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:09:33.904498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:33.905118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:33.919938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.920464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.920873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:33.921335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.922246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.922903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.923623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.927786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.928486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.929116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.930023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.930696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.931430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.963292 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69c805d2-79c3-4f67-93eb-39cbae55ef78 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "POST /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226/action" status: 202 len: 1110 microversion: 2.1 time: 0.275045 Oct 17 13:09:33.964626 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2019/3931] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:09:33 2022] POST /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226/action => generated 1110 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:09:33.971214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:33.972137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:33.978880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.979548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.980159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:33.981081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:33.981690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:33.982471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:34.204364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:34.204955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:34.212180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ede8131-bdd9-4a86-bd56-d98fff593e43 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1693 microversion: 2.1 time: 0.245149 Oct 17 13:09:34.213250 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2020/3932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:33 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1693 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:34.219252 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80f1be9e-6e1a-4918-afed-48a2379bfd2d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.319170 Oct 17 13:09:34.220987 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1913/3933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:33 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:34.226868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:34.227923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:34.234054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:34.234920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:34.247081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:34.248161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:34.248750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:34.250429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:34.251099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:34.251713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:34.252345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:34.252919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:34.253503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:34.256868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:34.257934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:34.258591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:34.309252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:34.462207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:34.471935 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ae90872b-46d4-4592-9c7a-3d62291a6c89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.248672 Oct 17 13:09:34.472552 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1914/3934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:34 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:34.489826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:34.502543 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-addcb21d-8b1d-4479-a099-ed46ecdbc1b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.287984 Oct 17 13:09:34.503162 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2021/3935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:34 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:35.256332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:35.257039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:35.258249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:35.259848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:35.268065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:35.268788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:35.269395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:35.269703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:35.270175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:35.270759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:35.271092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:35.271709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:35.271883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:35.272408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:35.272735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:35.273621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:35.420552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:35.423139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:35.431761 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c8a48b5a-cf56-4c34-ab8f-0661b02478a4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.178178 Oct 17 13:09:35.434214 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2022/3936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:35 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:35.435331 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9e4500b-dd5b-4ae2-bcea-bdbea80954a1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.183457 Oct 17 13:09:35.435903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1915/3937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:35 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:35.497027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:35.497565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:35.503589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:35.504074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:35.504516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:35.505212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:35.505670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:35.506101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:35.526653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:35.527543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:35.535002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:35.535494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:35.535935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:35.536639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:35.537092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:35.537519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:35.651823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:35.659806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-48621b09-ebf1-4646-a521-f7f29bebc92f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.166771 Oct 17 13:09:35.669096 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2023/3938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:35 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:35.688807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:35.696959 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-95892cad-ead9-4a5f-adbf-3281c7ab7a22 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.174537 Oct 17 13:09:35.697523 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1916/3939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:35 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:36.456534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:36.457805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:36.459923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:36.460523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:36.465853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:36.466529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:36.467187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:36.468095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:36.468208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:36.468557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:36.468693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:36.469102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:36.469316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:36.469815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:36.470297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:36.470726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:36.632470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:36.641318 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1f964cd-4d57-46f1-bde1-4208b6aa59e0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.189355 Oct 17 13:09:36.642482 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2024/3940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:36 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:36.683535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:36.685311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:36.691888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:36.692483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:36.693229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:36.693632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:36.694377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:36.694811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:36.723151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:36.731984 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cb6fcbe6-414e-4318-9643-2f0d486d2604 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.276414 Oct 17 13:09:36.743887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1917/3941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:36 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:36.751471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:36.752260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:36.762385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:36.763259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:36.766594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:36.768158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:36.768829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:36.769481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:36.895873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:36.907276 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6707e31-d140-4869-b196-2bb388b9c957 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.228050 Oct 17 13:09:36.924771 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2025/3942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:36 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:36.941183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:36.949746 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-63676a50-3e55-46e8-8419-9a074fc7113f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.211971 Oct 17 13:09:36.950357 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1918/3943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:36 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:37.665042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:37.665879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:37.673463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:37.673949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:37.674415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:37.675105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:37.675696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:37.676120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:37.757656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:37.758401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:37.766730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:37.767376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:37.768020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:37.768916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:37.769752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:37.770284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:37.830728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:37.839185 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3cee2ddb-950c-4607-b98e-b8ee7776c1da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.177975 Oct 17 13:09:37.839913 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2026/3944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:37 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:37.913566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:37.922756 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d31d3e74-74f5-4c54-98ad-8b693e62eca7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.169227 Oct 17 13:09:37.924251 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1919/3945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:37 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:37.931075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:37.931821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:37.938620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:37.939530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:37.940282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:37.941101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:37.941823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:37.942395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:37.982743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:37.983471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:37.990855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:37.990855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:37.990855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:37.991467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:37.991992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:37.992499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:38.082016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:38.091259 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fa4bc811-c8ab-4d6d-bd12-bbda5037b9ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.163786 Oct 17 13:09:38.091858 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2027/3946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:37 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:38.129448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:38.137909 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c67e116-51a0-41a1-b394-25e64f3451a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.159522 Oct 17 13:09:38.138598 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1920/3947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:37 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:38.865834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:38.866509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:38.873422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:38.873901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:38.874378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:38.875065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:38.875519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:38.875944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:38.947285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:38.948488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:38.956369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:38.956860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:38.957783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:38.958204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:38.958666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:38.959122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:38.964353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:39.021649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:39.030707 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87a2d5bb-aece-46df-aa80-70425e6fdba1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.168600 Oct 17 13:09:39.031579 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2028/3948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:38 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:39.110957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:39.114840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:39.115449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:39.120708 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a92b2971-cab5-4f5d-9983-e098e875b40e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.177412 Oct 17 13:09:39.122804 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1921/3949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:38 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:39.123044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:39.123469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:39.123964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:39.124678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:39.125130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:39.125585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:39.162421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:39.163108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:39.170389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:39.171191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:39.171635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:39.172523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:39.173078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:39.173687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:39.277943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:39.286593 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86747a1c-fd46-4225-93b1-84d4292bee99 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.175489 Oct 17 13:09:39.287164 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2029/3950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:39 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:39.328819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:39.336643 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-819a0a11-f8ed-451a-9c89-1d354e60a434 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.178805 Oct 17 13:09:39.337210 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1922/3951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:39 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:40.054680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:40.055219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:40.063202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:40.063694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:40.064130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:40.064823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:40.065278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:40.065705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:40.146326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:40.146959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:40.155408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:40.155737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:40.156370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:40.157081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:40.157550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:40.157972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:40.219318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:40.229118 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8d833447-c078-479b-be62-5d74e54b8a90 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.178517 Oct 17 13:09:40.229792 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2030/3952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:40 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:40.311081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:40.312031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:40.319619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:40.325787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:40.326556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:40.327144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:40.328014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:40.328780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:40.328879 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c1e9c8d7-5556-420d-83c8-1244ca0e6483 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.186279 Oct 17 13:09:40.329189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1923/3953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:40 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:40.330288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:40.361226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:40.361853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:40.368777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:40.369419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:40.370009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:40.370743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:40.371503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:40.371889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:40.480934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:40.489514 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-33bfae94-49af-4062-8141-4b82014cc058 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.182434 Oct 17 13:09:40.498077 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2031/3954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:40 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:40.514610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:40.525922 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-acb9854d-0b0d-4c69-a858-bebd378d1710 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.168398 Oct 17 13:09:40.527132 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1924/3955] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:40 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:41.252976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:41.253581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:41.260749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:41.261181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:41.261691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:41.262646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:41.263131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:41.263552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:41.357625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:41.359434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:41.368523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:41.369636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:41.370339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:41.373097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:41.373850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:41.374467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:41.415620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:41.425333 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-53c8b38e-1421-4614-b27c-59020b25690b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.176200 Oct 17 13:09:41.426203 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2032/3956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:41 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:41.521167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:41.521861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:41.528710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:41.529331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:41.529869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:41.530724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:41.531279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:41.531805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:41.547250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:41.555643 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b48fbd11-1994-4ac2-bddf-5bf2bfed3b1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.207595 Oct 17 13:09:41.556438 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1925/3957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:41 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:41.574694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:41.575471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:41.585079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:41.585814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:41.586277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:41.587246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:41.587848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:41.588426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:41.710780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:41.720816 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-09196aff-e181-4cc9-9334-cbde994dabe3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.203024 Oct 17 13:09:41.735163 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2033/3958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:41 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:41.753761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:41.763776 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f8a1117-7a9e-4038-9899-94cf62cd43d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.205524 Oct 17 13:09:41.775660 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1926/3959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:41 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:42.452711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:42.453425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:42.460344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:42.460839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:42.461281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:42.461979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:42.462458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:42.462886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:42.580688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:42.581315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:42.588600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:42.589182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:42.589638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:42.590425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:42.590888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:42.591323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:42.605316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:42.614376 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32e1ad02-20f2-4585-95ab-cc021adf70e2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.165661 Oct 17 13:09:42.626298 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2034/3960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:42 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:42.737007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:42.745184 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5ff868b1-1973-4510-8aa4-591bfc1f266d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.168439 Oct 17 13:09:42.748094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:42.748713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:42.754844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:42.755335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:42.755770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:42.756668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:42.757130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:42.757556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:42.759225 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1927/3961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:42 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:42.787666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:42.788395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:42.795356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:42.795850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:42.796355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:42.797262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:42.797721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:42.798228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:42.926491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:42.955579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13563d10-9e03-482d-aad4-c5f38f24c6aa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.211982 Oct 17 13:09:42.956920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2035/3962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:42 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:42.999552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:43.007374 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba410219-2401-4450-a474-10b7c4339330 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.223985 Oct 17 13:09:43.008161 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1928/3963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:42 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:43.639307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:43.640057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:43.647287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:43.648060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:43.648563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:43.649340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:43.649865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:43.650423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:43.771112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:43.771865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:43.778624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:43.779122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:43.779567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:43.780273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:43.780733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:43.781168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:43.844881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:43.853136 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-015304af-c390-47ee-ad88-a31cb94f6649 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.218559 Oct 17 13:09:43.853648 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2036/3964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:43 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:43.937117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:43.946705 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba3fe957-7687-4409-8450-bd6e15c59ef7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.179433 Oct 17 13:09:43.947398 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1929/3965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:43 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:43.984333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:43.984946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:43.987980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:43.991705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:43.992196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:43.992636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:43.993333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:43.993871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:43.994332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:44.044244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:44.045492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:44.052389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:44.053052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:44.053638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:44.054488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:44.055400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:44.056063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:44.151068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:44.156525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:44.162196 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-814769a6-2dd4-4162-8928-697f6968b580 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.182203 Oct 17 13:09:44.162781 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2037/3966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:43 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:44.205663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:44.213858 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-defb204a-aafe-499c-840d-4d74f1ffc967 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.186825 Oct 17 13:09:44.214597 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1930/3967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:44 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:44.878801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:44.879556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:44.886464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:44.887040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:44.887559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:44.888373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:44.888797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:44.889236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:44.972319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:44.972939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:44.980357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:44.980897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:44.981689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:44.982607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:44.983298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:44.983731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:45.131681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:45.140956 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aeb03133-3623-45a8-aef8-884ac100c6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.172565 Oct 17 13:09:45.143405 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1931/3968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:44 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:45.190424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:45.191494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:45.200796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:45.201883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:45.203114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:45.204499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:45.205133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:45.206006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:45.346243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:45.357738 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fa1d95f2-e490-4b92-a0c1-5b652aa9221c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.483217 Oct 17 13:09:45.358620 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2038/3969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:44 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:45.363427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:45.364211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:45.370346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:45.371406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:45.372008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:45.372901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:45.374277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:45.374943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:45.406804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:45.426198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6c87a8cd-0ea8-489b-9e4f-de47d3e2212b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1541 microversion: 2.1 time: 0.242909 Oct 17 13:09:45.427515 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1932/3970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:45 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1541 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:45.577471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:45.587539 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7be93e2-8b10-4f29-8407-dc8c1271db23 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.227458 Oct 17 13:09:45.588637 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2039/3971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:45 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:45.734270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:45.735360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:45.743898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:45.747749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:45.748408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:45.749346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:45.749986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:45.750629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.032608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:46.040887 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-64c9ef39-a471-4629-8352-4301e4bfcf9a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.310459 Oct 17 13:09:46.059181 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1933/3972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:45 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:46.067367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:46.069354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:46.079344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.080047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.080711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.081555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.082156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.082792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.165413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:46.167357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:46.175694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.176187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.176622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.177499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.177950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.178397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.360650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:46.389380 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f373f79e-44a4-4173-845f-420091956e42 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.327477 Oct 17 13:09:46.399892 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2040/3973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:46 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:46.413870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:46.414519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:46.416669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:46.422889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.423393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.423835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.424547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.425009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.425585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.438965 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-462b5818-62c9-4b14-88f5-8ada7bd620d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.277342 Oct 17 13:09:46.440423 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1934/3974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:46 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:46.446455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:46.447183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:46.453999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.454902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.455421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.456247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.456808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.457488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.611843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:46.623387 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35969614-9408-4d3e-a7b0-e11c37966a6c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.181449 Oct 17 13:09:46.626217 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1935/3975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:46 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:46.629394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:46.630186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:46.636588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.637749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.638427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.639276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.639932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.640343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.790952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:46.801124 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4df1bb1f-a832-4ef6-9179-4813c70a295b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1540 microversion: 2.1 time: 0.175494 Oct 17 13:09:46.802022 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1936/3976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:46 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1540 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:46.827609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:46.832649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:46.838676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:46.839398 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d46c8a8d-8075-4f77-afb0-6e000eb32859 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.437557 Oct 17 13:09:46.850195 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2041/3977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:46 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:46.850495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-176628200"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:46.854724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.855851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.856769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.857159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.857536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:46.858153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.860404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.869273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.869764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.870242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:46.872114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:46.872570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:46.872996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:47.111797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:47.115570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:47.123182 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c3f7b5c-4aa6-4c05-aede-e8a981966f69 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.307112 Oct 17 13:09:47.124038 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1937/3978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:46 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:47.129311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c9e11b3f-d44a-484e-9385-32829de15c37 req-2dbe8118-65ec-4a1d-8c5a-2ce8d294cbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "name": "network-vif-unplugged", "status": "completed", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:47.142615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c9e11b3f-d44a-484e-9385-32829de15c37 req-2dbe8118-65ec-4a1d-8c5a-2ce8d294cbd8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:47.143223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c9e11b3f-d44a-484e-9385-32829de15c37 req-2dbe8118-65ec-4a1d-8c5a-2ce8d294cbd8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:47.143754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c9e11b3f-d44a-484e-9385-32829de15c37 req-2dbe8118-65ec-4a1d-8c5a-2ce8d294cbd8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:47.157328 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c9e11b3f-d44a-484e-9385-32829de15c37 req-2dbe8118-65ec-4a1d-8c5a-2ce8d294cbd8 service nova] Creating event network-vif-unplugged:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h2-853316-12 Oct 17 13:09:47.167002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-c9e11b3f-d44a-484e-9385-32829de15c37 req-2dbe8118-65ec-4a1d-8c5a-2ce8d294cbd8 service nova] Instance 3878382b-8750-419c-a5d4-8519c3e0b73a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:09:47.174889 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a4177df3-aed5-4ca3-839e-2489aa17ac5d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.329101 Oct 17 13:09:47.176606 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2042/3979] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:09:46 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 13:09:47.189517 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c9e11b3f-d44a-484e-9385-32829de15c37 req-2dbe8118-65ec-4a1d-8c5a-2ce8d294cbd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063998 Oct 17 13:09:47.191731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1938/3980] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:47.469662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:47.471760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:47.478849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:47.479369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:47.479808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:47.482529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:47.483012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:47.483448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:47.691433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:47.701771 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a77ab3f-59c1-4bb0-b12c-463c7467512d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.238394 Oct 17 13:09:47.702812 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2043/3981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:47 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:47.832747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:47.833583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:47.842284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:47.842937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:47.843433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:47.844370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:47.844957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:47.845482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:47.875471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:47.875962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:47.889373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:47.890476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:47.891207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:47.892738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:47.894251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:47.895135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:48.019978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:48.033211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cbf941e7-d479-4a4b-b416-043e2130a1fc tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1540 microversion: 2.1 time: 0.205940 Oct 17 13:09:48.047346 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1939/3982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:47 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1540 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:48.126305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:48.137700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2757996-3390-438b-aa0a-ad34e909efb4 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.272212 Oct 17 13:09:48.138660 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2044/3983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:47 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:48.151036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:48.153860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:48.161786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:48.162375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:48.163262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:48.164055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:48.164698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:48.165132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:48.383859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:48.392590 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e58b7be1-399c-4998-84a0-4deecf7da3da tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.247294 Oct 17 13:09:48.393166 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1940/3984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:48 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:48.727492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:48.728031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:48.735493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:48.736280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:48.736897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:48.737807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:48.738452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:48.739052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:48.897626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:48.906443 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec7ea80e-1d49-4d0a-a271-856808bda874 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.183269 Oct 17 13:09:48.907030 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2045/3985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:48 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:49.060156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:49.060770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:49.067695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.068178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.068829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:49.069781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.070325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.070780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:49.164283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:49.164892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:49.172589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.173083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.173716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:49.174445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.175104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.175533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:49.283553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:49.295936 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-023342d0-ffe0-4aac-8dcb-9fe3fb09cb25 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1472 microversion: 2.1 time: 0.240871 Oct 17 13:09:49.298270 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1941/3986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:49 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:49.302999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-0640d862-5acf-432c-a636-b2ea6e32080c req-5ff35dff-7a8a-43e8-8241-809c8e452321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:49.332393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0640d862-5acf-432c-a636-b2ea6e32080c req-5ff35dff-7a8a-43e8-8241-809c8e452321 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.333163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0640d862-5acf-432c-a636-b2ea6e32080c req-5ff35dff-7a8a-43e8-8241-809c8e452321 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.333780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0640d862-5acf-432c-a636-b2ea6e32080c req-5ff35dff-7a8a-43e8-8241-809c8e452321 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:49.353076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:49.361347 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-0640d862-5acf-432c-a636-b2ea6e32080c req-5ff35dff-7a8a-43e8-8241-809c8e452321 service nova] Creating event network-changed:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h2-853316-12 Oct 17 13:09:49.368943 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-47e920be-72bc-43a7-8ccc-5e24721d0684 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.208374 Oct 17 13:09:49.369211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-0640d862-5acf-432c-a636-b2ea6e32080c req-5ff35dff-7a8a-43e8-8241-809c8e452321 service nova] Instance 3878382b-8750-419c-a5d4-8519c3e0b73a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:09:49.371795 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2046/3987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:49 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:49.394343 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-0640d862-5acf-432c-a636-b2ea6e32080c req-5ff35dff-7a8a-43e8-8241-809c8e452321 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093911 Oct 17 13:09:49.395335 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1942/3988] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:49.419497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:49.420134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:49.429026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.429970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.430814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:49.432123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.432775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.434137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:49.682983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:49.691391 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b40bbcc-3517-4b5c-8244-6cb53771382a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.277961 Oct 17 13:09:49.691962 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2047/3989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:49 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:49.931098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:49.932164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:49.939761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.940444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.940887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:49.941642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:49.942102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:49.942557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.285721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:50.299647 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-65a25de5-7243-4477-a35c-2c7f56dbdfe0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.372864 Oct 17 13:09:50.300609 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1943/3990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:49 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:50.319523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:50.320137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:50.327638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.328137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.328643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.329661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.330316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.331013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.401401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:50.402839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:50.411509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.412008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.412451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.413169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.413628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.414510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.571401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:50.580165 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2d8a129e-daf8-4140-9810-ca74e233c835 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1469 microversion: 2.1 time: 0.264953 Oct 17 13:09:50.595090 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2048/3991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:50 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:50.604627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:50.606298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:50.612808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.613583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.614301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.615496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.616181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.616816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.667158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.667727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.668857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.669589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.670043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.670564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.692457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:09:50.698031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for user bf508fbbaee740548bd6509b3d279b57 and project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:09:50.756978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:50.767943 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1529ab51-e12b-4240-8521-f8653935001d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.375361 Oct 17 13:09:50.770483 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1944/3992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:50 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:50.776165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:50.776811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:50.784821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:50.787328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.788236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.789129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.790779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.791614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.792273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.854359 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce7f93e9-4a86-443d-ba31-5669b14e0716 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a/action" status: 202 len: 0 microversion: 2.1 time: 0.253551 Oct 17 13:09:50.855933 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2049/3993] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:09:50 2022] POST /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:09:50.864318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:50.867789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:50.878351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.879031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.879892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.880764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:50.881333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:50.881870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:50.888713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:51.102081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:51.112810 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-807ebd79-2e09-412a-be93-ea8dc2ad3658 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.340758 Oct 17 13:09:51.113919 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1945/3994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:50 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:51.209825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:51.222953 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf2e8d3b-1af1-4e9c-b381-b51b4d36e03d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1468 microversion: 2.1 time: 0.359681 Oct 17 13:09:51.238204 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2050/3995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:50 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:51.331134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:51.333528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:51.346997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:51.347897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:51.348508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:51.349525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:51.350149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:51.351316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:51.599437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:51.610803 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b568c91a-ef06-4076-bb3f-bb954ca6cdd7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.287523 Oct 17 13:09:51.611632 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1946/3996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:51 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:51.795663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:51.797152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:51.805035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:51.806037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:51.807017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:51.807962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:51.809488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:51.810554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:51.976192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:51.985054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6be31b4f-7fbb-49a5-bf18-6cd0e4115305 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.193337 Oct 17 13:09:51.985886 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2051/3997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:51 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:52.139480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:52.140465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:52.148088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:52.148845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:52.149489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:52.150546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:52.153908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:52.153908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:52.248659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:52.249669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:52.257526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:52.258416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:52.259038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:52.259742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:52.260353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:52.261069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:52.384938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:52.408401 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0737218-ecf0-4399-a705-1f055df28300 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.265966 Oct 17 13:09:52.408401 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1947/3998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:52 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:52.446046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:52.454692 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6387f880-c153-4296-94bf-e9fb32d1bce8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1468 microversion: 2.1 time: 0.210529 Oct 17 13:09:52.455804 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2052/3999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:52 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:52.639599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:52.640514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:52.650807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:52.651711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:52.654425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:52.656349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:52.656349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:52.656637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:52.900214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:52.908977 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-341c1878-35af-47e4-81bd-04c9da2d18cf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.274740 Oct 17 13:09:52.909544 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1948/4000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:52 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:53.008644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:53.009795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:53.018039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.018780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.019411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:53.020453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.021059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.021637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:53.237363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:53.247330 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-26ca95c8-cf5b-472f-8db9-82ca422359d9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.241445 Oct 17 13:09:53.247905 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2053/4001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:53 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:53.425723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:53.426315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:53.439791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.440284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.440720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:53.441430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.441872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.442328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:53.482840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:53.484360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:53.507960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.508473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.508939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:53.512365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.512991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.528924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:53.688497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:53.700228 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70be9b0e-2470-49bc-97f6-75e6d1a95a13 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.279004 Oct 17 13:09:53.701545 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1949/4002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:53 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:53.706879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-ca691d6b-db54-4e56-abf0-81c0ebbc1769 req-3b8c1ca8-607b-4ab5-8de4-ae2ba2b67bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "name": "network-vif-plugged", "status": "completed", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:53.717632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ca691d6b-db54-4e56-abf0-81c0ebbc1769 req-3b8c1ca8-607b-4ab5-8de4-ae2ba2b67bfd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.718121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ca691d6b-db54-4e56-abf0-81c0ebbc1769 req-3b8c1ca8-607b-4ab5-8de4-ae2ba2b67bfd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.718586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ca691d6b-db54-4e56-abf0-81c0ebbc1769 req-3b8c1ca8-607b-4ab5-8de4-ae2ba2b67bfd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:53.731849 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-ca691d6b-db54-4e56-abf0-81c0ebbc1769 req-3b8c1ca8-607b-4ab5-8de4-ae2ba2b67bfd service nova] Creating event network-vif-plugged:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h2-853316-12 Oct 17 13:09:53.737781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-ca691d6b-db54-4e56-abf0-81c0ebbc1769 req-3b8c1ca8-607b-4ab5-8de4-ae2ba2b67bfd service nova] Instance 3878382b-8750-419c-a5d4-8519c3e0b73a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:09:53.750801 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-ca691d6b-db54-4e56-abf0-81c0ebbc1769 req-3b8c1ca8-607b-4ab5-8de4-ae2ba2b67bfd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047533 Oct 17 13:09:53.752579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:53.754153 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1950/4003] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:53.762758 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce1144a0-3625-4acb-b49e-4ce4b53172da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1468 microversion: 2.1 time: 0.287220 Oct 17 13:09:53.774198 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2054/4004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:53 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1468 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:53.934435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:53.935369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:53.941565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.942046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.942537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:53.943231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:53.943679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:53.944354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:54.098362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:54.120516 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9161e78d-3e08-4d76-b36c-bf6001ff07c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.191298 Oct 17 13:09:54.122414 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1951/4005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:53 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:54.270296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:54.270975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:54.278664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:54.279155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:54.279600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:54.280310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:54.280766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:54.281273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:54.434552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:54.443545 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a8a3a04-2810-4c69-83d8-454299b5f508 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.177403 Oct 17 13:09:54.444555 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2055/4006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:54 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:54.725930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:54.726570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:54.734842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:54.735542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:54.736164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:54.737033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:54.737641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:54.738231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:54.787477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:54.788017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:54.794773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:54.795415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:54.797205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:54.797934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:54.798404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:54.798856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:54.972992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:54.981501 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1639a338-23dc-476c-b9d4-08d4e9358eef tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1534 microversion: 2.1 time: 0.198723 Oct 17 13:09:54.994620 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2056/4007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:54 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1534 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:55.148792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:55.149709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:55.157038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:55.157611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:55.158631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:55.159168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:55.159535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:55.160935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:55.307209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:55.322014 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1e35099-23ff-4dc9-aba3-6a00b90af20c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.600482 Oct 17 13:09:55.337042 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1952/4008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:54 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:55.341727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:55.352507 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aecaca1f-d782-43d5-a882-4a7cc124fbe1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.207818 Oct 17 13:09:55.365710 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2057/4009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:55 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:55.430536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3f0fb11f-ab6d-45e1-8546-2680b60832c0 req-5b4300f6-3ae4-4718-a2b0-bfc91cc61f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "name": "network-vif-unplugged", "status": "completed", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:55.442632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3f0fb11f-ab6d-45e1-8546-2680b60832c0 req-5b4300f6-3ae4-4718-a2b0-bfc91cc61f97 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:55.443121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3f0fb11f-ab6d-45e1-8546-2680b60832c0 req-5b4300f6-3ae4-4718-a2b0-bfc91cc61f97 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:55.443607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3f0fb11f-ab6d-45e1-8546-2680b60832c0 req-5b4300f6-3ae4-4718-a2b0-bfc91cc61f97 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:55.458793 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3f0fb11f-ab6d-45e1-8546-2680b60832c0 req-5b4300f6-3ae4-4718-a2b0-bfc91cc61f97 service nova] Creating event network-vif-unplugged:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h1-853316-12 Oct 17 13:09:55.467301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-3f0fb11f-ab6d-45e1-8546-2680b60832c0 req-5b4300f6-3ae4-4718-a2b0-bfc91cc61f97 service nova] Instance 3878382b-8750-419c-a5d4-8519c3e0b73a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:09:55.472375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:55.473001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:55.480355 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3f0fb11f-ab6d-45e1-8546-2680b60832c0 req-5b4300f6-3ae4-4718-a2b0-bfc91cc61f97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054142 Oct 17 13:09:55.481440 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1953/4010] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:55.482798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:55.483299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:55.483743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:55.484455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:55.484916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:55.485344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:55.684868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:55.695464 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e39f280-bb45-4460-b4ed-58336d62c297 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.225904 Oct 17 13:09:55.695464 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2058/4011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:55 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:55.768365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-09dfdb2e-b351-45d7-b666-375ee0366148 req-65ed2421-2d7d-4886-8ef8-ed7577136d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "name": "network-vif-plugged", "status": "completed", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:55.779952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-09dfdb2e-b351-45d7-b666-375ee0366148 req-65ed2421-2d7d-4886-8ef8-ed7577136d02 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:55.780751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-09dfdb2e-b351-45d7-b666-375ee0366148 req-65ed2421-2d7d-4886-8ef8-ed7577136d02 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:55.781344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-09dfdb2e-b351-45d7-b666-375ee0366148 req-65ed2421-2d7d-4886-8ef8-ed7577136d02 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:55.796711 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-09dfdb2e-b351-45d7-b666-375ee0366148 req-65ed2421-2d7d-4886-8ef8-ed7577136d02 service nova] Creating event network-vif-plugged:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:09:55.802216 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-09dfdb2e-b351-45d7-b666-375ee0366148 req-65ed2421-2d7d-4886-8ef8-ed7577136d02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038670 Oct 17 13:09:55.803188 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1954/4012] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:56.008186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:56.008809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:56.015352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:56.015959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:56.016417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:56.017252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:56.018010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:56.018518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:56.173157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:56.184844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-99f426a6-16d8-4d47-9a42-8c6da1c8791d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1534 microversion: 2.1 time: 0.181651 Oct 17 13:09:56.185847 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2059/4013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:56 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1534 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:56.347810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:56.348790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:56.355273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:56.356495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:56.357160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:56.357987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:56.358684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:56.359319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:56.380468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:56.381059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:56.404523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:56.405303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:56.405903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:56.408412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:56.408871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:56.412381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:56.563480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:56.576275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:56.576988 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-caeff453-f34d-499b-bcd7-6e03d28f26a3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.233429 Oct 17 13:09:56.577567 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1955/4014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:56 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:56.584858 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d5c59e10-b751-49e7-8f5a-1e04c0345929 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.208046 Oct 17 13:09:56.594066 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2060/4015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:56 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:56.719459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:56.720335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:56.727828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:56.728547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:56.729199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:56.730047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:56.731411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:56.731411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:56.751185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:09:56.883071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:56.891805 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d676aca4-14a4-4f09-8a9c-06089d24655c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.176539 Oct 17 13:09:56.892459 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1956/4016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:56 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:57.208284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:57.208924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:57.214970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.215454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.215893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:57.216586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.217040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.217465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:57.351426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:57.360532 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc21c5b9-1ca4-4ca4-84ea-cb91c73d3fe4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1534 microversion: 2.1 time: 0.156185 Oct 17 13:09:57.361310 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2061/4017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:57 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1534 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:57.511110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c09f1c39-3951-45a4-9b71-31f30458abeb req-c77e610b-25d6-4969-ab67-5326022a5309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:09:57.521217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c09f1c39-3951-45a4-9b71-31f30458abeb req-c77e610b-25d6-4969-ab67-5326022a5309 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.521702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c09f1c39-3951-45a4-9b71-31f30458abeb req-c77e610b-25d6-4969-ab67-5326022a5309 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.522433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c09f1c39-3951-45a4-9b71-31f30458abeb req-c77e610b-25d6-4969-ab67-5326022a5309 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:57.534805 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c09f1c39-3951-45a4-9b71-31f30458abeb req-c77e610b-25d6-4969-ab67-5326022a5309 service nova] Creating event network-changed:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h1-853316-12 Oct 17 13:09:57.541166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-c09f1c39-3951-45a4-9b71-31f30458abeb req-c77e610b-25d6-4969-ab67-5326022a5309 service nova] Instance 3878382b-8750-419c-a5d4-8519c3e0b73a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:09:57.552528 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c09f1c39-3951-45a4-9b71-31f30458abeb req-c77e610b-25d6-4969-ab67-5326022a5309 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045068 Oct 17 13:09:57.553141 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1957/4018] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:09:57.602117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:57.604219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:57.611469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:57.615674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:57.627886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.630843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.631433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.631947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.632398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:57.633127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.633581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.634011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:57.639797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:57.640908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.641575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.642233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:57.830934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:57.839249 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7d65797e-d3fc-45ae-9199-55fcfc11bdeb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1698 microversion: 2.1 time: 0.233966 Oct 17 13:09:57.840857 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1958/4019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:57 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1698 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:57.898394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:57.907536 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1e1b8cc-8ff8-4874-9f28-1af37b64e578 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.310184 Oct 17 13:09:57.908414 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2062/4020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:57 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:57.919889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:57.921103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:57.927653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.928143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.928586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:57.929351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:57.929814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:57.930268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:58.075788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:58.084348 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ab81b76-60c9-46b6-b7dc-87c680105ce1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.169320 Oct 17 13:09:58.085555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1959/4021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:57 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:58.384878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:58.385493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:58.391732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:58.392226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:58.392664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:58.393361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:58.393819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:58.394276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:58.533693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:58.541484 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7dd8a902-7ad6-436c-a8da-c9cfbaed3814 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1534 microversion: 2.1 time: 0.160535 Oct 17 13:09:58.542088 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2063/4022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:58 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1534 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:58.863113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:58.863725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:58.870844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:58.871454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:58.871904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:58.872612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:58.873069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:58.873515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:58.930935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:58.931566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:58.939572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:58.940073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:58.940515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:58.941872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:58.942376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:58.942814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:59.017128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:59.026223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-85f6cef5-f002-47f2-ad23-73cc075fa1a4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1697 microversion: 2.1 time: 0.166857 Oct 17 13:09:59.026797 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1960/4023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:58 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:09:59.094775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:59.103033 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d11b832-5b85-482a-9832-a780f445c179 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.175981 Oct 17 13:09:59.104081 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2064/4024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:58 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:59.108098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:59.108719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:59.114827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:59.115243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:59.115679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:59.116368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:59.116820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:59.117248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:59.250332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:59.258336 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-253aa902-1c03-4f23-8c73-bb47591df57c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.154738 Oct 17 13:09:59.258916 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1961/4025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:59 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:09:59.564865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:09:59.565501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:09:59.571961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:59.572452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:59.572891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:59.573588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:09:59.574681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:09:59.575066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:09:59.709983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:09:59.718904 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2526b1ce-12ab-4c07-a509-aa8f30b2cb45 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1534 microversion: 2.1 time: 0.157929 Oct 17 13:09:59.719471 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2065/4026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:09:59 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1534 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:00.050843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:00.051480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:00.058104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:00.059114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:00.059559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:00.060283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:00.060753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:00.061253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:00.128252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:00.128975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:00.137476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:00.138066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:00.138607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:00.139406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:00.139941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:00.140580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:00.293367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:00.296976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:00.302777 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2ca71cb-8248-44db-84fc-793dd72da74d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.178609 Oct 17 13:10:00.303367 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2066/4027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:00 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:00.308440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:00.309141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:00.315317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:00.316119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:00.316795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:00.317714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:00.318418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:00.318914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:00.391750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:00.403034 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ba53e7c-e2be-40e1-ada8-fb3855b84965 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1697 microversion: 2.1 time: 0.356170 Oct 17 13:10:00.419272 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1962/4028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:00 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1697 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:00.520887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:00.524138 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b88b2ff-476a-437f-ad62-d171987a6e8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.219368 Oct 17 13:10:00.525316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2067/4029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:00 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:00.742089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:00.742832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:00.757607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:00.758482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:00.758944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:00.759681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:00.760136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:00.760726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:00.977956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:00.991935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-178158e3-786d-475a-bb77-80510801769f req-14377944-e9bb-4645-8058-54fdb329d29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586fd663-8db0-4d14-bf90-b3871f6374b5", "name": "network-vif-unplugged", "status": "completed", "tag": "3d6515c3-5c35-4518-9d9e-63d08da1216b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:00.999082 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-63d0b93b-630e-4141-858a-a35b302df7e2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1527 microversion: 2.1 time: 0.260822 Oct 17 13:10:00.999671 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1963/4030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:00 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1527 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:01.016643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:01.025407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:01.026025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:01.028752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-178158e3-786d-475a-bb77-80510801769f req-14377944-e9bb-4645-8058-54fdb329d29a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.031938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-178158e3-786d-475a-bb77-80510801769f req-14377944-e9bb-4645-8058-54fdb329d29a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.032376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-178158e3-786d-475a-bb77-80510801769f req-14377944-e9bb-4645-8058-54fdb329d29a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.038348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.038846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.039290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.040004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.040460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.040890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.056951 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-178158e3-786d-475a-bb77-80510801769f req-14377944-e9bb-4645-8058-54fdb329d29a service nova] Creating event network-vif-unplugged:3d6515c3-5c35-4518-9d9e-63d08da1216b for instance 586fd663-8db0-4d14-bf90-b3871f6374b5 on n-h1-853316-12 Oct 17 13:10:01.062694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-178158e3-786d-475a-bb77-80510801769f req-14377944-e9bb-4645-8058-54fdb329d29a service nova] Instance 586fd663-8db0-4d14-bf90-b3871f6374b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:10:01.075186 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-178158e3-786d-475a-bb77-80510801769f req-14377944-e9bb-4645-8058-54fdb329d29a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086340 Oct 17 13:10:01.076176 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2068/4031] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:10:01.327434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:01.329034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:01.341766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:01.343169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.343691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.344140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.344853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.346933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.347379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.356064 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5410a926-4c2a-43ff-9759-dae147bf6146 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1527 microversion: 2.1 time: 0.334173 Oct 17 13:10:01.357188 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1964/4032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:01 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1527 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:01.387409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abf74317-8418-4bb6-bb25-5af0f1918e89 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:01.397118 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-abf74317-8418-4bb6-bb25-5af0f1918e89 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] HTTP exception thrown: Flavor 9f07ca7e-cebd-4d4b-9898-67c2147f4610 could not be found. Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abf74317-8418-4bb6-bb25-5af0f1918e89 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Request method failure captured: Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/flavors/9f07ca7e-cebd-4d4b-9898-67c2147f4610 HTTP/1.1 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVNZjECGzN_5suTs4ux0jHtK-Eo8AAOwy9CYFy-lnSATD7dfBxq8NWP0tlOg1KlyR-FWsY5Kem1NsDSQXJuRQmcWqq-FOS7G9J1SxPilA7QqMnCJ8zXW85Dp02U_C7cYFIfit-fpCOvzgf4fWHu7ivIa305BM4VjzkVTOi-8BIfLW-w Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 5dc3a31ede2646df90496d5ecf55b835 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-MigrationsAdminTest-2124484477 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5dc3a31ede2646df90496d5ecf55b835", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dc3a31ede2646df90496d5ecf55b835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5dc3a31ede2646df90496d5ecf55b835"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5dc3a31ede2646df90496d5ecf55b835"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-MigrationsAdminTest-2124484477 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 5dc3a31ede2646df90496d5ecf55b835 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-MigrationsAdminTest-2124484477 Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-MigrationsAdminTest-2124484477-project-admin Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1706bfe90cd844d185fa7dab5710aeac Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-MigrationsAdminTest-2124484477-project-admin Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: exception: Flavor 9f07ca7e-cebd-4d4b-9898-67c2147f4610 could not be found. Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '9f07ca7e-cebd-4d4b-9898-67c2147f4610'} Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9f07ca7e-cebd-4d4b-9898-67c2147f4610 could not be found. Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9f07ca7e-cebd-4d4b-9898-67c2147f4610 could not be found. Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:01.410283 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9f07ca7e-cebd-4d4b-9898-67c2147f4610 could not be found. Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abf74317-8418-4bb6-bb25-5af0f1918e89 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Returning 404 to user: Flavor 9f07ca7e-cebd-4d4b-9898-67c2147f4610 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-abf74317-8418-4bb6-bb25-5af0f1918e89 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/9f07ca7e-cebd-4d4b-9898-67c2147f4610" status: 404 len: 109 microversion: 2.1 time: 0.030815 Oct 17 13:10:01.419068 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1965/4033] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:10:01 2022] DELETE /compute/v2.1/flavors/9f07ca7e-cebd-4d4b-9898-67c2147f4610 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:10:01.431610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:01.432309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:01.447112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.447613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.448059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.449110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.462948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.463407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.583518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:01.594698 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-33dd2b95-781b-4edc-976f-93091878cff3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.272931 Oct 17 13:10:01.595919 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2069/4034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:01 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:01.602554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:01.603472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:01.612888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.613829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.614451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.615244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:01.615879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:01.616504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:01.776221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:01.792730 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f27d6f22-6648-4630-81d9-5a03d22c819a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1697 microversion: 2.1 time: 0.366638 Oct 17 13:10:01.794340 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1966/4035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:01 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1697 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:01.799805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1649483285", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:01.841006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:01.849929 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60372b77-6557-4c51-8e0b-049a84b0dd81 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.252727 Oct 17 13:10:01.850529 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2070/4036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:01 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:01.861481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:10:02.084045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:10:02.084465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:10:02.084937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:10:02.085346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:10:02.085750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:10:02.096738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:02.097519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:02.098035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:02.098882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:02.099420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:02.099950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:02.117773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:10:02.123110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Getting quotas for user bf508fbbaee740548bd6509b3d279b57 and project 1b0cf99333e64c0dad09b7ae5c695743. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:10:02.135191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:10:02.138366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:10:02.189223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e12ab94-9c54-42f5-9338-08326e4f5e78 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.392279 Oct 17 13:10:02.190878 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1967/4037] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:10:02.202957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f1c38b0-32a0-4b32-b214-12b95fe793eb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:02.203573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f1c38b0-32a0-4b32-b214-12b95fe793eb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:02.263169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f1c38b0-32a0-4b32-b214-12b95fe793eb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:02.269991 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f1c38b0-32a0-4b32-b214-12b95fe793eb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1213 microversion: 2.1 time: 0.071530 Oct 17 13:10:02.270605 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2071/4038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:02 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:02.623703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:02.624529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:02.640345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:02.640847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:02.642897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:02.643670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:02.644153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:02.645632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:02.816968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:02.818321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:02.827165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:02.827769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:02.828330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:02.829358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:02.829905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:02.830611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:02.961559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:02.969914 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4a3467c-ab04-4373-966c-d863feb259d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 0.352847 Oct 17 13:10:02.971411 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1968/4039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:02 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:02.976621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:02.977442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:02.988114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:02.999286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:02.999902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:03.000692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:03.001168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:03.010481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:03.084143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:03.109493 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cda3e381-4123-47a2-9624-1d07bf5249b9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1697 microversion: 2.1 time: 0.295935 Oct 17 13:10:03.112234 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2072/4040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:02 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1697 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:03.123336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7e0defff-6a0c-411e-8957-521a34c52a18 req-0b2c87f0-3e43-4060-854d-4dc190478c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586fd663-8db0-4d14-bf90-b3871f6374b5", "tag": "3d6515c3-5c35-4518-9d9e-63d08da1216b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:03.134804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7e0defff-6a0c-411e-8957-521a34c52a18 req-0b2c87f0-3e43-4060-854d-4dc190478c93 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:03.135782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7e0defff-6a0c-411e-8957-521a34c52a18 req-0b2c87f0-3e43-4060-854d-4dc190478c93 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:03.136784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7e0defff-6a0c-411e-8957-521a34c52a18 req-0b2c87f0-3e43-4060-854d-4dc190478c93 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:03.171822 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7e0defff-6a0c-411e-8957-521a34c52a18 req-0b2c87f0-3e43-4060-854d-4dc190478c93 service nova] Creating event network-changed:3d6515c3-5c35-4518-9d9e-63d08da1216b for instance 586fd663-8db0-4d14-bf90-b3871f6374b5 on n-h1-853316-12 Oct 17 13:10:03.192605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-7e0defff-6a0c-411e-8957-521a34c52a18 req-0b2c87f0-3e43-4060-854d-4dc190478c93 service nova] Instance 586fd663-8db0-4d14-bf90-b3871f6374b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:10:03.221046 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7e0defff-6a0c-411e-8957-521a34c52a18 req-0b2c87f0-3e43-4060-854d-4dc190478c93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107170 Oct 17 13:10:03.223824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2073/4041] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:03.313628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:03.325548 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b15582fd-013b-4e0e-8da5-bc6b1bebe09a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1522 microversion: 2.1 time: 0.352844 Oct 17 13:10:03.326151 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1969/4042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:02 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:03.348352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:03.348971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:03.360609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:03.361106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:03.361545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:03.363244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:03.368150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:03.370514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:03.509244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:03.518525 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c81a08a-f3cc-4c01-81de-99325d91419f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1265 microversion: 2.1 time: 0.191240 Oct 17 13:10:03.519120 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1970/4043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:03 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:03.603739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c46ce63a-6b68-4ffe-9bcd-2634dc40b785 req-03a5f99c-ea51-4f8f-8358-c0f1a61e9311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "name": "network-vif-plugged", "status": "completed", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:03.620143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c46ce63a-6b68-4ffe-9bcd-2634dc40b785 req-03a5f99c-ea51-4f8f-8358-c0f1a61e9311 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:03.623206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c46ce63a-6b68-4ffe-9bcd-2634dc40b785 req-03a5f99c-ea51-4f8f-8358-c0f1a61e9311 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:03.624250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c46ce63a-6b68-4ffe-9bcd-2634dc40b785 req-03a5f99c-ea51-4f8f-8358-c0f1a61e9311 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:03.638353 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c46ce63a-6b68-4ffe-9bcd-2634dc40b785 req-03a5f99c-ea51-4f8f-8358-c0f1a61e9311 service nova] Creating event network-vif-plugged:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h1-853316-12 Oct 17 13:10:03.654945 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c46ce63a-6b68-4ffe-9bcd-2634dc40b785 req-03a5f99c-ea51-4f8f-8358-c0f1a61e9311 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374793 Oct 17 13:10:03.655560 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2074/4044] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:10:03.996408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:03.998028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:04.013587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:04.021118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:04.021649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:04.025639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:04.026282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:04.026825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:04.146090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:04.147904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:04.163970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:04.170464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:04.173814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:04.174865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:04.175589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:04.176267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:04.597867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:04.612365 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-73e5fbf5-32d6-4b6c-b72a-b595440d2e1d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1697 microversion: 2.1 time: 0.467849 Oct 17 13:10:04.613917 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2075/4045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:04 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1697 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:04.623816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:04.624509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:04.639112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:04.639715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:04.640264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:04.642842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:04.643430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:04.644370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:04.903381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:04.912593 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e0e04df-58bb-4d63-a12d-a2ec0e65b976 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1502 microversion: 2.1 time: 0.297323 Oct 17 13:10:04.913962 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2076/4046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:04 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:04.919623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:04.920456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:04.927608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:04.928275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:04.929205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:04.930065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:04.930721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:04.931299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.037011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:05.064932 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68df91fa-6008-437d-a334-f3ec04c780ca tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1271 microversion: 2.1 time: 0.149579 Oct 17 13:10:05.065999 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2077/4047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:04 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:05.076407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:05.077012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:05.092249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:05.092249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:05.092249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.092249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:05.092249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:05.092812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.099771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:05.115286 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b23e5110-6cae-411b-ab5d-952803c51fb2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1515 microversion: 2.1 time: 1.123741 Oct 17 13:10:05.118117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1971/4048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:03 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1515 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:05.326801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:05.337435 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0f02d522-44fa-4556-9e4e-36ebb8425564 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1516 microversion: 2.1 time: 0.270532 Oct 17 13:10:05.338014 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2078/4049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:05 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:05.364654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5972a75d-381b-43b2-991e-2e9151421130 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:05.367822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5972a75d-381b-43b2-991e-2e9151421130 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:05.378144 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-5972a75d-381b-43b2-991e-2e9151421130 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Instance 25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4 could not be found. Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5972a75d-381b-43b2-991e-2e9151421130 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4/action HTTP/1.1 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 14 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: {"rescue": {}} Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4 could not be found. Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4', 'body': {'rescue': {}}} Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4 could not be found. Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4 could not be found. Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:05.382002 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4 could not be found. Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5972a75d-381b-43b2-991e-2e9151421130 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 404 to user: Instance 25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5972a75d-381b-43b2-991e-2e9151421130 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4/action" status: 404 len: 111 microversion: 2.1 time: 0.022996 Oct 17 13:10:05.393488 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1972/4050] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:05 2022] POST /compute/v2.1/servers/25ac2cfd-d326-47f9-b082-a2ee3fc1f2d4/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:10:05.396222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:05.396749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:05.404670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:05.406267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:05.406761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:05.407203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.407914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:05.408430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:05.408856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.494485 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d9aa5ab4-a08d-4233-87ad-8d6c89e1b66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action" status: 202 len: 0 microversion: 2.1 time: 0.102948 Oct 17 13:10:05.495396 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2079/4051] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:05 2022] POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:10:05.505518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:05.506925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:05.515977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:05.516734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:05.517431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.518587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:05.519261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:05.519907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.640981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:05.642223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:05.654590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:05.655155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:05.655531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.665298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:05.666472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:05.669179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:05.867109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:05.888389 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-91b9b2a3-f927-4c14-b5b8-b1d4c8f4a59f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1521 microversion: 2.1 time: 0.386288 Oct 17 13:10:05.889842 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1973/4052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:05 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:06.092969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:06.100840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:06.102574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:06.107578 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0362fe31-dbe2-40cb-bfef-511dc2536817 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1695 microversion: 2.1 time: 0.472388 Oct 17 13:10:06.110566 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2080/4053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:05 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1695 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:06.133810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:06.140154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:06.142689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:06.143076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:06.143538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:06.144283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:06.145915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:06.146665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:06.154778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:06.155668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:06.158306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:06.159284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:06.159964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:06.165662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:06.273113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:06.282673 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c91d9e2e-2cf0-474f-8ec8-8037157564cd tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1271 microversion: 2.1 time: 0.189773 Oct 17 13:10:06.304926 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1974/4054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:06 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:06.428696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:06.443020 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9bb8237-69c3-4a26-8b69-2aa1d4419432 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1521 microversion: 2.1 time: 0.304950 Oct 17 13:10:06.443970 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2081/4055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:06 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:06.916733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:06.917869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:06.927984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:06.930662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:06.931161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:06.931823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:06.932283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:06.932770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.133493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:07.134254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:07.154860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.157091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.157622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.161672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.166041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.166815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.271193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:07.284673 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8f30661b-bd35-4f46-a93c-1e4e5195464d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1501 microversion: 2.1 time: 0.371434 Oct 17 13:10:07.285942 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1975/4056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:06 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1501 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:07.309553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:07.312232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:07.329312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.330081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.330838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.333504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.334780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.335425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.340357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:07.380750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lazy-loading 'flavor' on Instance uuid b27ca706-6340-4995-a586-b1ee6276bece {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:10:07.414358 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Cannot 'rescue' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state paused Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action HTTP/1.1 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 14 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: {"rescue": {}} Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'rescue' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state paused Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'b27ca706-6340-4995-a586-b1ee6276bece', 'body': {'rescue': {}}} Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b27ca706-6340-4995-a586-b1ee6276bece in vm_state paused. Cannot rescue while the instance is in this state. Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state paused Oct 17 13:10:07.418125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state paused Oct 17 13:10:07.427382 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:10:07.431984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 409 to user: Cannot 'rescue' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state paused {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:10:07.434248 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7b1a3c3-4cb3-472d-8b90-77e25750d34a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action" status: 409 len: 144 microversion: 2.1 time: 0.128471 Oct 17 13:10:07.436004 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1976/4057] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:07 2022] POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action => generated 144 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:10:07.446555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:07.448157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:07.466627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.467124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.467564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.468266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.468713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.469135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.500287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:07.508693 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3f60b1e-2e9a-4b7a-93d9-ae44814108a3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1695 microversion: 2.1 time: 0.379540 Oct 17 13:10:07.509282 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2082/4058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:07 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1695 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:07.521584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:07.522009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:07.554649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.556776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.564596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.566831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.567306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.568937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.662606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:07.706403 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1bba3589-3b05-4533-a808-58f6aa29d6d1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action" status: 202 len: 0 microversion: 2.1 time: 0.195392 Oct 17 13:10:07.707517 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2083/4059] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:07 2022] POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:10:07.733072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:07.734334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:07.761248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.762592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.767689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:07.769281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:07.770423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:07.774020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:08.142329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:08.160126 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6a891c58-357d-454e-a020-70dad58c95eb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1521 microversion: 2.1 time: 0.436000 Oct 17 13:10:08.161798 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2084/4060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:07 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:08.179261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:08.186249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:08.187256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:08.207724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb6d72f2-435d-4c17-8d59-d7699b21b327 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 0.769811 Oct 17 13:10:08.228702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:08.228702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:08.228702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:08.233646 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1977/4061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:07 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:08.235426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:08.241384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:08.242829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:08.533283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:08.534138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:08.546149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:08.546680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:08.547118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:08.553986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:08.563227 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0aeadcac-b620-4ecf-982e-609d52e2764c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1516 microversion: 2.1 time: 0.398909 Oct 17 13:10:08.563811 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2085/4062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:08 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1516 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:08.564712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:08.565198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:08.566078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:09.188579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:09.189706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:09.203145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:09.203916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:09.205794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:09.208299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:09.208917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:09.209481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:09.335547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:09.349448 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-265fe3b2-a8ae-4b5c-8521-e15b23ad8c8d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1692 microversion: 2.1 time: 0.819870 Oct 17 13:10:09.363307 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1978/4063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:08 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1692 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:09.388714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:09.390882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:09.416159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:09.417096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:09.419221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:09.420488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:09.421186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:09.422305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:09.516711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:09.526344 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e77e49e7-76d8-4cc3-980b-9714ed6d7039 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1521 microversion: 2.1 time: 0.342741 Oct 17 13:10:09.532510 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2086/4064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:09 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:09.541875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:09.543308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:09.558079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:09.561229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:09.562588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:09.565562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:09.566362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:09.572761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:09.691491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e7efb660-1abb-441d-874a-e6076ba730d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action" status: 204 len: 0 microversion: 2.1 time: 0.157539 Oct 17 13:10:09.695705 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2087/4065] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:09 2022] POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:10:09.710647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:09.720593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:09.739828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:09.740739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:09.742743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:09.746534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:09.748576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:09.749267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:10.236008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:10.252391 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-adeb56e5-a429-4ba3-bcb5-4603621c78ac tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1692 microversion: 2.1 time: 0.554552 Oct 17 13:10:10.254842 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2088/4066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:09 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1692 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:10.406207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:10.414806 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-187b6341-6cf0-494a-8851-75a5dd7c68ad tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 1.048834 Oct 17 13:10:10.415999 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1979/4067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:09 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:10.421479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-eaf8c89c-bd0d-4fac-8b9c-b6d3969f5434 req-4516b802-d612-40a4-a656-354539a762d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad23758-40e8-46a3-9c04-2f14d26d6226", "name": "network-vif-unplugged", "status": "completed", "tag": "dea17f7e-76dc-466a-b6f0-ecb7a0515eb5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:10.429968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f7f451ed-fb55-4843-814f-6526385d99ae req-28401cd0-c589-4f5e-bf30-e2c19664c07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:10.432044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eaf8c89c-bd0d-4fac-8b9c-b6d3969f5434 req-4516b802-d612-40a4-a656-354539a762d3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:10.432686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eaf8c89c-bd0d-4fac-8b9c-b6d3969f5434 req-4516b802-d612-40a4-a656-354539a762d3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:10.433865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-eaf8c89c-bd0d-4fac-8b9c-b6d3969f5434 req-4516b802-d612-40a4-a656-354539a762d3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:10.447827 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-eaf8c89c-bd0d-4fac-8b9c-b6d3969f5434 req-4516b802-d612-40a4-a656-354539a762d3 service nova] Creating event network-vif-unplugged:dea17f7e-76dc-466a-b6f0-ecb7a0515eb5 for instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 on n-h2-853316-12 Oct 17 13:10:10.454570 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-eaf8c89c-bd0d-4fac-8b9c-b6d3969f5434 req-4516b802-d612-40a4-a656-354539a762d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036855 Oct 17 13:10:10.455740 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1980/4068] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:10.465793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7f451ed-fb55-4843-814f-6526385d99ae req-28401cd0-c589-4f5e-bf30-e2c19664c07c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:10.468141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7f451ed-fb55-4843-814f-6526385d99ae req-28401cd0-c589-4f5e-bf30-e2c19664c07c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:10.468801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7f451ed-fb55-4843-814f-6526385d99ae req-28401cd0-c589-4f5e-bf30-e2c19664c07c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:10.513407 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f7f451ed-fb55-4843-814f-6526385d99ae req-28401cd0-c589-4f5e-bf30-e2c19664c07c service nova] Creating event network-changed:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h2-853316-12 Oct 17 13:10:10.552027 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f7f451ed-fb55-4843-814f-6526385d99ae req-28401cd0-c589-4f5e-bf30-e2c19664c07c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295516 Oct 17 13:10:10.561874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:10.563030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:10.563774 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2089/4069] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:10.580035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:10.581609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:10.586756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:10.588053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:10.588705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:10.589386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:11.283745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:11.284387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:11.315517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:11.316027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:11.316475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:11.326201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:11.326936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:11.331107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:11.363277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:11.374232 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-beaee309-aba9-41c0-81e6-71f567ac274d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1521 microversion: 2.1 time: 0.818846 Oct 17 13:10:11.379318 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1981/4070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:10 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1521 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:11.443470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:11.445396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:11.458696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:11.466348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:11.467160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:11.472166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:11.472896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:11.475605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:11.705354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:11.714298 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca78f399-0539-4670-81d8-9c096927e8ef tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1692 microversion: 2.1 time: 0.437145 Oct 17 13:10:11.715297 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2090/4071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:11 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1692 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:11.721450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:11.724287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:11.733092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:11.733918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:11.734142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:11.734885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:11.735340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:11.735761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:11.804677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lazy-loading 'flavor' on Instance uuid b27ca706-6340-4995-a586-b1ee6276bece {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:10:11.968242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:11.987059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f1cb929-316b-4fb8-b0c6-e875413416be tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 0.541483 Oct 17 13:10:11.988614 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1982/4072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:11 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:12.007801 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c23c13f-2f18-4d40-8aee-e6c9acad6931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action" status: 200 len: 32 microversion: 2.1 time: 0.291116 Oct 17 13:10:12.008634 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2091/4073] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:11 2022] POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:10:12.018139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:12.018779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:12.025239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:12.025936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:12.028255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:12.028993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:12.029620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:12.030239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:12.108761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:12.129606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:12.272445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:12.282109 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c6f2f4c6-6e10-4336-ba2d-e2c8c194ec39 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.267784 Oct 17 13:10:12.286238 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1983/4074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:12 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:12.404471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:12.405342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:12.414850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:12.419040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:12.419548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:12.419991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:12.420821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:12.421291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:12.421804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:12.608974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:12.617681 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d8be852-c308-4e6b-a756-05d3f998ccfd tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1521 microversion: 2.1 time: 0.218219 Oct 17 13:10:12.627113 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2092/4075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:12 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:12.743173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:12.744625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:12.752675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:12.753445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:12.754069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:12.754964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:12.755659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:12.756308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:13.000697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:13.013799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f14f85d6-1dec-4bce-bfa2-5abd2157d42e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1692 microversion: 2.1 time: 0.275692 Oct 17 13:10:13.014026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:13.014924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:13.015333 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1984/4076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:12 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1692 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:13.022824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:13.023426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:13.024168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:13.025075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:13.025746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:13.026491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:13.308020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:13.309006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:13.323172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:13.323664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:13.326705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:13.329103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:13.329578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:13.332352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:13.657722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:13.666731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc41c7af-0fd4-4b67-89cc-502d7ef7c79e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 0.659268 Oct 17 13:10:13.674135 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2093/4077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:13 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:13.682581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e67f8677-4759-4d7a-a58e-c459bc678ce9 req-29b74764-cc90-43a0-87ec-baf754f9f7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586fd663-8db0-4d14-bf90-b3871f6374b5", "name": "network-vif-plugged", "status": "completed", "tag": "3d6515c3-5c35-4518-9d9e-63d08da1216b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:13.698286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e67f8677-4759-4d7a-a58e-c459bc678ce9 req-29b74764-cc90-43a0-87ec-baf754f9f7a9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:13.699066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e67f8677-4759-4d7a-a58e-c459bc678ce9 req-29b74764-cc90-43a0-87ec-baf754f9f7a9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:13.699678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e67f8677-4759-4d7a-a58e-c459bc678ce9 req-29b74764-cc90-43a0-87ec-baf754f9f7a9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:13.713615 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e67f8677-4759-4d7a-a58e-c459bc678ce9 req-29b74764-cc90-43a0-87ec-baf754f9f7a9 service nova] Creating event network-vif-plugged:3d6515c3-5c35-4518-9d9e-63d08da1216b for instance 586fd663-8db0-4d14-bf90-b3871f6374b5 on n-h1-853316-12 Oct 17 13:10:13.722149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e67f8677-4759-4d7a-a58e-c459bc678ce9 req-29b74764-cc90-43a0-87ec-baf754f9f7a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044444 Oct 17 13:10:13.723473 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2094/4078] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:13.731514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:13.732685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:13.734937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:13.740445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:13.741124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:13.741712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:13.745267 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ef105c10-cc94-4123-b842-7bd349431ef6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.441800 Oct 17 13:10:13.749617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:13.749820 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1985/4079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:13 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:13.750493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:13.751284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:14.040813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:14.041541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:14.054250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:14.056825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:14.057993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:14.060688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:14.062694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:14.063262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:14.097882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:14.114698 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-35e87830-9f8f-4490-a29d-18b7c0bc195a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1521 microversion: 2.1 time: 0.387508 Oct 17 13:10:14.120739 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2095/4080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:13 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:14.260019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:14.271798 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf1cba10-dab5-454f-9bb0-d9393ba79676 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1684 microversion: 2.1 time: 0.234708 Oct 17 13:10:14.272595 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1986/4081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:14 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:14.702176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:14.703186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:14.712280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:14.713102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:14.716870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:14.717898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:14.719355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:14.720196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:14.778643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:14.784510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:14.800617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:14.801118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:14.801563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:14.802315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:14.802770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:14.806864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:14.935546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:14.946259 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-15995c60-d5e6-4ae3-9487-af557e89ce65 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 0.249863 Oct 17 13:10:14.949930 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2096/4082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:14 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:15.008985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:15.022965 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-703bac41-8b3a-4e9a-93b2-805696f3b402 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.246808 Oct 17 13:10:15.024200 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1987/4083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:14 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:15.145883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:15.146961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:15.156087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:15.156586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:15.157490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:15.158744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:15.159482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:15.159922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:15.340381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:15.356293 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-768ca1de-c938-49b7-a744-3dcca7533cd3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1521 microversion: 2.1 time: 0.214165 Oct 17 13:10:15.371178 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2097/4084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:15 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:15.736673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a456d52c-ed9d-4877-9e96-d7e8cbce3760 req-527c7aa7-20e7-43fd-a0cd-cbd1bf581c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad23758-40e8-46a3-9c04-2f14d26d6226", "name": "network-vif-plugged", "status": "completed", "tag": "dea17f7e-76dc-466a-b6f0-ecb7a0515eb5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:15.751630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:15.754301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a456d52c-ed9d-4877-9e96-d7e8cbce3760 req-527c7aa7-20e7-43fd-a0cd-cbd1bf581c29 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:15.755197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a456d52c-ed9d-4877-9e96-d7e8cbce3760 req-527c7aa7-20e7-43fd-a0cd-cbd1bf581c29 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:15.755830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a456d52c-ed9d-4877-9e96-d7e8cbce3760 req-527c7aa7-20e7-43fd-a0cd-cbd1bf581c29 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:15.772151 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a456d52c-ed9d-4877-9e96-d7e8cbce3760 req-527c7aa7-20e7-43fd-a0cd-cbd1bf581c29 service nova] Creating event network-vif-plugged:dea17f7e-76dc-466a-b6f0-ecb7a0515eb5 for instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 on n-h2-853316-12 Oct 17 13:10:15.778027 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a456d52c-ed9d-4877-9e96-d7e8cbce3760 req-527c7aa7-20e7-43fd-a0cd-cbd1bf581c29 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044672 Oct 17 13:10:15.782547 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1988/4085] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:15.973070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:15.973717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:15.983048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:15.984505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:15.987182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:15.988929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:15.990276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:15.993475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:16.047569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:16.048273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:16.059976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:16.061360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:16.062885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:16.064601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:16.066075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:16.067388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:16.278094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:16.291893 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77bc6986-a8c4-41ab-bc3a-973a2ab16baa tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.248305 Oct 17 13:10:16.310672 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1989/4086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:16 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:16.342033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:16.347204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:16.359460 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c28c555f-b4d8-42d4-889c-d715479a620e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 0.390541 Oct 17 13:10:16.360610 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2098/4087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:15 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:16.383199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:16.384185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:16.395725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:16.396529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:16.398395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:16.399286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:16.399987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:16.400608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:16.605315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:16.615388 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8387dce-5522-4c1b-8ecf-517e3934192b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1521 microversion: 2.1 time: 0.236212 Oct 17 13:10:16.618821 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1990/4088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:16 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:17.319285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:17.320177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:17.336829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.340818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.341302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:17.343158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.343733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.344046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:17.383189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:17.383796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:17.398741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.400824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.403509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:17.406759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.409447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.410207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:17.629181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:17.644355 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13fdcf3c-52b4-4b9b-b484-9fc8d8afc89f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.330028 Oct 17 13:10:17.649716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:17.659414 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8cf14c8c-40da-4714-8637-eb09b87af66f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 0.280339 Oct 17 13:10:17.660261 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1991/4089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:17 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:17.661453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2099/4090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:17 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:17.675937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:17.676942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:17.688395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.688990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.689438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:17.690133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.690607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.691025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:17.810355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-81669453-cb90-43de-a066-7e165af55609 req-e061e4ad-65b7-46f6-b65d-779d9c77a4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "name": "network-vif-plugged", "status": "completed", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:17.829986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-81669453-cb90-43de-a066-7e165af55609 req-e061e4ad-65b7-46f6-b65d-779d9c77a4c2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.831137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-81669453-cb90-43de-a066-7e165af55609 req-e061e4ad-65b7-46f6-b65d-779d9c77a4c2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.832264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-81669453-cb90-43de-a066-7e165af55609 req-e061e4ad-65b7-46f6-b65d-779d9c77a4c2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:17.906516 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-81669453-cb90-43de-a066-7e165af55609 req-e061e4ad-65b7-46f6-b65d-779d9c77a4c2 service nova] Creating event network-vif-plugged:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h2-853316-12 Oct 17 13:10:17.906946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:17.907344 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-81669453-cb90-43de-a066-7e165af55609 req-e061e4ad-65b7-46f6-b65d-779d9c77a4c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086200 Oct 17 13:10:17.907344 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2100/4091] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:10:17.920076 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69e6ac50-844f-4b1f-8282-da492dead7a8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1506 microversion: 2.1 time: 0.248919 Oct 17 13:10:17.934491 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1992/4092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:17 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:17.947076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:17.948230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:17.984807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.985910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.986635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:17.987940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:17.988652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:17.989319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:18.251481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:18.262946 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db59e856-4697-4c30-a04f-1fb2c3a2dda1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 200 len: 1506 microversion: 2.1 time: 0.320693 Oct 17 13:10:18.266031 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2101/4093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:17 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:18.288997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:18.289499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:18.297360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:18.298130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:18.298886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:18.299985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:18.300787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:18.301430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:18.333376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:10:18.351130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:18.426867 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b98218b-c377-4bfa-8785-1a5be641e2be tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 204 len: 0 microversion: 2.1 time: 0.141757 Oct 17 13:10:18.430449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1993/4094] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:10:18 2022] DELETE /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:10:18.598503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-615790414", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e53d95a2-0561-4745-a443-7230dc4fc44a"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:18.671291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:18.672428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:18.682850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:18.684065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:18.684921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:18.685665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:18.686128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:18.686712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:18.866520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:18.878560 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e5126a6-728c-45b6-8dcd-6f000d4e3ed5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.209616 Oct 17 13:10:18.879957 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1994/4095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:18 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:18.885237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:18.886084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:18.892941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:18.893648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:18.894282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:18.895442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:18.896061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:18.896691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:19.063347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:19.075687 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ecdbf2fb-cc9f-4a34-91d8-f696678db141 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 0.193868 Oct 17 13:10:19.076305 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1995/4096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:18 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:19.903127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:19.904193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:19.911834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:19.912330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:19.913072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:19.913817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:19.914329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:19.914738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:20.121489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:20.131297 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f942fe4-870b-42f4-bd13-c696094ed238 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.232988 Oct 17 13:10:20.145577 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1996/4097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:19 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:20.150377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:20.151101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:20.159037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:20.159533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:20.159986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:20.160689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:20.161292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:20.161876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:20.270129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] validate_networks() for [('e53d95a2-0561-4745-a443-7230dc4fc44a', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:10:20.336073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:20.347613 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8a2f3313-72e5-495e-9914-1cd1618f07a4 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1313 microversion: 2.1 time: 0.198563 Oct 17 13:10:20.347613 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1997/4098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:20 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:20.352371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:20.352994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:20.361181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:20.361885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:20.362611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:20.363254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:20.363779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:20.364300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:20.568722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:20.580849 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70af976c-f1e0-47ea-aee9-c0a6966a6b06 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.233027 Oct 17 13:10:20.582208 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1998/4099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:20 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:21.031479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:10:21.032231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:10:21.032914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:10:21.033654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:10:21.034554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:10:21.054343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.054879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.055330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.056123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.056588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.057016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.087753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Getting quotas for project 7a7fe0bfe98b4320be690d525152f6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:10:21.097851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Getting quotas for user f2af8096ed394d02bdf6c285e17df1f7 and project 7a7fe0bfe98b4320be690d525152f6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:10:21.114998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:10:21.118500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:10:21.160606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:21.161290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:21.170865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.171602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.172519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.173927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.175242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.176314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.209236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ca8441e-84bd-4613-a8dd-9fb70fcba9f6 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.615089 Oct 17 13:10:21.219568 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2102/4100] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:10:21.232510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-986de68f-29b0-4949-b8e2-4b1ba59c44c7 req-0f4a4c5c-5a02-427b-ac24-c613ae524e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad23758-40e8-46a3-9c04-2f14d26d6226", "name": "network-vif-deleted", "tag": "dea17f7e-76dc-466a-b6f0-ecb7a0515eb5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:21.244710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-986de68f-29b0-4949-b8e2-4b1ba59c44c7 req-0f4a4c5c-5a02-427b-ac24-c613ae524e2a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.246689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-986de68f-29b0-4949-b8e2-4b1ba59c44c7 req-0f4a4c5c-5a02-427b-ac24-c613ae524e2a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.247403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-986de68f-29b0-4949-b8e2-4b1ba59c44c7 req-0f4a4c5c-5a02-427b-ac24-c613ae524e2a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.259203 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-986de68f-29b0-4949-b8e2-4b1ba59c44c7 req-0f4a4c5c-5a02-427b-ac24-c613ae524e2a service nova] Creating event network-vif-deleted:dea17f7e-76dc-466a-b6f0-ecb7a0515eb5 for instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 on n-h2-853316-12 Oct 17 13:10:21.265279 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-986de68f-29b0-4949-b8e2-4b1ba59c44c7 req-0f4a4c5c-5a02-427b-ac24-c613ae524e2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044002 Oct 17 13:10:21.265968 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2103/4101] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:21.274722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-92a2dc81-edcb-4a96-81d9-c02a245eaf06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:21.275451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-92a2dc81-edcb-4a96-81d9-c02a245eaf06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:21.363921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-92a2dc81-edcb-4a96-81d9-c02a245eaf06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:21.373130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-92a2dc81-edcb-4a96-81d9-c02a245eaf06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1217 microversion: 2.1 time: 0.102942 Oct 17 13:10:21.378272 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2104/4102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:21 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:21.378884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:21.380029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:21.401193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.402217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.408537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.422724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.423221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.423700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.457667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:21.466357 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f70aa67-173b-4ab6-ad08-081f701f480a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.314509 Oct 17 13:10:21.470477 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 1999/4103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:21 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:21.606553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:21.607498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:21.618870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.618870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.618870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.618870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.618870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.618870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.678663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:21.688441 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca159436-deca-4749-bfc1-f5cb1bcd5f01 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1463 microversion: 2.1 time: 0.313260 Oct 17 13:10:21.698267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2105/4104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:21 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1463 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:21.711720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:21.712340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:21.720532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.722523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.723200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.724336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.724953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.725680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.796853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:21.816244 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f22dad80-5975-47d1-a318-dd1220d8b055 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.214945 Oct 17 13:10:21.817748 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2000/4105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:21 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:21.844047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1240769430"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:21.850078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:21.862707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.863205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.863638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.865224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.865854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.866473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.929700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fc9993c-fe1d-4781-9c7a-38d0972f1c23 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1616 microversion: 2.1 time: 0.221882 Oct 17 13:10:21.931401 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2106/4106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:21 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1616 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:21.958427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:21.962368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:21.972970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.973783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.974301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:21.975657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:21.976425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:21.976862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:22.018099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1706bfe90cd844d185fa7dab5710aeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc3a31ede2646df90496d5ecf55b835', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:22.019018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] flavor_id is None. Assuming migration. {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 13:10:22.024324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:10:22.174584 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c09a04cb-5ce7-44ea-a337-f4815fa5cd70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.337332 Oct 17 13:10:22.176289 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2001/4107] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:21 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 17 13:10:22.177697 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe50f608-f2f8-4f6a-9aa2-8842a82689da tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb/action" status: 202 len: 0 microversion: 2.1 time: 0.225555 Oct 17 13:10:22.181941 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2107/4108] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:21 2022] POST /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:10:22.206641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:22.207767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:22.217838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:22.218367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:22.219015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:22.219905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:22.220593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:22.221193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:22.400556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:22.401445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:22.416036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:22.417113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:22.418465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:22.419188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:22.419652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:22.420079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:22.426952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:22.441560 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9292903d-1978-4735-bc91-2a833f4c2a0b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1472 microversion: 2.1 time: 0.248037 Oct 17 13:10:22.442862 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2002/4109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:22 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:22.490071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:22.490713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:22.497642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:22.498282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:22.498973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:22.500329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:22.500983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:22.501563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:22.516468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:22.526656 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-536bcfa9-a05b-4f28-855b-a389a3ba2523 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1269 microversion: 2.1 time: 0.130397 Oct 17 13:10:22.528700 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2108/4110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:22 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:22.659073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:22.667300 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe0445ef-d5f6-4f4b-ab98-e383846405c2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.180934 Oct 17 13:10:22.668162 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2003/4111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:22 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:23.174781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e68bd24c-7290-40a1-a022-8743df6b6a57 req-f4261ad0-d904-4a94-a334-fd3a360420b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "name": "network-vif-unplugged", "status": "completed", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:23.196050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e68bd24c-7290-40a1-a022-8743df6b6a57 req-f4261ad0-d904-4a94-a334-fd3a360420b8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:23.198767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e68bd24c-7290-40a1-a022-8743df6b6a57 req-f4261ad0-d904-4a94-a334-fd3a360420b8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:23.201309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e68bd24c-7290-40a1-a022-8743df6b6a57 req-f4261ad0-d904-4a94-a334-fd3a360420b8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:23.234709 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e68bd24c-7290-40a1-a022-8743df6b6a57 req-f4261ad0-d904-4a94-a334-fd3a360420b8 service nova] Creating event network-vif-unplugged:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:10:23.247238 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e68bd24c-7290-40a1-a022-8743df6b6a57 req-f4261ad0-d904-4a94-a334-fd3a360420b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079490 Oct 17 13:10:23.250110 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2109/4112] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:23.470803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:23.471399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:23.479786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:23.480757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:23.481208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:23.489246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:23.489753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:23.490264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:23.553789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:23.555002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:23.562345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:23.563085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:23.563831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:23.564761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:23.565373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:23.565952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:23.693767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:23.726362 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf28f775-2577-48b0-ba9e-3999ad323196 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1472 microversion: 2.1 time: 0.254009 Oct 17 13:10:23.730325 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2004/4113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:23 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:23.735209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:23.738756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:23.763695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:23.778690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:23.779567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:23.780500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:23.781134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:23.781730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:23.858267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:23.867471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d4b08b62-2d03-4e05-ba53-98d08aac706e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1317 microversion: 2.1 time: 0.319680 Oct 17 13:10:23.868212 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2110/4114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:23 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:23.973146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:23.984079 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-000b44d1-cb29-47d0-998e-41b67626e459 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.252473 Oct 17 13:10:23.984903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2005/4115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:23 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:24.758201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:24.758783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:24.766189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:24.766939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:24.767538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:24.768420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:24.769027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:24.769609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:24.896817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:24.898424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:24.912239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:24.913214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:24.915132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:24.916031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:24.917009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:24.917723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:25.048221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:25.060436 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3601bc01-14a9-4f4d-a5c3-78d347073110 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1472 microversion: 2.1 time: 0.305645 Oct 17 13:10:25.062009 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2111/4116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:24 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:25.067456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:25.068371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:25.076871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:25.077660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:25.078720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:25.079700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:25.080786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:25.081411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:25.094975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:25.111855 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-96d0115b-5514-4f10-97e3-1c0ad9eae285 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1317 microversion: 2.1 time: 0.221439 Oct 17 13:10:25.113810 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2006/4117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:24 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:25.161485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cd750d01-a42e-4c84-9ef5-242166fa0f15 req-fc4ced9b-d9b2-4d42-9312-a4b59e019f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb587b1-1e80-467b-bee5-bc89f62360c2", "tag": "e1b91c9e-a498-4d68-9b3a-f7c9b11b8b56"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:25.173646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd750d01-a42e-4c84-9ef5-242166fa0f15 req-fc4ced9b-d9b2-4d42-9312-a4b59e019f69 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:25.174467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd750d01-a42e-4c84-9ef5-242166fa0f15 req-fc4ced9b-d9b2-4d42-9312-a4b59e019f69 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:25.175239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd750d01-a42e-4c84-9ef5-242166fa0f15 req-fc4ced9b-d9b2-4d42-9312-a4b59e019f69 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:25.188014 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cd750d01-a42e-4c84-9ef5-242166fa0f15 req-fc4ced9b-d9b2-4d42-9312-a4b59e019f69 service nova] Creating event network-changed:e1b91c9e-a498-4d68-9b3a-f7c9b11b8b56 for instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 on n-h2-853316-12 Oct 17 13:10:25.192980 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cd750d01-a42e-4c84-9ef5-242166fa0f15 req-fc4ced9b-d9b2-4d42-9312-a4b59e019f69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035957 Oct 17 13:10:25.193596 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2007/4118] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:25.401949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:25.411319 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ed624ffd-4b67-4549-afe8-b7c3ef812f47 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.347943 Oct 17 13:10:25.411893 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2112/4119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:25 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:26.086136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:26.086914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:26.093986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:26.094512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:26.094957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:26.095660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:26.096115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:26.096574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:26.118489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:26.138574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:26.139185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:26.146189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:26.146677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:26.147268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:26.148190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:26.148646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:26.149069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:26.266102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:26.274495 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f742d7fc-ffb2-497d-87c4-323555398430 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.193567 Oct 17 13:10:26.275414 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2008/4120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:26 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:26.294649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:26.302456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19be4687-2cd5-4c7e-8a07-c62c8454518c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1317 microversion: 2.1 time: 0.168897 Oct 17 13:10:26.303017 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2113/4121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:26 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:26.435987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:26.436603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:26.442899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:26.443390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:26.443830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:26.444544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:26.445253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:26.445893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:26.591066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:26.599072 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9c9ae7ee-9fd7-4e93-9101-57629ac6a5d5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.167813 Oct 17 13:10:26.599641 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2009/4122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:26 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:27.299772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:27.300387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:27.307279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:27.308849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:27.309556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:27.310294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:27.310759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:27.311190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:27.326217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:27.326922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:27.334018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:27.334617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:27.335179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:27.336104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:27.336822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:27.337316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:27.481673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:27.485207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:27.493235 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de467321-8271-417e-b4ca-0753a23202ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.196480 Oct 17 13:10:27.499946 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4e7c2f4-4b60-4c43-8c65-234aa7130c01 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1317 microversion: 2.1 time: 0.176184 Oct 17 13:10:27.504168 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2114/4123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:27 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:27.510687 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2010/4124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:27 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:27.625501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:27.626252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:27.632749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:27.633234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:27.633669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:27.634390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:27.634849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:27.635270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:27.790641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:27.798742 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b2459864-496f-4e40-afd8-27bcb7ba930d tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.179471 Oct 17 13:10:27.799305 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2115/4125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:27 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:28.518313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:28.519560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:28.525687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:28.526403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:28.537463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:28.537964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:28.538693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:28.539426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:28.540075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:28.540503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:28.543409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:28.543904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:28.544445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:28.547152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:28.547995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:28.549414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:28.695266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:28.703103 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a44dee6-f6b3-494e-9144-27ef72f308b1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1317 microversion: 2.1 time: 0.181232 Oct 17 13:10:28.703683 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2116/4126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:28 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:28.716789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:28.729524 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ef86b090-050c-47db-95ae-62e81dc5c417 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.215804 Oct 17 13:10:28.730202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2011/4127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:28 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:28.822298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:28.822918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:28.830738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:28.831402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:28.831840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:28.832551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:28.833005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:28.833430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:28.848904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:28.998743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:29.007523 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d10fcbca-61a8-4eb3-ba5a-ec7b629622e3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.189260 Oct 17 13:10:29.008946 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2117/4128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:28 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:29.279699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f6428c3e-8e71-4a1c-97aa-71a751cedfef req-96cc7645-9a7e-4b15-8ee9-8c6495d45406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "name": "network-vif-plugged", "status": "completed", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:29.294966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f6428c3e-8e71-4a1c-97aa-71a751cedfef req-96cc7645-9a7e-4b15-8ee9-8c6495d45406 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:29.296120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f6428c3e-8e71-4a1c-97aa-71a751cedfef req-96cc7645-9a7e-4b15-8ee9-8c6495d45406 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:29.296791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f6428c3e-8e71-4a1c-97aa-71a751cedfef req-96cc7645-9a7e-4b15-8ee9-8c6495d45406 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:29.311314 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f6428c3e-8e71-4a1c-97aa-71a751cedfef req-96cc7645-9a7e-4b15-8ee9-8c6495d45406 service nova] Creating event network-vif-plugged:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:10:29.317344 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f6428c3e-8e71-4a1c-97aa-71a751cedfef req-96cc7645-9a7e-4b15-8ee9-8c6495d45406 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045270 Oct 17 13:10:29.318737 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2012/4129] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:10:29.729188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:29.730506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:29.740299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:29.741078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:29.741871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:29.743093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:29.743924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:29.744627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:29.755624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:29.756558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:29.763817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:29.764389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:29.765028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:29.765882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:29.766373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:29.766980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:29.914354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:29.915575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:29.923172 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08b5866a-8036-47a2-9e60-2b682f665659 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1317 microversion: 2.1 time: 0.199760 Oct 17 13:10:29.923620 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd0666b7-b1d7-449a-9b61-6dd49cd9c007 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.173307 Oct 17 13:10:29.924202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2013/4130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:29 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:29.924545 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2118/4131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:29 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:30.033608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:30.034440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:30.040902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:30.041437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:30.042085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:30.042915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:30.043449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:30.043919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:30.222901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:30.232363 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e1d60fc-415d-406e-b75a-63a494cf7b25 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.203160 Oct 17 13:10:30.233257 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2014/4132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:30 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:30.948186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:30.949329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:30.956532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:30.957020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:30.957453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:30.958145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:30.958621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:30.958962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:30.959395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:30.959580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:30.966993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:30.967473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:30.967905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:30.968626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:30.969071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:30.969494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:31.074731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:31.108942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:31.112518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:31.116622 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2be85c76-f13c-4d76-b04f-0fa465a13a03 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1317 microversion: 2.1 time: 0.172776 Oct 17 13:10:31.117193 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2119/4133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:30 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:31.124287 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0604b203-51b8-4112-af4a-87a4af9436f7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.165522 Oct 17 13:10:31.124287 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2015/4134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:30 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:31.256026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:31.256639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:31.258646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:31.265509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:31.266006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:31.266477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:31.267188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:31.267929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:31.268369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:31.352918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cba32cc6-e3e8-4010-bbf9-dfd68e04237a req-50e6d5ef-f39e-40e9-ab91-e490150fbf2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb587b1-1e80-467b-bee5-bc89f62360c2", "name": "network-vif-plugged", "status": "completed", "tag": "e1b91c9e-a498-4d68-9b3a-f7c9b11b8b56"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:31.363649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cba32cc6-e3e8-4010-bbf9-dfd68e04237a req-50e6d5ef-f39e-40e9-ab91-e490150fbf2d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:31.364197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cba32cc6-e3e8-4010-bbf9-dfd68e04237a req-50e6d5ef-f39e-40e9-ab91-e490150fbf2d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:31.364697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cba32cc6-e3e8-4010-bbf9-dfd68e04237a req-50e6d5ef-f39e-40e9-ab91-e490150fbf2d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:31.372388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:31.376814 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cba32cc6-e3e8-4010-bbf9-dfd68e04237a req-50e6d5ef-f39e-40e9-ab91-e490150fbf2d service nova] Creating event network-vif-plugged:e1b91c9e-a498-4d68-9b3a-f7c9b11b8b56 for instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 on n-h2-853316-12 Oct 17 13:10:31.381782 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cba32cc6-e3e8-4010-bbf9-dfd68e04237a req-50e6d5ef-f39e-40e9-ab91-e490150fbf2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Oct 17 13:10:31.382933 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2016/4135] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:31.424768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:31.434321 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3eee3d9b-c9b5-4291-9089-9c0be83c91af tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.182045 Oct 17 13:10:31.443004 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2120/4136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:31 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:32.143268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:32.144009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:32.144683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:32.147229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:32.153522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:32.154146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:32.154373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:32.154687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:32.154858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:32.155300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:32.155581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:32.156059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:32.156221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:32.156543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:32.156757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:32.156969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:32.300092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:32.312211 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-620b1a1f-753f-4e47-a0e1-44263158a890 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.171802 Oct 17 13:10:32.312950 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2121/4137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:32 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:32.328276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:32.336254 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eee8b72a-6d0e-4e3e-aebb-b74e4d90f752 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1317 microversion: 2.1 time: 0.198588 Oct 17 13:10:32.336962 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2017/4138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:32 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:32.462151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:32.462811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:32.469608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:32.470135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:32.470657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:32.471406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:32.471916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:32.472343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:32.620429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:32.630663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d5f4f6c-5d34-4910-9ea4-f183ec4a4ad9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.174464 Oct 17 13:10:32.631266 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2122/4139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:32 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:33.336747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:33.337264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:33.345126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.345615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.346641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.347383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.347838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.348265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.360678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:33.361507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:33.368892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.369540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.370050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.371537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.372069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.372565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.523354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:33.533026 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-73b27a65-5de7-4a38-a98c-a8582884eb02 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.200708 Oct 17 13:10:33.533619 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2018/4140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:33 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:33.538461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:33.549586 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c08c40f8-57fe-44bd-b09f-d6f62b5a70bc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1507 microversion: 2.1 time: 0.192957 Oct 17 13:10:33.551268 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2123/4141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:33 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:33.577989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:33.578732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:33.586500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.587157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.587714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.588510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.589074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.589567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.658582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:33.659463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:33.668699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.668699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.668699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.671405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.672923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.673443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.816518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:33.832102 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19a11d47-cc7d-428c-b053-75fc2de30a5e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1507 microversion: 2.1 time: 0.259034 Oct 17 13:10:33.832688 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2019/4142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:33 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1507 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:33.861092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:33.861944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:33.862733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:33.870651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.871650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.872687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.873097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.873562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.873763 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5db89926-b626-4eb4-948e-2276cc1f9c96 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1502 microversion: 2.1 time: 0.222383 Oct 17 13:10:33.873993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.874706 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2124/4143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:33 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:33.899710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dcded04-05b1-47c4-854e-f132e9732612"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:33.904155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:33.914800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.915503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.916126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.917005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.917997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.918843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.956788 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Cannot 'attach_volume' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state rescued Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/os-volume_attachments HTTP/1.1 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 74 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: {"volumeAttachment": {"volumeId": "0dcded04-05b1-47c4-854e-f132e9732612"}} Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: exception: Cannot 'attach_volume' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state rescued Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'server_id': 'b27ca706-6340-4995-a586-b1ee6276bece', 'body': {'volumeAttachment': {'volumeId': '0dcded04-05b1-47c4-854e-f132e9732612'}}} Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b27ca706-6340-4995-a586-b1ee6276bece in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 13:10:33.958882 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state rescued Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state rescued Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:10:33.963223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 409 to user: Cannot 'attach_volume' instance b27ca706-6340-4995-a586-b1ee6276bece while it is in vm_state rescued {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:10:33.965209 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dd8ae9be-1129-4b92-81ce-ede53a2daa58 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "PUT /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1079 microversion: 2.1 time: 0.105010 Oct 17 13:10:33.965460 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee3f2d60-047c-47b0-8b95-c9337f7e9274 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066118 Oct 17 13:10:33.965729 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2020/4145] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:10:33 2022] PUT /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1079 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:33.965979 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2125/4145] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:10:33 2022] POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:10:33.970349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:33.973376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:33.984209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.984700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.985137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.987125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:33.987749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:33.990332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.991084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.991752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.994645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.995132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.996320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:33.997115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:33.997682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:33.997994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:34.117125 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1c9f88eb-8c03-4bba-a22c-d064ab4398a8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action" status: 202 len: 0 microversion: 2.1 time: 0.150574 Oct 17 13:10:34.118329 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2021/4146] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:33 2022] POST /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:10:34.130105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:34.131387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:34.145108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:34.145604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:34.152146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:34.153492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:34.153985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:34.154619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:34.266950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:34.281042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc0dd77c-c77d-4423-a178-b79957f62614 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1505 microversion: 2.1 time: 0.302679 Oct 17 13:10:34.295837 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2126/4147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:33 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:34.310119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:34.312021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:34.347987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:34.348774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:34.349468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:34.352129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:34.353083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:34.353679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:34.548571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:34.565259 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-41acabee-8b05-4cd0-aabe-9a9f8ca4080e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1505 microversion: 2.1 time: 0.260554 Oct 17 13:10:34.578200 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2127/4148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:34 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:34.582226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:34.583047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:34.591087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:34.591726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:34.592026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:34.592746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:34.593240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:34.593672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:34.798423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:34.816631 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea5aa8fa-7d96-41b9-bb8a-9c9124c6d5c8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.248824 Oct 17 13:10:34.840375 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2128/4149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:34 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:34.857346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:34.860272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:34.868093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:34.868599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:34.869046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:34.869760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:34.870345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:34.870747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:35.015133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:10:35.015777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:10:35.016439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:10:35.017004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:10:35.017571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:10:35.019649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:35.029458 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51cee793-9d9e-4eb2-8217-d3ff5b5a3be2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1510 microversion: 2.1 time: 0.906752 Oct 17 13:10:35.030932 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2022/4150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:34 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1510 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:35.184174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:35.195511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:35.196123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:35.196571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:35.197964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:35.200159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:35.200614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:35.282646 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-23b1adb3-c646-427e-801f-38b740e42f0b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "POST /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2/action" status: 202 len: 1111 microversion: 2.1 time: 0.441001 Oct 17 13:10:35.285828 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2129/4151] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:34 2022] POST /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2/action => generated 1111 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:10:35.307279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:35.309251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:35.324441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:35.326332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:35.327007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:35.330337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:35.331027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:35.332731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:35.593374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:35.615207 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-efe97c78-ce2f-4060-951e-7c889ad8e97f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.311627 Oct 17 13:10:35.630218 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2023/4152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:35 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:35.844997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:35.845556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:35.853227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:35.853760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:35.854317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:35.855763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:35.856319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:35.856779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:36.031494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:36.044181 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b747ffd2-a504-4d36-8f80-8f926a892867 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.203096 Oct 17 13:10:36.046685 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2130/4153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:35 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:36.056607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:36.058610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:36.065799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:36.066628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:36.067286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:36.068072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:36.068637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:36.069138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:36.268101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:36.273597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:36.294370 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-195c06eb-6eba-4bbd-8292-a2f36ff6e237 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1510 microversion: 2.1 time: 0.242219 Oct 17 13:10:36.314136 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2024/4154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:36 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:36.640937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:36.641623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:36.649345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:36.649838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:36.650307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:36.651069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:36.651501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:36.651959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:36.841042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:36.852081 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56a9de8e-0a26-42d1-a590-500fa97eeade tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.216068 Oct 17 13:10:36.861598 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2131/4155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:36 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:37.070596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:37.071892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:37.082278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:37.083133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:37.083784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:37.084709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:37.085174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:37.085615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:37.262989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:37.274069 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dda09560-2fae-4bd0-b40b-e8768fb09a20 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.208415 Oct 17 13:10:37.292403 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2025/4156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:37 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:37.321584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:37.322558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:37.331697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:37.332614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:37.333498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:37.334728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:37.335454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:37.336131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:37.357948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:37.566315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:37.575074 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7f1c0bc-71ea-471b-a72e-791e96d7adc1 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1516 microversion: 2.1 time: 0.258007 Oct 17 13:10:37.576880 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2132/4157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:37 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:37.884414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:37.885197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:37.893588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:37.893588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:37.894424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:37.895879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:37.896595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:37.897316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:38.163946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:38.176451 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9572a440-f894-45ab-aad4-014793af5d61 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.295929 Oct 17 13:10:38.182953 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2026/4158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:37 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:38.300512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:38.302287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:38.313664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:38.321921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:38.322695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:38.324575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:38.325085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:38.325530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:38.631101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:38.643952 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19201120-6189-442f-a468-e9a4bd53af11 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.348163 Oct 17 13:10:38.646460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2133/4159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:38 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:39.211267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:39.212462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:39.225864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:39.227977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:39.228648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:39.230632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:39.232616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:39.233261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:39.485980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:39.494560 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac0e37d8-8a16-4919-8457-f9e25b4f853f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.291434 Oct 17 13:10:39.496086 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2027/4160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:39 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:39.675470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:39.677349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:39.687247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:39.687974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:39.688580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:39.689479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:39.690097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:39.690728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:39.909942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:39.923471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab20214e-a94c-4099-a678-b10806599c09 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.256489 Oct 17 13:10:39.924064 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2134/4161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:39 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:40.287695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b80384b4-9278-4bac-bbfa-3cf1dd2c70b3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'create', calling method: .version_select at 0x7fa820441b80>, body: {"keypair": {"name": "tempest-keypair-1002004053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvdXBqYZqgsgrWLEfn+VGPLN5CyVxYX+7t6Sj7libiv9LrYTwMXgGdvo4kJseA4f4+NoXnHguUmdgICC+Go5ZaoqouhPXeZbO6Om0E0NetmnsnsSRge5woI5SIP89yIfQ=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:40.307577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b80384b4-9278-4bac-bbfa-3cf1dd2c70b3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Getting quotas for project 15d82cd61ac94563ab7bd8b9c13a0a06. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:10:40.315204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b80384b4-9278-4bac-bbfa-3cf1dd2c70b3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Getting quotas for user 3e452d90f659446db23827a290a819f1 and project 15d82cd61ac94563ab7bd8b9c13a0a06. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:10:40.363791 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b80384b4-9278-4bac-bbfa-3cf1dd2c70b3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080866 Oct 17 13:10:40.372798 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2028/4162] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:10:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:40.520169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:40.521228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:40.530770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:40.532891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:40.534118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:40.535517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:40.536367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:40.537305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:40.766877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:40.779387 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b402bda3-0d99-4408-a85f-11d3ebcb5477 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.263156 Oct 17 13:10:40.780008 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2135/4163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:40 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:40.952488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:40.954241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:40.971065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:40.971560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:40.972004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:40.980134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:40.980675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:40.981130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:41.177214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:41.187562 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-58e22db7-5802-4864-8c0b-1054c8266ed7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.243375 Oct 17 13:10:41.188315 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2029/4164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:40 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:41.806403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:41.807863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:41.822711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:41.823013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:41.823987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:41.824961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:41.830985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:41.831896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:42.215742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:42.216937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:42.228605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:42.232887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:42.234138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:42.244535 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc2fd929-9592-4547-8f15-b377f22cd862 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.442138 Oct 17 13:10:42.246793 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2136/4165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:41 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:42.247997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:42.248897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:42.249892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:42.250634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:42.251268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:42.749378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:42.759199 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-edc2f3b2-4d9a-4eb4-957c-b96e7771ffe0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.548273 Oct 17 13:10:42.760406 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2030/4166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:42 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:42.939314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1073867530", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2bbfbbe9-4ab2-4b95-a68f-5e8ba7706545"}], "security_groups": [{"name": "tempest-securitygroup--1770000789"}], "key_name": "tempest-keypair-1002004053", "user_data": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:43.062371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] validate_networks() for [('2bbfbbe9-4ab2-4b95-a68f-5e8ba7706545', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:10:43.270602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:43.271224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:43.282773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:43.283287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:43.283727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:43.284925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:43.285538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:43.286147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:43.540298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:43.550934 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-06ea8952-2a9e-4d25-b7c9-789c184e6d59 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.284132 Oct 17 13:10:43.566189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2031/4167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:43 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:43.714664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:10:43.715377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:10:43.715945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:10:43.716544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:10:43.717031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:10:43.737785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:43.738434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:43.740465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:43.741392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:43.743061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:43.743607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:43.789650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:43.790389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:43.798897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:43.799398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:43.799839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:43.807535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Getting quotas for project 15d82cd61ac94563ab7bd8b9c13a0a06. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:10:43.808953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:43.809610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:43.810580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:43.827435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Getting quotas for user 3e452d90f659446db23827a290a819f1 and project 15d82cd61ac94563ab7bd8b9c13a0a06. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:10:43.882213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:10:43.882213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:10:44.008943 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f468eeb8-43af-4cda-a28c-b4fca97b4e0b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.073712 Oct 17 13:10:44.010564 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2137/4168] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:10:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:10:44.024875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-22df5354-8dc0-4f40-a3d7-f40e82068207 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:44.028367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22df5354-8dc0-4f40-a3d7-f40e82068207 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:44.143449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-22df5354-8dc0-4f40-a3d7-f40e82068207 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:44.153236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-22df5354-8dc0-4f40-a3d7-f40e82068207 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1246 microversion: 2.1 time: 0.134078 Oct 17 13:10:44.154597 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2138/4169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:44 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1246 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:44.269095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:44.280537 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb1373be-74df-4144-a283-fd04ad07c472 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.495581 Oct 17 13:10:44.281688 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2032/4170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:43 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:44.581571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:44.582729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:44.592988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:44.593609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:44.594118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:44.595111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:44.598920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:44.599553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:44.810280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:44.821782 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c4f603f-099f-483d-a2eb-d08791f5955a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.243445 Oct 17 13:10:44.840421 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2139/4171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:44 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:45.185719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:45.186390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:45.199055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:45.199726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:45.200187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:45.200915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:45.201372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:45.204628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:45.306151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:45.307484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:45.317803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:45.320356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:45.321190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:45.321632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:45.322385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:45.323011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:45.323483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:45.334137 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c9b7731-afa1-41a8-bbad-025de5fa8074 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1298 microversion: 2.1 time: 0.154126 Oct 17 13:10:45.335560 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2033/4172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:45 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:45.596613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:45.604408 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-77109e1b-9132-4a9c-a39a-420b21be55d2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.302544 Oct 17 13:10:45.606517 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2140/4173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:45 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:45.853398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:45.856400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:45.868200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:45.871797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:45.872847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:45.874003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:45.875711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:45.877133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:46.265921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:46.286766 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c6523747-7566-4247-a158-657b285eef8d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.443249 Oct 17 13:10:46.287869 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2034/4174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:45 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:46.358112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:46.358891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:46.373060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:46.373603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:46.374051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:46.376193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:46.376997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:46.377592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:46.469383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:46.482066 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c1b14e93-0326-4bda-ba4d-f89ce9a81af7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1304 microversion: 2.1 time: 0.128619 Oct 17 13:10:46.482958 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2141/4175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:46 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:46.629755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:46.632152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:46.650543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:46.651240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:46.652622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:46.653567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:46.658873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:46.659932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:46.946190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:46.961330 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a937d459-9308-4f60-a5c7-36055f484a96 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.335257 Oct 17 13:10:46.979420 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2035/4176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:46 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:47.317026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:47.318025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:47.325185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:47.327144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:47.327832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:47.332250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:47.340200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:47.340916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:47.521642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:47.522562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:47.556307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:47.556825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:47.557279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:47.558111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:47.558606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:47.559042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:47.612038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:47.624562 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a8ed5af7-c1d8-43a9-91c7-12b6483a3ae7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.312906 Oct 17 13:10:47.626549 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2142/4177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:47 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:47.852731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:47.861690 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8cf1c89-4d79-4898-a0dc-156ad0f20ba2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1372 microversion: 2.1 time: 0.344949 Oct 17 13:10:47.864851 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2036/4178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:47 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1372 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:47.986081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:47.987202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:47.993963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:47.994908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:47.996092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:47.997131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:47.997802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:47.998470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:48.169246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:48.178575 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-efc9ca29-9d0d-4ed2-b751-ed4103fa53ea tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.196969 Oct 17 13:10:48.179186 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2143/4179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:47 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:48.294370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-804e1a01-a425-4b51-ae49-ba3750e895c2 req-25aaf082-fdad-4f2a-850c-db52f6147c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ca72ce-c82a-4daa-93bc-1ad80dea90f1", "tag": "bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:48.308349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-804e1a01-a425-4b51-ae49-ba3750e895c2 req-25aaf082-fdad-4f2a-850c-db52f6147c52 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:48.309201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-804e1a01-a425-4b51-ae49-ba3750e895c2 req-25aaf082-fdad-4f2a-850c-db52f6147c52 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:48.309831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-804e1a01-a425-4b51-ae49-ba3750e895c2 req-25aaf082-fdad-4f2a-850c-db52f6147c52 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:48.327734 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-804e1a01-a425-4b51-ae49-ba3750e895c2 req-25aaf082-fdad-4f2a-850c-db52f6147c52 service nova] Creating event network-changed:bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4 for instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 on n-h2-853316-12 Oct 17 13:10:48.343152 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-804e1a01-a425-4b51-ae49-ba3750e895c2 req-25aaf082-fdad-4f2a-850c-db52f6147c52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053768 Oct 17 13:10:48.345006 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2037/4180] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:48.654001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:48.655575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:48.664961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:48.666458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:48.667286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:48.668589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:48.669267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:48.670131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:48.888370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:48.889078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:48.899703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:48.908995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:48.909773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:48.910730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:48.912520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:48.914695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:48.938501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:48.947540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00c837f6-e6b0-46a1-9fa3-fa78287d0cc5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.302545 Oct 17 13:10:48.949020 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2144/4181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:48 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:49.218099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:49.221988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:49.231027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:49.239261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:49.239864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:49.241346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:49.242106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:49.242565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:49.325919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:49.350079 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ec67dda-8886-4ed1-9c83-d2fd35becffc tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1372 microversion: 2.1 time: 0.466685 Oct 17 13:10:49.350672 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2038/4182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:48 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1372 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:49.442861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:49.452206 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b5d72bf-c8af-44e6-bf15-7762dbe87a89 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.245486 Oct 17 13:10:49.452918 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2145/4183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:49 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:49.977106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:49.977724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:49.985341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:49.985826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:49.986315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:49.987005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:49.987461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:49.987892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.128075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:50.136433 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0dba4b58-d888-4bf5-9b30-cf37a6fb68fa tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.163437 Oct 17 13:10:50.137080 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2039/4184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:49 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:50.303804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:50.304562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:50.311128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.311700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.312234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.313004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.313551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.314146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.331701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:50.512627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:50.513154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:50.521155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.521891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.522367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.523073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.525740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.526277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.562911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:10:50.572982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:50.584278 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15fa9c02-c0a7-4e31-b4b5-a30e04a3c810 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.284262 Oct 17 13:10:50.585356 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2040/4185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:50 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:50.591151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:50.591867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:50.603079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.603933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.605124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.606134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.606934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.607446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.670722 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-839ad003-fe80-4684-b02b-2270c29818c9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 204 len: 0 microversion: 2.42 time: 0.454410 Oct 17 13:10:50.674304 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2146/4186] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:10:50 2022] DELETE /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:10:50.681612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:50.683719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:50.691210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.691801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.692213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.692920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.693376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.693946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.834904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:50.842867 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ada762a-2ba9-4678-98c3-b2cb9ad2747e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.166955 Oct 17 13:10:50.843445 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2147/4187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:50 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:50.848048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:50.850498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:50.852448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:50.857440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.858646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.859287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.860008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.860464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.860890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.863171 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-850e8e6d-eebb-480f-9b79-bca4f3810087 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1372 microversion: 2.1 time: 0.276635 Oct 17 13:10:50.863918 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2041/4188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:50 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1372 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:50.869433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-890143939"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:50.873950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:50.880717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.881197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.881630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:50.882515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:50.882966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:50.883416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:51.051339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:51.098883 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f9d3e35c-f32c-4d10-b4d1-129857981dbc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.233272 Oct 17 13:10:51.099571 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2042/4189] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:50 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 13:10:51.105063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:51.105760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:51.112174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:51.112668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:51.113109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:51.113815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:51.114295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:51.114726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:51.338256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:51.347904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:51.349274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:51.350541 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-87bcb481-8b90-4ac3-ad3d-b1f2da4081a9 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2960 microversion: 2.42 time: 0.249774 Oct 17 13:10:51.351096 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2043/4190] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:10:51 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2960 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:10:51.356307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:51.356931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:51.362795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:51.363281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:51.363734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:51.364410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:51.364861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:51.366920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:51.501226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:51.509057 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8f7420c9-8acd-4627-aa13-450950db7c4c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.157019 Oct 17 13:10:51.509627 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2044/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:51 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:51.514773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:51.515377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:51.521176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:51.521661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:51.522097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:51.522890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:51.523354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:51.523783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:51.653789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:51.661674 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f20d8492-12c4-4238-816c-13047706a660 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.151085 Oct 17 13:10:51.662265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2045/4192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:51 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:51.865828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:51.866558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:51.873431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:51.873931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:51.874410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:51.875127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:51.875586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:51.876018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:52.007280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:52.015704 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd713df0-3b1d-4b79-b492-a17b5301a0d7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1477 microversion: 2.1 time: 0.153794 Oct 17 13:10:52.016277 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2046/4193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:51 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:52.020721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:52.021326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:52.027234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:52.027716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:52.028153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:52.028848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:52.029303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:52.029754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:52.164233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:52.173444 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7a5b0afa-3769-4fb1-8af5-91d15a623a36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1372 microversion: 2.1 time: 0.156127 Oct 17 13:10:52.174112 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2047/4194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:52 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:52.380311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:52.380926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:52.388089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:52.388581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:52.389021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:52.389725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:52.390202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:52.390624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:52.927594 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60058a95-3de3-4ad8-b369-b106ba0b692d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action" status: 200 len: 24559 microversion: 2.1 time: 2.082512 Oct 17 13:10:52.935724 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2148/4195] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:10:50 2022] POST /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5/action => generated 24559 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:10:52.943506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:52.944597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:52.952960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:52.953449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:52.953888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:52.954618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:52.955077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:52.955504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:52.972546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:52.981425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:52.991104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:52.992564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:52.993816 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c3f868d-780e-43c3-89ce-90d45bcd9ad1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2960 microversion: 2.42 time: 0.617653 Oct 17 13:10:52.994540 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2048/4196] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:10:52 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2960 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:10:52.999915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:53.000524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:53.007986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:53.008481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:53.008916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:53.009625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:53.010079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:53.010537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:53.111687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:53.119914 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-04ede694-f8dc-485d-940d-8f24ab19575c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.181979 Oct 17 13:10:53.121365 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2149/4197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:52 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:53.125740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:53.126401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:53.132341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:53.133068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:53.133524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:53.134356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:53.135016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:53.135736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:53.181813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:53.190771 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43b03c75-e1eb-4c90-8992-71571ad9e299 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.194342 Oct 17 13:10:53.192173 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2049/4198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:52 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:53.197494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:53.198798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:53.205542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:53.206363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:53.206880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:53.207665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:53.208200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:53.208707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:53.291997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:53.301094 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac890e13-62d6-4d82-a525-5a1d2cfb410f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1476 microversion: 2.1 time: 0.178833 Oct 17 13:10:53.301965 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2150/4199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:53 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:53.325767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-01e9a89a-6ecd-4dc6-bae4-2ee5371517ac req-310611dd-6c6f-4237-8d1f-d52243572715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "name": "network-vif-unplugged", "status": "completed", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:53.335414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-01e9a89a-6ecd-4dc6-bae4-2ee5371517ac req-310611dd-6c6f-4237-8d1f-d52243572715 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:53.336192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-01e9a89a-6ecd-4dc6-bae4-2ee5371517ac req-310611dd-6c6f-4237-8d1f-d52243572715 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:53.336703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-01e9a89a-6ecd-4dc6-bae4-2ee5371517ac req-310611dd-6c6f-4237-8d1f-d52243572715 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:53.350323 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-01e9a89a-6ecd-4dc6-bae4-2ee5371517ac req-310611dd-6c6f-4237-8d1f-d52243572715 service nova] Creating event network-vif-unplugged:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:10:53.357404 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-01e9a89a-6ecd-4dc6-bae4-2ee5371517ac req-310611dd-6c6f-4237-8d1f-d52243572715 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035353 Oct 17 13:10:53.358408 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2151/4200] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:53.389544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:53.399230 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e63bd29-c8d4-4834-ab44-286aca38ac60 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1372 microversion: 2.1 time: 0.205615 Oct 17 13:10:53.399816 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2050/4201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:53 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:53.725110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8ffe9c45-71ab-4fac-ad78-574a65881001 req-7830cac4-3f44-4bd1-acd7-be4fb0f8442c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "name": "network-vif-unplugged", "status": "completed", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:53.736706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8ffe9c45-71ab-4fac-ad78-574a65881001 req-7830cac4-3f44-4bd1-acd7-be4fb0f8442c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:53.737207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8ffe9c45-71ab-4fac-ad78-574a65881001 req-7830cac4-3f44-4bd1-acd7-be4fb0f8442c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:53.737817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8ffe9c45-71ab-4fac-ad78-574a65881001 req-7830cac4-3f44-4bd1-acd7-be4fb0f8442c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:53.751544 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8ffe9c45-71ab-4fac-ad78-574a65881001 req-7830cac4-3f44-4bd1-acd7-be4fb0f8442c service nova] Creating event network-vif-unplugged:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h1-853316-12 Oct 17 13:10:53.757615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-8ffe9c45-71ab-4fac-ad78-574a65881001 req-7830cac4-3f44-4bd1-acd7-be4fb0f8442c service nova] Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:10:53.763990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:53.771791 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8ffe9c45-71ab-4fac-ad78-574a65881001 req-7830cac4-3f44-4bd1-acd7-be4fb0f8442c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054400 Oct 17 13:10:53.772611 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2152/4202] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:10:54.024471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:54.025171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:54.034848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.035351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.036042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.036518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.036979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.037931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.145607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:54.146569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:54.152457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:54.154373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.155323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.155702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.157160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.157781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.160042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.324249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:54.334226 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0cd6527b-7beb-4f83-b72b-226b3c4ea47f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.192466 Oct 17 13:10:54.335040 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2153/4203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:54 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:54.358826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:54.360076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:54.367309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.368058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.368498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.369205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.369664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.370708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.440629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:54.461128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:54.462728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:54.464116 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2da07ee6-581a-413d-a6d3-e981da6f5055 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2960 microversion: 2.42 time: 0.444699 Oct 17 13:10:54.464698 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2051/4204] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:10:54 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2960 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:10:54.490832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:54.504483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:54.519342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.520109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.521071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.525360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.526042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.527062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.596657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:54.605753 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-70d6a6fa-b51d-4191-856d-1bdbf89be3c8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.253675 Oct 17 13:10:54.606356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2154/4205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:54 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:54.624727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:54.625467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:54.633427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.634223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.634728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.635584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:54.636806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:54.637317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:54.785588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:54.794570 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b686cbd-8e7c-4a3f-8bf3-2f384d8a4710 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1372 microversion: 2.1 time: 0.182822 Oct 17 13:10:54.795445 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2155/4206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:54 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:54.899150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:54.907547 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44f2e1c0-8715-4cb6-b0c0-dd6b4ec73b9e tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1476 microversion: 2.1 time: 0.424447 Oct 17 13:10:54.908131 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2052/4207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:54 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:55.361319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:55.362841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:55.366779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:55.373121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.373910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.375571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.379149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.379912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.380578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.384269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b5b97cac-422d-45b1-a34c-18a99e7132c9 req-1266d308-206b-4f25-832a-f86911ff8957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ca72ce-c82a-4daa-93bc-1ad80dea90f1", "name": "network-vif-plugged", "status": "completed", "tag": "bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:55.396218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b5b97cac-422d-45b1-a34c-18a99e7132c9 req-1266d308-206b-4f25-832a-f86911ff8957 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.396987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b5b97cac-422d-45b1-a34c-18a99e7132c9 req-1266d308-206b-4f25-832a-f86911ff8957 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.397593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b5b97cac-422d-45b1-a34c-18a99e7132c9 req-1266d308-206b-4f25-832a-f86911ff8957 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.410588 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b5b97cac-422d-45b1-a34c-18a99e7132c9 req-1266d308-206b-4f25-832a-f86911ff8957 service nova] Creating event network-vif-plugged:bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4 for instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 on n-h2-853316-12 Oct 17 13:10:55.415659 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b5b97cac-422d-45b1-a34c-18a99e7132c9 req-1266d308-206b-4f25-832a-f86911ff8957 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035379 Oct 17 13:10:55.416276 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2053/4208] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:10:55.495871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:55.497471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:55.507317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.507960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.508408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.509194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.509648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.510073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.556856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:55.566128 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90c3b14d-38c9-43ab-9aa2-2cdd5f7fefe5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.212396 Oct 17 13:10:55.566735 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2156/4209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:55 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:55.632052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:55.633097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:55.642454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.643211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.643817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.644522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.645388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.645823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.762565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:55.776661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:55.779474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:55.781429 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ea4a4f73-4156-490e-a209-3787398a4132 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2939 microversion: 2.42 time: 0.290317 Oct 17 13:10:55.782245 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2054/4210] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:10:55 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2939 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:10:55.813902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-1ed5dd52-0960-4c9a-8128-1726a53621ad req-8676ba44-1a0f-4932-aaba-08c464e7a5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:55.824529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1ed5dd52-0960-4c9a-8128-1726a53621ad req-8676ba44-1a0f-4932-aaba-08c464e7a5d1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.825354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1ed5dd52-0960-4c9a-8128-1726a53621ad req-8676ba44-1a0f-4932-aaba-08c464e7a5d1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.826079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1ed5dd52-0960-4c9a-8128-1726a53621ad req-8676ba44-1a0f-4932-aaba-08c464e7a5d1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.840113 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-1ed5dd52-0960-4c9a-8128-1726a53621ad req-8676ba44-1a0f-4932-aaba-08c464e7a5d1 service nova] Creating event network-changed:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h1-853316-12 Oct 17 13:10:55.841602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:55.846513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-1ed5dd52-0960-4c9a-8128-1726a53621ad req-8676ba44-1a0f-4932-aaba-08c464e7a5d1 service nova] Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:10:55.856082 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dce11ef4-f883-4ff9-9609-6129ac8c757e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.229337 Oct 17 13:10:55.857236 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2157/4211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:55 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:55.862020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:55.862973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:55.868856 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-1ed5dd52-0960-4c9a-8128-1726a53621ad req-8676ba44-1a0f-4932-aaba-08c464e7a5d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058735 Oct 17 13:10:55.870722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2055/4212] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:55.871607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.872349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.873101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.874091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.874989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.875606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.931598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:55.933185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:55.940115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.941102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.941794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:55.942746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:55.943430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:55.944095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:56.056701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:56.065400 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2184a7a8-4684-403e-9bfc-c1c6920dde04 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1372 microversion: 2.1 time: 0.206961 Oct 17 13:10:56.066677 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2158/4213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:55 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:56.212753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:56.222866 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70edfa2b-cabe-4aab-876a-dff0d74be0cf tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1474 microversion: 2.1 time: 0.295784 Oct 17 13:10:56.234759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2056/4214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:55 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1474 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:56.594780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:56.595741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:56.603958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:56.606025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:56.606781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:56.607787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:56.608498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:56.609609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:56.783654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:56.793059 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-861a45db-5375-4ec3-a742-a651e332d9dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.201132 Oct 17 13:10:56.793829 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2159/4215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:56 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:56.833135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:56.834492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:56.844183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:56.844708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:56.845155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:56.845879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:56.846374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:56.846922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:56.883573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:56.884685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:56.891844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:56.892751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:56.893379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:56.894144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:56.894826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:56.895315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.076701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:57.086367 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-41fc8755-02f3-4e99-8156-92cfcd0daa92 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.207134 Oct 17 13:10:57.098896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2160/4216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:56 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:57.109899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:57.110764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:57.118551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.119497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.120838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.122403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.123037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.123647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.149844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:57.156012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:57.158135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:57.171195 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ae94e195-3a05-40e7-acef-d5a1bad8a098 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2939 microversion: 2.42 time: 0.352658 Oct 17 13:10:57.172116 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2057/4217] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:10:56 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2939 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:10:57.249379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:57.250057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:57.258517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.259798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.260883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.261770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.262841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.264482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.290486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:57.300096 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b97334de-7c4e-47bc-83fe-21098066ecb7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1565 microversion: 2.1 time: 0.199453 Oct 17 13:10:57.300808 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2161/4218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:57 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:57.325940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:57.326479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:57.334810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.335371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.335826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.336603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.337060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.337488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.430233 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad9a5356-d21f-41f9-949c-761dbb6ee928 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109040 Oct 17 13:10:57.435567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2162/4219] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:10:57 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:10:57.442311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-924457d4-2bce-4f79-96a2-7617162898a3 req-db505a30-ce47-4960-8037-d348e95d84ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-unplugged", "status": "completed", "tag": "3796462d-86a6-4308-9740-cc052a3080f5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:57.450256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:57.457967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-924457d4-2bce-4f79-96a2-7617162898a3 req-db505a30-ce47-4960-8037-d348e95d84ec service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.459150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-924457d4-2bce-4f79-96a2-7617162898a3 req-db505a30-ce47-4960-8037-d348e95d84ec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.459656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-924457d4-2bce-4f79-96a2-7617162898a3 req-db505a30-ce47-4960-8037-d348e95d84ec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.462044 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba6cb34e-0114-40d0-9c8d-8e37f3a6a94d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1474 microversion: 2.1 time: 0.218411 Oct 17 13:10:57.464700 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2058/4220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:57 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1474 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:57.478677 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-924457d4-2bce-4f79-96a2-7617162898a3 req-db505a30-ce47-4960-8037-d348e95d84ec service nova] Creating event network-vif-unplugged:3796462d-86a6-4308-9740-cc052a3080f5 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:10:57.487898 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-924457d4-2bce-4f79-96a2-7617162898a3 req-db505a30-ce47-4960-8037-d348e95d84ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050678 Oct 17 13:10:57.490128 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2163/4221] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:57.838333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:57.840357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:57.855483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.856297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.857035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.857765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:57.858408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:57.859038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:57.885988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:10:58.114137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:58.115903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:58.123301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:58.124030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:58.124632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:58.125904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:58.126660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:58.127248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:58.179268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:58.190251 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b298f91-5f01-44e5-aabe-f64115060938 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.370128 Oct 17 13:10:58.190780 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2059/4222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:57 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:10:58.202100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:58.204386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:58.215173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:58.218267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:58.219201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:58.219948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:58.220414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:58.220847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:58.330866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:58.346125 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f8d5b5b-5b52-4e1e-b634-e35e6a3053d8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.236987 Oct 17 13:10:58.346775 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2164/4223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:58 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:58.489272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:58.490971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:58.501270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:58.502028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:58.502695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:58.503529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:58.504544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:58.505162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:58.666097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:58.674550 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-efffd829-9668-42e5-82a6-fca07bfc75d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1474 microversion: 2.1 time: 0.189406 Oct 17 13:10:58.675142 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2165/4224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:58 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1474 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:58.860757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2be15bbf-888d-4892-992c-d6a4b67611b2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Action: 'create', calling method: .version_select at 0x7fa81be6ad30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1239119533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRo1r6pnvrNF/6hZ84PKhW/8LYvYgNhSHtXVxK1nFKH+ICtdYxiCwUDU5Zv6SOJyrjRAKIA9Z+eyZmiFkaE7v4sZoCWfY0X/ojd//XVtgq/CatdhVE0ZD4WHQqwJE+yQw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:58.876198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2be15bbf-888d-4892-992c-d6a4b67611b2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Getting quotas for project 8096ad9cc4a242b1a3ecf4cdb9a2dcb0. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:10:58.881199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2be15bbf-888d-4892-992c-d6a4b67611b2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Getting quotas for user efab0c775fd94096912d8844df7457b6 and project 8096ad9cc4a242b1a3ecf4cdb9a2dcb0. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:10:58.906979 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2be15bbf-888d-4892-992c-d6a4b67611b2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.230637 Oct 17 13:10:58.907588 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2166/4225] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:10:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:58.949644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:58.960200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:58.962054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:58.963383 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1f85bc65-05ba-4d4e-9053-a2e423e5dac7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2939 microversion: 2.42 time: 0.765993 Oct 17 13:10:58.981959 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2060/4226] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:10:58 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2939 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:10:59.138114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-70ba2c9d-6de7-457c-b89d-a44ec64c40fb req-16db8df3-6ea4-4598-8d1c-bd090ab221da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ca72ce-c82a-4daa-93bc-1ad80dea90f1", "tag": "bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:59.154055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-70ba2c9d-6de7-457c-b89d-a44ec64c40fb req-16db8df3-6ea4-4598-8d1c-bd090ab221da service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:59.154809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-70ba2c9d-6de7-457c-b89d-a44ec64c40fb req-16db8df3-6ea4-4598-8d1c-bd090ab221da service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:59.155451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-70ba2c9d-6de7-457c-b89d-a44ec64c40fb req-16db8df3-6ea4-4598-8d1c-bd090ab221da service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:59.167737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-70ba2c9d-6de7-457c-b89d-a44ec64c40fb req-16db8df3-6ea4-4598-8d1c-bd090ab221da service nova] Creating event network-changed:bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4 for instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 on n-h2-853316-12 Oct 17 13:10:59.173596 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-70ba2c9d-6de7-457c-b89d-a44ec64c40fb req-16db8df3-6ea4-4598-8d1c-bd090ab221da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040572 Oct 17 13:10:59.174877 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2167/4227] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:59.218865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:59.219827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:59.237079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:59.238190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:59.239206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:59.240854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:59.243006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:59.244648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:59.377205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:59.378117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:59.399891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:59.400793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:59.401865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:59.405598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:59.406191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:59.406946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:59.717296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:10:59.725954 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ed045a5-0308-4af0-982a-ba1573de8776 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.354451 Oct 17 13:10:59.726575 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2168/4228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:59 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:10:59.747661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-unplugged", "status": "completed", "tag": "037a67ef-17b4-4934-9932-ff5de09b20a1"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-unplugged", "status": "completed", "tag": "d42ee3ac-da2f-45ea-ae11-913f70990f8d"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-unplugged", "status": "completed", "tag": "b6d1e2b2-34a9-4cea-a23e-66a20792cbc9"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-unplugged", "status": "completed", "tag": "025f2a1c-bddb-4db6-92ff-a5f29cba7b91"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-unplugged", "status": "completed", "tag": "800b13ad-79c1-429e-ab7f-36ad171e6e50"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:10:59.762359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:59.763694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:59.764768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:59.786311 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Creating event network-vif-unplugged:037a67ef-17b4-4934-9932-ff5de09b20a1 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:10:59.787264 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Creating event network-vif-unplugged:d42ee3ac-da2f-45ea-ae11-913f70990f8d for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:10:59.788006 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Creating event network-vif-unplugged:b6d1e2b2-34a9-4cea-a23e-66a20792cbc9 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:10:59.788745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Creating event network-vif-unplugged:025f2a1c-bddb-4db6-92ff-a5f29cba7b91 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:10:59.789532 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] Creating event network-vif-unplugged:800b13ad-79c1-429e-ab7f-36ad171e6e50 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:10:59.798340 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2a3c14b8-0fdc-489b-84cd-a8b2e63bd27f req-12c14bfc-c3bb-4259-99f3-bc64dd94c653 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.054512 Oct 17 13:10:59.799292 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2169/4229] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:10:59.816958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:10:59.818080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:10:59.833328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:59.833833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:59.834303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:59.835023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:10:59.835485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:10:59.843016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:10:59.867328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:00.173187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:00.183018 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ad3d13a-8d0e-404b-b7f2-224dc5bb9b70 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1684 microversion: 2.1 time: 0.968884 Oct 17 13:11:00.188687 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2061/4230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:59 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1684 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:00.206446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:00.209105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:00.223818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:00.224361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:00.227621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:00.228604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:00.229278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:00.229775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:00.292686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:00.304908 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7ef1f9f-dd6b-4c7a-b232-06dbec2d74ab tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1471 microversion: 2.1 time: 0.504163 Oct 17 13:11:00.305996 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2170/4231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:10:59 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:00.328521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:00.329142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:00.335835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:00.339504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:00.340116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:00.340930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:00.342103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:00.342765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:00.488904 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46d3d850-9068-4d19-a4a3-01f5d39c6321 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "POST /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb/action" status: 202 len: 0 microversion: 2.1 time: 0.164190 Oct 17 13:11:00.493026 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2171/4232] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:11:00 2022] POST /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:11:00.499411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:00.500315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:00.507213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:00.507848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:00.508569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:00.509912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:00.511125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:00.512046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:00.866773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:00.869346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:00.880663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2df4a166-7d2a-4938-aafd-d2d63ea0c476 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.386021 Oct 17 13:11:00.885042 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2172/4233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:00 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:00.898620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:00.898620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:00.898620 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d616218-98be-4286-9c09-99b6dbb66143 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2939 microversion: 2.42 time: 0.698849 Oct 17 13:11:00.898620 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2062/4234] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:00 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2939 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:00.898957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:00.898957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:00.901035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:00.901035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:00.906209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:00.906209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:00.910251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:00.918744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:01.141065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:01.155975 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0aeb5760-c83f-4467-a34e-149eb7cc0cf1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.269725 Oct 17 13:11:01.156855 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2173/4235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:00 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:01.218474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:01.219718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:01.227337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:01.227931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:01.228449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:01.229233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:01.229817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:01.230346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:01.607993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:01.616068 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71b33fbb-50a2-4d4c-9c90-766f1dbe49a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1684 microversion: 2.1 time: 0.403925 Oct 17 13:11:01.616913 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2063/4236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:01 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1684 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:01.913049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:01.914487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:01.921800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:01.922336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:01.922802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:01.928472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:01.929104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:01.936315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:01.936853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:01.937061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:01.937739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:01.938343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:01.938680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:01.939636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:01.940358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:01.941027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:02.226320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:02.247879 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe1c7e1b-265e-4af7-8dd7-0ae7b777470f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.336036 Oct 17 13:11:02.264592 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2174/4237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:01 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:02.270319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:02.273860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:02.284328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:02.285153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:02.285768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:02.287131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:02.287742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:02.288550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:02.529103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:02.555659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:02.557253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:02.562830 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-56d4f7e2-3789-4b9b-a375-25de2fcdba46 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2918 microversion: 2.42 time: 0.636194 Oct 17 13:11:02.563503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2064/4238] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:01 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2918 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:02.611920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:02.621176 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f65b231f-98a0-4d4f-979b-cac4c6fac9f7 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1516 microversion: 2.1 time: 0.354459 Oct 17 13:11:02.622248 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2175/4239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:02 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1516 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:02.641863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:02.642560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:02.654877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:02.655344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:02.656297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:02.657202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:02.657854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:02.658472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:02.928417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5a53d5b0-cc06-4355-8cbd-c19cf9879c18 req-d57b377a-6b86-41e2-a4a5-81d958b271a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-deleted", "tag": "d42ee3ac-da2f-45ea-ae11-913f70990f8d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:02.962205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:02.975225 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-972e3ec8-62a0-4a4a-b875-5608e0f507f3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1684 microversion: 2.1 time: 0.338156 Oct 17 13:11:02.977000 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2065/4240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:02 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1684 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:02.980371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5a53d5b0-cc06-4355-8cbd-c19cf9879c18 req-d57b377a-6b86-41e2-a4a5-81d958b271a4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:02.981235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5a53d5b0-cc06-4355-8cbd-c19cf9879c18 req-d57b377a-6b86-41e2-a4a5-81d958b271a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:02.982023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5a53d5b0-cc06-4355-8cbd-c19cf9879c18 req-d57b377a-6b86-41e2-a4a5-81d958b271a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:03.030584 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5a53d5b0-cc06-4355-8cbd-c19cf9879c18 req-d57b377a-6b86-41e2-a4a5-81d958b271a4 service nova] Creating event network-vif-deleted:d42ee3ac-da2f-45ea-ae11-913f70990f8d for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:11:03.048981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5a53d5b0-cc06-4355-8cbd-c19cf9879c18 req-d57b377a-6b86-41e2-a4a5-81d958b271a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134618 Oct 17 13:11:03.061254 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2176/4241] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:11:03.273208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:03.274255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:03.281823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:03.282710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:03.283423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:03.284424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:03.285104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:03.285708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:03.371546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d6cfb895-3968-47fa-9085-d30588831e8e req-598bc01b-0989-4975-91f8-e981a514e916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "name": "network-vif-plugged", "status": "completed", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:03.396285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d6cfb895-3968-47fa-9085-d30588831e8e req-598bc01b-0989-4975-91f8-e981a514e916 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:03.396899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d6cfb895-3968-47fa-9085-d30588831e8e req-598bc01b-0989-4975-91f8-e981a514e916 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:03.397341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d6cfb895-3968-47fa-9085-d30588831e8e req-598bc01b-0989-4975-91f8-e981a514e916 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:03.427604 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d6cfb895-3968-47fa-9085-d30588831e8e req-598bc01b-0989-4975-91f8-e981a514e916 service nova] Creating event network-vif-plugged:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h1-853316-12 Oct 17 13:11:03.450266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-d6cfb895-3968-47fa-9085-d30588831e8e req-598bc01b-0989-4975-91f8-e981a514e916 service nova] Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:11:03.475939 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d6cfb895-3968-47fa-9085-d30588831e8e req-598bc01b-0989-4975-91f8-e981a514e916 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112935 Oct 17 13:11:03.480536 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2177/4242] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:03.516320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:03.527989 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-95893610-e77b-4d3d-bcaf-17ed8d671626 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.258980 Oct 17 13:11:03.529229 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2066/4243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:03 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:03.593354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:03.594084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:03.612363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:03.615747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:03.618511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:03.623354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:03.625064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:03.625942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:03.652871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:03.653817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:03.666506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:03.667366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:03.667956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:03.668734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:03.673294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:03.674526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:03.987243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:04.003204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:04.014969 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2b2c0420-6b94-4f31-9e54-1ec63a3e01b4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1522 microversion: 2.1 time: 0.368811 Oct 17 13:11:04.015907 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2067/4244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:03 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:04.016590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:04.021058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:04.025538 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe9d9677-f340-4a2f-9f65-c0f9b7f8aeba tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2871 microversion: 2.42 time: 0.437530 Oct 17 13:11:04.027861 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2178/4245] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:03 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2871 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:04.031309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:04.032400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:04.052817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:04.053976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:04.054659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:04.056858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:04.064842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:04.065836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:04.411078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:04.422317 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f99ecbfd-f466-4a84-b905-e2a0e68efbe8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1684 microversion: 2.1 time: 0.397983 Oct 17 13:11:04.423058 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2068/4246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:04 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1684 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:04.563038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:04.563921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:04.576585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:04.577629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:04.578657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:04.580195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:04.582088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:04.582667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.028008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:05.045789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:05.047856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:05.053956 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1361268-d75b-4914-bce7-9044e2a806e0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.504125 Oct 17 13:11:05.057027 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2179/4247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:04 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:05.059387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:05.060057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:05.060653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.061543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:05.062150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:05.062752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.077390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:05.078437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:05.089277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:05.090756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:05.092722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.096913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:05.097710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:05.098841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.631855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:05.664670 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c657a414-c494-4409-88a6-0fe90b114ac0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1522 microversion: 2.1 time: 0.624393 Oct 17 13:11:05.685806 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2069/4248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:05 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:05.711247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-406b958c-73d8-4420-af9a-3b8b97c598ea req-a85fa1c0-0970-4c6f-8f84-31e6319c59e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-deleted", "tag": "3796462d-86a6-4308-9740-cc052a3080f5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:05.732228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-406b958c-73d8-4420-af9a-3b8b97c598ea req-a85fa1c0-0970-4c6f-8f84-31e6319c59e2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:05.732898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-406b958c-73d8-4420-af9a-3b8b97c598ea req-a85fa1c0-0970-4c6f-8f84-31e6319c59e2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:05.733615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-406b958c-73d8-4420-af9a-3b8b97c598ea req-a85fa1c0-0970-4c6f-8f84-31e6319c59e2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.754628 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-406b958c-73d8-4420-af9a-3b8b97c598ea req-a85fa1c0-0970-4c6f-8f84-31e6319c59e2 service nova] Creating event network-vif-deleted:3796462d-86a6-4308-9740-cc052a3080f5 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:11:05.758782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:05.761801 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-406b958c-73d8-4420-af9a-3b8b97c598ea req-a85fa1c0-0970-4c6f-8f84-31e6319c59e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074318 Oct 17 13:11:05.763227 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2070/4249] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:05.770411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:05.771900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:05.773872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:05.784322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:05.785026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:05.785664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.786051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:05.786777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:05.787421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:05.787868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.791320 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18e4dc14-54ff-4bcd-b0da-485404a4d56a tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2533 microversion: 2.42 time: 0.714705 Oct 17 13:11:05.792977 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2180/4250] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:05 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2533 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:05.812232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-01bd6310-43a4-43ae-83ff-c4b6d7194ffc req-ebd656cd-bb1f-48f7-9ecb-986539f06cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "name": "network-vif-plugged", "status": "completed", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:05.843654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-01bd6310-43a4-43ae-83ff-c4b6d7194ffc req-ebd656cd-bb1f-48f7-9ecb-986539f06cb2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:05.844145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-01bd6310-43a4-43ae-83ff-c4b6d7194ffc req-ebd656cd-bb1f-48f7-9ecb-986539f06cb2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:05.844571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-01bd6310-43a4-43ae-83ff-c4b6d7194ffc req-ebd656cd-bb1f-48f7-9ecb-986539f06cb2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:05.875688 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-01bd6310-43a4-43ae-83ff-c4b6d7194ffc req-ebd656cd-bb1f-48f7-9ecb-986539f06cb2 service nova] Creating event network-vif-plugged:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:11:05.884176 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-01bd6310-43a4-43ae-83ff-c4b6d7194ffc req-ebd656cd-bb1f-48f7-9ecb-986539f06cb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083576 Oct 17 13:11:05.885261 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2181/4251] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:06.080534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:06.082185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:06.093727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:06.094649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:06.095544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:06.096499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:06.100746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:06.101264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:06.399885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:06.422524 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ef89fe7-db55-45d5-b44f-0074d782af99 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1684 microversion: 2.1 time: 0.645279 Oct 17 13:11:06.434331 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2071/4252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:05 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1684 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:06.693582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:06.694238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:06.716552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:06.717474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:06.718095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:06.719023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:06.724191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:06.724894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:06.881162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:06.892237 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c4d405a-f279-40bd-a576-e1d5e1a2bc8d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.816263 Oct 17 13:11:06.896730 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2182/4253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:06 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:06.912257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:06.914280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:06.929976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:06.933399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:06.934442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:06.948953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:06.951247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:06.956219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:07.331013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:07.340838 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eea30a81-d7e7-441f-8d54-71ce1940577d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1522 microversion: 2.1 time: 0.652941 Oct 17 13:11:07.345628 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2072/4254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:06 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1522 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:07.452574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:07.453032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:07.462678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:07.463192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:07.478855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:07.479877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:07.480378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:07.480833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:07.527911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:07.546812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:07.553754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:07.555638 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-801669cd-0776-4abe-9559-ae926937ac32 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2372 microversion: 2.42 time: 0.657363 Oct 17 13:11:07.593682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2183/4255] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:06 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2372 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:07.880203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-deleted", "tag": "b6d1e2b2-34a9-4cea-a23e-66a20792cbc9"}, {"server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "name": "network-vif-unplugged", "status": "completed", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-deleted", "tag": "800b13ad-79c1-429e-ab7f-36ad171e6e50"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:07.924224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:07.925037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:07.925645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:07.946316 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] Creating event network-vif-deleted:b6d1e2b2-34a9-4cea-a23e-66a20792cbc9 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:11:07.947104 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] Creating event network-vif-unplugged:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h2-853316-12 Oct 17 13:11:07.948260 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] Creating event network-vif-deleted:800b13ad-79c1-429e-ab7f-36ad171e6e50 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:11:07.956130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:11:07.980683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0aca9845-f66a-4be9-bb61-ceed8c820952 req-1ceaff3b-e97e-4512-9341-81b3602ca30f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.109949 Oct 17 13:11:07.982341 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2184/4256] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:07.991750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:07.993224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:08.030873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:08.031640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:08.032415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:08.035778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:08.038591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:08.039274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:08.218946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:08.230816 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd9f8e08-7d35-4a09-ab37-d4af7408d950 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.783120 Oct 17 13:11:08.237512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2073/4257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:07 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:08.309528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:08.332287 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8e6e05e-80ab-49ab-a2b7-dadda3f654ac tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.345149 Oct 17 13:11:08.333370 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2185/4258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:07 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:08.371819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:08.372709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:08.387834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:08.390548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:08.391184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:08.393369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:08.394761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:08.397836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:08.589915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:08.591483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:08.606886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:08.607719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:08.608388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:08.609401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:08.610314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:08.610987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:08.889267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:09.013542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:09.033414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:09.034033 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-37dd0d4b-4bb5-416e-859b-6c8317bc9e66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1522 microversion: 2.1 time: 0.667650 Oct 17 13:11:09.035133 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2074/4259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:08 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:09.064738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:09.067235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:09.069014 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5575ce66-80bc-4c44-bf95-db523462467d tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 2055 microversion: 2.42 time: 0.483548 Oct 17 13:11:09.083036 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2186/4260] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:08 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 2055 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:09.266467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:09.267149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:09.293567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:09.294083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:09.296442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:09.305374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:09.306198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:09.306868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:09.371290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:09.376509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:09.405700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:09.410711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:09.411889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:09.413405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:09.417953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:09.423886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:09.471971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:09.730481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:09.740702 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e0d0a775-148f-4952-ab3b-6f3d440e6f3c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.379389 Oct 17 13:11:09.741295 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2187/4261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:09 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:09.821732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:09.837647 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e91cb985-96f3-4d14-98ac-ecc2e340a4f8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.574835 Oct 17 13:11:09.840619 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2075/4262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:09 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:10.034671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-bc75a453-eded-4649-b4fb-6b07bfd4802b req-b060a0d6-1898-4ef1-9651-1916e3af2c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}, {"server_uuid": "9f020194-d135-4f53-8a62-266832996cda", "name": "network-vif-deleted", "tag": "037a67ef-17b4-4934-9932-ff5de09b20a1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:10.057936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-bc75a453-eded-4649-b4fb-6b07bfd4802b req-b060a0d6-1898-4ef1-9651-1916e3af2c4c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:10.068162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:10.069644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:10.079384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-bc75a453-eded-4649-b4fb-6b07bfd4802b req-b060a0d6-1898-4ef1-9651-1916e3af2c4c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:10.083290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:10.084370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-bc75a453-eded-4649-b4fb-6b07bfd4802b req-b060a0d6-1898-4ef1-9651-1916e3af2c4c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:10.091323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:10.092148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:10.100868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:10.105611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:10.106335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:10.127946 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-bc75a453-eded-4649-b4fb-6b07bfd4802b req-b060a0d6-1898-4ef1-9651-1916e3af2c4c service nova] Creating event network-changed:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h2-853316-12 Oct 17 13:11:10.134814 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-bc75a453-eded-4649-b4fb-6b07bfd4802b req-b060a0d6-1898-4ef1-9651-1916e3af2c4c service nova] Creating event network-vif-deleted:037a67ef-17b4-4934-9932-ff5de09b20a1 for instance 9f020194-d135-4f53-8a62-266832996cda on n-h1-853316-12 Oct 17 13:11:10.154028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-bc75a453-eded-4649-b4fb-6b07bfd4802b req-b060a0d6-1898-4ef1-9651-1916e3af2c4c service nova] Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:11:10.202716 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-bc75a453-eded-4649-b4fb-6b07bfd4802b req-b060a0d6-1898-4ef1-9651-1916e3af2c4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.172980 Oct 17 13:11:10.206728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2188/4263] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:10.212783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:10.219437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:10.232713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:10.237519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:10.239188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:10.240170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:10.240633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:10.241068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:10.399304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:10.409685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:10.411169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:10.419663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fed5f73-c90f-428e-9301-3faa24b3f2db tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.211305 Oct 17 13:11:10.422674 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2189/4264] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:10 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:10.427493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-679056250-access_point-982406812", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "5343e106-4d3f-444a-932d-0ca85661e8d7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1239119533", "security_groups": [{"name": "tempest-secgroup_access--2035884965"}, {"name": "tempest-secgroup_general--1893597583"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:10.779845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] validate_networks() for [('5343e106-4d3f-444a-932d-0ca85661e8d7', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:11:11.344524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:11.348845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:11.365412 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a871def0-00ba-4d36-8eee-1859644e8ba8 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1522 microversion: 2.1 time: 1.304705 Oct 17 13:11:11.366044 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2076/4265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:10 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1522 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:11.396407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:11.397562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:11.419629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:11.421060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:11.421716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:11.423411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:11.424632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:11.425232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:11.694718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:11:11.695278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:11:11.696372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:11:11.697384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:11:11.698042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:11:11.712061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:11.714642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:11.716343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:11.717574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:11.719765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:11.720359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:11.788414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Getting quotas for project 8096ad9cc4a242b1a3ecf4cdb9a2dcb0. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:11:11.802284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Getting quotas for user efab0c775fd94096912d8844df7457b6 and project 8096ad9cc4a242b1a3ecf4cdb9a2dcb0. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:11:11.817043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:11.838124 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b2d6745e-c8f8-4e61-99c6-e860f39e1aed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.459050 Oct 17 13:11:11.839803 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2077/4266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:11 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:11.842156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:11:11.844496 n-d-853316-12 devstack@n-api.service[127540]: WARNING nova.utils [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-679056250-access_point-982406812 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-679056250-acc Oct 17 13:11:11.845444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:11:11.854970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:11.865014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:11.880966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:11.881814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:11.882855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:11.884292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:11.888218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:11.893225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:11.962675 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78b16f1a-2c21-4341-a947-c738b404e2a2 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.538972 Oct 17 13:11:11.971898 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2190/4267] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:11:10 2022] POST /compute/v2.1/servers => generated 458 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:11:11.984372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-00e1ae17-bc1d-4bb7-bb2c-e81826cbd090 req-4f873bdb-ff90-436b-93cd-36690e89bddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb587b1-1e80-467b-bee5-bc89f62360c2", "name": "network-vif-plugged", "status": "completed", "tag": "e1b91c9e-a498-4d68-9b3a-f7c9b11b8b56"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:11.995535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:11.998385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-00e1ae17-bc1d-4bb7-bb2c-e81826cbd090 req-4f873bdb-ff90-436b-93cd-36690e89bddd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:11.999478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-00e1ae17-bc1d-4bb7-bb2c-e81826cbd090 req-4f873bdb-ff90-436b-93cd-36690e89bddd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:12.000213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-00e1ae17-bc1d-4bb7-bb2c-e81826cbd090 req-4f873bdb-ff90-436b-93cd-36690e89bddd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:12.014789 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-00e1ae17-bc1d-4bb7-bb2c-e81826cbd090 req-4f873bdb-ff90-436b-93cd-36690e89bddd service nova] Creating event network-vif-plugged:e1b91c9e-a498-4d68-9b3a-f7c9b11b8b56 for instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 on n-h2-853316-12 Oct 17 13:11:12.021955 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-00e1ae17-bc1d-4bb7-bb2c-e81826cbd090 req-4f873bdb-ff90-436b-93cd-36690e89bddd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048208 Oct 17 13:11:12.023385 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2191/4268] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:12.030150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:12.031873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:12.040997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:12.042496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:12.043920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:12.046478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:12.049993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:12.052273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:12.210248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:12.223453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:12.225513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:12.226926 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2889fc5-84cf-4aa8-8544-43e5e0b05838 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.202139 Oct 17 13:11:12.227925 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2192/4269] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:12 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:12.233376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07789280-53b7-4e06-b28b-dcfa5a56552a tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:12.242016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07789280-53b7-4e06-b28b-dcfa5a56552a tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:12.341243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-07789280-53b7-4e06-b28b-dcfa5a56552a tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:12.349485 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07789280-53b7-4e06-b28b-dcfa5a56552a tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1293 microversion: 2.1 time: 0.120293 Oct 17 13:11:12.350496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:12.351035 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2193/4270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:12 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1293 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:12.377604 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad7a324f-8fd2-4706-99b7-ce7ca1e35320 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.533650 Oct 17 13:11:12.379245 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2078/4271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:11 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:12.400464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:12.401680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:12.413646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:12.414457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:12.415062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:12.418486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:12.420061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:12.421140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:12.681395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:12.714454 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d152ae83-f266-4bed-a7cf-cecd7511d901 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1522 microversion: 2.1 time: 0.314882 Oct 17 13:11:12.715580 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2194/4272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:12 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:12.865097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:12.865774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:12.869148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=97 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:12.880770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:12.884412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:12.884936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:12.887412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:12.888394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:12.888841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.227596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:13.250084 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b0ddbc04-aa4e-45d9-8e8e-3025444558ed tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1470 microversion: 2.1 time: 0.388915 Oct 17 13:11:13.263199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:13.263990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:13.268777 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2079/4273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:12 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:13.279631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:13.280188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:13.280745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.281579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:13.301400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:13.304748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.376908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:13.381719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:13.392046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:13.392833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:13.393438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.394391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:13.395000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:13.395787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.549000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:13.558426 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-22adacfa-5170-4d8d-848c-d711f5abbb01 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1289 microversion: 2.1 time: 0.185449 Oct 17 13:11:13.559874 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2080/4274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:13 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1289 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:13.565369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:13.566271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:13.573692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:13.574771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:13.575382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.576276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:13.577515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:13.578124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.594206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:13.619751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:13.624665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:13.629120 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b39db195-0690-40a2-b89a-a5a0798dafb8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.372995 Oct 17 13:11:13.630591 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2195/4275] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:13 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:13.740495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:13.741051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:13.756787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:13.757290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:13.757734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.758507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:13.758968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:13.770219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:13.997867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:14.013463 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-add5d8f7-61f6-4322-bc10-92811980426f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.451500 Oct 17 13:11:14.016386 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2081/4276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:13 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:14.190257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:14.212110 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae715ad1-2c53-4254-8021-40d19a47d601 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1522 microversion: 2.1 time: 0.476817 Oct 17 13:11:14.212756 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2196/4277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:13 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:14.276180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:14.277400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:14.290355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:14.292847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:14.298002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:14.299305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:14.306851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:14.314218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:14.590808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:14.592251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:14.616122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:14.616697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:14.617161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:14.622665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:14.630230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:14.631168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:14.889252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:14.909514 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-042dd89f-4563-4985-9c95-6887a1a670fe tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1353 microversion: 2.1 time: 0.324018 Oct 17 13:11:14.918354 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2197/4278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:14 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1353 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:14.936531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:14.944148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:14.966198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:14.967012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:14.967814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:14.971769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:14.973361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:14.974459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.130998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:15.146078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:15.147585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:15.148796 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eb6e6cd1-d82a-4e13-b153-7dc707e51ed8 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.227086 Oct 17 13:11:15.149359 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2198/4279] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:14 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:15.324803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:15.325304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:15.347642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:15.348483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:15.349086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.350004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:15.350659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:15.351244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.363079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:15.378089 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44afae2a-d5a7-4aac-a314-4d1674f1dbe7 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1463 microversion: 2.1 time: 1.105946 Oct 17 13:11:15.395974 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2082/4280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:14 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1463 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:15.422392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:15.437928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:15.439014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:15.446199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:15.448585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:15.454450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.455478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:15.456133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:15.456742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.624427 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2264d02f-fbbe-48ed-9d49-27e2764f534c tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "DELETE /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 204 len: 0 microversion: 2.1 time: 0.473069 Oct 17 13:11:15.626081 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2199/4281] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:15 2022] DELETE /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:11:15.633220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:15.634546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:15.652327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:15.653200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:15.653980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.654958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:15.655939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:15.656830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.782634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:15.795547 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-526e9295-0443-4ba3-af2e-d2a94742362e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.384547 Oct 17 13:11:15.796572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2083/4282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:15 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:15.806886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:15.808046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:15.821095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:15.824315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:15.826099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.827310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:15.829459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:15.830098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:15.973541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:15.985977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-387e8c82-34b8-4662-8ea0-4ad1749a697f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1507 microversion: 2.1 time: 0.358171 Oct 17 13:11:15.986729 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2200/4283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:15 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1507 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:16.014838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:16.015989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:16.024447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.025554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.026368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.028136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.028728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.029268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.178755 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-147d7caf-6e84-42a0-8214-9333d9dccdd9 tempest-MigrationsAdminTest-2124484477 tempest-MigrationsAdminTest-2124484477-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1616 microversion: 2.1 time: 0.380896 Oct 17 13:11:16.180754 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2084/4284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:15 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1616 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:16.186820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:16.187735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:16.194457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.195783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.196454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.197950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.200286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.200917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.267273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:16.277329 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49702af3-f76d-41ac-a787-81e52870899a tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1734 microversion: 2.1 time: 0.273689 Oct 17 13:11:16.291189 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2201/4285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:15 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1734 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:16.302027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:16.303102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:16.311561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.312413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.313073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.314031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.314927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.315563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.506768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:16.508228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:16.554424 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b26a134-e08f-44fc-9bfb-d6678ffe3f72 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 200 len: 1507 microversion: 2.1 time: 0.258410 Oct 17 13:11:16.556094 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2202/4286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:16 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:16.556994 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51232a3d-7a41-4fad-a582-9c6af3d401b6 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1351 microversion: 2.1 time: 0.373774 Oct 17 13:11:16.570981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:16.573034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:16.576529 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2085/4287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:16 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1351 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:16.586511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:16.587103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:16.594467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.596386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.597421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.599230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.602516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.603012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.607726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.608296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.608746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.609471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.609933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.610406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.666222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:16.764590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:16.783844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:16.785715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:16.787282 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9af22955-a7b8-4fc1-89e3-a995b8caa7bb tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.226685 Oct 17 13:11:16.799551 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2203/4288] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:16 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:16.843341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:16.844304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:16.853938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.855536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.855795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.856469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:16.862922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:16.865426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:16.919906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8c1d779a-4553-40fe-b971-de1b356a9df0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 204 len: 0 microversion: 2.1 time: 0.341909 Oct 17 13:11:16.922762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:16.932805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:16.938590 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2086/4289] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:16 2022] DELETE /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:11:16.950212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-edc21ae9-7a31-4c97-bb83-c300efef2a62 req-f451c81a-e0d0-4f82-a17c-39ba98f84a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "name": "network-vif-plugged", "status": "completed", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:17.013740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-edc21ae9-7a31-4c97-bb83-c300efef2a62 req-f451c81a-e0d0-4f82-a17c-39ba98f84a03 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:17.016315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-edc21ae9-7a31-4c97-bb83-c300efef2a62 req-f451c81a-e0d0-4f82-a17c-39ba98f84a03 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:17.017911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-edc21ae9-7a31-4c97-bb83-c300efef2a62 req-f451c81a-e0d0-4f82-a17c-39ba98f84a03 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:17.051626 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-edc21ae9-7a31-4c97-bb83-c300efef2a62 req-f451c81a-e0d0-4f82-a17c-39ba98f84a03 service nova] Creating event network-vif-plugged:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h2-853316-12 Oct 17 13:11:17.069476 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-edc21ae9-7a31-4c97-bb83-c300efef2a62 req-f451c81a-e0d0-4f82-a17c-39ba98f84a03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126983 Oct 17 13:11:17.071611 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2087/4290] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:17.090679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:17.094499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:17.113282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:17.114083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:17.114828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:17.116550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:17.118290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:17.118843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:17.152840 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68500035-82b5-49f7-a1ae-e2bd3311fc66 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 204 len: 0 microversion: 2.1 time: 0.349919 Oct 17 13:11:17.153669 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2204/4291] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:16 2022] DELETE /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:11:17.165653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:17.166884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:17.179013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:17.183849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:17.186251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:17.188782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:17.189393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:17.189940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:17.385124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:17.397149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-79ba2c62-ee27-4d0d-a967-1866e88cc735 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1469 microversion: 2.1 time: 0.241439 Oct 17 13:11:17.398552 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2205/4292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:17 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:17.405528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:17.406524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:17.424018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:17.424799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:17.425462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:17.426443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:17.427118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:17.427960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:17.620624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:17.630585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5315c70c-8ce2-40a4-ab83-37f1fa16b9b8 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1734 microversion: 2.1 time: 0.229989 Oct 17 13:11:17.633501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2206/4293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:17 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:17.658785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-89693433", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e53d95a2-0561-4745-a443-7230dc4fc44a"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:17.748062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] validate_networks() for [('e53d95a2-0561-4745-a443-7230dc4fc44a', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:11:18.022242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:18.035160 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e1225ff-ec48-44ef-88ed-aaa848e74866 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.959836 Oct 17 13:11:18.036847 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2088/4294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:17 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:18.056364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:18.057492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:18.072339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:18.073773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:18.074570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:18.075551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:18.076202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:18.076822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:18.380535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:11:18.381011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:11:18.381414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:11:18.381941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:11:18.382527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:11:18.397928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:18.398701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:18.399260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:18.400124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:18.400697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:18.401479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:18.426149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Getting quotas for project 7a7fe0bfe98b4320be690d525152f6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:11:18.435704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Getting quotas for user f2af8096ed394d02bdf6c285e17df1f7 and project 7a7fe0bfe98b4320be690d525152f6f1. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:11:18.454442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:11:18.457617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:11:18.543316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:18.562977 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-acb82aa0-d498-4068-a41c-0cff28dcadfa tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 0.525014 Oct 17 13:11:18.570358 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ef9fa359-6b82-4a66-962d-4e362d5d3975 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921014 Oct 17 13:11:18.574641 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2089/4295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:18 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:18.583199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2207/4296] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:11:18.587230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:18.592414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:18.593232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:18.595886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:18.614631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:18.615548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:18.616863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:18.617857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:18.618730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:18.619375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:18.629874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:18.638553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:18.639033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:18.639849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:18.640328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:18.640765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:18.884190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:18.894084 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44c9d763-2877-4cfe-ac02-d98ee911c34f tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1469 microversion: 2.1 time: 0.309828 Oct 17 13:11:18.898708 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2208/4297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:18 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1469 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:18.926947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c25e08ee-ab3e-4df1-8995-204c9ce13fd5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:18.929782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c25e08ee-ab3e-4df1-8995-204c9ce13fd5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:19.046027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c25e08ee-ab3e-4df1-8995-204c9ce13fd5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:19.053870 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c25e08ee-ab3e-4df1-8995-204c9ce13fd5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1216 microversion: 2.1 time: 0.133971 Oct 17 13:11:19.056344 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2209/4298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:18 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:19.077365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:19.078060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:19.086260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.087433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.088008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:19.090087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.090835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.091509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:19.194114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:19.203103 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0fa15c64-f8ee-43b7-9319-1f27791b9de2 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1666 microversion: 2.1 time: 0.131046 Oct 17 13:11:19.207104 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2210/4299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:19 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1666 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:19.218041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:19.220023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:19.233091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.245614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.246427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:19.247466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.248160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.248906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:19.414213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:19.456625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:19.460651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:19.465541 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1bbcd25a-239d-4ef4-95e8-96960579e8fa tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.889482 Oct 17 13:11:19.496778 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2090/4300] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:18 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:19.593614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:19.594619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:19.633233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:19.651675 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7665ace5-26e3-4dd2-8924-caedbc656137 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.434959 Oct 17 13:11:19.653765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.655191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2211/4301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:19 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:19.662689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.668713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:19.671682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.673495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-704453c4-77d7-46a2-a9c7-18f4da393008 req-832b8693-b413-430b-b7d5-c4a1e7e036f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262ce52d-8aa5-47f0-b4f7-bddcac72af07", "name": "network-vif-deleted", "tag": "563cd410-61d3-44cc-a2ec-2685078817a5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:19.676536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.680609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:19.715118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-704453c4-77d7-46a2-a9c7-18f4da393008 req-832b8693-b413-430b-b7d5-c4a1e7e036f9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.716714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-704453c4-77d7-46a2-a9c7-18f4da393008 req-832b8693-b413-430b-b7d5-c4a1e7e036f9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.717261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-704453c4-77d7-46a2-a9c7-18f4da393008 req-832b8693-b413-430b-b7d5-c4a1e7e036f9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:19.765527 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-704453c4-77d7-46a2-a9c7-18f4da393008 req-832b8693-b413-430b-b7d5-c4a1e7e036f9 service nova] Creating event network-vif-deleted:563cd410-61d3-44cc-a2ec-2685078817a5 for instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 on n-h1-853316-12 Oct 17 13:11:19.780350 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-704453c4-77d7-46a2-a9c7-18f4da393008 req-832b8693-b413-430b-b7d5-c4a1e7e036f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117746 Oct 17 13:11:19.784684 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2212/4302] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:19.947127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:19.949316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:19.976891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.979558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.985428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:19.990620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:19.994343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:19.995704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.276818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:20.285608 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10d1da85-eccf-4b73-b873-970f9f290106 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 0.697833 Oct 17 13:11:20.286913 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2091/4303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:19 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:20.292620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:20.303119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:20.314789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.315282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.315724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.316452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.316895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.317342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.393806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:20.528894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:20.549068 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd324f62-353c-4de7-8f40-3791bd9055d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1212 microversion: 2.1 time: 0.260901 Oct 17 13:11:20.549966 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2092/4304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:20 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1212 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:20.554688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:20.555294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:20.582650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.583148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.583586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.584356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.584805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.585273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.661818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.662431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.662940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.663403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lazy-loading 'fault' on Instance uuid 262ce52d-8aa5-47f0-b4f7-bddcac72af07 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:20.717166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:20.727997 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1017b6d1-2e43-40b1-8b58-024f0264e024 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1469 microversion: 2.1 time: 0.804238 Oct 17 13:11:20.748270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2213/4305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:19 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1469 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:20.757661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3d95ff203842ec9ccc96251e9d91f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af0dc362a9d46799be2735e547afd26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:20.768198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52741ba7-7254-4f89-b735-f832e7ce42d5 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 200 len: 1389 microversion: 2.1 time: 0.217044 Oct 17 13:11:20.783148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:20.783148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:20.783536 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2093/4306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:20 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 1389 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:20.795835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:20.796460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:20.802726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.803219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.803652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.809052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.809052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.809052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.850228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.850756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.851205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:20.856287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:20.856783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:20.857228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:21.748000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:21.758466 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b655a3b-0768-442c-99be-ecaccc493ded tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.978204 Oct 17 13:11:21.765819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2094/4307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:20 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:21.791160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:21.794949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:21.839226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:21.843196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:21.843794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:21.845971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:21.846487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:21.848532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:22.156459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:22.178208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:22.181825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:22.188130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e6483c1c-eab4-4b80-8c32-d1186d73dd19 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 1.437077 Oct 17 13:11:22.190682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2214/4308] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:20 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:22.410151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b13a9f3e-abb6-425a-83df-e26920c54224 req-b4c3e16e-0b8d-4a36-9f94-54f01f6ca02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb587b1-1e80-467b-bee5-bc89f62360c2", "name": "network-vif-deleted", "tag": "e1b91c9e-a498-4d68-9b3a-f7c9b11b8b56"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:22.433633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b13a9f3e-abb6-425a-83df-e26920c54224 req-b4c3e16e-0b8d-4a36-9f94-54f01f6ca02a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:22.444705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b13a9f3e-abb6-425a-83df-e26920c54224 req-b4c3e16e-0b8d-4a36-9f94-54f01f6ca02a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:22.458035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b13a9f3e-abb6-425a-83df-e26920c54224 req-b4c3e16e-0b8d-4a36-9f94-54f01f6ca02a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:22.495708 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b13a9f3e-abb6-425a-83df-e26920c54224 req-b4c3e16e-0b8d-4a36-9f94-54f01f6ca02a service nova] Creating event network-vif-deleted:e1b91c9e-a498-4d68-9b3a-f7c9b11b8b56 for instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 on n-h2-853316-12 Oct 17 13:11:22.506758 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b13a9f3e-abb6-425a-83df-e26920c54224 req-b4c3e16e-0b8d-4a36-9f94-54f01f6ca02a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314462 Oct 17 13:11:22.509544 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2215/4309] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:22.534213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:22.535000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:22.563266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:22.566067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:22.566606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:22.568381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:22.568870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:22.571174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:22.769076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:22.781993 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5cda8eb5-efa9-4b48-8071-73d039807e16 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1286 microversion: 2.1 time: 0.268192 Oct 17 13:11:22.807413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:22.843638 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2216/4310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:22 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1286 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:22.847653 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70146d1f-cf8b-4bff-9968-e00fb100171b tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 1.079597 Oct 17 13:11:22.876725 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2095/4311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:21 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:22.881404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:22.882028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:22.902600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:22.903325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:22.925434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:22.927482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:22.927975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:22.928722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:22.930835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:22.932825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:22.933584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:22.935185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:22.935467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:22.936095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:22.938247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:22.938988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.001592 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] HTTP exception thrown: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Request method failure captured: Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 HTTP/1.1 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVMAyofQVh5b_JEzHpiKlec-lsXS0tc_fHiW_t_w7tLlqos6tu8gp_LnaDYipeRjtviaY06Zk7Vqu8EfFeezTcJ6F8sBfpGxzpFZcQdamr3bC3DhL02x1SGpk1gnEoUWdJhgkwjB0SzA_bxchNMVJwMl03KHbfjeJScWAagwkQbs4-E Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 4af0dc362a9d46799be2735e547afd26 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4af0dc362a9d46799be2735e547afd26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 4af0dc362a9d46799be2735e547afd26 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestServerBasicOps-1370166267-project Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: cb3d95ff203842ec9ccc96251e9d91f4 Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestServerBasicOps-1370166267-project Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '262ce52d-8aa5-47f0-b4f7-bddcac72af07'} Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:23.009898 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Returning 404 to user: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:23.014597 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf99cfa8-5ed0-46f3-a98c-71a0068b9390 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 404 len: 111 microversion: 2.1 time: 0.136402 Oct 17 13:11:23.034725 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2096/4312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:22 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:23.052887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b0f26c18-ca5d-4b9c-84ad-2928caaaad5c req-50f6aafc-6f6f-4025-a64b-1ae256ae6599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97db364f-e815-4522-90ee-61887b73aae3", "tag": "5454a97f-6776-477b-ab04-5ad3b99c6ee5"}, {"server_uuid": "1ecc5ec5-0ec6-499d-b18d-63122ccffbbb", "name": "network-vif-deleted", "tag": "c5556652-7ce4-4931-862a-d1700b7eb19c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:23.101914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0f26c18-ca5d-4b9c-84ad-2928caaaad5c req-50f6aafc-6f6f-4025-a64b-1ae256ae6599 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.106823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0f26c18-ca5d-4b9c-84ad-2928caaaad5c req-50f6aafc-6f6f-4025-a64b-1ae256ae6599 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.107644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0f26c18-ca5d-4b9c-84ad-2928caaaad5c req-50f6aafc-6f6f-4025-a64b-1ae256ae6599 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.118659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.120764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.124020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.127241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lazy-loading 'fault' on Instance uuid 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:23.137891 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b0f26c18-ca5d-4b9c-84ad-2928caaaad5c req-50f6aafc-6f6f-4025-a64b-1ae256ae6599 service nova] Creating event network-changed:5454a97f-6776-477b-ab04-5ad3b99c6ee5 for instance 97db364f-e815-4522-90ee-61887b73aae3 on n-h1-853316-12 Oct 17 13:11:23.142475 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b0f26c18-ca5d-4b9c-84ad-2928caaaad5c req-50f6aafc-6f6f-4025-a64b-1ae256ae6599 service nova] Creating event network-vif-deleted:c5556652-7ce4-4931-862a-d1700b7eb19c for instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb on n-h2-853316-12 Oct 17 13:11:23.163513 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b0f26c18-ca5d-4b9c-84ad-2928caaaad5c req-50f6aafc-6f6f-4025-a64b-1ae256ae6599 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.123782 Oct 17 13:11:23.164598 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2097/4313] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:23.180009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:23.180853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:23.196733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.197768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.203458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.204480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.205173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.205787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.327799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:23.339691 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dea2f4e0-2912-4730-a4c1-f4da84373b7a tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 200 len: 1303 microversion: 2.1 time: 0.494492 Oct 17 13:11:23.340452 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2217/4314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:22 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 1303 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:23.350023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:23.350974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:23.366616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.369373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.370416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.373592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.375536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.375996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.594232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:23.608420 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0394aeec-0e6c-4b02-b241-ec589260a685 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.442421 Oct 17 13:11:23.610768 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2098/4315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:23 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:23.619046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:23.620249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:23.632976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.640690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.643461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.645687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.646994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.649049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.756361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:23.780159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:23.782782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:23.787697 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bfd84112-8fb1-4f33-9b9a-4fb348befe95 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.445778 Oct 17 13:11:23.790531 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2218/4316] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:23 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:23.847350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:23.848353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:23.861912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.864295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.864846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:23.865664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:23.866282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:23.866970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.001692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-393135e1-76bb-4b06-8dbf-fb28356b5bc8 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1837 microversion: 2.1 time: 0.389443 Oct 17 13:11:24.002397 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2099/4317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:23 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1837 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:24.008901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:24.009805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:24.017137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.017969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.018639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.019566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.020228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.020848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.043429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:24.054520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-735588fc-0959-4ea0-9a9e-8d55449f5a14 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1274 microversion: 2.1 time: 0.210957 Oct 17 13:11:24.055417 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2219/4318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:23 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1274 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:24.070893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:24.071955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:24.080112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.080740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.081281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.082155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.082747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.083255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.099031 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] HTTP exception thrown: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Request method failure captured: Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 HTTP/1.1 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVMAyofQVh5b_JEzHpiKlec-lsXS0tc_fHiW_t_w7tLlqos6tu8gp_LnaDYipeRjtviaY06Zk7Vqu8EfFeezTcJ6F8sBfpGxzpFZcQdamr3bC3DhL02x1SGpk1gnEoUWdJhgkwjB0SzA_bxchNMVJwMl03KHbfjeJScWAagwkQbs4-E Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 4af0dc362a9d46799be2735e547afd26 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4af0dc362a9d46799be2735e547afd26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 4af0dc362a9d46799be2735e547afd26 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestServerBasicOps-1370166267-project Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: cb3d95ff203842ec9ccc96251e9d91f4 Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestServerBasicOps-1370166267-project Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '262ce52d-8aa5-47f0-b4f7-bddcac72af07'} Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:24.100959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Returning 404 to user: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6207508d-68c7-4c58-9595-9e1838629709 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "DELETE /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 404 len: 111 microversion: 2.1 time: 0.045805 Oct 17 13:11:24.105778 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2220/4319] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:24 2022] DELETE /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:24.114918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:24.117510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] [instance: 262ce52d-8aa5-47f0-b4f7-bddcac72af07] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:24.129931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.130930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.131866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.133486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.134442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.136051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.163471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] HTTP exception thrown: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Request method failure captured: Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 HTTP/1.1 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVMAyofQVh5b_JEzHpiKlec-lsXS0tc_fHiW_t_w7tLlqos6tu8gp_LnaDYipeRjtviaY06Zk7Vqu8EfFeezTcJ6F8sBfpGxzpFZcQdamr3bC3DhL02x1SGpk1gnEoUWdJhgkwjB0SzA_bxchNMVJwMl03KHbfjeJScWAagwkQbs4-E Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 4af0dc362a9d46799be2735e547afd26 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4af0dc362a9d46799be2735e547afd26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4af0dc362a9d46799be2735e547afd26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 4af0dc362a9d46799be2735e547afd26 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestServerBasicOps-1370166267 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestServerBasicOps-1370166267-project Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: cb3d95ff203842ec9ccc96251e9d91f4 Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestServerBasicOps-1370166267-project Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '262ce52d-8aa5-47f0-b4f7-bddcac72af07'} Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:24.165235 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.170399 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.170399 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:24.170399 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:24.170399 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:24.170399 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:24.170399 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. Oct 17 13:11:24.170399 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.171129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Returning 404 to user: Instance 262ce52d-8aa5-47f0-b4f7-bddcac72af07 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:24.172466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9cf86a6a-db0f-4674-88c3-fdf8f6bc53ea tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07" status: 404 len: 111 microversion: 2.1 time: 0.063869 Oct 17 13:11:24.176766 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2221/4320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:24 2022] GET /compute/v2.1/servers/262ce52d-8aa5-47f0-b4f7-bddcac72af07 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:24.349389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:24.378475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:24.380162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:24.395913 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-18421c7e-1ae6-4a62-a840-c51c24973320 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 0.392519 Oct 17 13:11:24.410969 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2100/4321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:24 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:24.418716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.420118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.420780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.422047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.422781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.423394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.445851 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] HTTP exception thrown: Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb could not be found. Oct 17 13:11:24.448502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b9cd2e1-978c-4f50-a3bd-f5a6020be656 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] Calling method '.version_select at 0x7fa825262c10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Request method failure captured: Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb HTTP/1.1 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVNYOSTBVZmJixGNW6Mii_C3-TMwAnRFatHz7E48FPif6HnZgcZY4ZL747HPVOQl9GisTv8hg-OEKKVGwRCs3Qh7I5eV6_GPC77lzvqOJvSavlkj8m6z8CZE6AI0Azji9MrI-fXFtIYM-1eLcPch1bhNx74LoTNoceq1WKTlVD8GyRc Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 1b0cf99333e64c0dad09b7ae5c695743 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b0cf99333e64c0dad09b7ae5c695743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 1b0cf99333e64c0dad09b7ae5c695743 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-MigrationsAdminTest-1090556604-project Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: bf508fbbaee740548bd6509b3d279b57 Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-MigrationsAdminTest-1090556604-project Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb could not be found. Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1ecc5ec5-0ec6-499d-b18d-63122ccffbbb'} Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb could not be found. Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb could not be found. Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:24.448959 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb could not be found. Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Returning 404 to user: Instance 1ecc5ec5-0ec6-499d-b18d-63122ccffbbb could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a211db4c-059b-4d51-beb9-85e13e9faf67 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb" status: 404 len: 111 microversion: 2.1 time: 0.083637 Oct 17 13:11:24.454749 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2222/4322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:24 2022] GET /compute/v2.1/servers/1ecc5ec5-0ec6-499d-b18d-63122ccffbbb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:24.459065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:24.459722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:24.474991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.475524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.476068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.476796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.477566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.478406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.490742 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b9cd2e1-978c-4f50-a3bd-f5a6020be656 tempest-TestServerBasicOps-1370166267 tempest-TestServerBasicOps-1370166267-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1277831846" status: 202 len: 0 microversion: 2.1 time: 0.047988 Oct 17 13:11:24.494107 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2101/4323] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 17 13:11:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1277831846 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:11:24.540583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:24.585299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:24.637430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:24.638051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:24.649434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.650064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.650565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.651837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.652296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.652725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.664518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:24.670717 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4190c0be-50f0-45e6-a92d-45a80623cac2 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 204 len: 0 microversion: 2.1 time: 0.214961 Oct 17 13:11:24.671880 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2223/4324] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:24 2022] DELETE /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:11:24.689097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:24.690290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:24.713749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.714625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.715277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.716179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:24.717217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:24.721290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:24.995750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:25.009024 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2efae6cd-4b36-4056-a084-09dc420ba3b5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.375607 Oct 17 13:11:25.012266 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2102/4325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:24 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:25.021846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:25.022821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:25.048311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.051215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.056490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.058424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.059924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.060629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.159642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:25.174217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:25.174946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:25.185631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:25.187401 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd8c0b78-33cd-4700-8c18-a3c90567b35f tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.173829 Oct 17 13:11:25.190719 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea54ca76-37b4-4794-8b2f-aef13508f9fa tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1533 microversion: 2.1 time: 0.513137 Oct 17 13:11:25.191352 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2224/4326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:24 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1533 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:25.192510 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2103/4327] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:25 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:25.208091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:25.208731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:25.228271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.229086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.229733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.231622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.233236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.234801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.343434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:25.351432 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-63aace66-7085-423d-90ee-863180ec0051 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1274 microversion: 2.1 time: 0.156427 Oct 17 13:11:25.371529 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2225/4328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:25 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:25.436444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:25.437395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:25.454203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.462694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.465177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.466140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.466786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.468863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.872605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:25.873059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:25.881988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.894765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.895316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.896096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.896604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.897041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.925693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:25.937899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:25.942894 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf72ea13-789d-41ba-b8da-6e64dd7f8f10 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 0.510602 Oct 17 13:11:25.944758 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2104/4329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:25 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:25.955111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9fc74aaf-0946-4add-ac44-3eeed19fc0e2 req-a11011b0-8e4b-484b-bfcf-d23926592210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586fd663-8db0-4d14-bf90-b3871f6374b5", "tag": "3d6515c3-5c35-4518-9d9e-63d08da1216b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:25.976945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9fc74aaf-0946-4add-ac44-3eeed19fc0e2 req-a11011b0-8e4b-484b-bfcf-d23926592210 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:25.978741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9fc74aaf-0946-4add-ac44-3eeed19fc0e2 req-a11011b0-8e4b-484b-bfcf-d23926592210 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:25.980338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9fc74aaf-0946-4add-ac44-3eeed19fc0e2 req-a11011b0-8e4b-484b-bfcf-d23926592210 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:25.995518 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9fc74aaf-0946-4add-ac44-3eeed19fc0e2 req-a11011b0-8e4b-484b-bfcf-d23926592210 service nova] Creating event network-changed:3d6515c3-5c35-4518-9d9e-63d08da1216b for instance 586fd663-8db0-4d14-bf90-b3871f6374b5 on n-h1-853316-12 Oct 17 13:11:26.001421 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9fc74aaf-0946-4add-ac44-3eeed19fc0e2 req-a11011b0-8e4b-484b-bfcf-d23926592210 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054143 Oct 17 13:11:26.006742 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2105/4330] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:26.044195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:26.045671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:26.063977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:26.064856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:26.065477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:26.067063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:26.070313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:26.071484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:26.111609 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-075bee95-89d6-4d06-a7c9-f4f42764d05e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "DELETE /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 204 len: 0 microversion: 2.1 time: 0.242667 Oct 17 13:11:26.113038 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2226/4331] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:25 2022] DELETE /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:11:26.128933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:26.129964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:26.139669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:26.140806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:26.141566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:26.142582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:26.143271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:26.144205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:26.478651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:26.494091 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f012283-c6d0-4983-bd89-cb2134197f94 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.454590 Oct 17 13:11:26.497533 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2106/4332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:26 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:26.511909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:26.513003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:26.533038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:26.542261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:26.543370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:26.544794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:26.545515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:26.546063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:26.779446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:26.790443 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1fd3cb6-64fc-4749-b9ed-faae2a4dbf53 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1533 microversion: 2.1 time: 0.291053 Oct 17 13:11:26.792170 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2107/4333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:26 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1533 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:26.819484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:26.836255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:26.865054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:26.865653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:26.866108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:26.866868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:26.867332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:26.867794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:26.987570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:27.006506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:27.013079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:27.016921 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8d2eb92-a8da-43c1-8997-576d8e222a97 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.223731 Oct 17 13:11:27.018065 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2108/4334] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:26 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:27.028621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:27.039210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:27.049655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:27.052286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:27.053474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:27.054437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:27.055117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:27.056242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:27.077142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:27.089849 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3a680eda-2ac2-448d-86ad-3138f3c0e3c5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1690 microversion: 2.1 time: 0.972328 Oct 17 13:11:27.113606 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2227/4335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:26 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1690 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:27.126858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:27.130036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:27.148666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:27.149528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:27.154649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:27.157456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:27.158219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:27.162023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:27.569216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:27.579154 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2182b6c1-deb3-4311-a87f-afac85e26b34 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 0.463597 Oct 17 13:11:27.587440 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2228/4336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:27 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:27.596299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:27.597313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:27.620491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:27.621088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:27.621614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:27.622453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:27.623013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:27.623510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:27.873707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:27.889689 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5ef8099e-b70e-499e-aa0a-1ecbb9d98ce3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1274 microversion: 2.1 time: 0.870340 Oct 17 13:11:27.890615 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2109/4337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:27 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1274 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:27.896894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:27.897511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:27.909570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:27.910072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:27.910542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:27.911254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:27.911710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:27.912139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:27.989838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:28.017497 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd006294-0666-47a6-8003-9a6420820884 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.427849 Oct 17 13:11:28.018095 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2229/4338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:27 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:28.050412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:28.055740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:28.070889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:28.071402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:28.071850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:28.072569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:28.073747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:28.074197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:28.211977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:28.228366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:28.232609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:28.238123 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-562bd3fc-a69e-481d-a887-316b3b8bda40 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.197548 Oct 17 13:11:28.239391 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2230/4339] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:28 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:28.260592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:28.261673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:28.282811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:28.284169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:28.284801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:28.286564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:28.287195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:28.287792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:28.304826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:28.320530 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-64da811e-fb3b-4d52-aa71-2b099b93a941 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1533 microversion: 2.1 time: 0.427881 Oct 17 13:11:28.322568 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2110/4340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:27 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1533 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:28.413489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:28.596535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:28.610636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:28.612088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:28.633638 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-05f03d9d-ff64-48ae-a3fb-7e65ccf5e325 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1690 microversion: 2.1 time: 0.392584 Oct 17 13:11:28.634152 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2231/4341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:28 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1690 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:28.635978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:28.639126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:28.642284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:28.645734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:28.650555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:28.653519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:28.917409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:28.917541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:28.936406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:28.936406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:28.936406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:28.936880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:28.937651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:28.938501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:29.072362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=16 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:29.335593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:29.377088 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fa3ed02d-c0a7-4ded-861d-8175b391d95a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.465290 Oct 17 13:11:29.386801 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2232/4342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:28 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:29.418869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:29.419601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:29.446546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:29.459358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:29.460108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:29.468757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:29.469623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:29.485721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:30.265761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:30.280747 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d32e55c7-33cb-4e2f-a8c9-cb6043ff4bc9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.889223 Oct 17 13:11:30.281459 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2233/4343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:29 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:30.295260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:30.308908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:30.339475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:30.340944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:30.341569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:30.342608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:30.346484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:30.347151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:30.581181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:30.609425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:30.613592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:30.617703 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2841c7b-f6a9-455e-acbb-a25260291d5c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.331918 Oct 17 13:11:30.621393 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2234/4344] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:30 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:30.633073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:30.634083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:30.661119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:30.662191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:30.662909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:30.667886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:30.669273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:30.674757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:30.831268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:30.839203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:30.857030 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-91011ad4-3c55-446d-bcce-c9f135426ba0 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 2.254189 Oct 17 13:11:30.865741 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2111/4345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:28 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:30.874203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:30.916138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:30.937254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:30.941089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:30.941919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:30.943009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:30.944303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:30.951506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:31.355292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:31.373932 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f6a2866d-90d1-414b-b70c-5abce53773d0 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1533 microversion: 2.1 time: 0.751023 Oct 17 13:11:31.390958 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2235/4346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:30 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1533 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:31.400669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:31.410033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:31.440228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:31.443994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:31.444838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:31.446245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:31.447243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:31.450882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:32.134921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:32.157650 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aadf9ddf-e6cd-4fbb-b2f3-8cf33cc39a3c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.758287 Oct 17 13:11:32.177686 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2236/4347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:31 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:32.192093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:32.192820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:32.222264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:32.225915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:32.226729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:32.227730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:32.229422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:32.231085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:32.603730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:32.622976 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4715d01e-be09-46c4-a375-e4e376c46b06 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1571 microversion: 2.1 time: 1.751918 Oct 17 13:11:32.641017 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2112/4348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:30 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1571 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:32.651673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:32.652301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:32.661019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:32.664479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:32.670794 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ef3344ad-397c-4441-93ae-ec34df44b056 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.491851 Oct 17 13:11:32.673869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:32.674401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:32.674842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:32.675564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:32.676022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:32.676452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:32.678077 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2237/4349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:32 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:32.685695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:32.691047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:32.715678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:32.716750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:32.718774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:32.725221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:32.726489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:32.731923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.087748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:33.106585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e14a3e74-4d20-479e-ab85-01ac973176fc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 0.427205 Oct 17 13:11:33.112613 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2238/4350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:32 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:33.138239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:33.141656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:33.147943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:33.167980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.170728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:33.170877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.171814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.172608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.173101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.175712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.179301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:33.181301 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-56cf742d-68e8-4635-a817-259493c028e1 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.539143 Oct 17 13:11:33.206748 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2113/4351] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:32 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:33.223170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-0c25b755-e6ce-4700-8862-d127b49a24bf req-a80ed5d5-cd9a-463f-9c06-0bb0f467b114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97db364f-e815-4522-90ee-61887b73aae3", "name": "network-vif-plugged", "status": "completed", "tag": "5454a97f-6776-477b-ab04-5ad3b99c6ee5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:33.277896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0c25b755-e6ce-4700-8862-d127b49a24bf req-a80ed5d5-cd9a-463f-9c06-0bb0f467b114 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.278751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0c25b755-e6ce-4700-8862-d127b49a24bf req-a80ed5d5-cd9a-463f-9c06-0bb0f467b114 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.279440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0c25b755-e6ce-4700-8862-d127b49a24bf req-a80ed5d5-cd9a-463f-9c06-0bb0f467b114 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.283711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.284286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.288172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.288905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lazy-loading 'fault' on Instance uuid 3878382b-8750-419c-a5d4-8519c3e0b73a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:33.339716 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-0c25b755-e6ce-4700-8862-d127b49a24bf req-a80ed5d5-cd9a-463f-9c06-0bb0f467b114 service nova] Creating event network-vif-plugged:5454a97f-6776-477b-ab04-5ad3b99c6ee5 for instance 97db364f-e815-4522-90ee-61887b73aae3 on n-h1-853316-12 Oct 17 13:11:33.365529 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-0c25b755-e6ce-4700-8862-d127b49a24bf req-a80ed5d5-cd9a-463f-9c06-0bb0f467b114 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157315 Oct 17 13:11:33.371538 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2114/4352] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:33.398090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6f37727e-61ca-4fd9-930f-dd4f32266fe1 req-f4ab4406-792b-4585-9494-12fb284cd1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3878382b-8750-419c-a5d4-8519c3e0b73a", "name": "network-vif-deleted", "tag": "373158c1-e16e-465b-8602-e13c49ecee1c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:33.398430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:33.413102 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad175ab0-f1b0-4196-b31e-63024325bae3 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 200 len: 1368 microversion: 2.1 time: 0.292928 Oct 17 13:11:33.416074 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2239/4353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:33 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:33.428204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:33.430106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:33.440306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f37727e-61ca-4fd9-930f-dd4f32266fe1 req-f4ab4406-792b-4585-9494-12fb284cd1e9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.446540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.447077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f37727e-61ca-4fd9-930f-dd4f32266fe1 req-f4ab4406-792b-4585-9494-12fb284cd1e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.448654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.449150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.449747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f37727e-61ca-4fd9-930f-dd4f32266fe1 req-f4ab4406-792b-4585-9494-12fb284cd1e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.451340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.453162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.453617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.483368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6f37727e-61ca-4fd9-930f-dd4f32266fe1 req-f4ab4406-792b-4585-9494-12fb284cd1e9 service nova] Creating event network-vif-deleted:373158c1-e16e-465b-8602-e13c49ecee1c for instance 3878382b-8750-419c-a5d4-8519c3e0b73a on n-h1-853316-12 Oct 17 13:11:33.499952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6f37727e-61ca-4fd9-930f-dd4f32266fe1 req-f4ab4406-792b-4585-9494-12fb284cd1e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118372 Oct 17 13:11:33.501228 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2115/4354] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:33.655462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:33.656853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:33.677548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.679547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.682807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.688512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.690300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.694742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.797972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.806778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.809134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.809803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lazy-loading 'fault' on Instance uuid 586fd663-8db0-4d14-bf90-b3871f6374b5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:33.852748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:33.863770 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08d97bb4-351c-451a-9569-b12d9b657e19 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.446017 Oct 17 13:11:33.879867 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2240/4355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:33 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:33.889255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:33.890748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:33.911025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.912379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.913014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:33.914044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:33.914712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:33.915302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.190922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:34.200805 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-945c4ac0-c3b2-4d20-be4c-c2760243f29c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.319727 Oct 17 13:11:34.224461 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2241/4356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:33 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:34.239794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:34.241109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:34.263491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:34.264714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:34.265344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.266428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:34.267052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:34.267776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.344354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:34.356214 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ccf02425-0a90-456b-81d7-c0d741410da1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1357 microversion: 2.1 time: 0.703329 Oct 17 13:11:34.359977 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2116/4357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:33 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1357 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:34.376953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:34.377540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:34.408793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:34.415186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:34.417519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.418581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:34.419118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:34.419489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.555590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:34.567973 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9b00c33-ff48-42ea-8869-4ed8f9e45304 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 0.342008 Oct 17 13:11:34.570117 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2242/4358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:34 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:34.618068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:34.631689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:34.634641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:34.637339 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b3db328c-8f53-44a3-b159-041c0c68252c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.275800 Oct 17 13:11:34.661918 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2117/4359] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:34 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:34.810152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:34.810941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 3878382b-8750-419c-a5d4-8519c3e0b73a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:34.818042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:34.818874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:34.819561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.820527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:34.821513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:34.822187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.845567 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] HTTP exception thrown: Instance 3878382b-8750-419c-a5d4-8519c3e0b73a could not be found. Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Request method failure captured: Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a HTTP/1.1 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVNYOSTBVZmJixGNW6Mii_C3-TMwAnRFatHz7E48FPif6HnZgcZY4ZL747HPVOQl9GisTv8hg-OEKKVGwRCs3Qh7I5eV6_GPC77lzvqOJvSavlkj8m6z8CZE6AI0Azji9MrI-fXFtIYM-1eLcPch1bhNx74LoTNoceq1WKTlVD8GyRc Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 1b0cf99333e64c0dad09b7ae5c695743 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b0cf99333e64c0dad09b7ae5c695743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 1b0cf99333e64c0dad09b7ae5c695743 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-MigrationsAdminTest-1090556604-project Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: bf508fbbaee740548bd6509b3d279b57 Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-MigrationsAdminTest-1090556604-project Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 3878382b-8750-419c-a5d4-8519c3e0b73a could not be found. Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '3878382b-8750-419c-a5d4-8519c3e0b73a'} Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3878382b-8750-419c-a5d4-8519c3e0b73a could not be found. Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3878382b-8750-419c-a5d4-8519c3e0b73a could not be found. Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:34.848184 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:34.851978 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:34.851978 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:34.851978 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:34.851978 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:34.851978 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:34.851978 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3878382b-8750-419c-a5d4-8519c3e0b73a could not be found. Oct 17 13:11:34.851978 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:34.853154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Returning 404 to user: Instance 3878382b-8750-419c-a5d4-8519c3e0b73a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:34.854893 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbe688d5-56ff-4b23-a026-2c75e7ef5242 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a" status: 404 len: 111 microversion: 2.1 time: 0.282171 Oct 17 13:11:34.855672 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2243/4360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:34 2022] GET /compute/v2.1/servers/3878382b-8750-419c-a5d4-8519c3e0b73a => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:34.864927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fbc09e92-a9ac-42c5-9f2c-0491d80c1c46 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '.version_select at 0x7fa8251e0040>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:34.891166 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fbc09e92-a9ac-42c5-9f2c-0491d80c1c46 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701652201" status: 202 len: 0 microversion: 2.1 time: 0.030075 Oct 17 13:11:34.892866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:34.893713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:34.900597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:34.901395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:34.902284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.903180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:34.903794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:34.904388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:34.906257 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2118/4361] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 13:11:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701652201 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:11:35.236013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:35.236917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:35.248742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:35.249386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:35.250105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:35.250872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:35.251334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:35.251768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:35.513722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:35.540297 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e27b97fb-e6a7-43e8-b4c2-9981597bda98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1679 microversion: 2.1 time: 0.300627 Oct 17 13:11:35.540935 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2119/4362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:35 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1679 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:35.547483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:35.553911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:35.554749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:35.567411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:35.568111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:35.568332 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-869ed29b-63c1-4f22-ad91-b70b09a2cc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.679637 Oct 17 13:11:35.568893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:35.569017 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2244/4363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:34 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:35.569903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:35.571104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:35.571751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:35.598624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7e86591-f285-4bf7-9488-e577d1bfbee3"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:35.609173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:35.638940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:35.639445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:35.639948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:35.640683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:35.642642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:35.643765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:35.644420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:35.644924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:35.645607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:35.648345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lazy-loading 'fault' on Instance uuid 586fd663-8db0-4d14-bf90-b3871f6374b5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:35.883454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:35.899325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-374cb42a-08e3-455a-9cb6-f976ba1e4ce1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 200 len: 1357 microversion: 2.1 time: 0.353105 Oct 17 13:11:35.918737 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2120/4364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:35 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 1357 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:35.929367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e6e99bfd-f01e-4e7e-88ca-5060ecdbf155 req-059e36ac-3b9b-4c23-835f-fb28ee49e7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586fd663-8db0-4d14-bf90-b3871f6374b5", "name": "network-vif-deleted", "tag": "3d6515c3-5c35-4518-9d9e-63d08da1216b"}, {"name": "network-changed", "server_uuid": "b3f4ea8e-65e7-4913-8333-029dfe4a75fa", "tag": "6e6e985f-8bcf-45bf-8c6f-e114ca3c2af8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:35.947413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:35.965493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e6e99bfd-f01e-4e7e-88ca-5060ecdbf155 req-059e36ac-3b9b-4c23-835f-fb28ee49e7f7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:35.968225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e6e99bfd-f01e-4e7e-88ca-5060ecdbf155 req-059e36ac-3b9b-4c23-835f-fb28ee49e7f7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:35.971993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e6e99bfd-f01e-4e7e-88ca-5060ecdbf155 req-059e36ac-3b9b-4c23-835f-fb28ee49e7f7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:36.022020 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e6e99bfd-f01e-4e7e-88ca-5060ecdbf155 req-059e36ac-3b9b-4c23-835f-fb28ee49e7f7 service nova] Creating event network-vif-deleted:3d6515c3-5c35-4518-9d9e-63d08da1216b for instance 586fd663-8db0-4d14-bf90-b3871f6374b5 on n-h1-853316-12 Oct 17 13:11:36.025082 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e6e99bfd-f01e-4e7e-88ca-5060ecdbf155 req-059e36ac-3b9b-4c23-835f-fb28ee49e7f7 service nova] Creating event network-changed:6e6e985f-8bcf-45bf-8c6f-e114ca3c2af8 for instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa on n-h1-853316-12 Oct 17 13:11:36.041648 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e6e99bfd-f01e-4e7e-88ca-5060ecdbf155 req-059e36ac-3b9b-4c23-835f-fb28ee49e7f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.120537 Oct 17 13:11:36.042599 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2121/4365] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:36.049166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:36.050249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:36.057970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:36.059337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:36.059974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:36.061565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:36.062271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:36.062959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:36.118525 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-83e53699-3a30-4728-af3d-8be3d5a951da tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547540 Oct 17 13:11:36.149974 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2245/4366] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:11:35 2022] POST /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:36.174149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:36.176754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:36.189054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:36.190138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:36.190988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:36.191975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:36.192722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:36.193363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:36.286316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:36.333758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:36.341950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:36.357959 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbd4b903-8036-4e12-9a42-c21f99e89671 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1605 microversion: 2.42 time: 0.189453 Oct 17 13:11:36.362121 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2246/4367] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:36 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:36.565965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:36.567560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:36.581943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:36.582631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:36.583168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:36.583875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:36.584852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:36.585481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:36.864281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:36.874941 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b3aaa10-fb30-46bd-8cc3-655a25cbabe3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.312842 Oct 17 13:11:36.887305 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2247/4368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:36 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:36.911282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:36.912114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:36.920811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:36.921757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:36.922407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:36.923824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:36.924459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:36.925029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.053343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:37.069170 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eba8b830-97d8-4a0d-9daa-04ecfe50989e tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1471 microversion: 2.1 time: 1.025036 Oct 17 13:11:37.071084 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2122/4369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:36 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1471 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:37.085129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:37.087070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:37.105754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.107993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.110703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.115372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.117911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.120078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.176910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:37.203226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:37.217304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ccc8c61c-4ff6-4474-aae2-3f761f8c0b06 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.327929 Oct 17 13:11:37.218255 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2248/4370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:36 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:37.224455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:37.225963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 586fd663-8db0-4d14-bf90-b3871f6374b5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:37.244678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.247146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.247603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.250633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.251278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.251826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.284007 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] HTTP exception thrown: Instance 586fd663-8db0-4d14-bf90-b3871f6374b5 could not be found. Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Request method failure captured: Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 HTTP/1.1 Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVO8wsZSqmfW49vI1THHOfwL_5j3vM2FktN7RpHbtgow7aDmUW4Pv3BVI8Oy7tO9oSfFgC6rTSlxAHfrY-eM07pY0Umu71X2M6X4Ue9KgT0Ml48iFOxFgBMPMdHbsgVJGlEaT3gitl9BY6UXQ9cLmroOJW8AWk3NApwUBQgRlOKon1A Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: e5d16284093341d980341f1dce38f68b Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5d16284093341d980341f1dce38f68b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5d16284093341d980341f1dce38f68b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5d16284093341d980341f1dce38f68b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5d16284093341d980341f1dce38f68b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: e5d16284093341d980341f1dce38f68b Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestNetworkAdvancedServerOps-497241743-project Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0cee3a8479444aa3a00b2c29407931d9 Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestNetworkAdvancedServerOps-497241743-project Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 586fd663-8db0-4d14-bf90-b3871f6374b5 could not be found. Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '586fd663-8db0-4d14-bf90-b3871f6374b5'} Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586fd663-8db0-4d14-bf90-b3871f6374b5 could not be found. Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586fd663-8db0-4d14-bf90-b3871f6374b5 could not be found. Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:37.298221 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586fd663-8db0-4d14-bf90-b3871f6374b5 could not be found. Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:37.302387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Returning 404 to user: Instance 586fd663-8db0-4d14-bf90-b3871f6374b5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:37.304585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c61f20ae-4080-4776-94e1-1a4a206bebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5" status: 404 len: 111 microversion: 2.1 time: 0.083949 Oct 17 13:11:37.325258 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2249/4371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:37 2022] GET /compute/v2.1/servers/586fd663-8db0-4d14-bf90-b3871f6374b5 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:37.356184 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a3627040-7cad-46a9-b211-88caf7f7602b tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "DELETE /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 204 len: 0 microversion: 2.1 time: 0.281602 Oct 17 13:11:37.356807 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2123/4372] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:37 2022] DELETE /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:11:37.383627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:37.384230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:37.414261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.415891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.418863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.420925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.422645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.423232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.424642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:37.425394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:37.442385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.445266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.446221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.448875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.451593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.452818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.499736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:37.500160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:37.500653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:37.501312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lazy-loading 'fault' on Instance uuid 9f020194-d135-4f53-8a62-266832996cda {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:37.553688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:37.566477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:37.568709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:37.570223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b648b02c-b4a7-4eac-a0b7-bdaad242804e tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1610 microversion: 2.42 time: 0.179105 Oct 17 13:11:37.572182 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2124/4373] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:37 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1610 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:37.702379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:37.713712 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7bc26464-ec9f-451c-9be8-5441cc6403da tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1468 microversion: 2.1 time: 0.351421 Oct 17 13:11:37.715715 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2250/4374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:37 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1468 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:38.097583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:38.098967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:38.114831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.115417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.115873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.116606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.117064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.117489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.244996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:38.246016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:38.276705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.279372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.279844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.285926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.286576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.286868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.514600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:38.528688 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b0212b5d-4e31-4a89-b7c7-78a710e47970 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1642 microversion: 2.1 time: 0.432231 Oct 17 13:11:38.529949 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2125/4375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:38 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1642 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:38.538520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:38.539541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:38.553026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.561291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.565102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.566189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.568329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.569688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.701814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:38.722792 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1fb0f9c-789c-4188-bc7e-eed540ce6f7c tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.481293 Oct 17 13:11:38.724924 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2251/4376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:38 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:38.741120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:38.742904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:38.775790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.778053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.778856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.782892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.784384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.785135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.903082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:38.915598 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-81523f75-f915-4889-a04a-64e686286db5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.381151 Oct 17 13:11:38.918428 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2126/4377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:38 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:38.928383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:38.929965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:38.946793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.948235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.948997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:38.958345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:38.959394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:38.960083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:39.017434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:39.018372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:39.019032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:39.019706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lazy-loading 'fault' on Instance uuid 9f020194-d135-4f53-8a62-266832996cda {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:39.153327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:39.174367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:39.187630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:39.190204 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f045ecf-471f-4fc7-a904-1da63ff3e2ed tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1610 microversion: 2.42 time: 0.269372 Oct 17 13:11:39.193861 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2127/4378] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:38 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1610 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:39.204538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:39.205953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:39.238438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:39.240477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:39.245473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:39.249941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:39.252969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:39.258558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:39.371628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:40.184001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:40.196217 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-11ac8e65-2e6d-459e-b11b-7014ea802efb tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 200 len: 1468 microversion: 2.1 time: 0.999094 Oct 17 13:11:40.199289 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2128/4379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:39 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 1468 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:40.215744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:40.218227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:40.243935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:40.245950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:40.263989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:40.266956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:40.274063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:40.278591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:40.347851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:40.387645 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c7485496-e42e-4b75-b3dd-7b1bcbc0f601 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1642 microversion: 2.1 time: 1.660247 Oct 17 13:11:40.389665 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2252/4380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:38 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1642 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:40.399911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:40.402013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:40.433463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:40.434457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:40.435453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:40.438968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:40.440531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:40.441671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:40.584889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:40.586042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:40.587042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:40.588203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lazy-loading 'fault' on Instance uuid 9f020194-d135-4f53-8a62-266832996cda {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:40.826802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:40.833656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:40.891160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:40.898198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4a2a5521caf47859f5e1ad5c30519e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86553345eb00474c9b8322ae23489ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:40.904781 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b2d4a5b-95e5-415e-accb-7cb7b6f3ea66 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 200 len: 1372 microversion: 2.42 time: 0.508389 Oct 17 13:11:40.920876 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2253/4381] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:40 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 1372 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:11:40.943167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2e13c11a-c1c0-4c26-a233-2b9a85977a1d req-fabf4daa-3692-499d-9fe5-2d31e23849a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9472cc-309e-4a00-b88c-15b2a9e5a65a", "name": "network-vif-deleted", "tag": "29d4af6b-d4aa-4ef7-90ba-99895fa78c62"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:41.034452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2e13c11a-c1c0-4c26-a233-2b9a85977a1d req-fabf4daa-3692-499d-9fe5-2d31e23849a1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:41.035355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2e13c11a-c1c0-4c26-a233-2b9a85977a1d req-fabf4daa-3692-499d-9fe5-2d31e23849a1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:41.039190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2e13c11a-c1c0-4c26-a233-2b9a85977a1d req-fabf4daa-3692-499d-9fe5-2d31e23849a1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:41.086550 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2e13c11a-c1c0-4c26-a233-2b9a85977a1d req-fabf4daa-3692-499d-9fe5-2d31e23849a1 service nova] Creating event network-vif-deleted:29d4af6b-d4aa-4ef7-90ba-99895fa78c62 for instance de9472cc-309e-4a00-b88c-15b2a9e5a65a on n-h2-853316-12 Oct 17 13:11:41.132881 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2e13c11a-c1c0-4c26-a233-2b9a85977a1d req-fabf4daa-3692-499d-9fe5-2d31e23849a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198693 Oct 17 13:11:41.138661 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2254/4382] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:41.146495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:41.154479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:41.175793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:41.176341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:41.178603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:41.183115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:41.183578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:41.185568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:41.477295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:41.489925 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7afbbfc4-e64b-4b2b-a2ff-b4045eee394d tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 1.289280 Oct 17 13:11:41.491230 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2129/4383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:40 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:41.499574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:41.500469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: de9472cc-309e-4a00-b88c-15b2a9e5a65a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:41.511452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:41.512292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:41.512949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:41.514834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:41.515807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:41.516748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:41.537337 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] HTTP exception thrown: Instance de9472cc-309e-4a00-b88c-15b2a9e5a65a could not be found. Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Request method failure captured: Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a HTTP/1.1 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVNYOSTBVZmJixGNW6Mii_C3-TMwAnRFatHz7E48FPif6HnZgcZY4ZL747HPVOQl9GisTv8hg-OEKKVGwRCs3Qh7I5eV6_GPC77lzvqOJvSavlkj8m6z8CZE6AI0Azji9MrI-fXFtIYM-1eLcPch1bhNx74LoTNoceq1WKTlVD8GyRc Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 1b0cf99333e64c0dad09b7ae5c695743 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b0cf99333e64c0dad09b7ae5c695743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 1b0cf99333e64c0dad09b7ae5c695743 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-MigrationsAdminTest-1090556604-project Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: bf508fbbaee740548bd6509b3d279b57 Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-MigrationsAdminTest-1090556604-project Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance de9472cc-309e-4a00-b88c-15b2a9e5a65a could not be found. Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'de9472cc-309e-4a00-b88c-15b2a9e5a65a'} Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9472cc-309e-4a00-b88c-15b2a9e5a65a could not be found. Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9472cc-309e-4a00-b88c-15b2a9e5a65a could not be found. Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:41.539662 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:41.546595 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:41.546595 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:41.546595 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:41.546595 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:41.546595 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:41.546595 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9472cc-309e-4a00-b88c-15b2a9e5a65a could not be found. Oct 17 13:11:41.546595 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:41.562123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Returning 404 to user: Instance de9472cc-309e-4a00-b88c-15b2a9e5a65a could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:41.562123 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-050ede72-f965-4be8-8378-757ec8420383 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a" status: 404 len: 111 microversion: 2.1 time: 0.063658 Oct 17 13:11:41.562123 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2130/4384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:41 2022] GET /compute/v2.1/servers/de9472cc-309e-4a00-b88c-15b2a9e5a65a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:41.562123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:41.562774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:41.579253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:41.579763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:41.580216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:41.580937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:41.581398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:41.581832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:42.578743 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4eb29bfa-73e4-4c9b-a7e3-7beff7537e61 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1795 microversion: 2.1 time: 1.437288 Oct 17 13:11:42.585193 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2255/4385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:41 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1795 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:42.590842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:42.591351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:42.617979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:42.618514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:42.618964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:42.620230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:42.620700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:42.621231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:42.715439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:42.867454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:42.889988 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75f709e4-1f4e-40bd-a34c-36f9b2ade133 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 1.329119 Oct 17 13:11:42.890759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2131/4386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:41 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:42.912674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-bacbeccf-e859-498c-b335-066d5824f06f req-95dbd0d7-aa2a-4c06-bd22-76051f88d1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "name": "network-vif-unplugged", "status": "completed", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:42.965753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bacbeccf-e859-498c-b335-066d5824f06f req-95dbd0d7-aa2a-4c06-bd22-76051f88d1f3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:42.968054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bacbeccf-e859-498c-b335-066d5824f06f req-95dbd0d7-aa2a-4c06-bd22-76051f88d1f3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:42.970788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bacbeccf-e859-498c-b335-066d5824f06f req-95dbd0d7-aa2a-4c06-bd22-76051f88d1f3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:42.984365 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ed5c526-c468-4e2e-b4f5-4d6db68bc287 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 204 len: 0 microversion: 2.1 time: 0.397751 Oct 17 13:11:42.998300 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2256/4387] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:42 2022] DELETE /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:11:43.009610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:43.010699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:43.023601 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-bacbeccf-e859-498c-b335-066d5824f06f req-95dbd0d7-aa2a-4c06-bd22-76051f88d1f3 service nova] Creating event network-vif-unplugged:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:11:43.028450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.039372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.040209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.041701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.042385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.043195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.054730 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-bacbeccf-e859-498c-b335-066d5824f06f req-95dbd0d7-aa2a-4c06-bd22-76051f88d1f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155862 Oct 17 13:11:43.059699 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2132/4388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:43.078347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] HTTP exception thrown: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Request method failure captured: Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda HTTP/1.1 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLPsv3xmzlZLWFaBbPv-YQY8_BCAe08fN-MFgoVGqBmEsmtEUptyncOUcHL6tXHhrflR1lN5t6wKCu4zNWjpNAbS1GEHRCy4Sam84S-tGUO6s4gqbhUv1P14AFF339Mrm-RhYy-8xFWHADyY_FdDUNBSND7pv3GNHpCc_3mPKLwN30 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 86553345eb00474c9b8322ae23489ade Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86553345eb00474c9b8322ae23489ade", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86553345eb00474c9b8322ae23489ade"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86553345eb00474c9b8322ae23489ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86553345eb00474c9b8322ae23489ade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 86553345eb00474c9b8322ae23489ade Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TaggedBootDevicesTest_v242-367166092-project Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: c4a2a5521caf47859f5e1ad5c30519e8 Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TaggedBootDevicesTest_v242-367166092-project Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9f020194-d135-4f53-8a62-266832996cda'} Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:43.080777 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:43.085058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:43.085058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:43.085058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:43.085058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:43.085058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:43.085058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:43.085058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:43.085058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:43.085930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:43.086876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Returning 404 to user: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:43.087981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-311baedc-0557-4a4d-946f-61ce38fe5b4c tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 404 len: 111 microversion: 2.42 time: 0.088279 Oct 17 13:11:43.089883 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2257/4389] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:42 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:11:43.095524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:43.100941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:43.104067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:43.127829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.129343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.130048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.130368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.130838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.131164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.132070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.135964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.136521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.136804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.136950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.137596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.684275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:43.701105 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ce99c0d-9c7b-4523-829c-d72ba262ebcb tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.637086 Oct 17 13:11:43.704039 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2133/4390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:43 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:43.717793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:43.719941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:43.725872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:43.733890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.734419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.734870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.735584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.736137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.736463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.737289 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-84a6705a-09d4-455d-808b-970e8cb77ae2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.643084 Oct 17 13:11:43.738982 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2258/4391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:43 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:43.747595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-929e2ad1-6933-437b-9c36-e1904e920628 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '.version_select at 0x7fa820cccb80>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:43.790451 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-929e2ad1-6933-437b-9c36-e1904e920628 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090121720" status: 204 len: 0 microversion: 2.42 time: 0.043098 Oct 17 13:11:43.792474 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2259/4392] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 13:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090121720 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:11:43.802038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:43.803068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:43.815180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.821974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.823379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:43.824398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:43.825096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:43.825781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:44.721611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:44.733044 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf6ee981-ed62-448b-abe9-311ec322877c tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1466 microversion: 2.1 time: 1.027203 Oct 17 13:11:44.762266 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2134/4393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:43 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1466 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:44.771418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:44.789792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:44.801918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:44.804752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:44.805535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:44.806475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:44.807624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:44.808212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:44.947347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:44.956410 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-222ae53d-21a6-4fcb-97b2-2b5b04d2732a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 1.162632 Oct 17 13:11:44.957182 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2260/4394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:43 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:44.984603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:44.987209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:45.002114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:45.002972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:45.003423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:45.004147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:45.004786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:45.005226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:45.138794 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e0261d7c-5470-45d6-a26d-e3733d1ba9fa tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.157807 Oct 17 13:11:45.139741 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2261/4395] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:11:44 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:11:45.145920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:45.154813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:45.156952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:45.158914 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c5a7377-4067-45a3-aadb-c9e1eedf719a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.395143 Oct 17 13:11:45.168831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:45.169341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:45.169782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:45.169979 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2135/4396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:44 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:45.173517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:45.174026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:45.174527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:45.409836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8afa7899-0ae7-4680-b01c-21f0a3daff99 req-26dd3597-3b32-4b4d-ac10-101c8224d8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f4ea8e-65e7-4913-8333-029dfe4a75fa", "name": "network-vif-plugged", "status": "completed", "tag": "6e6e985f-8bcf-45bf-8c6f-e114ca3c2af8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:45.425346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8afa7899-0ae7-4680-b01c-21f0a3daff99 req-26dd3597-3b32-4b4d-ac10-101c8224d8aa service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:45.427169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8afa7899-0ae7-4680-b01c-21f0a3daff99 req-26dd3597-3b32-4b4d-ac10-101c8224d8aa service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:45.428184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8afa7899-0ae7-4680-b01c-21f0a3daff99 req-26dd3597-3b32-4b4d-ac10-101c8224d8aa service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:45.459185 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8afa7899-0ae7-4680-b01c-21f0a3daff99 req-26dd3597-3b32-4b4d-ac10-101c8224d8aa service nova] Creating event network-vif-plugged:6e6e985f-8bcf-45bf-8c6f-e114ca3c2af8 for instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa on n-h1-853316-12 Oct 17 13:11:45.466545 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8afa7899-0ae7-4680-b01c-21f0a3daff99 req-26dd3597-3b32-4b4d-ac10-101c8224d8aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060294 Oct 17 13:11:45.470993 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2136/4397] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:45.763094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:45.764691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:45.778521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:45.779617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:45.781966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:45.783259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:45.785845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:45.786705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:46.092229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:46.126382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9da8a615-271d-45c2-ab0b-c3aef952bf55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1668 microversion: 2.1 time: 0.978914 Oct 17 13:11:46.127321 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2262/4398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:45 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1668 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:46.186952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:46.187707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:46.193527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:46.202727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:46.208052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c098a2e-1154-4619-8f5a-9a1bd5f0acc5 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1466 microversion: 2.1 time: 0.450051 Oct 17 13:11:46.208458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:46.208969 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2137/4399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:45 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1466 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:46.209376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:46.209936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:46.213732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:46.214422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:46.216753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:46.774468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:46.787750 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f4b56f4-3eff-4471-812d-35c5b5ff77a1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1316 microversion: 2.1 time: 0.606015 Oct 17 13:11:46.788420 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2263/4400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:46 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:47.098214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b76b4daf-52d5-4a51-a7fd-8b2761df6868 req-1d3ee382-733c-4c03-b90e-3d9583849a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8", "name": "network-vif-deleted", "tag": "7b8a1e49-f76d-443e-bb48-2b56a2f21443"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:47.113587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b76b4daf-52d5-4a51-a7fd-8b2761df6868 req-1d3ee382-733c-4c03-b90e-3d9583849a0f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:47.114396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b76b4daf-52d5-4a51-a7fd-8b2761df6868 req-1d3ee382-733c-4c03-b90e-3d9583849a0f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:47.115705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b76b4daf-52d5-4a51-a7fd-8b2761df6868 req-1d3ee382-733c-4c03-b90e-3d9583849a0f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:47.143822 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b76b4daf-52d5-4a51-a7fd-8b2761df6868 req-1d3ee382-733c-4c03-b90e-3d9583849a0f service nova] Creating event network-vif-deleted:7b8a1e49-f76d-443e-bb48-2b56a2f21443 for instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 on n-h2-853316-12 Oct 17 13:11:47.155409 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b76b4daf-52d5-4a51-a7fd-8b2761df6868 req-1d3ee382-733c-4c03-b90e-3d9583849a0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061639 Oct 17 13:11:47.158449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2138/4401] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:47.169773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:47.170469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:47.183710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:47.184214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:47.184654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:47.185363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:47.185811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:47.186864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:47.236863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:47.242033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:47.253240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:47.255860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:47.256585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:47.257585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:47.259141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:47.260564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:47.321702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:47.322091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:47.322629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:47.323117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lazy-loading 'fault' on Instance uuid 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:47.421459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf508fbbaee740548bd6509b3d279b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0cf99333e64c0dad09b7ae5c695743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:47.433550 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-386080cb-5a96-4b9d-858d-1d6dce0eb4b8 tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 200 len: 1302 microversion: 2.1 time: 0.201399 Oct 17 13:11:47.434591 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2139/4402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:47 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 1302 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:47.812801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:47.813444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:47.831501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:47.832014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:47.832460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:47.833218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:47.834139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:47.834649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.028364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:48.038327 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-daf72043-5e12-4a0c-becd-29dbec8e46e1 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1505 microversion: 2.1 time: 0.228902 Oct 17 13:11:48.038815 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2140/4403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:47 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:48.062913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:48.063539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:48.071353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:48.072203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:48.072708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.073528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:48.073990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:48.074469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.283818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:48.294233 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8c9d9b19-0f9f-48b3-9193-d6fdeff1a591 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1505 microversion: 2.1 time: 0.235233 Oct 17 13:11:48.294871 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2141/4404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:48 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:48.306367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:48.319381 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aee3aed3-fc2b-4eb0-ad6f-f0e5bfe892c7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1668 microversion: 2.1 time: 1.154383 Oct 17 13:11:48.321464 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2264/4405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:47 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1668 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:48.323355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:48.327234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:48.334781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:48.335603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:48.336490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.338908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:48.339759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:48.340490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.437779 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8226e74b-2d70-499f-a6af-a923a341d94e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "PUT /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1077 microversion: 2.1 time: 0.122643 Oct 17 13:11:48.438814 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2142/4406] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:11:48 2022] PUT /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1077 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:48.463902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:48.465535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:48.468300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:48.469210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] [instance: 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:48.473246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:48.473996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:48.475385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.475893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:48.476387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:48.476511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:48.476891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.477302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:48.477591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:48.477948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.478082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:48.478756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:48.522526 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] HTTP exception thrown: Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 could not be found. Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Request method failure captured: Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 HTTP/1.1 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVNYOSTBVZmJixGNW6Mii_C3-TMwAnRFatHz7E48FPif6HnZgcZY4ZL747HPVOQl9GisTv8hg-OEKKVGwRCs3Qh7I5eV6_GPC77lzvqOJvSavlkj8m6z8CZE6AI0Azji9MrI-fXFtIYM-1eLcPch1bhNx74LoTNoceq1WKTlVD8GyRc Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 1b0cf99333e64c0dad09b7ae5c695743 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b0cf99333e64c0dad09b7ae5c695743", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b0cf99333e64c0dad09b7ae5c695743"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 1b0cf99333e64c0dad09b7ae5c695743 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-MigrationsAdminTest-1090556604 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-MigrationsAdminTest-1090556604-project Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: bf508fbbaee740548bd6509b3d279b57 Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-MigrationsAdminTest-1090556604-project Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 could not be found. Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8'} Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 could not be found. Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 could not be found. Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:48.527015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 could not be found. Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] Returning 404 to user: Instance 4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2b81699f-f961-4891-99d9-aed6671f1c3d tempest-MigrationsAdminTest-1090556604 tempest-MigrationsAdminTest-1090556604-project] 10.222.0.27 "GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8" status: 404 len: 111 microversion: 2.1 time: 0.068064 Oct 17 13:11:48.531270 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2143/4407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:48 2022] GET /compute/v2.1/servers/4fda9e19-4384-4fc4-8c2d-d3b8a2f55be8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:49.079591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:49.110229 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51001ee9-b0f4-4af2-8290-b908034adc73 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1503 microversion: 2.1 time: 0.654362 Oct 17 13:11:49.111392 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2265/4408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:48 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1503 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:49.142904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:49.144912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:49.165293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:49.169389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:49.170775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:49.174127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:49.175370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:49.176635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:49.351775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:49.352483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:49.361869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:49.362717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:49.363610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:49.365327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:49.366315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:49.367233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:49.779238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:49.788663 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0da17ebe-b8be-4f0e-812b-086536a105df tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1503 microversion: 2.1 time: 0.654999 Oct 17 13:11:49.797858 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2144/4409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:49 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1503 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:49.829856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:49.860754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:49.869566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c9a4c803-879b-47cf-8bb1-6f73cbe45ee7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.522493 Oct 17 13:11:49.875813 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2266/4410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:49 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:49.877754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:49.891784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:49.894315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:49.896458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:49.898475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:49.899597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:49.900651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:49.928667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:49.934527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:49.956099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:49.957511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:49.957634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:49.958782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:49.959560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:49.960308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:50.054661 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-180d0ccf-28ca-405d-9a0f-63fccbf23d32 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 200 len: 324 microversion: 2.1 time: 0.136487 Oct 17 13:11:50.056716 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2267/4411] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:11:49 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 324 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:50.071634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:50.072888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:50.081754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:50.082658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:50.083327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:50.084280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:50.084972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:50.085821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:50.113696 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2063b755-77ae-43a4-b7d2-bbc5fa92795a tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "PUT /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1079 microversion: 2.1 time: 0.269426 Oct 17 13:11:50.114768 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2145/4412] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:11:49 2022] PUT /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1079 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:50.136576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:50.137887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:50.148296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:50.148880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:50.149459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:50.150969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:50.151681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:50.152239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:50.537420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:50.557672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49935063-0438-44c5-9df5-05798632864a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.491090 Oct 17 13:11:50.572226 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2268/4413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:50 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:50.612044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:50.613693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:50.648798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:50.650334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:50.652772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:50.654433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:50.655502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:50.656527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:51.036749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:51.042472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:51.072538 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-390cc5ee-a882-4270-bf34-b739dcce1cc2 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1505 microversion: 2.1 time: 0.940730 Oct 17 13:11:51.080163 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2146/4414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:50 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1505 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:51.101873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c2222061-d9e6-4ac5-af43-c4846be32075 req-2ca24406-277e-4bf0-9e2d-d770a0b9e0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97db364f-e815-4522-90ee-61887b73aae3", "tag": "5454a97f-6776-477b-ab04-5ad3b99c6ee5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:51.154455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c2222061-d9e6-4ac5-af43-c4846be32075 req-2ca24406-277e-4bf0-9e2d-d770a0b9e0ba service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:51.156832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c2222061-d9e6-4ac5-af43-c4846be32075 req-2ca24406-277e-4bf0-9e2d-d770a0b9e0ba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:51.158232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c2222061-d9e6-4ac5-af43-c4846be32075 req-2ca24406-277e-4bf0-9e2d-d770a0b9e0ba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:51.212977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:51.231476 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c2222061-d9e6-4ac5-af43-c4846be32075 req-2ca24406-277e-4bf0-9e2d-d770a0b9e0ba service nova] Creating event network-changed:5454a97f-6776-477b-ab04-5ad3b99c6ee5 for instance 97db364f-e815-4522-90ee-61887b73aae3 on n-h1-853316-12 Oct 17 13:11:51.255501 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3f94faa-ba4e-4438-bd15-b92ae6743ef8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.655859 Oct 17 13:11:51.258279 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c2222061-d9e6-4ac5-af43-c4846be32075 req-2ca24406-277e-4bf0-9e2d-d770a0b9e0ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173760 Oct 17 13:11:51.265168 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2147/4415] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:51.267352 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2269/4416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:50 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:51.277187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:51.279755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:51.301672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:51.303724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:51.311456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:51.312538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:51.317541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:51.319234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:51.320676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:51.323910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:51.326582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:51.327095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:51.327534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:51.328424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:51.338424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:51.340020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:51.444283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:51.892966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:51.905218 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b95dffc2-815e-43a4-87cc-30fdc4f048b6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.620928 Oct 17 13:11:51.918292 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2270/4417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:51 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:51.920743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd046d82-1f10-4399-8e9e-f366305cc460 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '.version_select at 0x7fa820df29d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:51.965116 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd046d82-1f10-4399-8e9e-f366305cc460 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1781650193" status: 202 len: 0 microversion: 2.1 time: 0.053170 Oct 17 13:11:51.967770 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2271/4418] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 17 13:11:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1781650193 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:11:51.984764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:51.985788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:52.002813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:52.003431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:52.003948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:52.004738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:52.005302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:52.005802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:52.161798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:52.171824 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d94f0de2-bff1-46f1-9b34-3a0122bb6dcc tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1505 microversion: 2.1 time: 0.902544 Oct 17 13:11:52.174690 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2148/4419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:51 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1505 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:52.203423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39c8d1b4-571e-4186-80d6-1fa19d4b5298 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'create', calling method: .version_select at 0x7fa82045aaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-113359504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeqKyjkjwctZWKgl4VfFJUTg3xIlGHi5G/NmaSJtgbN5wgQ2v/1wNKIPpr+Y2SjcRrp/c3VPWXD2wgDMU1SeqqK9v8N9WMA2nFL1uXdbbnrlM4Ej5xR/jUwg59TsWyrmg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:52.248487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-39c8d1b4-571e-4186-80d6-1fa19d4b5298 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for project e5d16284093341d980341f1dce38f68b. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:11:52.268087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-39c8d1b4-571e-4186-80d6-1fa19d4b5298 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for user 0cee3a8479444aa3a00b2c29407931d9 and project e5d16284093341d980341f1dce38f68b. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:11:52.325664 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-39c8d1b4-571e-4186-80d6-1fa19d4b5298 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.136967 Oct 17 13:11:52.326298 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2149/4420] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:11:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:52.346766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:52.347670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:52.363920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:52.366202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:52.368669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:52.371188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:52.371925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:52.373687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:52.374703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:52.383154 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-27fed274-b6e7-4a0a-8f85-12613cffb783 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.413983 Oct 17 13:11:52.386816 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2272/4421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:51 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:52.477862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:52.675415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1044527384", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:52.765157 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02f5afaf-95d0-44fc-946e-b5d5012f13d0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 204 len: 0 microversion: 2.1 time: 0.427302 Oct 17 13:11:52.770577 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2150/4422] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:52 2022] DELETE /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:11:52.785051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:52.789223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:52.792690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] validate_networks() for [('24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:11:52.797099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:52.797849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:52.798531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:52.799825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:52.800534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:52.801144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:52.896698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lazy-loading 'flavor' on Instance uuid 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:53.159291 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dedb9480-3dfb-4907-8689-6001d8920791 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/action" status: 200 len: 32 microversion: 2.1 time: 0.378533 Oct 17 13:11:53.161282 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2151/4423] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:11:52 2022] POST /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/action => generated 32 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:11:53.191754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:53.198681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:53.231455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:53.235303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:53.236429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:53.238224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:53.239106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:53.239975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:53.312914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:11:53.437696 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Instance is already in deleting state, ignoring this request Oct 17 13:11:53.438744 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8fc59bb-b18a-466b-a268-ab12ae06a0e0 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 204 len: 0 microversion: 2.1 time: 0.259677 Oct 17 13:11:53.439773 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2152/4424] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:53 2022] DELETE /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:11:53.448890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:53.449848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:53.458880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:53.460066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:53.461124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:53.462223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:53.462974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:53.464281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:53.784876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:53.794850 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31fa1c69-3d98-4b10-b5c9-f8ae58c2f439 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.351650 Oct 17 13:11:53.801503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2153/4425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:53 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:53.811864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:53.812893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:53.830549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:53.831523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:53.832018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:53.833394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:53.833860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:53.839203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:54.435567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:54.455486 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62cdf4a2-8b57-4bbf-b463-e7b65acfe92b tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1511 microversion: 2.1 time: 0.652465 Oct 17 13:11:54.472352 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2154/4426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:53 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1511 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:54.827387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:54.828088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:54.844487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:54.845763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:54.846835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:54.848348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:54.849751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:54.851020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:55.220850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:11:55.222026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:11:55.222849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:11:55.223437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:11:55.224818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:11:55.245495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:55.248421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:55.249557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:55.266519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:55.269015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:55.269739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:55.308476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:11:55.328123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for user c71ac2b898f649cdaa99fbace633e738 and project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:11:55.362880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:11:55.368619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:11:55.481129 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6534018c-44db-45fe-8797-6a4a350ff7d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.811770 Oct 17 13:11:55.483243 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2273/4427] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:11:55.493886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:55.496672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:55.506356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:55.507013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:55.507669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:55.508628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:55.509232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:55.510057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:55.830743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:55.841099 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b173096-e69e-4523-9b06-636b106a1286 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1511 microversion: 2.1 time: 0.355553 Oct 17 13:11:55.852569 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2274/4428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:55 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:55.860803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e59e8e69-42e6-46b2-8435-92361ca97e76 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:55.861841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e59e8e69-42e6-46b2-8435-92361ca97e76 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:55.886258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:55.907784 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f595bd0d-ffc4-4121-bd19-ddaeec368008 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 1.085595 Oct 17 13:11:55.909293 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2155/4429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:54 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:55.960473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e59e8e69-42e6-46b2-8435-92361ca97e76 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:55.970502 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e59e8e69-42e6-46b2-8435-92361ca97e76 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1215 microversion: 2.1 time: 0.116403 Oct 17 13:11:55.972006 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2275/4430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:55 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:56.150975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:56.151622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:56.160410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.160911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.161354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.162129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.162534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.162964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.195917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-36e4d8ce-b104-451d-9888-5054d47653dc tempest-QuotaClassesAdmin257Test-879693442 tempest-QuotaClassesAdmin257Test-879693442-project-admin] Calling method '.version_select at 0x7fa8250a4dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:56.199100 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] HTTP exception thrown: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Request method failure captured: Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda HTTP/1.1 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLPsv3xmzlZLWFaBbPv-YQY8_BCAe08fN-MFgoVGqBmEsmtEUptyncOUcHL6tXHhrflR1lN5t6wKCu4zNWjpNAbS1GEHRCy4Sam84S-tGUO6s4gqbhUv1P14AFF339Mrm-RhYy-8xFWHADyY_FdDUNBSND7pv3GNHpCc_3mPKLwN30 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 86553345eb00474c9b8322ae23489ade Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86553345eb00474c9b8322ae23489ade", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86553345eb00474c9b8322ae23489ade"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86553345eb00474c9b8322ae23489ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86553345eb00474c9b8322ae23489ade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 86553345eb00474c9b8322ae23489ade Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TaggedBootDevicesTest_v242-367166092-project Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: c4a2a5521caf47859f5e1ad5c30519e8 Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TaggedBootDevicesTest_v242-367166092-project Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9f020194-d135-4f53-8a62-266832996cda'} Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:56.200852 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Returning 404 to user: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:56.205633 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f52a4d8d-1cc1-4042-9557-a0270bb9b6c7 tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 404 len: 111 microversion: 2.42 time: 0.056111 Oct 17 13:11:56.213521 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2276/4431] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:11:56 2022] DELETE /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:11:56.225683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:56.226747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] [instance: 9f020194-d135-4f53-8a62-266832996cda] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:56.228295 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-36e4d8ce-b104-451d-9888-5054d47653dc tempest-QuotaClassesAdmin257Test-879693442 tempest-QuotaClassesAdmin257Test-879693442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.317358 Oct 17 13:11:56.229887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2156/4432] 10.222.0.27 () {60 vars in 1226 bytes} [Mon Oct 17 13:11:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:11:56.237617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.238118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.245181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.245854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4205d4f2-e741-47f2-bf35-66c1466737e4 tempest-QuotaClassesAdmin257Test-879693442 tempest-QuotaClassesAdmin257Test-879693442-project-admin] Action: 'update', calling method: .version_select at 0x7fa8204a30d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:56.245983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.246411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.246855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.264340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:11:56.281803 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] HTTP exception thrown: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Request method failure captured: Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda HTTP/1.1 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVLPsv3xmzlZLWFaBbPv-YQY8_BCAe08fN-MFgoVGqBmEsmtEUptyncOUcHL6tXHhrflR1lN5t6wKCu4zNWjpNAbS1GEHRCy4Sam84S-tGUO6s4gqbhUv1P14AFF339Mrm-RhYy-8xFWHADyY_FdDUNBSND7pv3GNHpCc_3mPKLwN30 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 86553345eb00474c9b8322ae23489ade Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86553345eb00474c9b8322ae23489ade", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86553345eb00474c9b8322ae23489ade"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86553345eb00474c9b8322ae23489ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86553345eb00474c9b8322ae23489ade"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 86553345eb00474c9b8322ae23489ade Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-367166092 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TaggedBootDevicesTest_v242-367166092-project Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: c4a2a5521caf47859f5e1ad5c30519e8 Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TaggedBootDevicesTest_v242-367166092-project Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9f020194-d135-4f53-8a62-266832996cda'} Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.284409 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:56.290991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.290991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:56.290991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:56.290991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:56.290991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:56.290991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:56.290991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. Oct 17 13:11:56.290991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:56.293796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] Returning 404 to user: Instance 9f020194-d135-4f53-8a62-266832996cda could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:56.295323 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43dcd8ef-395c-4903-8e7a-7b0c66f957dd tempest-TaggedBootDevicesTest_v242-367166092 tempest-TaggedBootDevicesTest_v242-367166092-project] 10.222.0.27 "GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda" status: 404 len: 111 microversion: 2.42 time: 0.080279 Oct 17 13:11:56.300316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2277/4433] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:11:56 2022] GET /compute/v2.1/servers/9f020194-d135-4f53-8a62-266832996cda => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:11:56.468042 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4205d4f2-e741-47f2-bf35-66c1466737e4 tempest-QuotaClassesAdmin257Test-879693442 tempest-QuotaClassesAdmin257Test-879693442-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.227220 Oct 17 13:11:56.468801 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2157/4434] 10.222.0.27 () {62 vars in 1247 bytes} [Mon Oct 17 13:11:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:11:56.469289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9d345e1e-8e63-45f7-aede-c5ffc7a97152 req-721ac1d4-7837-4079-86bf-1f32428f4f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f4ea8e-65e7-4913-8333-029dfe4a75fa", "name": "network-vif-deleted", "tag": "6e6e985f-8bcf-45bf-8c6f-e114ca3c2af8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:56.481010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7a0b7f4f-edf9-40a1-956b-48bc3885ae4a tempest-QuotaClassesAdmin257Test-879693442 tempest-QuotaClassesAdmin257Test-879693442-project-admin] Calling method '.version_select at 0x7fa81beb0dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:56.490825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9d345e1e-8e63-45f7-aede-c5ffc7a97152 req-721ac1d4-7837-4079-86bf-1f32428f4f4e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.492913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9d345e1e-8e63-45f7-aede-c5ffc7a97152 req-721ac1d4-7837-4079-86bf-1f32428f4f4e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.493373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9d345e1e-8e63-45f7-aede-c5ffc7a97152 req-721ac1d4-7837-4079-86bf-1f32428f4f4e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.532711 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7a0b7f4f-edf9-40a1-956b-48bc3885ae4a tempest-QuotaClassesAdmin257Test-879693442 tempest-QuotaClassesAdmin257Test-879693442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.057023 Oct 17 13:11:56.535412 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2158/4435] 10.222.0.27 () {60 vars in 1226 bytes} [Mon Oct 17 13:11:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:11:56.546083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a14007c5-d57d-4fc0-8025-42fe29cbb2a3 tempest-QuotaClassesAdmin257Test-879693442 tempest-QuotaClassesAdmin257Test-879693442-project-admin] Action: 'update', calling method: .version_select at 0x7fa82045a790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:56.552124 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9d345e1e-8e63-45f7-aede-c5ffc7a97152 req-721ac1d4-7837-4079-86bf-1f32428f4f4e service nova] Creating event network-vif-deleted:6e6e985f-8bcf-45bf-8c6f-e114ca3c2af8 for instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa on n-h1-853316-12 Oct 17 13:11:56.584548 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9d345e1e-8e63-45f7-aede-c5ffc7a97152 req-721ac1d4-7837-4079-86bf-1f32428f4f4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118869 Oct 17 13:11:56.585462 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2278/4436] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:11:56.691826 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a14007c5-d57d-4fc0-8025-42fe29cbb2a3 tempest-QuotaClassesAdmin257Test-879693442 tempest-QuotaClassesAdmin257Test-879693442-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.150169 Oct 17 13:11:56.694334 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2159/4437] 10.222.0.27 () {62 vars in 1247 bytes} [Mon Oct 17 13:11:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:11:56.870211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:56.872636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:56.882521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.883298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.884425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.885875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.886964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.887565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.937345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:56.937967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:56.952555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.953603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.954563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.955566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.956023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.956753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lazy-loading 'fault' on Instance uuid b3f4ea8e-65e7-4913-8333-029dfe4a75fa {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:11:56.958367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:56.959303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:56.962008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:56.962763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:57.019598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2af8096ed394d02bdf6c285e17df1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7fe0bfe98b4320be690d525152f6f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:57.032192 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49f01cd6-1eb7-4a41-bbb6-a4c993394d48 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 200 len: 1306 microversion: 2.1 time: 0.169724 Oct 17 13:11:57.033391 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2279/4438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:56 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 1306 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:57.045698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:57.049545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:57.064819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:57.065466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:57.066115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:57.066873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:57.069400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:57.070073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:57.167462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:57.179059 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00039234-9e95-4dae-b8c9-cb2e9450793b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1267 microversion: 2.1 time: 0.144334 Oct 17 13:11:57.180123 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2280/4439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:57 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:57.383738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:57.405994 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-03dfef7d-daac-44f1-a2cb-cb372d169857 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.470686 Oct 17 13:11:57.410830 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2160/4440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:56 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:11:58.064904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:58.067130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: b3f4ea8e-65e7-4913-8333-029dfe4a75fa] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:58.079243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.080419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.081411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.082395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.083108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.083758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.108415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] HTTP exception thrown: Instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa could not be found. Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Request method failure captured: Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa HTTP/1.1 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVQBt71aOQlpGNxQBECOeNNz53o9rgGfcb6mFap2PDwHVD3c31kCy8VI1XuR2yF8V_bcdrCdjwaa8PSWUYODiTYuKY5sdBaqQqTSbQWbExbzLW1wsbI3JPgQ4qKuN9Gs3X-HywgOQtEvT5JdlXVcmhtOD2eQER-CRjG5uARuLFPSABM Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a7fe0bfe98b4320be690d525152f6f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f2af8096ed394d02bdf6c285e17df1f7 Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa could not be found. Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b3f4ea8e-65e7-4913-8333-029dfe4a75fa'} Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa could not be found. Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa could not be found. Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.112461 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.116435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.116435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.116435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.116435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:58.116435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:58.116435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa could not be found. Oct 17 13:11:58.116435 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.121074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Returning 404 to user: Instance b3f4ea8e-65e7-4913-8333-029dfe4a75fa could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:58.123263 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8c978480-1683-499d-a66b-b0763dc110d4 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa" status: 404 len: 111 microversion: 2.1 time: 0.066598 Oct 17 13:11:58.127456 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2281/4441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:58 2022] GET /compute/v2.1/servers/b3f4ea8e-65e7-4913-8333-029dfe4a75fa => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:58.132458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:58.133514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:58.141078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.141799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.142470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.143569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.144263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.144852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.169648 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] HTTP exception thrown: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Request method failure captured: Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 HTTP/1.1 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVQBt71aOQlpGNxQBECOeNNz53o9rgGfcb6mFap2PDwHVD3c31kCy8VI1XuR2yF8V_bcdrCdjwaa8PSWUYODiTYuKY5sdBaqQqTSbQWbExbzLW1wsbI3JPgQ4qKuN9Gs3X-HywgOQtEvT5JdlXVcmhtOD2eQER-CRjG5uARuLFPSABM Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a7fe0bfe98b4320be690d525152f6f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: f2af8096ed394d02bdf6c285e17df1f7 Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '7fb587b1-1e80-467b-bee5-bc89f62360c2'} Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:58.172379 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.176828 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.179382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Returning 404 to user: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:58.180480 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-93122770-51d2-4b7d-a4df-c1825d45a69e tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 404 len: 111 microversion: 2.1 time: 0.051983 Oct 17 13:11:58.181569 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2161/4442] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:58 2022] DELETE /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:58.192248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:58.192971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 7fb587b1-1e80-467b-bee5-bc89f62360c2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:58.205258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.208154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:58.208328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.209105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:58.209563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.210823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.216891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.217130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.217782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.217929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.219186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.220262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.221645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.222686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.259634 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] HTTP exception thrown: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Request method failure captured: Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 HTTP/1.1 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVQBt71aOQlpGNxQBECOeNNz53o9rgGfcb6mFap2PDwHVD3c31kCy8VI1XuR2yF8V_bcdrCdjwaa8PSWUYODiTYuKY5sdBaqQqTSbQWbExbzLW1wsbI3JPgQ4qKuN9Gs3X-HywgOQtEvT5JdlXVcmhtOD2eQER-CRjG5uARuLFPSABM Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a7fe0bfe98b4320be690d525152f6f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f2af8096ed394d02bdf6c285e17df1f7 Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7fb587b1-1e80-467b-bee5-bc89f62360c2'} Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.265381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Returning 404 to user: Instance 7fb587b1-1e80-467b-bee5-bc89f62360c2 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:58.269394 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5517bec3-ee30-47db-887a-4e1a74bbf91f tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2" status: 404 len: 111 microversion: 2.1 time: 0.079767 Oct 17 13:11:58.271216 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2282/4443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:58 2022] GET /compute/v2.1/servers/7fb587b1-1e80-467b-bee5-bc89f62360c2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:58.277702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:58.278227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:58.284972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.285470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.285915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.288351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.288823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.289265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.311621 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] HTTP exception thrown: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Request method failure captured: Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 HTTP/1.1 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVQBt71aOQlpGNxQBECOeNNz53o9rgGfcb6mFap2PDwHVD3c31kCy8VI1XuR2yF8V_bcdrCdjwaa8PSWUYODiTYuKY5sdBaqQqTSbQWbExbzLW1wsbI3JPgQ4qKuN9Gs3X-HywgOQtEvT5JdlXVcmhtOD2eQER-CRjG5uARuLFPSABM Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a7fe0bfe98b4320be690d525152f6f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f2af8096ed394d02bdf6c285e17df1f7 Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '8ad23758-40e8-46a3-9c04-2f14d26d6226'} Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:58.315466 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Returning 404 to user: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cdaca505-0d72-4fbc-b120-7e0de1d752a5 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 404 len: 111 microversion: 2.1 time: 0.044963 Oct 17 13:11:58.324749 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2283/4444] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:11:58 2022] DELETE /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:58.327253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:58.327900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:58.328526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] [instance: 8ad23758-40e8-46a3-9c04-2f14d26d6226] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:58.335496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.336432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.336554 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-21f23ffe-8ebc-41a8-b725-89193c8c0928 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1273 microversion: 2.1 time: 0.133049 Oct 17 13:11:58.337228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.337488 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2162/4445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:58 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1273 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:58.340325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.340885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.341428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.359416 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] HTTP exception thrown: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Request method failure captured: Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 HTTP/1.1 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVQBt71aOQlpGNxQBECOeNNz53o9rgGfcb6mFap2PDwHVD3c31kCy8VI1XuR2yF8V_bcdrCdjwaa8PSWUYODiTYuKY5sdBaqQqTSbQWbExbzLW1wsbI3JPgQ4qKuN9Gs3X-HywgOQtEvT5JdlXVcmhtOD2eQER-CRjG5uARuLFPSABM Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a7fe0bfe98b4320be690d525152f6f1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a7fe0bfe98b4320be690d525152f6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7a7fe0bfe98b4320be690d525152f6f1 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839491455 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f2af8096ed394d02bdf6c285e17df1f7 Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerDiskConfigTestJSON-839491455-project Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '8ad23758-40e8-46a3-9c04-2f14d26d6226'} Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:11:58.361296 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] Returning 404 to user: Instance 8ad23758-40e8-46a3-9c04-2f14d26d6226 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:11:58.365297 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e87c13b3-9e32-4ee4-9db9-44ff860002c3 tempest-ServerDiskConfigTestJSON-839491455 tempest-ServerDiskConfigTestJSON-839491455-project] 10.222.0.27 "GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226" status: 404 len: 111 microversion: 2.1 time: 0.039417 Oct 17 13:11:58.367951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2284/4446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:58 2022] GET /compute/v2.1/servers/8ad23758-40e8-46a3-9c04-2f14d26d6226 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:11:58.437893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:58.438689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:58.451613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.452124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.460933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:58.462515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:58.462515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:58.462734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:59.064759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:59.106510 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-121a9a92-2d8d-4e00-a166-f0bc479a9d5a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.667015 Oct 17 13:11:59.107175 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2163/4447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:58 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:11:59.367096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:11:59.367923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:11:59.378022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:59.378842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:59.379456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:59.380346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:59.380982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:59.381421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:59.687515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4c1b0b1b-dbaa-4750-ac8c-2e339e9540ab req-e2f44ee8-c705-4d12-9d83-9b7c75191ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac7c688b-c922-471a-8a08-c1ba365c4dc6", "tag": "91f1ce14-9d8b-47c9-a806-d9abb7e75671"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:11:59.705242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c1b0b1b-dbaa-4750-ac8c-2e339e9540ab req-e2f44ee8-c705-4d12-9d83-9b7c75191ace service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:11:59.706222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c1b0b1b-dbaa-4750-ac8c-2e339e9540ab req-e2f44ee8-c705-4d12-9d83-9b7c75191ace service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:11:59.706857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c1b0b1b-dbaa-4750-ac8c-2e339e9540ab req-e2f44ee8-c705-4d12-9d83-9b7c75191ace service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:11:59.720948 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4c1b0b1b-dbaa-4750-ac8c-2e339e9540ab req-e2f44ee8-c705-4d12-9d83-9b7c75191ace service nova] Creating event network-changed:91f1ce14-9d8b-47c9-a806-d9abb7e75671 for instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 on n-h2-853316-12 Oct 17 13:11:59.723883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:11:59.729990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4c1b0b1b-dbaa-4750-ac8c-2e339e9540ab req-e2f44ee8-c705-4d12-9d83-9b7c75191ace service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048381 Oct 17 13:11:59.731344 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2164/4448] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:11:59.738558 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b20bec20-9f2b-4402-a997-f5469fc52d40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1315 microversion: 2.1 time: 0.375826 Oct 17 13:11:59.755905 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2285/4449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:11:59 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:00.130984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:00.131698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:00.143011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:00.143538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:00.144163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:00.146002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:00.146678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:00.149020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:00.182992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:00.770850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:00.772107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:00.779594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:00.780465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:00.781168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:00.782176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:00.782936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:00.783588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:00.875792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:00.890114 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cff99444-87f7-4b0e-b945-401798cce66c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.763491 Oct 17 13:12:00.891079 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2165/4450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:00 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:00.982475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:00.994476 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f1e73f60-8863-4623-a5c8-322c62597774 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1315 microversion: 2.1 time: 0.226939 Oct 17 13:12:00.995073 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2286/4451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:00 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:01.918498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:01.919848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:01.955591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:01.956898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:01.960747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:01.961746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:01.962436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:01.963937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:02.021059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:02.021664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:02.035531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:02.039701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:02.040171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:02.041452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:02.051515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:02.052563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:02.651150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:02.679706 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19adf4e1-f45f-4eae-b9ca-2976c983bd48 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.768144 Oct 17 13:12:02.682980 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2166/4452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:01 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:02.907794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ecf073e8-dc85-42da-91bd-1d97ce4964da tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Calling method '.version_select at 0x7fa820d31b80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:02.956662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:02.971571 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-02b5eef4-e14e-44a9-a804-359f4641b628 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1315 microversion: 2.1 time: 0.954685 Oct 17 13:12:02.975066 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2287/4453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:02 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1315 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:03.057042 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ecf073e8-dc85-42da-91bd-1d97ce4964da tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c6418df877814eac9b0f2b1ade65b5bc" status: 200 len: 371 microversion: 2.1 time: 0.372660 Oct 17 13:12:03.058258 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2167/4454] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 13:12:02 2022] GET /compute/v2.1/os-quota-sets/c6418df877814eac9b0f2b1ade65b5bc => generated 371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:03.070552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08a57b84-ed17-421e-be04-d2f782563b45 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Action: 'update', calling method: .version_select at 0x7fa820cf1c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:03.164301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a57b84-ed17-421e-be04-d2f782563b45 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:03.164811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a57b84-ed17-421e-be04-d2f782563b45 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:03.165582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a57b84-ed17-421e-be04-d2f782563b45 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:03.167255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a57b84-ed17-421e-be04-d2f782563b45 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:03.167738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a57b84-ed17-421e-be04-d2f782563b45 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:03.168169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08a57b84-ed17-421e-be04-d2f782563b45 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:03.386267 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08a57b84-ed17-421e-be04-d2f782563b45 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6418df877814eac9b0f2b1ade65b5bc" status: 200 len: 328 microversion: 2.1 time: 0.308451 Oct 17 13:12:03.387823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-745702f5-b2b5-42c5-a0a7-c74fb0512073 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:03.395062 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2288/4455] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 13:12:03 2022] PUT /compute/v2.1/os-quota-sets/c6418df877814eac9b0f2b1ade65b5bc => generated 328 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:03.403930 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-745702f5-b2b5-42c5-a0a7-c74fb0512073 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/c6418df877814eac9b0f2b1ade65b5bc" status: 202 len: 0 microversion: 2.1 time: 0.020161 Oct 17 13:12:03.405308 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2168/4456] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:12:03 2022] DELETE /compute/v2.1/os-quota-sets/c6418df877814eac9b0f2b1ade65b5bc => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:12:03.413299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90c5c15c-3fcf-4460-9adf-e5677a3d99fb tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Calling method '.version_select at 0x7fa81bdaa1f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:03.512980 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90c5c15c-3fcf-4460-9adf-e5677a3d99fb tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c6418df877814eac9b0f2b1ade65b5bc" status: 200 len: 371 microversion: 2.1 time: 0.103465 Oct 17 13:12:03.522669 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2289/4457] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 13:12:03 2022] GET /compute/v2.1/os-quota-sets/c6418df877814eac9b0f2b1ade65b5bc => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:03.719397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:03.736877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:03.754714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:03.757410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:03.758701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:03.763997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:03.767037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:03.769309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:03.794617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aeb05ceb-b318-4220-b7cc-895ff06207bb tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Calling method '.version_select at 0x7fa820cf13a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:04.210493 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aeb05ceb-b318-4220-b7cc-895ff06207bb tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ab6fcb967ca44b00b523fea79c085930/defaults" status: 200 len: 371 microversion: 2.1 time: 0.419904 Oct 17 13:12:04.211162 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2290/4458] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 13:12:03 2022] GET /compute/v2.1/os-quota-sets/ab6fcb967ca44b00b523fea79c085930/defaults => generated 371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:04.216046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:04.216672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:04.249956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:04.250768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:04.251270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:04.252469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:04.253111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:04.253828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:04.411917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:04.430179 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e521618-234f-495e-b3fe-d329d8da5e7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.719578 Oct 17 13:12:04.445009 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2169/4459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:03 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:04.726110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-470955a9-de0d-42a2-9c3c-56b863748e59 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Action: 'update', calling method: .version_select at 0x7fa8204ea160>, body: {"quota_set": {"ram": "5120"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:04.980063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:04.991643 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b83c55b3-c69d-44fe-a281-bf8dd1d56b33 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1315 microversion: 2.1 time: 0.779464 Oct 17 13:12:04.993554 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2291/4460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:04 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:05.096124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-470955a9-de0d-42a2-9c3c-56b863748e59 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:05.101184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-470955a9-de0d-42a2-9c3c-56b863748e59 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:05.101949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-470955a9-de0d-42a2-9c3c-56b863748e59 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:05.110905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-470955a9-de0d-42a2-9c3c-56b863748e59 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:05.111857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-470955a9-de0d-42a2-9c3c-56b863748e59 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:05.113271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-470955a9-de0d-42a2-9c3c-56b863748e59 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:05.238271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-470955a9-de0d-42a2-9c3c-56b863748e59 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/7a01688151f548fb9d3c6df92afcc02f" status: 200 len: 328 microversion: 2.1 time: 0.517268 Oct 17 13:12:05.242319 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2170/4461] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 13:12:04 2022] PUT /compute/v2.1/os-quota-sets/7a01688151f548fb9d3c6df92afcc02f => generated 328 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:05.255983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72f3ce54-4721-4dcd-b218-09f9d37be76a tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Calling method '.version_select at 0x7fa820d0e310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:05.469393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:05.471799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:05.473662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72f3ce54-4721-4dcd-b218-09f9d37be76a tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:05.475407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72f3ce54-4721-4dcd-b218-09f9d37be76a tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:05.476833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72f3ce54-4721-4dcd-b218-09f9d37be76a tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:05.481953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72f3ce54-4721-4dcd-b218-09f9d37be76a tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:05.484285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72f3ce54-4721-4dcd-b218-09f9d37be76a tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:05.485181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72f3ce54-4721-4dcd-b218-09f9d37be76a tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:05.487385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:05.487540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:05.492584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:05.495556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:05.496153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:05.496723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:05.590853 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72f3ce54-4721-4dcd-b218-09f9d37be76a tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/7a01688151f548fb9d3c6df92afcc02f/detail" status: 200 len: 916 microversion: 2.1 time: 0.335586 Oct 17 13:12:05.590853 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2292/4462] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 17 13:12:05 2022] GET /compute/v2.1/os-quota-sets/7a01688151f548fb9d3c6df92afcc02f/detail => generated 916 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:05.937301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Action: 'update', calling method: .version_select at 0x7fa8212abee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:06.069599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:06.070218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:06.070811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:06.071893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:06.073037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:06.073858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:06.132625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:06.158291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:06.196088 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4faf9e8a-bc79-46bd-82a6-e52853034c62 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.730300 Oct 17 13:12:06.199882 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2171/4463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:05 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:06.206085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:06.206961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:06.219064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:06.219931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:06.220632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:06.223414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:06.224174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:06.225881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:06.234425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:06.235275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:06.235925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:06.236850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:06.242197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:06.243070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:06.416097 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f6a84179-30f6-42c2-9afd-fb69f306c9f3 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/7a01688151f548fb9d3c6df92afcc02f?user_id=007c3944d1914423a78cd803abf1c24e" status: 200 len: 328 microversion: 2.1 time: 0.487972 Oct 17 13:12:06.430460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2293/4464] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:12:05 2022] PUT /compute/v2.1/os-quota-sets/7a01688151f548fb9d3c6df92afcc02f?user_id=007c3944d1914423a78cd803abf1c24e => generated 328 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:06.440920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad2cd90f-387e-4299-bb93-16b520a21035 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Calling method '.version_select at 0x7fa82146fdc0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:06.614206 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad2cd90f-387e-4299-bb93-16b520a21035 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/7a01688151f548fb9d3c6df92afcc02f?user_id=007c3944d1914423a78cd803abf1c24e" status: 200 len: 370 microversion: 2.1 time: 0.181717 Oct 17 13:12:06.634387 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2294/4465] 10.222.0.27 () {58 vars in 1323 bytes} [Mon Oct 17 13:12:06 2022] GET /compute/v2.1/os-quota-sets/7a01688151f548fb9d3c6df92afcc02f?user_id=007c3944d1914423a78cd803abf1c24e => generated 370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:06.721971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:06.738003 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c58854c6-f2fa-425d-8474-f0d2ecaf6eb9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1315 microversion: 2.1 time: 0.536288 Oct 17 13:12:06.754193 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2172/4466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:06 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:07.226592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:07.227502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:07.241331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:07.241989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:07.242525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:07.243594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:07.244134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:07.244578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:07.482828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f42f1388-fa7e-4e28-9de7-e44a4c6ab737 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Calling method '.version_select at 0x7fa82529ab80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:07.942647 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f42f1388-fa7e-4e28-9de7-e44a4c6ab737 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ab6fcb967ca44b00b523fea79c085930/defaults" status: 200 len: 371 microversion: 2.1 time: 0.463675 Oct 17 13:12:07.944742 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2173/4467] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 13:12:07 2022] GET /compute/v2.1/os-quota-sets/ab6fcb967ca44b00b523fea79c085930/defaults => generated 371 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:07.953251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:07.953872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:07.965314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:07.966219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:07.967358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:07.968408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:07.969374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:07.969969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:08.172171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:08.187076 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-54cae089-c008-4cc0-987a-a3caf9c8613b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.967278 Oct 17 13:12:08.191230 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2295/4468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:07 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:08.196196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-279e03c4-7538-4662-b48b-e4760707a3fd tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Action: 'update', calling method: .version_select at 0x7fa82086d3a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:08.407172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-279e03c4-7538-4662-b48b-e4760707a3fd tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:08.407674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-279e03c4-7538-4662-b48b-e4760707a3fd tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:08.408025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:08.408190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-279e03c4-7538-4662-b48b-e4760707a3fd tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:08.408841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-279e03c4-7538-4662-b48b-e4760707a3fd tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:08.409502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-279e03c4-7538-4662-b48b-e4760707a3fd tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:08.410116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-279e03c4-7538-4662-b48b-e4760707a3fd tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:08.419575 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-deec1071-16c9-4693-a51d-a98c3485bbed tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1315 microversion: 2.1 time: 0.473709 Oct 17 13:12:08.438107 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2174/4469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:07 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:08.450346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-1335155f-6885-44f5-b9be-1c25caa5be96 req-a86f1b8b-4a78-43e7-b5d0-5ade5f5528f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac7c688b-c922-471a-8a08-c1ba365c4dc6", "name": "network-vif-plugged", "status": "completed", "tag": "91f1ce14-9d8b-47c9-a806-d9abb7e75671"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:08.462329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1335155f-6885-44f5-b9be-1c25caa5be96 req-a86f1b8b-4a78-43e7-b5d0-5ade5f5528f1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:08.466922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1335155f-6885-44f5-b9be-1c25caa5be96 req-a86f1b8b-4a78-43e7-b5d0-5ade5f5528f1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:08.467793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-1335155f-6885-44f5-b9be-1c25caa5be96 req-a86f1b8b-4a78-43e7-b5d0-5ade5f5528f1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:08.505006 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-1335155f-6885-44f5-b9be-1c25caa5be96 req-a86f1b8b-4a78-43e7-b5d0-5ade5f5528f1 service nova] Creating event network-vif-plugged:91f1ce14-9d8b-47c9-a806-d9abb7e75671 for instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 on n-h2-853316-12 Oct 17 13:12:08.518413 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-1335155f-6885-44f5-b9be-1c25caa5be96 req-a86f1b8b-4a78-43e7-b5d0-5ade5f5528f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078302 Oct 17 13:12:08.521772 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2175/4470] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:08.855456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-279e03c4-7538-4662-b48b-e4760707a3fd tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/ab6fcb967ca44b00b523fea79c085930" status: 200 len: 329 microversion: 2.1 time: 0.662816 Oct 17 13:12:08.856495 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2296/4471] 10.222.0.27 () {60 vars in 1263 bytes} [Mon Oct 17 13:12:08 2022] PUT /compute/v2.1/os-quota-sets/ab6fcb967ca44b00b523fea79c085930 => generated 329 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:08.876814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75a0bdf5-49bc-45f5-876c-615f69462f91 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Action: 'update', calling method: .version_select at 0x7fa820463a60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:09.238917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:09.243009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:09.272826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:09.273552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:09.274836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:09.277299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:09.278679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:09.279836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:09.539181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75a0bdf5-49bc-45f5-876c-615f69462f91 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:09.540299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75a0bdf5-49bc-45f5-876c-615f69462f91 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:09.541938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75a0bdf5-49bc-45f5-876c-615f69462f91 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:09.543937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75a0bdf5-49bc-45f5-876c-615f69462f91 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:09.544618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75a0bdf5-49bc-45f5-876c-615f69462f91 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:09.545245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75a0bdf5-49bc-45f5-876c-615f69462f91 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:09.688170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:09.707511 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-463cb3e0-16f9-47ec-aca4-bcfcf3b8d917 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.474383 Oct 17 13:12:09.708234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:UPDATE=15,nova_api:SELECT=78,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:09.708486 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2297/4472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:09 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:09.713510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:09.714494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:09.731772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:09.732792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:09.733659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:09.743352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:09.744759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:09.746069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:10.095223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:10.105517 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ede27b84-a41d-409f-802f-8916642c25e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1315 microversion: 2.1 time: 0.396083 Oct 17 13:12:10.122359 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2298/4473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:09 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:10.128389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1306641664", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "dcc9b61b-3373-4dcd-bfe8-4bd93fb5a0d9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-113359504", "security_groups": [{"name": "tempest-secgroup-smoke-1112370007"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:10.273540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] validate_networks() for [('dcc9b61b-3373-4dcd-bfe8-4bd93fb5a0d9', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:12:10.409158 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75a0bdf5-49bc-45f5-876c-615f69462f91 tempest-QuotasAdminTestJSON-1982667070 tempest-QuotasAdminTestJSON-1982667070-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/ab6fcb967ca44b00b523fea79c085930" status: 200 len: 329 microversion: 2.1 time: 1.523414 Oct 17 13:12:10.416930 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2176/4474] 10.222.0.27 () {60 vars in 1263 bytes} [Mon Oct 17 13:12:08 2022] PUT /compute/v2.1/os-quota-sets/ab6fcb967ca44b00b523fea79c085930 => generated 329 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:10.735411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:10.736912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:10.746536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:10.751203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:10.751993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:10.755013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:10.755764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:10.756476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:11.044808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:12:11.045802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:12:11.046730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:12:11.048138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:12:11.048890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:12:11.061248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:11.061973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:11.062109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:11.062851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:11.064462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:11.065379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:11.066242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:11.070627 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4667239b-e9c4-43ca-a583-382a7dc48e71 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.340856 Oct 17 13:12:11.074413 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2177/4475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:10 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:11.091507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for project e5d16284093341d980341f1dce38f68b. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:12:11.099088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for user 0cee3a8479444aa3a00b2c29407931d9 and project e5d16284093341d980341f1dce38f68b. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:12:11.114849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:12:11.117465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:12:11.129785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:11.130637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:11.157610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:11.158379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:11.162591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:11.166978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:11.169375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:11.170430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:11.280824 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-37e574c5-6596-4074-94e3-269e3443174c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.156681 Oct 17 13:12:11.288530 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2299/4476] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:12:11.294310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21f9ca5c-fd68-4301-8202-2f10b0195bc2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:11.295112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21f9ca5c-fd68-4301-8202-2f10b0195bc2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:11.540007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21f9ca5c-fd68-4301-8202-2f10b0195bc2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:11.556195 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21f9ca5c-fd68-4301-8202-2f10b0195bc2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1266 microversion: 2.1 time: 0.266114 Oct 17 13:12:11.586588 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2300/4477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:11 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:11.723916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:11.745319 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6174b097-b54a-4b55-bd41-dd94fcb48acf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1501 microversion: 2.1 time: 0.617357 Oct 17 13:12:11.752677 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2178/4478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:11 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1501 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:11.772234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d26ffdf0-79f4-419b-8605-b4d161f5cdc5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:11.784662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d26ffdf0-79f4-419b-8605-b4d161f5cdc5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:11.785207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d26ffdf0-79f4-419b-8605-b4d161f5cdc5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:11.785661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d26ffdf0-79f4-419b-8605-b4d161f5cdc5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:11.866375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:11.870902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d26ffdf0-79f4-419b-8605-b4d161f5cdc5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Going to try to stop instance {{(pid=127540) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:12:11.973799 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d26ffdf0-79f4-419b-8605-b4d161f5cdc5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.205617 Oct 17 13:12:11.974792 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2301/4479] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:12:11 2022] POST /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:12:11.984388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:11.985262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:12.000999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:12.002279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:12.003451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:12.006471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:12.007740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:12.008915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:12.106021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:12.107084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:12.123980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:12.125756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:12.126571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:12.128762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:12.130510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:12.131070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:12.294320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:12.308779 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7fc882eb-0862-47fd-b70c-0e3d303083c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.329641 Oct 17 13:12:12.310475 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2179/4480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:11 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:12.454228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:12.470213 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8828b082-df7b-41df-b040-f0bfc1bebf36 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.374290 Oct 17 13:12:12.471183 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2302/4481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:12 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:12.583154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:12.583926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:12.594111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:12.598864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:12.599486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:12.600502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:12.601224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:12.601861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:12.757751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:12.776197 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee1703dc-89cf-423f-b418-de7d3fce559e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1262 microversion: 2.1 time: 0.194169 Oct 17 13:12:12.795896 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2180/4482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:12 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1262 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:13.338558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:13.339349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:13.343136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=18 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:13.359779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:13.361374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:13.364732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:13.365576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:13.366369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:13.370937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:13.499245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:13.500249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:13.514175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:13.514695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:13.515344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:13.516311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:13.517337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:13.520278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:14.380291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:14.389080 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8bd0738a-8e2a-466d-bcaf-50702d57f031 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.894581 Oct 17 13:12:14.405714 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2181/4483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:13 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:14.421284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:14.422287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:14.434186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:14.435034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:14.435663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:14.439930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:14.440679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:14.443059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:14.485155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:14.495974 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9b6f4275-edc3-48fb-bf48-41ce7de234c9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 1.162848 Oct 17 13:12:14.502384 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2303/4484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:13 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:14.846587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:14.863013 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b9df648-77aa-4af5-850f-f8bdd11058d6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1324 microversion: 2.1 time: 0.455823 Oct 17 13:12:14.883219 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2182/4485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:14 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1324 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:15.412994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:15.413611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:15.427754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:15.428257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:15.432768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:15.433606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:15.434078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:15.434729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:15.533749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:15.534909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:15.558529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:15.562903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:15.563654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:15.568217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:15.568938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:15.569534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:15.936860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:15.955876 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d173a10-4b5b-441a-8f0d-54a08f95bb03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.546684 Oct 17 13:12:15.956905 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2304/4486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:15 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:15.961676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:15.962306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:15.970672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:15.971371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:15.971976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:15.972842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:15.973464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:15.973892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:16.127917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:16.140917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e0e15881-54ae-4d21-95f5-6e1dd7b85d86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1324 microversion: 2.1 time: 0.182893 Oct 17 13:12:16.141910 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2305/4487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:15 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:16.363723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:16.373401 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dfcde777-4cc3-4e04-a906-6445693977e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.847242 Oct 17 13:12:16.375838 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2183/4488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:15 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:16.610350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0e90b53e-7dc4-4ef1-8385-2d3280adf730 tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] Action: 'create', calling method: .version_select at 0x7fa820aa6e50>, body: {"security_group": {"name": "tempest-securitygroup-1533456774", "description": "tempest-description-502883090"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:16.986419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:16.987014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:17.004926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:17.005460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:17.005919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:17.006875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:17.008413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:17.008413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:17.157424 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0e90b53e-7dc4-4ef1-8385-2d3280adf730 tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.868126 Oct 17 13:12:17.165950 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2306/4489] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:12:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:17.167965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:17.168487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:17.184488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:17.184999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:17.186347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:17.187295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:17.187955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:17.188635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:17.468795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:17.482401 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7e4bb19-4415-40e5-a873-f5762c2a3716 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.318297 Oct 17 13:12:17.496352 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2307/4490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:17 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:17.506791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cb42dcd2-0162-441f-99b5-3baf0bc634d3 tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] Action: 'create', calling method: .version_select at 0x7fa820aa6a60>, body: {"security_group": {"name": "tempest-securitygroup-1763184763", "description": "tempest-description-331230366"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:17.738130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cb42dcd2-0162-441f-99b5-3baf0bc634d3 tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.240242 Oct 17 13:12:17.739157 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2308/4491] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:12:17 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:17.745836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:17.746588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:17.755892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:17.756385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:17.756823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:17.757578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:17.758079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:17.758528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:17.906223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:17.923872 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d44ccc97-1ad1-4ac7-b385-ea41799908d7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.941892 Oct 17 13:12:17.926004 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2184/4492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:16 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:17.942788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:17.954916 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-721004b9-0d9a-4ef7-a418-a34d0c833e66 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.214314 Oct 17 13:12:17.956087 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2309/4493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:17 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:18.023449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb78eaf3-4e12-4223-9938-e24eef8932fc tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] Action: 'create', calling method: .version_select at 0x7fa8203f1f70>, body: {"security_group": {"name": "tempest-securitygroup-1737557574", "description": "tempest-description-1087102593"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:18.518533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:18.520988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:18.533133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:18.533832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:18.534376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:18.535402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:18.536395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:18.536924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:18.707648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:18.718700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-265f1941-2dbe-4437-b37d-2e450bdae87c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.212013 Oct 17 13:12:18.719297 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2310/4494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:18 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:18.740233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d39aab06-63d6-423e-96aa-6024927ddfd6 req-823f8c0d-6210-40de-870d-5bf91881510a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:18.752403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d39aab06-63d6-423e-96aa-6024927ddfd6 req-823f8c0d-6210-40de-870d-5bf91881510a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:18.752946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d39aab06-63d6-423e-96aa-6024927ddfd6 req-823f8c0d-6210-40de-870d-5bf91881510a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:18.753805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d39aab06-63d6-423e-96aa-6024927ddfd6 req-823f8c0d-6210-40de-870d-5bf91881510a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:18.766738 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d39aab06-63d6-423e-96aa-6024927ddfd6 req-823f8c0d-6210-40de-870d-5bf91881510a service nova] Creating event network-changed:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h1-853316-12 Oct 17 13:12:18.772959 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d39aab06-63d6-423e-96aa-6024927ddfd6 req-823f8c0d-6210-40de-870d-5bf91881510a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036662 Oct 17 13:12:18.773574 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2311/4495] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:18.971930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:18.973549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:18.989771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:18.991335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:18.992960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:18.995018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:18.996336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:18.997018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:19.221025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:19.234594 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a4266cb5-c8b6-4f61-9b44-ac4f0bd7dda6 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.268994 Oct 17 13:12:19.254820 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2312/4496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:18 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:19.261252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:19.262141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:19.276748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:19.277831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:19.278561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:19.279451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:19.280073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:19.280665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:19.541419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:19.554550 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86e820ee-c102-438a-82a2-0d7c9f3f4494 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.294830 Oct 17 13:12:19.555645 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2313/4497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:19 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:19.556221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:19.747193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:19.748562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:19.761891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:19.764869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:19.765425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:19.766229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:19.766719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:19.767163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:19.844814 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb78eaf3-4e12-4223-9938-e24eef8932fc tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.916912 Oct 17 13:12:19.845490 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2185/4498] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:12:17 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:19.860414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8e61335-6bd7-4bac-9e29-2f65da5e6b5a tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] Action: 'create', calling method: .version_select at 0x7fa8204c4a60>, body: {"security_group": {"name": "tempest-securitygroup-681449243", "description": "tempest-description-843402168"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:19.982587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:19.991421 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c73964b-4034-470d-8204-aa2eb80236e2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.252385 Oct 17 13:12:19.992867 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2314/4499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:19 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:20.262646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:20.263776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:20.270103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:20.270852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:20.271192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:20.271972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:20.272630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:20.273061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:20.367397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:20.427141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:20.436131 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-551aebfc-5e26-4080-980e-40fbdd957116 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.178463 Oct 17 13:12:20.436718 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2315/4500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:20 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:20.506608 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8e61335-6bd7-4bac-9e29-2f65da5e6b5a tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.650295 Oct 17 13:12:20.507310 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2186/4501] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:12:19 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:20.520487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4c808451-091f-44a8-af3a-b8112a1785ce tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] Calling method '.version_select at 0x7fa820207f70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:20.581321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:20.583490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:20.592669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:20.594245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:20.594913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:20.596433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:20.597025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:20.597835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:20.893145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:20.911518 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c2c89fd-27e6-43c0-8281-2744f65e016a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.334295 Oct 17 13:12:20.913119 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2187/4502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:20 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:21.016600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:21.017896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:21.034360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:21.035858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:21.037202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:21.042487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:21.043395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:21.044273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:21.081450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=15 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:21.344715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:21.354780 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cfc941b0-eee9-4170-9574-bfe7b134f49a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.342925 Oct 17 13:12:21.370669 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2188/4503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:21 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:21.464291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:21.464936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:21.474566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:21.475067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:21.475504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:21.477275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:21.477928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:21.482592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:21.511619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:21.545319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=78 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:21.724326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:21.748529 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f95cd193-5153-4ade-82db-fc5d58bff7b5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.290996 Oct 17 13:12:21.765772 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2189/4504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:21 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:21.935823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:21.936432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:21.952301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:21.952815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:21.955566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:21.959251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:21.959251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:21.959488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:22.142289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:22.160101 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb21bb6a-5a78-4ce5-b0a0-b2c45efb50c1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.228057 Oct 17 13:12:22.161109 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2190/4505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:21 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:22.378433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1197338674", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "de13a9e7-1475-49d1-8904-ada2e1e2e0ba"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:22.439610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] validate_networks() for [('de13a9e7-1475-49d1-8904-ada2e1e2e0ba', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:12:23.309859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:12:23.310500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:12:23.310874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:12:23.310874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:12:23.310874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:12:23.333377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:23.338930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:23.339461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:23.340532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:23.342404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:23.354078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:23.389387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Getting quotas for project c8c5cd880cc14ec98153be5f3208187a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:12:23.405129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Getting quotas for user 0623ee4e83f84d7dbb0b27c40c6b9c7d and project c8c5cd880cc14ec98153be5f3208187a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:12:23.431941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Going to run 3 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:12:23.434626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:12:23.482809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=86251db7-6bf6-4c1d-a50c-11b2ccdb792a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:12:23.534747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=4f3b68f0-eeab-42f9-bab7-fe69c2261ac4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:12:23.558493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=13,nova_api:INSERT=19 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:23.663623 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-29fbc7ca-0dbe-4b70-912e-ee4254b3c53e tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383862 Oct 17 13:12:23.675341 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2191/4506] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:12:23.681005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:23.682151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:23.689929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:23.690966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:23.691667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:23.692637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:23.693358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:23.694041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:24.235165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:24.245404 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1de9d9a4-871e-480e-92d2-3b54d427a172 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.568349 Oct 17 13:12:24.246692 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2192/4507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:23 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:24.268921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:24.269875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:24.278199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:24.278921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:24.279569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:24.280480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:24.281108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:24.281705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:24.496361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:24.510778 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-429efa54-f482-46ca-a6f6-5690a3914cc7 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.245065 Oct 17 13:12:24.511936 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2193/4508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:24 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:24.520348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:24.521799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:24.542010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:24.543152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:24.544520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:24.546529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:24.548183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:24.550400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:24.770506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:24.782916 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c69ebbd5-f123-4e58-8801-b01c88c2c115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.269266 Oct 17 13:12:24.783903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2194/4509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:24 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:24.804931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:24.813046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:24.814539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'deleted': False, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:24.849035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:24.849677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:24.850204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:24.851007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:24.851739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:24.852097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:24.881333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Listed batch of 2 results from cell out of 997 limit. Returned 2 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:12:24.917053 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-61c9e9ac-9f54-46f7-af32-26db96750bd2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.130734 Oct 17 13:12:24.917706 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2195/4510] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 13:12:24 2022] GET /compute/v2.1/servers => generated 1018 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:24.930637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9a6feb5a-305f-4dcf-9bab-66fbd330aacd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:24.932205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9a6feb5a-305f-4dcf-9bab-66fbd330aacd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:25.019424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9a6feb5a-305f-4dcf-9bab-66fbd330aacd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:25.028786 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9a6feb5a-305f-4dcf-9bab-66fbd330aacd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1223 microversion: 2.1 time: 0.102850 Oct 17 13:12:25.029796 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2196/4511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:24 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:25.283835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:25.286957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:25.316784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:25.317669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:25.343179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:25.344697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:25.348078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:25.349214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:25.467886 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4c808451-091f-44a8-af3a-b8112a1785ce tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13183 microversion: 2.1 time: 4.951023 Oct 17 13:12:25.468913 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2316/4512] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 17 13:12:20 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13183 bytes in 4953 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:12:25.501735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-afa5552f-7275-47f8-95ca-525635a7afcf tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] Calling method '.version_select at 0x7fa81be5e4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:25.647430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:25.659476 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d33f0b59-4d57-4aff-9497-d1e581aa6902 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.384772 Oct 17 13:12:25.662468 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2197/4513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:25 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:25.673058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:25.673878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:25.684530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:25.686974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:25.687860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:25.690922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:25.693207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:25.693941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:25.942611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:25.952818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b14fd6f4-bf76-42db-bacd-da62f71d1aae tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.289240 Oct 17 13:12:25.955737 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2198/4514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:25 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:25.971336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:25.977211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:25.985690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:25.987450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:25.988408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:25.989721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:25.990649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:25.991329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:26.006457 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-afa5552f-7275-47f8-95ca-525635a7afcf tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.511871 Oct 17 13:12:26.008162 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2317/4515] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 17 13:12:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:26.020737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3a9a4bf-1fb3-407e-8f31-753fc8b2b074 tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] Calling method '.version_select at 0x7fa825209280>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:26.149343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:26.159835 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aab62511-9a33-43d9-a6f2-d1dd0a038b45 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.202912 Oct 17 13:12:26.167861 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2199/4516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:25 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:26.183174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:26.191380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:26.205426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:26.207346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:26.208288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:26.211348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:26.213571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:26.214620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:26.378811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:26.394598 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd2bf93f-2ea3-42c1-86ed-fbfb752dbe8f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1219 microversion: 2.1 time: 0.223445 Oct 17 13:12:26.408247 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2200/4517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:26 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1219 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:26.579082 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3a9a4bf-1fb3-407e-8f31-753fc8b2b074 tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/11579a9a-5da7-46c3-bf3d-97feae6b38a8" status: 202 len: 0 microversion: 2.1 time: 0.561340 Oct 17 13:12:26.580710 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2318/4518] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:12:26 2022] DELETE /compute/v2.1/os-security-groups/11579a9a-5da7-46c3-bf3d-97feae6b38a8 => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:12:26.590036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b5f3276-07f5-4b09-a5da-ae2dad28945a tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] Calling method '.version_select at 0x7fa820454ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:26.686980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:26.687937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:26.696555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:26.697773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:26.698420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:26.700876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:26.704412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:26.706331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:26.971599 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b5f3276-07f5-4b09-a5da-ae2dad28945a tempest-SecurityGroupsTestAdminJSON-415719465 tempest-SecurityGroupsTestAdminJSON-415719465-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/51153e34-3609-4774-911f-763777b130af" status: 202 len: 0 microversion: 2.1 time: 0.385409 Oct 17 13:12:26.973689 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2201/4519] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:12:26 2022] DELETE /compute/v2.1/os-security-groups/51153e34-3609-4774-911f-763777b130af => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:12:26.982761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:26.983940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:27.014626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:27.061614 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af88a358-cecf-4f16-a884-e37a3d5c80d7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.381162 Oct 17 13:12:27.062247 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2319/4520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:26 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:27.070921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:27.075516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:27.081173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:27.081958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:27.082469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:27.091462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:27.096819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-619aef48-2a8f-4317-8dad-b1cc2ede3917 tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] Calling method '.version_select at 0x7fa825209160>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:27.569966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:27.588872 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ef70a70-8150-4baa-ab80-dcdb0ba38369 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1735 microversion: 2.1 time: 0.612814 Oct 17 13:12:27.617028 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2202/4521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:26 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1735 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:27.635451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:27.636420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:27.648606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:27.649432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:27.652613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:27.654335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:27.656141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:27.659947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:28.101502 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-619aef48-2a8f-4317-8dad-b1cc2ede3917 tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4e4c578e-d7f4-4fed-bde0-eb4a1a1b889d" status: 202 len: 0 microversion: 2.1 time: 1.027089 Oct 17 13:12:28.105201 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2320/4522] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:12:27 2022] DELETE /compute/v2.1/os-security-groups/4e4c578e-d7f4-4fed-bde0-eb4a1a1b889d => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:12:28.123012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:28.124784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:28.140866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:28.143219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:28.145893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:28.147928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:28.149898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:28.152869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:28.353909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:28.363063 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1f184c3-8233-4fbd-9f36-f7ad960dd34b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.744338 Oct 17 13:12:28.382189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2203/4523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:27 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:28.382189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9f7b3fa7-e63c-4814-ba1e-ee333353dd7c req-8d70bd2e-512c-4cf2-9f36-e144537e7db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "name": "network-vif-plugged", "status": "completed", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:28.417743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9f7b3fa7-e63c-4814-ba1e-ee333353dd7c req-8d70bd2e-512c-4cf2-9f36-e144537e7db3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:28.418261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9f7b3fa7-e63c-4814-ba1e-ee333353dd7c req-8d70bd2e-512c-4cf2-9f36-e144537e7db3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:28.418704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9f7b3fa7-e63c-4814-ba1e-ee333353dd7c req-8d70bd2e-512c-4cf2-9f36-e144537e7db3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:28.456512 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9f7b3fa7-e63c-4814-ba1e-ee333353dd7c req-8d70bd2e-512c-4cf2-9f36-e144537e7db3 service nova] Creating event network-vif-plugged:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h1-853316-12 Oct 17 13:12:28.468603 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9f7b3fa7-e63c-4814-ba1e-ee333353dd7c req-8d70bd2e-512c-4cf2-9f36-e144537e7db3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095218 Oct 17 13:12:28.469833 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2204/4524] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:28.476295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:28.477236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:28.485889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:28.486721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:28.487385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:28.488276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:28.488923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:28.489590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:28.585636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:28.621234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f4a8984-11f2-4657-a42b-7e9386f404c8 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1293 microversion: 2.1 time: 0.513964 Oct 17 13:12:28.621971 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2321/4525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:28 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1293 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:28.644327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87ccd204-1687-4fcf-9d49-42e1afac223d tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] Calling method '.version_select at 0x7fa820d48310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:29.214993 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87ccd204-1687-4fcf-9d49-42e1afac223d tempest-SecurityGroupsTestAdminJSON-347300488 tempest-SecurityGroupsTestAdminJSON-347300488-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/76cd9769-0176-416a-8133-29ed365cd48e" status: 202 len: 0 microversion: 2.1 time: 0.579423 Oct 17 13:12:29.216197 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2322/4526] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:12:28 2022] DELETE /compute/v2.1/os-security-groups/76cd9769-0176-416a-8133-29ed365cd48e => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:12:29.235023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:29.236336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:29.252877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:29.254285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:29.255183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:29.258280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:29.260860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:29.262086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:29.329527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:29.342093 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9a662b63-1735-4110-99bf-843cdae9d339 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.870759 Oct 17 13:12:29.343072 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2205/4527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:28 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:29.398551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:29.399208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:29.418764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:29.419187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:29.419630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:29.420353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:29.420808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:29.421230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:29.701658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:29.715621 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-efd74526-8d0e-45f2-b529-cfdaa3173243 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.321122 Oct 17 13:12:29.716202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2206/4528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:29 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:29.742310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:29.743225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:29.751585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:29.752412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:29.753069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:29.754009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:29.754687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:29.755315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:29.856842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:29.868653 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac5eda9c-9e31-42d9-9bb7-1f8d271070b2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1281 microversion: 2.1 time: 0.137046 Oct 17 13:12:29.869591 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2207/4529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:29 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:30.119829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:30.138779 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9d81e6f0-8766-4d6d-ba68-5f16db18fb69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1715 microversion: 2.1 time: 0.920783 Oct 17 13:12:30.139715 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2323/4530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:29 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1715 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:30.324246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:30.325678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:30.335457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.339688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.341243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.347142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.348225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.348907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.373158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:30.375366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:30.402544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.404409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.405291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.406223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.406962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.408657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.438101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:30.491656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:30.500045 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Cannot 'detach_volume' instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 while it is in vm_state rescued Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments/a7e86591-f285-4bf7-9488-e577d1bfbee3 HTTP/1.1 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'detach_volume' instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 while it is in vm_state rescued Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '37ca72ce-c82a-4daa-93bc-1ad80dea90f1', 'id': 'a7e86591-f285-4bf7-9488-e577d1bfbee3'} Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 while it is in vm_state rescued Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:30.503761 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:30.508957 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:30.508957 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:30.508957 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:12:30.508957 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:12:30.508957 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 while it is in vm_state rescued Oct 17 13:12:30.508957 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:30.511939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 409 to user: Cannot 'detach_volume' instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 while it is in vm_state rescued {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:30.513130 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6845a206-a11f-4bb0-8afc-f97d36a32d97 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "DELETE /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments/a7e86591-f285-4bf7-9488-e577d1bfbee3" status: 409 len: 152 microversion: 2.1 time: 0.196348 Oct 17 13:12:30.517941 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2208/4531] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:12:30 2022] DELETE /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments/a7e86591-f285-4bf7-9488-e577d1bfbee3 => generated 152 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:12:30.526777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:30.527896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:30.535376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.535934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.536522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.538149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.539212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.539852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.660859 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a7e7dba5-bb3f-42f7-95d5-7434935bb5ec tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/action" status: 202 len: 0 microversion: 2.1 time: 0.138988 Oct 17 13:12:30.664734 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2209/4532] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:12:30 2022] POST /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:12:30.672620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:30.673952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:30.682707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.683112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.683609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.684345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.685107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.685715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.808213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:30.823810 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3c383af-e3e0-4d73-93c7-75179edee593 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1392 microversion: 2.1 time: 0.457517 Oct 17 13:12:30.828500 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2324/4533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:30 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1392 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:30.833873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:30.839353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:30.857438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.858848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.859422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:30.861921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:30.862742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:30.863924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:31.153012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:31.172935 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45b88e25-db23-4270-a327-09098eb4bc23 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.342967 Oct 17 13:12:31.173632 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2325/4534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:30 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:31.191102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:31.193026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:31.204394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:31.205442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:31.206156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:31.207441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:31.208080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:31.209051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:31.466960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:31.485203 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7d599d12-07f0-40d7-a4b8-409828ad6e74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1723 microversion: 2.1 time: 0.817755 Oct 17 13:12:31.496742 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2210/4535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:30 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1723 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:31.511463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-ee2cac5c-1c77-4d2d-9791-81dc4287e00c req-da1235ed-c604-4ec7-971e-42482174377b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3b68f0-eeab-42f9-bab7-fe69c2261ac4", "tag": "9f2e9d49-2f47-4450-829e-0986bd830d52"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:31.526867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ee2cac5c-1c77-4d2d-9791-81dc4287e00c req-da1235ed-c604-4ec7-971e-42482174377b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:31.527397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ee2cac5c-1c77-4d2d-9791-81dc4287e00c req-da1235ed-c604-4ec7-971e-42482174377b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:31.528304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ee2cac5c-1c77-4d2d-9791-81dc4287e00c req-da1235ed-c604-4ec7-971e-42482174377b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:31.543245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-ee2cac5c-1c77-4d2d-9791-81dc4287e00c req-da1235ed-c604-4ec7-971e-42482174377b service nova] Creating event network-changed:9f2e9d49-2f47-4450-829e-0986bd830d52 for instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 on n-h1-853316-12 Oct 17 13:12:31.548768 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-ee2cac5c-1c77-4d2d-9791-81dc4287e00c req-da1235ed-c604-4ec7-971e-42482174377b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047366 Oct 17 13:12:31.549718 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2211/4536] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:31.577248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:31.589010 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a63e942e-d6cf-4d6e-8749-ca25898c77b4 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.410685 Oct 17 13:12:31.590276 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2326/4537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:31 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:31.854893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:31.856056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:31.866632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:31.867897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:31.869636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:31.880776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:31.881824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-290dbbe1-7e14-45d8-93ca-c83e6797a2b5 req-f24ce8f4-aff2-4493-90ac-f2516290bbbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86251db7-6bf6-4c1d-a50c-11b2ccdb792a", "tag": "161e7dec-ea6b-4829-bb29-b2fc9beb75f7"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:31.881988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:31.883600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:31.903974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-290dbbe1-7e14-45d8-93ca-c83e6797a2b5 req-f24ce8f4-aff2-4493-90ac-f2516290bbbb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:31.904620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-290dbbe1-7e14-45d8-93ca-c83e6797a2b5 req-f24ce8f4-aff2-4493-90ac-f2516290bbbb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:31.904956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-290dbbe1-7e14-45d8-93ca-c83e6797a2b5 req-f24ce8f4-aff2-4493-90ac-f2516290bbbb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:31.935292 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-290dbbe1-7e14-45d8-93ca-c83e6797a2b5 req-f24ce8f4-aff2-4493-90ac-f2516290bbbb service nova] Creating event network-changed:161e7dec-ea6b-4829-bb29-b2fc9beb75f7 for instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a on n-h2-853316-12 Oct 17 13:12:31.944813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-290dbbe1-7e14-45d8-93ca-c83e6797a2b5 req-f24ce8f4-aff2-4493-90ac-f2516290bbbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068166 Oct 17 13:12:31.945451 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2327/4538] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:32.198498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:32.199220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:32.205793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:32.206466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:32.207153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:32.207865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:32.208493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:32.209086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:32.521541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:32.537419 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be13465f-fb2a-41ae-aed7-30d25f2e53fc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1565 microversion: 2.1 time: 0.690747 Oct 17 13:12:32.550199 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2212/4539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:31 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1565 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:32.550199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:32.550199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:32.554800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:32.555546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:32.556209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:32.558635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:32.562293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:32.562974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:32.624490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:32.642100 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5bc389b1-4375-475b-a0a3-80807fe4d7d7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.447616 Oct 17 13:12:32.643036 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2328/4540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:32 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:32.674654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:32.676169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:32.685127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:32.685755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:32.686222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:32.687001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:32.687435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:32.688400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:32.880512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:32.891160 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d03ca9c0-875a-4355-91a5-0e26b8d91caf tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1565 microversion: 2.1 time: 0.241977 Oct 17 13:12:32.892006 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2329/4541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:32 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1565 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:32.897559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:32.898596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:32.915765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:32.916600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:32.917508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:32.918613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:32.919336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:32.920289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:33.189644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:33.203790 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-501a917a-e673-4f87-8929-119de1452e35 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.310344 Oct 17 13:12:33.204671 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2330/4542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:32 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:33.516444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:33.528574 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9ae57be-9bf8-410a-8717-f6c77637a843 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1723 microversion: 2.1 time: 0.989056 Oct 17 13:12:33.530334 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2213/4543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:32 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1723 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:33.671450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:33.672077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:33.717054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:33.717610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:33.718127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:33.719023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:33.726892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:33.731575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:34.078003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:34.088285 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c909fe3-ef1f-439a-8387-2ce1bed1924a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.420556 Oct 17 13:12:34.090494 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2331/4544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:33 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:34.197566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1631183612", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:34.229310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:34.230731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:34.237668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:34.238575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:34.239245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:34.240672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:34.241426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:34.242132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:34.257760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:12:34.484824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:34.494467 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a732ae05-1623-47d8-9bfa-163a487bd423 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.268827 Oct 17 13:12:34.495486 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2332/4545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:34 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:34.500299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f0e7e3e9-0c18-4a79-8900-2406055e2851 req-9e0d825e-cfe3-4a4f-9415-c6cf8e993486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "912f82ec-fa54-45cd-972c-995acce4b2e4", "tag": "f61158a4-ec13-4655-a3e6-fd61886d1e0a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:34.513341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f0e7e3e9-0c18-4a79-8900-2406055e2851 req-9e0d825e-cfe3-4a4f-9415-c6cf8e993486 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:34.513923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f0e7e3e9-0c18-4a79-8900-2406055e2851 req-9e0d825e-cfe3-4a4f-9415-c6cf8e993486 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:34.514451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f0e7e3e9-0c18-4a79-8900-2406055e2851 req-9e0d825e-cfe3-4a4f-9415-c6cf8e993486 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:34.526643 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f0e7e3e9-0c18-4a79-8900-2406055e2851 req-9e0d825e-cfe3-4a4f-9415-c6cf8e993486 service nova] Creating event network-changed:f61158a4-ec13-4655-a3e6-fd61886d1e0a for instance 912f82ec-fa54-45cd-972c-995acce4b2e4 on n-h2-853316-12 Oct 17 13:12:34.531709 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f0e7e3e9-0c18-4a79-8900-2406055e2851 req-9e0d825e-cfe3-4a4f-9415-c6cf8e993486 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034740 Oct 17 13:12:34.532693 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2333/4546] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:34.563548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:34.564590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:34.573916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:34.574840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:34.575506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:34.576470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:34.577191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:34.577951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:34.716406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:12:34.720009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:12:34.721598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:12:34.723555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:12:34.724091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:12:34.738873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:34.739902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:34.740388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:34.741393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:34.741858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:34.742306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:34.766332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Getting quotas for project 34f04048d29f458881da0063c9cd501f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:12:34.772510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Getting quotas for user 35bc5b1329eb489d8f4099cb45dea020 and project 34f04048d29f458881da0063c9cd501f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:12:34.789919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:12:34.794504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:12:34.824665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:34.835584 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d87a6d3-998c-4b0b-9512-e202da614931 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1723 microversion: 2.1 time: 0.276235 Oct 17 13:12:34.850582 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2334/4547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:34 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:34.866832 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31eb5dec-be70-48f7-943b-9d4cc949a314 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842743 Oct 17 13:12:34.874810 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2214/4548] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:12:34.885754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-76c0ac3e-4e4d-44c1-b8cf-2da44f4991c7 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:34.890945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-76c0ac3e-4e4d-44c1-b8cf-2da44f4991c7 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:35.032618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-76c0ac3e-4e4d-44c1-b8cf-2da44f4991c7 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:35.043739 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-76c0ac3e-4e4d-44c1-b8cf-2da44f4991c7 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1222 microversion: 2.1 time: 0.167819 Oct 17 13:12:35.049830 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2335/4549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:34 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:35.117498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:35.118323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:35.143950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:35.146600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:35.147077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:35.147837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:35.148314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:35.148751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:35.524946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:35.528175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:35.544020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:35.545018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:35.545592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:35.546508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:35.547318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:35.548030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:35.753829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:35.775818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff13afb5-d522-4948-8a9b-9951ba2190c6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.665950 Oct 17 13:12:35.779277 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2215/4550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:35 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:35.861198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:35.862090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:35.869963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:35.870637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:35.871081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:35.871795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:35.872247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:35.872671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.072154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:36.095990 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea408d02-896d-4541-935d-cf2918d3d4f9 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.580189 Oct 17 13:12:36.097455 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2336/4551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:35 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:36.117550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:36.118282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:36.126540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.127251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.128066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.128957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.129584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.130220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.261834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:36.284174 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21335d5d-c585-46fe-a288-852d7b06aaa5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1218 microversion: 2.1 time: 0.174110 Oct 17 13:12:36.286978 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2337/4552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:36 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:36.310976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:36.311709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:36.324823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.325649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.326367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.327520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.328497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.328980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.385800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:36.433863 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f523ebe8-692f-483a-bec6-e61987a6de5b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1729 microversion: 2.1 time: 0.576450 Oct 17 13:12:36.463526 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2216/4553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:35 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1729 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:36.476098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-97587706-863c-45b7-a7c2-5113622dbab5 req-cadde926-6c39-457f-8a59-729e5ce2dbaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:36.501159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-97587706-863c-45b7-a7c2-5113622dbab5 req-cadde926-6c39-457f-8a59-729e5ce2dbaf service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.501989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-97587706-863c-45b7-a7c2-5113622dbab5 req-cadde926-6c39-457f-8a59-729e5ce2dbaf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.503323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-97587706-863c-45b7-a7c2-5113622dbab5 req-cadde926-6c39-457f-8a59-729e5ce2dbaf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.530468 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-97587706-863c-45b7-a7c2-5113622dbab5 req-cadde926-6c39-457f-8a59-729e5ce2dbaf service nova] Creating event network-changed:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h1-853316-12 Oct 17 13:12:36.538274 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-97587706-863c-45b7-a7c2-5113622dbab5 req-cadde926-6c39-457f-8a59-729e5ce2dbaf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072295 Oct 17 13:12:36.539832 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2217/4554] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:36.552150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:36.554191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:36.573496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.574216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.575625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.576685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.578092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.579075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.611941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:36.623456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-801f81cb-b1ed-4070-b533-168113a14fe2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1565 microversion: 2.1 time: 0.328116 Oct 17 13:12:36.624053 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2338/4555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:36 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1565 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:36.808149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:36.808996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:36.822754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.823541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.824310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.825203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:36.825807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:36.826416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:36.835391 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7201d1c6-05ee-46ec-9302-02b652ec3f77 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.293805 Oct 17 13:12:36.836172 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2218/4556] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:12:36 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-interface => generated 284 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:37.093932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:37.105998 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b8672d9-b4dc-4677-a7db-d660ce192980 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1511 microversion: 2.1 time: 0.303427 Oct 17 13:12:37.116118 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2339/4557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:36 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:37.121349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:37.121964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:37.132326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:37.132931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:37.135603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:37.136443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:37.136990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:37.138717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:37.152553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-16907476-029c-4a8c-a1ae-bd337e403fee req-71b06093-4bb2-46a8-8a99-ec5bb35f2b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86251db7-6bf6-4c1d-a50c-11b2ccdb792a", "name": "network-vif-plugged", "status": "completed", "tag": "161e7dec-ea6b-4829-bb29-b2fc9beb75f7"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:37.172268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16907476-029c-4a8c-a1ae-bd337e403fee req-71b06093-4bb2-46a8-8a99-ec5bb35f2b15 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:37.173421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16907476-029c-4a8c-a1ae-bd337e403fee req-71b06093-4bb2-46a8-8a99-ec5bb35f2b15 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:37.176179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-16907476-029c-4a8c-a1ae-bd337e403fee req-71b06093-4bb2-46a8-8a99-ec5bb35f2b15 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:37.205007 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-16907476-029c-4a8c-a1ae-bd337e403fee req-71b06093-4bb2-46a8-8a99-ec5bb35f2b15 service nova] Creating event network-vif-plugged:161e7dec-ea6b-4829-bb29-b2fc9beb75f7 for instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a on n-h2-853316-12 Oct 17 13:12:37.221131 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-16907476-029c-4a8c-a1ae-bd337e403fee req-71b06093-4bb2-46a8-8a99-ec5bb35f2b15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074059 Oct 17 13:12:37.228789 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2340/4558] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:37.313636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:37.314442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:37.330368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:37.331098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:37.331784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:37.332681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:37.333303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:37.333987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:37.525734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:37.535793 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c8d26c1-0aa7-4635-8b36-927f18b27ea6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1280 microversion: 2.1 time: 0.227279 Oct 17 13:12:37.536384 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2341/4559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:37 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1280 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:38.167315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7733a08e-012d-40f2-bcbc-b3c4f68ac612 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-70242684", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:38.171494 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-7733a08e-012d-40f2-bcbc-b3c4f68ac612 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] HTTP exception thrown: min_count must be <= max_count Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7733a08e-012d-40f2-bcbc-b3c4f68ac612 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Request method failure captured: Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 182 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVTFSy6vt7Sr_jTt7o8Zrhcu51ep6dPdevt4NTXp032LRPFWdq0s3Q8FgAI_BJLPTsiiDZyW560eEhjr49PzvyLYbuavEmPVwhnXxCBncAPXUcKQv0QhhstpdNJiGyunYFRtK46C4yTQsJ5szKOGhBGrLKVuGKmGSJB7dVPQsXfCt8U Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fda4c2c1b043c0a6f768dc9beeee02", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 428909256e93452b95d0453ada1f4d26 Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-70242684", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: exception: min_count must be <= max_count Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-70242684', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 17 13:12:38.173051 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.177036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7733a08e-012d-40f2-bcbc-b3c4f68ac612 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Returning 400 to user: min_count must be <= max_count {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:38.177036 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7733a08e-012d-40f2-bcbc-b3c4f68ac612 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.147473 Oct 17 13:12:38.184633 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2342/4560] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:38 2022] POST /compute/v2.1/servers => generated 74 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 13:12:38.201411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:38.202018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:38.208684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:38.209536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:38.210051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:38.211339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:38.211907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:38.213221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:38.354919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:38.363171 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18161b00-ed3e-42b7-b691-cace919cfd3a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1488 microversion: 2.1 time: 0.177200 Oct 17 13:12:38.364435 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2343/4561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:38 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1488 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:38.370774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbbbc5d5-8877-4138-8fe5-820b8e5fdaed tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1827359457", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "max_count": 0}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbbbc5d5-8877-4138-8fe5-820b8e5fdaed tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Request method failure captured: Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 168 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVTFSy6vt7Sr_jTt7o8Zrhcu51ep6dPdevt4NTXp032LRPFWdq0s3Q8FgAI_BJLPTsiiDZyW560eEhjr49PzvyLYbuavEmPVwhnXxCBncAPXUcKQv0QhhstpdNJiGyunYFRtK46C4yTQsJ5szKOGhBGrLKVuGKmGSJB7dVPQsXfCt8U Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fda4c2c1b043c0a6f768dc9beeee02", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 428909256e93452b95d0453ada1f4d26 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1827359457", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "max_count": 0}} Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1827359457', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'max_count': 0}}} Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 0 Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:12:38.375473 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbbbc5d5-8877-4138-8fe5-820b8e5fdaed tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbbbc5d5-8877-4138-8fe5-820b8e5fdaed tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012556 Oct 17 13:12:38.380633 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2344/4562] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:38 2022] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:12:38.395591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:38.397943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:38.423955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:38.424465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:38.424914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:38.425652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:38.426103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:38.426560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:38.453302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:38.461595 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-948d2bdb-fff6-41d0-935f-fd73e8594788 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 1.344245 Oct 17 13:12:38.462219 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2219/4563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:37 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:38.467826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-14bd1447-4f37-4419-ab15-33b1be2fa5b6 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-874589764", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "max_count": 2.5}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-14bd1447-4f37-4419-ab15-33b1be2fa5b6 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Request method failure captured: Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 169 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVTFSy6vt7Sr_jTt7o8Zrhcu51ep6dPdevt4NTXp032LRPFWdq0s3Q8FgAI_BJLPTsiiDZyW560eEhjr49PzvyLYbuavEmPVwhnXxCBncAPXUcKQv0QhhstpdNJiGyunYFRtK46C4yTQsJ5szKOGhBGrLKVuGKmGSJB7dVPQsXfCt8U Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fda4c2c1b043c0a6f768dc9beeee02", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 428909256e93452b95d0453ada1f4d26 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-874589764", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "max_count": 2.5}} Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-874589764', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'max_count': 2.5}}} Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 2.5 Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:12:38.472991 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-14bd1447-4f37-4419-ab15-33b1be2fa5b6 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:38.484705 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-14bd1447-4f37-4419-ab15-33b1be2fa5b6 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010579 Oct 17 13:12:38.488623 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2220/4564] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:38 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:12:38.489660 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b581a33-6688-48bc-96ad-666ad2202e96 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 200 len: 170 microversion: 2.1 time: 0.097747 Oct 17 13:12:38.495001 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2345/4565] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:12:38 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 170 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:38.505284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:38.506106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:38.514347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:38.514850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:38.515296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:38.516417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:38.516892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:38.517326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:38.548493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b757037d-45ee-4da5-8e1c-4067b4f5f813 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1847602087", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 0}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b757037d-45ee-4da5-8e1c-4067b4f5f813 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Request method failure captured: Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 168 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVTFSy6vt7Sr_jTt7o8Zrhcu51ep6dPdevt4NTXp032LRPFWdq0s3Q8FgAI_BJLPTsiiDZyW560eEhjr49PzvyLYbuavEmPVwhnXxCBncAPXUcKQv0QhhstpdNJiGyunYFRtK46C4yTQsJ5szKOGhBGrLKVuGKmGSJB7dVPQsXfCt8U Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fda4c2c1b043c0a6f768dc9beeee02", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 428909256e93452b95d0453ada1f4d26 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1847602087", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 0}} Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1847602087', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'min_count': 0}}} Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 0 Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:12:38.552617 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b757037d-45ee-4da5-8e1c-4067b4f5f813 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:38.559176 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b757037d-45ee-4da5-8e1c-4067b4f5f813 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010248 Oct 17 13:12:38.562403 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2346/4566] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:38 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:12:38.568172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:38.569209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:38.579396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:38.580056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:38.580732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:38.581528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:38.582189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:38.582696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:38.600322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:38.658966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:38.669504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a92fe0c-142d-4937-9d5e-ed8dab7181e3 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1280 microversion: 2.1 time: 0.105657 Oct 17 13:12:38.670086 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2347/4567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:38 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:38.674869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4e7c79e-d153-47ee-bd15-99800509de89 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1645286987", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 2.5}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4e7c79e-d153-47ee-bd15-99800509de89 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Request method failure captured: Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 170 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVTFSy6vt7Sr_jTt7o8Zrhcu51ep6dPdevt4NTXp032LRPFWdq0s3Q8FgAI_BJLPTsiiDZyW560eEhjr49PzvyLYbuavEmPVwhnXxCBncAPXUcKQv0QhhstpdNJiGyunYFRtK46C4yTQsJ5szKOGhBGrLKVuGKmGSJB7dVPQsXfCt8U Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0fda4c2c1b043c0a6f768dc9beeee02", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0fda4c2c1b043c0a6f768dc9beeee02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a0fda4c2c1b043c0a6f768dc9beeee02 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1380796127 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 428909256e93452b95d0453ada1f4d26 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1380796127-project Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1645286987", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "min_count": 2.5}} Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1645286987', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'min_count': 2.5}}} Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 2.5 Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:12:38.679351 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:12:38.685503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:38.687568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4e7c79e-d153-47ee-bd15-99800509de89 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:38.688511 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4e7c79e-d153-47ee-bd15-99800509de89 tempest-MultipleCreateNegativeTestJSON-1380796127 tempest-MultipleCreateNegativeTestJSON-1380796127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017443 Oct 17 13:12:38.689454 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2348/4568] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:38 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:12:39.047956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:39.056362 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b1bdf3f4-df28-43a6-a786-4fd8fcba0152 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.559835 Oct 17 13:12:39.058226 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2221/4569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:38 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:39.087140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:39.088394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:39.096267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.096849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.097530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.098310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.098779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.099218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.304351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:39.342841 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-14e11fd9-af8c-4cee-8c71-ac90b12da6ba tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.261570 Oct 17 13:12:39.344793 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2349/4570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:39 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:39.371001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:39.372009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:39.382241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.383210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.383800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.385369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.386311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.387538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.485808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-64da3786-a293-4ded-b590-04e9bad46580 req-ac5e139b-98fa-4516-ab71-25d075d4d1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3b68f0-eeab-42f9-bab7-fe69c2261ac4", "name": "network-vif-plugged", "status": "completed", "tag": "9f2e9d49-2f47-4450-829e-0986bd830d52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:39.515195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-64da3786-a293-4ded-b590-04e9bad46580 req-ac5e139b-98fa-4516-ab71-25d075d4d1a3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.515689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-64da3786-a293-4ded-b590-04e9bad46580 req-ac5e139b-98fa-4516-ab71-25d075d4d1a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.516129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-64da3786-a293-4ded-b590-04e9bad46580 req-ac5e139b-98fa-4516-ab71-25d075d4d1a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.549649 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-64da3786-a293-4ded-b590-04e9bad46580 req-ac5e139b-98fa-4516-ab71-25d075d4d1a3 service nova] Creating event network-vif-plugged:9f2e9d49-2f47-4450-829e-0986bd830d52 for instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 on n-h1-853316-12 Oct 17 13:12:39.557609 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-64da3786-a293-4ded-b590-04e9bad46580 req-ac5e139b-98fa-4516-ab71-25d075d4d1a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076748 Oct 17 13:12:39.559089 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2350/4571] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:39.566173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:39.567148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:39.576912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.580243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.580968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.582013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.582810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.583257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.808992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:39.818844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6e9e4150-7072-4489-9143-1d1221c8e14f tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.258350 Oct 17 13:12:39.840645 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2351/4572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:39 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:39.854179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:39.855294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:39.866071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.867686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:39.868827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.869369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.870413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.870953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.872023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.882818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dc27ab2e-45ca-4ff3-b1f5-534c6cc8ed3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.516479 Oct 17 13:12:39.884440 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2222/4573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:39 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:39.916330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:39.917579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:39.924071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.929949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.930622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.931965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:39.932757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:39.933351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:39.984958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:39.995338 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be687a7b-8088-4255-8512-63167cbf95f5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1280 microversion: 2.1 time: 0.153219 Oct 17 13:12:39.996044 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2352/4574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:39 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:40.375844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:40.401805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5d17fbaf-9cee-4dbb-bd22-ace5daff607f req-69cbc120-8ab1-4a4e-a5a8-b3d23ecbe3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ca72ce-c82a-4daa-93bc-1ad80dea90f1", "tag": "bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:40.411686 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d49ec314-641d-426b-8eb5-71f34d2850cb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.504030 Oct 17 13:12:40.413721 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2223/4575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:39 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:40.425870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5d17fbaf-9cee-4dbb-bd22-ace5daff607f req-69cbc120-8ab1-4a4e-a5a8-b3d23ecbe3a4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:40.428273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5d17fbaf-9cee-4dbb-bd22-ace5daff607f req-69cbc120-8ab1-4a4e-a5a8-b3d23ecbe3a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:40.430902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5d17fbaf-9cee-4dbb-bd22-ace5daff607f req-69cbc120-8ab1-4a4e-a5a8-b3d23ecbe3a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:40.492185 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5d17fbaf-9cee-4dbb-bd22-ace5daff607f req-69cbc120-8ab1-4a4e-a5a8-b3d23ecbe3a4 service nova] Creating event network-changed:bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4 for instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 on n-h2-853316-12 Oct 17 13:12:40.515047 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5d17fbaf-9cee-4dbb-bd22-ace5daff607f req-69cbc120-8ab1-4a4e-a5a8-b3d23ecbe3a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120046 Oct 17 13:12:40.519733 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2353/4576] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:40.595161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1558992957", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:40.718003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] validate_networks() for [('24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:12:40.848374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:40.849082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:40.855954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:40.856512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:40.856957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:40.857909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:40.858403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:40.859003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:41.216708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:41.241489 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eedc271f-a2c0-45a9-a75f-c44f78d0d296 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.394833 Oct 17 13:12:41.247559 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2354/4577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:40 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:41.264519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:41.267239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:41.289596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:41.293947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:41.294731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:41.297672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:41.299264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:41.302782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:41.929137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:41.940077 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b91e9326-b8fb-4857-85a3-679431023dd5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.689438 Oct 17 13:12:41.941784 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2355/4578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:41 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:42.199644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:12:42.200827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:12:42.201697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:12:42.203136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:12:42.204204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:12:42.216981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:42.217852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:42.218687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:42.220409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:42.221112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:42.221783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:42.245870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:12:42.253529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for user c71ac2b898f649cdaa99fbace633e738 and project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:12:42.272692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:42.273312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:42.277100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:12:42.281383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:12:42.283635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:42.284147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:42.284589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:42.285309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:42.298935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:42.299403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:42.382141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2fca1411-0d55-4fcb-bb94-7ffb9bd03e65 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.791756 Oct 17 13:12:42.388018 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2224/4579] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:12:42.403956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ca966668-4c31-48cd-9cc0-c36d70e99c0d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:42.409154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ca966668-4c31-48cd-9cc0-c36d70e99c0d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:42.754431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ca966668-4c31-48cd-9cc0-c36d70e99c0d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:42.764691 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ca966668-4c31-48cd-9cc0-c36d70e99c0d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1215 microversion: 2.1 time: 0.365197 Oct 17 13:12:42.765614 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2225/4580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:42 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1215 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:42.777045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2cd05014-7ced-44c9-b90e-0c1438b61eff req-054d4593-749c-4a31-9863-668846a03740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ca72ce-c82a-4daa-93bc-1ad80dea90f1", "tag": "bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:42.795152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:42.810388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2cd05014-7ced-44c9-b90e-0c1438b61eff req-054d4593-749c-4a31-9863-668846a03740 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:42.813479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2cd05014-7ced-44c9-b90e-0c1438b61eff req-054d4593-749c-4a31-9863-668846a03740 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:42.815587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2cd05014-7ced-44c9-b90e-0c1438b61eff req-054d4593-749c-4a31-9863-668846a03740 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:42.852210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2cd05014-7ced-44c9-b90e-0c1438b61eff req-054d4593-749c-4a31-9863-668846a03740 service nova] Creating event network-changed:bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4 for instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 on n-h2-853316-12 Oct 17 13:12:42.872560 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2cd05014-7ced-44c9-b90e-0c1438b61eff req-054d4593-749c-4a31-9863-668846a03740 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104954 Oct 17 13:12:42.873466 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2226/4581] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:42.883232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:42.902050 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-092199a2-45d6-4896-b69e-17ebfbc9ba33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.633142 Oct 17 13:12:42.905111 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2356/4582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:42 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:42.966890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:42.967610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:42.982595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:42.983108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:42.983561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:42.984289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:42.984746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:42.985175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:43.333972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:43.347736 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-870f53e4-86e2-45c8-ad0a-276f10b1f491 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.386934 Oct 17 13:12:43.348539 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2227/4583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:42 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:43.374049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4cf7e9bc-659f-42aa-8a13-0fdb0756face req-39bec52c-a721-429c-a195-62cd4ba8bb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912f82ec-fa54-45cd-972c-995acce4b2e4", "name": "network-vif-plugged", "status": "completed", "tag": "f61158a4-ec13-4655-a3e6-fd61886d1e0a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:43.388232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=87 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:43.390282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4cf7e9bc-659f-42aa-8a13-0fdb0756face req-39bec52c-a721-429c-a195-62cd4ba8bb12 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:43.390989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4cf7e9bc-659f-42aa-8a13-0fdb0756face req-39bec52c-a721-429c-a195-62cd4ba8bb12 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:43.391588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4cf7e9bc-659f-42aa-8a13-0fdb0756face req-39bec52c-a721-429c-a195-62cd4ba8bb12 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:43.408607 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4cf7e9bc-659f-42aa-8a13-0fdb0756face req-39bec52c-a721-429c-a195-62cd4ba8bb12 service nova] Creating event network-vif-plugged:f61158a4-ec13-4655-a3e6-fd61886d1e0a for instance 912f82ec-fa54-45cd-972c-995acce4b2e4 on n-h2-853316-12 Oct 17 13:12:43.415140 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4cf7e9bc-659f-42aa-8a13-0fdb0756face req-39bec52c-a721-429c-a195-62cd4ba8bb12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045073 Oct 17 13:12:43.417979 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2357/4584] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:43.789410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:43.790041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:43.803014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:43.805639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:43.806764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:43.808460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:43.809526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:43.811017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:43.930881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:43.932144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:43.939740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:43.940282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:43.940660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:43.941557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:43.942210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:43.942645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:44.027157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:44.047716 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4503ec57-3764-4280-82ad-490829af05ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1267 microversion: 2.1 time: 0.262529 Oct 17 13:12:44.049445 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2228/4585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:43 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:44.258430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:44.270465 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3cc0313b-7b57-4bdd-aa24-d31f917c6344 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.343836 Oct 17 13:12:44.271399 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2358/4586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:43 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:44.376080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:44.376712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:44.382998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:44.383492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:44.383935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:44.384676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:44.385132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:44.385716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:44.592038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:44.617368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3706487b-3f87-48dc-a116-b4356f354ad0 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.245487 Oct 17 13:12:44.619399 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2229/4587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:44 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:44.916179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2d56bde8-40dc-47de-8105-d73dfb9f54ab req-bded09a2-1832-461b-9bf5-a5816d479e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d7f294a-8b5a-4788-a2d1-e34a1e214755", "tag": "62c86613-669f-4cc1-a0af-fea9a5fc2d30"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:44.936037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2d56bde8-40dc-47de-8105-d73dfb9f54ab req-bded09a2-1832-461b-9bf5-a5816d479e7b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:44.939669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2d56bde8-40dc-47de-8105-d73dfb9f54ab req-bded09a2-1832-461b-9bf5-a5816d479e7b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:44.940289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2d56bde8-40dc-47de-8105-d73dfb9f54ab req-bded09a2-1832-461b-9bf5-a5816d479e7b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:44.967157 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2d56bde8-40dc-47de-8105-d73dfb9f54ab req-bded09a2-1832-461b-9bf5-a5816d479e7b service nova] Creating event network-changed:62c86613-669f-4cc1-a0af-fea9a5fc2d30 for instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 on n-h1-853316-12 Oct 17 13:12:44.972378 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2d56bde8-40dc-47de-8105-d73dfb9f54ab req-bded09a2-1832-461b-9bf5-a5816d479e7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060773 Oct 17 13:12:44.972996 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2359/4588] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:45.073471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:45.074407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:45.082253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:45.082750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:45.083193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:45.083988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:45.084588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:45.085486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:45.091544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:45.192961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:45.203622 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a082ed89-932d-4c6d-990f-65c46c65181c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1275 microversion: 2.1 time: 0.134392 Oct 17 13:12:45.219906 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2230/4589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:45 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:45.294421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:45.299570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:45.300294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:45.317544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:45.320117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:45.320617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:45.323205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:45.325204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:45.327893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:45.642808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:45.644280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:45.657786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:45.658713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:45.659439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:45.660461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:45.663776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:45.664290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:45.729598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:45.739102 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc341135-74ec-44b8-afc2-8096de2d5d0a tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1323 microversion: 2.1 time: 0.446443 Oct 17 13:12:45.739789 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2360/4590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:45 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1323 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:46.022029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:46.032086 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ba3e467-6753-4ba9-9e65-76d96112dd84 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.394409 Oct 17 13:12:46.033158 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2231/4591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:45 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:46.232242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:46.233710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:46.241482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:46.242242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:46.242948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:46.244043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:46.244719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:46.246156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:46.314077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:46.323465 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68624d8c-34d9-46cf-aa11-8b414efae172 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1273 microversion: 2.1 time: 0.096285 Oct 17 13:12:46.331050 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2361/4592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:46 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:46.764465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:46.766748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:46.783623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:46.784411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:46.798041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:46.800833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:46.809201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:46.812215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:47.057430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:47.058135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:47.067791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:47.068305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:47.068758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:47.069492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:47.069965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:47.070486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:47.266345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:47.276574 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a9eefea-7b02-4a1d-b66f-06141aad5e59 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.223931 Oct 17 13:12:47.280085 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2362/4593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:47 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:47.348094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:47.348982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:47.370028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:47.370028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:47.370028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:47.370028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:47.370028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:47.370028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:47.614413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:47.624506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1900df14-62a8-4f3c-9b88-17b40ad56333 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.280443 Oct 17 13:12:47.638970 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2363/4594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:47 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:47.717724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:47.725852 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cfad2c81-3f23-4ef2-9a62-4f6b5f396d34 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 200 len: 1516 microversion: 2.1 time: 0.966493 Oct 17 13:12:47.726800 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2232/4595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:46 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 1516 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:47.751714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:47.752671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:47.759884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:47.760479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:47.760979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:47.761914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:47.762733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:47.763159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:47.948448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:47.957725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0be2113-d4dc-4bc2-b3d7-fb144f2eba59 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4" status: 200 len: 1517 microversion: 2.1 time: 0.210190 Oct 17 13:12:47.958579 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2364/4596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:47 2022] GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 => generated 1517 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:47.986954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:47.988207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:47.998555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:47.999207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:47.999731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.000537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.001896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.002565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.306903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:48.308218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:48.319633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.320422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.321169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.324297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.325134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.326264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.528551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:48.541600 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd8d6c6b-c6f1-42b3-a7dd-c73a936beafd tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.240447 Oct 17 13:12:48.543046 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2365/4597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:48 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:48.551986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:48.577625 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-95af1852-23e2-4b18-81e7-c1cb50c69631 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 200 len: 1516 microversion: 2.1 time: 0.599622 Oct 17 13:12:48.578247 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2233/4598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:47 2022] GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 1516 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:48.605492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:48.606632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:48.614574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.615393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.616115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.617206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.618004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.619383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.652686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:48.653930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:48.667469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.672027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.673101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.675408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.677396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.677831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.683113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:12:48.749861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:48.841492 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d24d62d-4ff2-46da-be25-ace0ea6e3c03 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "DELETE /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 204 len: 0 microversion: 2.1 time: 0.241117 Oct 17 13:12:48.842443 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2366/4599] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:12:48 2022] DELETE /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:12:48.858634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:48.859773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:48.867899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.869377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.869807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:48.870289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:48.870753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:48.871185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:49.073076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:49.089979 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f8f0a59a-f406-4df0-a9b7-a8e9098704ec tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 200 len: 1522 microversion: 2.1 time: 0.240476 Oct 17 13:12:49.090886 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2367/4600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:48 2022] GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:49.286541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:49.302803 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1527613a-e2e1-47da-8e18-1219aa3dd0a5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.657468 Oct 17 13:12:49.304178 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2234/4601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:48 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:49.576832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:49.577391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:49.590740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:49.591228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:49.591677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:49.592410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:49.592868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:49.593303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:49.641503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-39af0eca-8942-46d0-99c7-9a74f3108b57 req-5396b507-fa8d-4fd4-9506-5c26c803be91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6fbb90d-ee4d-419d-b839-c032d62fbb89", "tag": "3cf027b7-9cb8-42d3-b227-094e4d67ed61"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:49.663285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-39af0eca-8942-46d0-99c7-9a74f3108b57 req-5396b507-fa8d-4fd4-9506-5c26c803be91 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:49.664561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-39af0eca-8942-46d0-99c7-9a74f3108b57 req-5396b507-fa8d-4fd4-9506-5c26c803be91 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:49.666949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-39af0eca-8942-46d0-99c7-9a74f3108b57 req-5396b507-fa8d-4fd4-9506-5c26c803be91 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:49.694739 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-39af0eca-8942-46d0-99c7-9a74f3108b57 req-5396b507-fa8d-4fd4-9506-5c26c803be91 service nova] Creating event network-changed:3cf027b7-9cb8-42d3-b227-094e4d67ed61 for instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 on n-h2-853316-12 Oct 17 13:12:49.713294 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-39af0eca-8942-46d0-99c7-9a74f3108b57 req-5396b507-fa8d-4fd4-9506-5c26c803be91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074735 Oct 17 13:12:49.715652 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2235/4602] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:49.851643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:49.863962 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f2af659c-ffc9-4ebf-85bb-287fdf55fbd9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.290630 Oct 17 13:12:49.867424 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2368/4603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:49 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:50.014598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2004141014", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "d8794e4a-e984-4d6c-a09c-e66be9be82be"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:50.075477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] validate_networks() for [('d8794e4a-e984-4d6c-a09c-e66be9be82be', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:12:50.114476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:50.115349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:50.122537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:50.123374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:50.123891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:50.125124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:50.125662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:50.126465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:50.328196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:50.343897 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86b3d621-99cf-4ee6-97d3-fc08a79639c6 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 200 len: 1522 microversion: 2.1 time: 0.232918 Oct 17 13:12:50.361755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2369/4604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:50 2022] GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:50.370069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:50.373085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:50.383135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:50.384222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:50.385704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:50.386862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:50.387681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:50.388362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:50.580987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:50.591685 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b9ee2db-94ff-4cf3-84dc-d9a783f46fc3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.228205 Oct 17 13:12:50.592660 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2370/4605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:50 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:50.892228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:50.893816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:50.902306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:50.902808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:50.903496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:50.904445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:50.905618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:50.906491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:51.084993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:51.095613 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9eacb30b-cbf6-437b-8c17-ad34c6d5e495 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.207314 Oct 17 13:12:51.096619 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2371/4606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:50 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:51.370956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:51.374929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:51.383687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:51.385269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:51.387295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:51.388308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:51.389006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:51.389687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:51.568626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:51.577526 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85d97889-b213-4330-bfcb-c9448c857714 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 200 len: 1522 microversion: 2.1 time: 0.211056 Oct 17 13:12:51.591845 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2372/4607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:51 2022] GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:51.623151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:51.624137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:51.633348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:51.634859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:51.636258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:51.638355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:51.639818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:51.640723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:51.817130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:51.825870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:12:51.827412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:12:51.829258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:12:51.829932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:12:51.830600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:12:51.835044 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0aa24c1a-d4cd-429d-80bd-cea792e32cdc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.216237 Oct 17 13:12:51.846895 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2373/4608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:51 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:51.858108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0649229e-865b-4920-81b1-e4d0183bc79f req-af51535b-d212-4ba5-b176-2c679ee901b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7f294a-8b5a-4788-a2d1-e34a1e214755", "name": "network-vif-plugged", "status": "completed", "tag": "62c86613-669f-4cc1-a0af-fea9a5fc2d30"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:51.860471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=23 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:51.871208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:51.871208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:51.871208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:51.871208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:51.871208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:51.871208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:51.882061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0649229e-865b-4920-81b1-e4d0183bc79f req-af51535b-d212-4ba5-b176-2c679ee901b9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:51.882582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0649229e-865b-4920-81b1-e4d0183bc79f req-af51535b-d212-4ba5-b176-2c679ee901b9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:51.883018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0649229e-865b-4920-81b1-e4d0183bc79f req-af51535b-d212-4ba5-b176-2c679ee901b9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:51.883568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=9 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:51.910850 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0649229e-865b-4920-81b1-e4d0183bc79f req-af51535b-d212-4ba5-b176-2c679ee901b9 service nova] Creating event network-vif-plugged:62c86613-669f-4cc1-a0af-fea9a5fc2d30 for instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 on n-h1-853316-12 Oct 17 13:12:51.923411 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0649229e-865b-4920-81b1-e4d0183bc79f req-af51535b-d212-4ba5-b176-2c679ee901b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074600 Oct 17 13:12:51.924160 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2374/4609] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:51.928455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Getting quotas for project 10a80389f0004e0f85121d42d25c1eea. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:12:51.936507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Getting quotas for user 61d31fdb269b4bcf98b2c9f83fa97b3b and project 10a80389f0004e0f85121d42d25c1eea. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:12:51.956007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:12:51.958978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:12:52.042955 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1a59450-debe-4547-85f6-5858cf66b129 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.324828 Oct 17 13:12:52.044025 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2236/4610] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:12:52.058385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1ee4c57-aac5-4ced-9f61-b16c42cf237a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:52.059115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1ee4c57-aac5-4ced-9f61-b16c42cf237a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:52.122583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:52.123281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:52.144648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:52.145275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:52.145818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:52.146639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:52.147318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:52.147951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:52.164621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1ee4c57-aac5-4ced-9f61-b16c42cf237a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:52.177343 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1ee4c57-aac5-4ced-9f61-b16c42cf237a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1216 microversion: 2.1 time: 0.124702 Oct 17 13:12:52.178556 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2375/4611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:52 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:52.427107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b73bce53-83e5-42dc-8058-6e35d608194d req-d132a020-56e5-4563-b907-552a96204fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86251db7-6bf6-4c1d-a50c-11b2ccdb792a", "name": "network-vif-deleted", "tag": "161e7dec-ea6b-4829-bb29-b2fc9beb75f7"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:52.471643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b73bce53-83e5-42dc-8058-6e35d608194d req-d132a020-56e5-4563-b907-552a96204fb5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:52.472149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b73bce53-83e5-42dc-8058-6e35d608194d req-d132a020-56e5-4563-b907-552a96204fb5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:52.476585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b73bce53-83e5-42dc-8058-6e35d608194d req-d132a020-56e5-4563-b907-552a96204fb5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:52.512495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b73bce53-83e5-42dc-8058-6e35d608194d req-d132a020-56e5-4563-b907-552a96204fb5 service nova] Creating event network-vif-deleted:161e7dec-ea6b-4829-bb29-b2fc9beb75f7 for instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a on n-h2-853316-12 Oct 17 13:12:52.533100 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b73bce53-83e5-42dc-8058-6e35d608194d req-d132a020-56e5-4563-b907-552a96204fb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110270 Oct 17 13:12:52.533739 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2376/4612] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:52.606906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:52.607696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:52.625123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:52.625853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:52.626356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:52.627549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:52.627549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:52.627982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:52.693417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:52.694140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:52.694795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:52.695424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lazy-loading 'fault' on Instance uuid 86251db7-6bf6-4c1d-a50c-11b2ccdb792a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:12:52.717249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:52.740876 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a297bc79-9325-49f1-a7d3-621c94af980e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.621225 Oct 17 13:12:52.745106 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2237/4613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:52 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:52.778728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:52.787899 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e603cf50-6ada-4682-8f6d-8f87a7598b81 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 200 len: 1313 microversion: 2.1 time: 0.186973 Oct 17 13:12:52.788504 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2377/4614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:52 2022] GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:52.870926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:52.871540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:52.878121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:52.878637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:52.879074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:52.879760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:52.880219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:52.880644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:53.067471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:53.076980 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52a19b93-6af7-4bfd-aaff-e430d294c2bc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.211327 Oct 17 13:12:53.077498 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2238/4615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:52 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:53.205699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:53.206423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:53.213815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:53.214341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:53.214868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:53.215583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:53.216044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:53.216476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:53.586525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:53.595242 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fcf8a581-ba4c-4d39-a8b4-9d32f312965e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1212 microversion: 2.1 time: 0.393774 Oct 17 13:12:53.595848 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2378/4616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:53 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1212 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:53.769034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:53.769685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:53.776854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:53.777331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:53.777765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:53.778484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:53.778931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:53.779353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:53.815948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:53.816683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:53.824179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:53.824828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:53.825337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:53.826128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:53.826682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:53.827343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:53.864919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:53.865416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:53.865854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:53.866892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lazy-loading 'fault' on Instance uuid 86251db7-6bf6-4c1d-a50c-11b2ccdb792a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:12:53.911473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:53.921515 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2ed663f-a618-4e74-a9e6-305a0b365d15 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 200 len: 1313 microversion: 2.1 time: 0.109391 Oct 17 13:12:53.932323 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2379/4617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:53 2022] GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 1313 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:53.942565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:53.951982 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9724445b-31d1-4bf4-8ccc-40e482a5ba09 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1322 microversion: 2.1 time: 0.186757 Oct 17 13:12:53.952564 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2239/4618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:53 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:54.103688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:54.104319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:54.110890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:54.111394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:54.112050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:54.112771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:54.113233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:54.113942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:54.295554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:54.304392 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-23f9ff39-0499-4bfa-a28d-7a4caf1d6b8b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.204936 Oct 17 13:12:54.304969 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2380/4619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:54 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:54.627729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:54.635760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:54.643244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:54.643907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:54.644390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:54.645904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:54.646358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:54.646788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:54.715914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:54.724221 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cdab8446-7b9e-4261-967b-669f129ac2b7 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1268 microversion: 2.1 time: 0.109050 Oct 17 13:12:54.724831 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2240/4620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:54 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1268 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:54.944690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:54.945927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:54.954221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:54.954876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:54.955327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:54.956048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:54.956512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:54.956944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:54.979020 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] HTTP exception thrown: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Request method failure captured: Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a HTTP/1.1 Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVS26KzdxBu31P-bPiOclnZCTVVNJ72Y1EKsKz8agQk65V5OCB5nmYc-wNLKxNVTN2I_CbK06or9006QFNClRuis9looq0WL8qumh8RROwk_NEENNN70tWDzD84eQ0l7hz0FY5D_pzKJTMgm51RNGoPDu_XZgGOoZY2jF249V9a8LAk Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8c5cd880cc14ec98153be5f3208187a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0623ee4e83f84d7dbb0b27c40c6b9c7d Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '86251db7-6bf6-4c1d-a50c-11b2ccdb792a'} Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:54.980711 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Returning 404 to user: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72d571dc-5bf1-4b94-b673-9a33750d8f38 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 404 len: 111 microversion: 2.1 time: 0.041687 Oct 17 13:12:54.984870 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2381/4621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:54 2022] GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:12:54.992352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:54.998095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:54.998545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:54.999186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:54.999381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:55.005176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.005991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.006589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.007110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.007279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.007956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.008507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.008612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.009127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.010641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.016437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.017177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.108653 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-89dd5a99-f825-4264-945c-c14b32961970 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.120046 Oct 17 13:12:55.109259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2382/4622] 10.222.0.27 () {58 vars in 1230 bytes} [Mon Oct 17 13:12:54 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:12:55.125102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-872b81f6-72d3-43ac-9b4f-dd01792875ba tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-872b81f6-72d3-43ac-9b4f-dd01792875ba tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Request method failure captured: Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVS26KzdxBu31P-bPiOclnZCTVVNJ72Y1EKsKz8agQk65V5OCB5nmYc-wNLKxNVTN2I_CbK06or9006QFNClRuis9looq0WL8qumh8RROwk_NEENNN70tWDzD84eQ0l7hz0FY5D_pzKJTMgm51RNGoPDu_XZgGOoZY2jF249V9a8LAk Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8c5cd880cc14ec98153be5f3208187a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0623ee4e83f84d7dbb0b27c40c6b9c7d Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:12:55.129183 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-872b81f6-72d3-43ac-9b4f-dd01792875ba tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-872b81f6-72d3-43ac-9b4f-dd01792875ba tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009762 Oct 17 13:12:55.135570 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2383/4623] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:12:55.142997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.148177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:55.148786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'deleted': False, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:55.155700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.156205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.156651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.157392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.157855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.158324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.186289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:12:55.218365 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f57a0b7d-bb5b-4ec5-b66a-ceaf7d29d44d tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.079233 Oct 17 13:12:55.219230 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2384/4624] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers => generated 683 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:55.244841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.255714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:55.256657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.servers [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Removing options 'limit' from query {{(pid=127540) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:12:55.260471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'deleted': False, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:55.269037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.269682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.270257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.271201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.272785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.273349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.300764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:55.314656 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f9e89df-9569-41e0-b154-06d5ce5194b5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1472 microversion: 2.1 time: 0.339343 Oct 17 13:12:55.327606 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2241/4625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:54 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:55.340280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.340660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:12:55.341213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:55.349178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.350233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.350846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.351985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.352612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.353455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.393587 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ba1ea685-18ed-4cf9-b214-31815b2365ce tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.161735 Oct 17 13:12:55.394532 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2385/4626] 10.222.0.27 () {58 vars in 1144 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:12:55.556623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e9c1a6e-a323-4e1f-91e1-9ce0b9479c2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:55.557264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5e9c1a6e-a323-4e1f-91e1-9ce0b9479c2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] [instance: 5dfff974-b1b8-48af-a515-f017c07d229d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:55.563037 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-5e9c1a6e-a323-4e1f-91e1-9ce0b9479c2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] HTTP exception thrown: Instance 5dfff974-b1b8-48af-a515-f017c07d229d could not be found. Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e9c1a6e-a323-4e1f-91e1-9ce0b9479c2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Request method failure captured: Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/5dfff974-b1b8-48af-a515-f017c07d229d/action HTTP/1.1 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 15 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVTB2QElZXXYQQ0rPWC4Ta6l5YIZtLZJWiXdV4n7Ts43WYj2--qs-siUzRqyE--wGoegI9XdUyRLPcAKGyvFSwIXZ5kxRiAuPhLlxLqDNw_0kDwB_d7A_ofpbC6LbYsTZhsOnOtnNJ2_u15TiTgsQ6Dq3Kh9pccbAClDJRkoP7Oa5WU Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02684267a8034abc810696a1dbfdd319", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02684267a8034abc810696a1dbfdd319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: a6d030723c8c41fcb4bbf7dcb583f891 Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: {"migrate": {}} Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 5dfff974-b1b8-48af-a515-f017c07d229d could not be found. Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5dfff974-b1b8-48af-a515-f017c07d229d', 'body': {'migrate': {}}} Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dfff974-b1b8-48af-a515-f017c07d229d could not be found. Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dfff974-b1b8-48af-a515-f017c07d229d could not be found. Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.565019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.569800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:55.569800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:55.569800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:12:55.569800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:12:55.569800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dfff974-b1b8-48af-a515-f017c07d229d could not be found. Oct 17 13:12:55.569800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.571330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e9c1a6e-a323-4e1f-91e1-9ce0b9479c2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Returning 404 to user: Instance 5dfff974-b1b8-48af-a515-f017c07d229d could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:55.573042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5e9c1a6e-a323-4e1f-91e1-9ce0b9479c2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5dfff974-b1b8-48af-a515-f017c07d229d/action" status: 404 len: 111 microversion: 2.1 time: 0.177397 Oct 17 13:12:55.573712 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2386/4627] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:12:55 2022] POST /compute/v2.1/servers/5dfff974-b1b8-48af-a515-f017c07d229d/action => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:12:55.579707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9fb38cc-b30d-4ffa-af3f-a270b63c4c33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9fb38cc-b30d-4ffa-af3f-a270b63c4c33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Request method failure captured: Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVS26KzdxBu31P-bPiOclnZCTVVNJ72Y1EKsKz8agQk65V5OCB5nmYc-wNLKxNVTN2I_CbK06or9006QFNClRuis9looq0WL8qumh8RROwk_NEENNN70tWDzD84eQ0l7hz0FY5D_pzKJTMgm51RNGoPDu_XZgGOoZY2jF249V9a8LAk Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8c5cd880cc14ec98153be5f3208187a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0623ee4e83f84d7dbb0b27c40c6b9c7d Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi '-1' Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:12:55.585921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.591579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9fb38cc-b30d-4ffa-af3f-a270b63c4c33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:55.593518 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d9fb38cc-b30d-4ffa-af3f-a270b63c4c33 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.017538 Oct 17 13:12:55.594264 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2387/4628] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:12:55.611327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b8c2bc6-ee6d-4198-8bee-5b9a2bdd25af tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b8c2bc6-ee6d-4198-8bee-5b9a2bdd25af tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Request method failure captured: Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVS26KzdxBu31P-bPiOclnZCTVVNJ72Y1EKsKz8agQk65V5OCB5nmYc-wNLKxNVTN2I_CbK06or9006QFNClRuis9looq0WL8qumh8RROwk_NEENNN70tWDzD84eQ0l7hz0FY5D_pzKJTMgm51RNGoPDu_XZgGOoZY2jF249V9a8LAk Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8c5cd880cc14ec98153be5f3208187a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0623ee4e83f84d7dbb0b27c40c6b9c7d Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'testing' Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:12:55.615607 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b8c2bc6-ee6d-4198-8bee-5b9a2bdd25af tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9b8c2bc6-ee6d-4198-8bee-5b9a2bdd25af tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016426 Oct 17 13:12:55.620329 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2388/4629] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:12:55.629019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03fe1abc-1030-49e2-8a4f-c0250fb81616 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.635084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-03fe1abc-1030-49e2-8a4f-c0250fb81616 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:55.635879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-03fe1abc-1030-49e2-8a4f-c0250fb81616 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:55.643652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.servers [None req-03fe1abc-1030-49e2-8a4f-c0250fb81616 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Flavor 'non_existing_flavor' could not be found {{(pid=127540) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 17 13:12:55.644544 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-03fe1abc-1030-49e2-8a4f-c0250fb81616 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.019591 Oct 17 13:12:55.660526 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2389/4630] 10.222.0.27 () {58 vars in 1178 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:12:55.667187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.672504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:55.673186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:55.678962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.679449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.679891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.680616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.681926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.681926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.726409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:55.738541 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-afb1cb3a-1983-46e3-a315-6dc0b9adf75f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.408151 Oct 17 13:12:55.739791 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2242/4631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:55.751076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1423679761", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:55.774583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:55.794367 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13c142b0-5a95-4784-9f75-923174fd9c48 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.131446 Oct 17 13:12:55.795464 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2390/4632] 10.222.0.27 () {58 vars in 1174 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:12:55.800516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.808332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:55.817396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.818062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.818564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.819590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.820065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.820497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.827017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:12:55.909077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:55.921010 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b8eed5c-6a5c-4b38-9e40-c324324e0eb9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1274 microversion: 2.1 time: 0.124407 Oct 17 13:12:55.934434 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2391/4633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:55.934434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:55.934434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:55.935387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:55.948444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.948444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.948444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:55.948444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:55.948444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:55.949441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.039356 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91c4fead-4f32-4d41-9fbd-00c037532d4c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.115900 Oct 17 13:12:56.039941 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2392/4634] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Oct 17 13:12:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:12:56.056601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:56.065675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:56.066556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'deleted': False, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:56.072161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.073091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.073524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.074291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.074745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.075166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.106327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:12:56.143697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:56.151847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.152335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.152803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.285259 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-15dcb473-d6cf-43ec-8e33-4f55c4cd4764 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.235802 Oct 17 13:12:56.285862 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2393/4635] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:12:56 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:56.311790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-985cf7d8-d911-468e-a3c7-93e8aebb13f7 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:56.317231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-985cf7d8-d911-468e-a3c7-93e8aebb13f7 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:56.318206 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-985cf7d8-d911-468e-a3c7-93e8aebb13f7 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011008 Oct 17 13:12:56.318798 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2394/4636] 10.222.0.27 () {58 vars in 1178 bytes} [Mon Oct 17 13:12:56 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:12:56.333090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:56.339341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:56.340035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Searching by: {'deleted': False, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:12:56.345597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.346137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.346639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.347421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.347879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.348308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.375227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:12:56.375806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:12:56.376300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:12:56.376519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:12:56.377027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:12:56.377948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:12:56.389706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.390637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.391566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.392855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.393549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.394237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.413579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-08d61971-0bde-4c78-9855-e7c65cf20362 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.085130 Oct 17 13:12:56.414645 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2395/4637] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 13:12:56 2022] GET /compute/v2.1/servers => generated 683 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:56.430948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Getting quotas for project 34f04048d29f458881da0063c9cd501f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:12:56.432153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:56.432759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:56.439433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.440367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Getting quotas for user 35bc5b1329eb489d8f4099cb45dea020 and project 34f04048d29f458881da0063c9cd501f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:12:56.440890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.441361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.442736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.443338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.443958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.458251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:12:56.460618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:12:56.463927 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] HTTP exception thrown: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Request method failure captured: Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a HTTP/1.1 Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVS26KzdxBu31P-bPiOclnZCTVVNJ72Y1EKsKz8agQk65V5OCB5nmYc-wNLKxNVTN2I_CbK06or9006QFNClRuis9looq0WL8qumh8RROwk_NEENNN70tWDzD84eQ0l7hz0FY5D_pzKJTMgm51RNGoPDu_XZgGOoZY2jF249V9a8LAk Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8c5cd880cc14ec98153be5f3208187a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0623ee4e83f84d7dbb0b27c40c6b9c7d Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '86251db7-6bf6-4c1d-a50c-11b2ccdb792a'} Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:12:56.465528 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Returning 404 to user: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-96883648-6801-48c0-ad64-9cfcd57f28d3 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "DELETE /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 404 len: 111 microversion: 2.1 time: 0.042546 Oct 17 13:12:56.473948 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2396/4638] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:12:56 2022] DELETE /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:12:56.481965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:56.482536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:56.489042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.489527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.490189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.491227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.491958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.492537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.528796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:12:56.534968 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c37eca2-0497-4ca9-8438-855f01994d7b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793950 Oct 17 13:12:56.536289 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2243/4639] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:12:56.554401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ec80d60b-4259-45ae-8ca6-008edc7dafa2 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:56.556766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ec80d60b-4259-45ae-8ca6-008edc7dafa2 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:56.628284 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f767469e-7f7b-426c-9cda-2d6f2ffe593c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4" status: 204 len: 0 microversion: 2.1 time: 0.151628 Oct 17 13:12:56.629311 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2397/4640] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:12:56 2022] DELETE /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:12:56.640176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:56.640723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:56.648298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.648898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.649241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.650552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.651011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.651462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.685384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:12:56.794145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:12:56.800249 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bb79d1f5-073c-4071-94cc-92e49898421c tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "DELETE /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 204 len: 0 microversion: 2.1 time: 0.165755 Oct 17 13:12:56.801569 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2398/4641] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:12:56 2022] DELETE /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:12:56.811317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:56.812437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:56.819965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.820725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.821377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:56.823352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:56.824004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:56.824682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:57.010084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:57.021736 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e48eb2f-73f7-4d23-84ed-69050fefda92 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.218215 Oct 17 13:12:57.022949 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2399/4642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:56 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:57.030202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:57.031095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 86251db7-6bf6-4c1d-a50c-11b2ccdb792a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:57.039528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:57.040868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:57.041570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:57.042721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:57.043836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:57.044494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:57.058902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec80d60b-4259-45ae-8ca6-008edc7dafa2 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:57.064347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] HTTP exception thrown: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Request method failure captured: Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a HTTP/1.1 Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVS26KzdxBu31P-bPiOclnZCTVVNJ72Y1EKsKz8agQk65V5OCB5nmYc-wNLKxNVTN2I_CbK06or9006QFNClRuis9looq0WL8qumh8RROwk_NEENNN70tWDzD84eQ0l7hz0FY5D_pzKJTMgm51RNGoPDu_XZgGOoZY2jF249V9a8LAk Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8c5cd880cc14ec98153be5f3208187a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0623ee4e83f84d7dbb0b27c40c6b9c7d Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '86251db7-6bf6-4c1d-a50c-11b2ccdb792a'} Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:57.066341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:12:57.070685 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:57.070685 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:12:57.070685 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:12:57.070685 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:12:57.070685 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:12:57.070685 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:12:57.070685 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. Oct 17 13:12:57.070685 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:12:57.073649 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ec80d60b-4259-45ae-8ca6-008edc7dafa2 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1222 microversion: 2.1 time: 0.519398 Oct 17 13:12:57.073879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Returning 404 to user: Instance 86251db7-6bf6-4c1d-a50c-11b2ccdb792a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:12:57.073879 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0201c4a-c5cb-4c19-b52b-1039c103ded2 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a" status: 404 len: 111 microversion: 2.1 time: 0.043703 Oct 17 13:12:57.073879 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2400/4643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:57 2022] GET /compute/v2.1/servers/86251db7-6bf6-4c1d-a50c-11b2ccdb792a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:12:57.078559 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2244/4644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:56 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1222 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:57.079261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:57.080381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:57.089624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:57.089996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:57.090258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:57.090998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:57.091672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:57.092758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:57.093895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:57.094607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:57.096631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:57.097122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:57.097791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:57.098752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:57.099414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:57.100081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:57.263628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:57.273150 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7860de9-f231-485b-8e3a-45dde44fea6d tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.198326 Oct 17 13:12:57.273723 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2401/4645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:57 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:57.322965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-05f9ae7f-cb19-4fd2-89a3-4679c395fc84 req-33645814-c6cd-4ce6-8757-f8831606ab61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6fbb90d-ee4d-419d-b839-c032d62fbb89", "name": "network-vif-plugged", "status": "completed", "tag": "3cf027b7-9cb8-42d3-b227-094e4d67ed61"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:12:57.335622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-05f9ae7f-cb19-4fd2-89a3-4679c395fc84 req-33645814-c6cd-4ce6-8757-f8831606ab61 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:57.336359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-05f9ae7f-cb19-4fd2-89a3-4679c395fc84 req-33645814-c6cd-4ce6-8757-f8831606ab61 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:57.337051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-05f9ae7f-cb19-4fd2-89a3-4679c395fc84 req-33645814-c6cd-4ce6-8757-f8831606ab61 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:57.351283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-05f9ae7f-cb19-4fd2-89a3-4679c395fc84 req-33645814-c6cd-4ce6-8757-f8831606ab61 service nova] Creating event network-vif-plugged:3cf027b7-9cb8-42d3-b227-094e4d67ed61 for instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 on n-h2-853316-12 Oct 17 13:12:57.358969 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-05f9ae7f-cb19-4fd2-89a3-4679c395fc84 req-33645814-c6cd-4ce6-8757-f8831606ab61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040481 Oct 17 13:12:57.360330 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2402/4646] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:12:57.545127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:57.554368 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2433ce3c-56a9-4816-a3f7-e2c7cebab1d5 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4" status: 200 len: 1523 microversion: 2.1 time: 0.473991 Oct 17 13:12:57.555430 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2245/4647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:57 2022] GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 => generated 1523 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:58.051218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:58.052608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:58.074660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:58.075190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:58.075642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:58.076385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:58.076847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:58.077280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:58.098828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:58.099735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:58.110608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:58.111376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:58.112031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:58.113397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:58.115091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:58.116341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:58.246864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:58.257314 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4765c284-72c2-47c8-a63c-8e8f6fab5f01 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1218 microversion: 2.1 time: 0.165023 Oct 17 13:12:58.258574 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2246/4648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:58 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:58.303160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:58.303800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:58.315759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:58.316944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:58.317703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:58.320348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:58.321211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:58.322000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:58.474326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:58.484349 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-343d016b-0fbc-47d5-b6a5-5d018cd70961 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 0.438648 Oct 17 13:12:58.485479 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2403/4649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:58 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:58.583658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:58.584266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:58.595226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:58.596319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:58.596942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:58.597869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:58.598512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:58.599105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:58.773329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:58.783761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:58.784438 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7fb934d-e2fb-4d1d-aed4-a15761cb93ff tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4" status: 200 len: 1523 microversion: 2.1 time: 0.204886 Oct 17 13:12:58.790304 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2404/4650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:58 2022] GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:58.813425 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4a2b4d6a-fce5-47e1-bc36-2be0c81857fc tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.515939 Oct 17 13:12:58.814742 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2247/4651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:58 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:12:59.294626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:59.296070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:59.309830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:59.310436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:59.310884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:59.313172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:59.313172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:59.313172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:59.419007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:12:59.428688 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e974dd59-dac1-40a3-8759-84683dd2ff9a tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1274 microversion: 2.1 time: 0.147447 Oct 17 13:12:59.429808 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2405/4652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:59 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:12:59.514963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:59.516068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:59.530633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:59.533518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:59.537785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:59.539028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:59.539700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:59.543060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:59.813944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:12:59.815032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:12:59.823201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:59.823758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:59.824269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:12:59.825183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:12:59.825643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:12:59.826497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:00.045061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:00.048545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:00.060704 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72718011-1c72-4f4c-97cf-ce5558f82994 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4" status: 200 len: 1523 microversion: 2.1 time: 0.251728 Oct 17 13:13:00.066265 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2406/4653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:59 2022] GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:00.070908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:00.071853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:00.080224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:00.080785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:00.081419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:00.082235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:00.082685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:00.083119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:00.240379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:00.249981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff188ebe-e6c5-4835-a502-b955ccb30b0f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.187373 Oct 17 13:13:00.250615 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2407/4654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:00 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:00.458858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:00.459844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:00.474071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:00.475276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:00.476111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:00.477602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:00.479526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:00.479526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:00.546281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:00.558003 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c5ebedd-2fd6-4704-b324-8bf25d1319bd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1315 microversion: 2.1 time: 1.049243 Oct 17 13:13:00.561917 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2248/4655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:12:59 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:00.581830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:00.591718 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07d61330-9873-48b6-bbeb-13a7aecd095f tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1280 microversion: 2.1 time: 0.137656 Oct 17 13:13:00.592533 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2408/4656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:00 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:00.954430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c9d2862a-3564-4ea5-a63d-78fb99f19aa0 req-5d99817b-635b-4338-8d9a-2098f0b0d312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912f82ec-fa54-45cd-972c-995acce4b2e4", "name": "network-vif-deleted", "tag": "f61158a4-ec13-4655-a3e6-fd61886d1e0a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:00.981214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c9d2862a-3564-4ea5-a63d-78fb99f19aa0 req-5d99817b-635b-4338-8d9a-2098f0b0d312 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:00.982533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c9d2862a-3564-4ea5-a63d-78fb99f19aa0 req-5d99817b-635b-4338-8d9a-2098f0b0d312 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:00.983214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c9d2862a-3564-4ea5-a63d-78fb99f19aa0 req-5d99817b-635b-4338-8d9a-2098f0b0d312 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:01.022029 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c9d2862a-3564-4ea5-a63d-78fb99f19aa0 req-5d99817b-635b-4338-8d9a-2098f0b0d312 service nova] Creating event network-vif-deleted:f61158a4-ec13-4655-a3e6-fd61886d1e0a for instance 912f82ec-fa54-45cd-972c-995acce4b2e4 on n-h2-853316-12 Oct 17 13:13:01.036748 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c9d2862a-3564-4ea5-a63d-78fb99f19aa0 req-5d99817b-635b-4338-8d9a-2098f0b0d312 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091730 Oct 17 13:13:01.037732 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2249/4657] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:13:01.085568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:01.086598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:01.094063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:01.094745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:01.095280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:01.096240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:01.096920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:01.097427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:01.222760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0623ee4e83f84d7dbb0b27c40c6b9c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c5cd880cc14ec98153be5f3208187a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:01.234607 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50887db5-839b-4678-ace0-8e48521bc269 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4" status: 200 len: 1481 microversion: 2.1 time: 0.153191 Oct 17 13:13:01.235201 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2409/4658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:01 2022] GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 => generated 1481 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:01.274320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:01.276007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:01.293549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:01.294806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:01.303288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:01.306296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:01.307238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:01.308443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:01.383119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:01.586861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:01.588806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:01.599275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:01.600935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:01.601450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:01.603624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:01.604286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:01.606649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:01.883598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:01.895884 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b1e25fb-129d-4877-8f8e-e69e17a09f31 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1501 microversion: 2.1 time: 0.314696 Oct 17 13:13:01.897280 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2410/4659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:01 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:01.903728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:01.904726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:01.912087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:01.913249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:01.913957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:01.915055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:01.915938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:01.916885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:02.013667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:02.028354 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-480321cb-279e-4a7c-af9a-02484e6c96c5 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1280 microversion: 2.1 time: 0.129647 Oct 17 13:13:02.030206 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2411/4660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:01 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:02.034747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:02.037097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:02.047912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:02.048622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:02.049077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:02.049800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:02.050304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:02.051187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:02.111012 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29a54634-5c93-4749-8414-20661125848c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.080006 Oct 17 13:13:02.115808 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2412/4661] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:02 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:02.254087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:02.264499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:02.265345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:02.276664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:02.277112 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3f891c33-83dc-433a-b6a3-d7e0782323e9 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 1.003947 Oct 17 13:13:02.277609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:02.278350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:02.279289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:02.279995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:02.280139 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2250/4662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:01 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:02.281172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:02.300549 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] HTTP exception thrown: Instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 could not be found. Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Request method failure captured: Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 HTTP/1.1 Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVS26KzdxBu31P-bPiOclnZCTVVNJ72Y1EKsKz8agQk65V5OCB5nmYc-wNLKxNVTN2I_CbK06or9006QFNClRuis9looq0WL8qumh8RROwk_NEENNN70tWDzD84eQ0l7hz0FY5D_pzKJTMgm51RNGoPDu_XZgGOoZY2jF249V9a8LAk Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8c5cd880cc14ec98153be5f3208187a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0623ee4e83f84d7dbb0b27c40c6b9c7d Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 could not be found. Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '4f3b68f0-eeab-42f9-bab7-fe69c2261ac4'} Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 could not be found. Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 could not be found. Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.302719 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:02.306887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.306887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:02.306887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:02.306887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:02.306887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:02.306887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:02.306887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 could not be found. Oct 17 13:13:02.306887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.308967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Returning 404 to user: Instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:02.309970 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b55fd67e-1141-4432-bcba-5203c4f7c3bd tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4" status: 404 len: 111 microversion: 2.1 time: 0.053464 Oct 17 13:13:02.310695 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2413/4663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:02 2022] GET /compute/v2.1/servers/4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:13:02.319834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:02.320608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] [instance: 912f82ec-fa54-45cd-972c-995acce4b2e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:02.331628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:02.332446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:02.333047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:02.334655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:02.335874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:02.336959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:02.355242 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] HTTP exception thrown: Instance 912f82ec-fa54-45cd-972c-995acce4b2e4 could not be found. Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Request method failure captured: Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 HTTP/1.1 Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVS26KzdxBu31P-bPiOclnZCTVVNJ72Y1EKsKz8agQk65V5OCB5nmYc-wNLKxNVTN2I_CbK06or9006QFNClRuis9looq0WL8qumh8RROwk_NEENNN70tWDzD84eQ0l7hz0FY5D_pzKJTMgm51RNGoPDu_XZgGOoZY2jF249V9a8LAk Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c8c5cd880cc14ec98153be5f3208187a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c8c5cd880cc14ec98153be5f3208187a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c8c5cd880cc14ec98153be5f3208187a Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1227140224 Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 0623ee4e83f84d7dbb0b27c40c6b9c7d Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ListServersNegativeTestJSON-1227140224-project Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 912f82ec-fa54-45cd-972c-995acce4b2e4 could not be found. Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '912f82ec-fa54-45cd-972c-995acce4b2e4'} Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 912f82ec-fa54-45cd-972c-995acce4b2e4 could not be found. Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 912f82ec-fa54-45cd-972c-995acce4b2e4 could not be found. Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.357517 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:02.362910 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.362910 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:02.362910 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:02.362910 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:02.362910 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:02.362910 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:02.362910 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 912f82ec-fa54-45cd-972c-995acce4b2e4 could not be found. Oct 17 13:13:02.362910 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:02.364033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] Returning 404 to user: Instance 912f82ec-fa54-45cd-972c-995acce4b2e4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:02.365909 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d98c1b81-2188-4d34-b3c6-0e3a96ef8246 tempest-ListServersNegativeTestJSON-1227140224 tempest-ListServersNegativeTestJSON-1227140224-project] 10.222.0.27 "GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4" status: 404 len: 111 microversion: 2.1 time: 0.049691 Oct 17 13:13:02.366454 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2251/4664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:02 2022] GET /compute/v2.1/servers/912f82ec-fa54-45cd-972c-995acce4b2e4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:03.053580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:03.054106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:03.070666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:03.071541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:03.072813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:03.073776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:03.074430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:03.075017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:03.077654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-26652121-a1bc-4795-874c-64fcab125e0a req-6579916f-6343-48d0-a04a-b39585f36a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3b68f0-eeab-42f9-bab7-fe69c2261ac4", "name": "network-vif-deleted", "tag": "9f2e9d49-2f47-4450-829e-0986bd830d52"}, {"name": "network-changed", "server_uuid": "2f0627aa-678d-4424-8ae7-9d9ef5b157e5", "tag": "39353df8-7c6d-47cd-a8e8-91de9abb0de3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:03.111136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-26652121-a1bc-4795-874c-64fcab125e0a req-6579916f-6343-48d0-a04a-b39585f36a59 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:03.111857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-26652121-a1bc-4795-874c-64fcab125e0a req-6579916f-6343-48d0-a04a-b39585f36a59 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:03.112348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-26652121-a1bc-4795-874c-64fcab125e0a req-6579916f-6343-48d0-a04a-b39585f36a59 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:03.135487 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-26652121-a1bc-4795-874c-64fcab125e0a req-6579916f-6343-48d0-a04a-b39585f36a59 service nova] Creating event network-vif-deleted:9f2e9d49-2f47-4450-829e-0986bd830d52 for instance 4f3b68f0-eeab-42f9-bab7-fe69c2261ac4 on n-h1-853316-12 Oct 17 13:13:03.137019 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-26652121-a1bc-4795-874c-64fcab125e0a req-6579916f-6343-48d0-a04a-b39585f36a59 service nova] Creating event network-changed:39353df8-7c6d-47cd-a8e8-91de9abb0de3 for instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 on n-h1-853316-12 Oct 17 13:13:03.151241 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-26652121-a1bc-4795-874c-64fcab125e0a req-6579916f-6343-48d0-a04a-b39585f36a59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.078308 Oct 17 13:13:03.153028 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2252/4665] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:03.161844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:03.164220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:03.171504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:03.172001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:03.172489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:03.173127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:03.173772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:03.174399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:03.222722 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41e4457b-19f4-4ee5-ad67-532a0a420aa5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.067176 Oct 17 13:13:03.232187 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2253/4666] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:03 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:03.304924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:03.306142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:03.316786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:03.317549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:03.318354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:03.320908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:03.321787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:03.323447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:03.529410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:03.545861 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-10456f08-6bf3-42c9-9f11-0b704773b3b9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1322 microversion: 2.1 time: 0.495926 Oct 17 13:13:03.566490 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2414/4667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:03 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:03.733381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:03.746675 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3df42c33-58d0-4d7f-9b9a-8e2dd276e258 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.446418 Oct 17 13:13:03.766261 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2254/4668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:03 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:04.431493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:04.433936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:04.443074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:04.443809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:04.444788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:04.447872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:04.448815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:04.449462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:04.505504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-949e0292-f4e8-45a4-954f-88ea71d901f7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.270186 Oct 17 13:13:04.506895 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2415/4669] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:04 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:04.575700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:04.576732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:04.598019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:04.598817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:04.599530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:04.600714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:04.601436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:04.602241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:04.773683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:04.774723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:04.789779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:04.790496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:04.795527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:04.796764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:04.797471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:04.798130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:05.060166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:05.080050 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e0c6eb20-d751-411a-b1ff-fd95dfc2f9ad tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.307116 Oct 17 13:13:05.081171 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2416/4670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:04 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:05.518837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:05.522512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:05.532409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:05.533319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:05.533926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:05.534868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:05.535330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:05.535756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:05.543235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:05.555261 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2cdd278a-a4f9-437e-b98e-c5485659dd23 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1322 microversion: 2.1 time: 0.985793 Oct 17 13:13:05.567145 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2255/4671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:04 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1322 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:05.602530 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ac3e8e5-73eb-45a1-a9fb-b7ea0a689169 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.087789 Oct 17 13:13:05.603337 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2417/4672] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:05 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:13:05.776495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-72b21b09-445e-4299-b0df-b17fcac13269 req-9b8bbb41-14df-463e-8918-69076d7411e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47eb26da-f121-42a0-97d5-f71275010785", "tag": "5e6c7459-714e-4aad-b591-0fef65fc98d9"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:05.811069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-72b21b09-445e-4299-b0df-b17fcac13269 req-9b8bbb41-14df-463e-8918-69076d7411e8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:05.811069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-72b21b09-445e-4299-b0df-b17fcac13269 req-9b8bbb41-14df-463e-8918-69076d7411e8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:05.811069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-72b21b09-445e-4299-b0df-b17fcac13269 req-9b8bbb41-14df-463e-8918-69076d7411e8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:05.847992 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-72b21b09-445e-4299-b0df-b17fcac13269 req-9b8bbb41-14df-463e-8918-69076d7411e8 service nova] Creating event network-changed:5e6c7459-714e-4aad-b591-0fef65fc98d9 for instance 47eb26da-f121-42a0-97d5-f71275010785 on n-h2-853316-12 Oct 17 13:13:05.862865 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-72b21b09-445e-4299-b0df-b17fcac13269 req-9b8bbb41-14df-463e-8918-69076d7411e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106736 Oct 17 13:13:05.867802 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2256/4673] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:06.106714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:06.107780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:06.116244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:06.117009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:06.117447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:06.118235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:06.118893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:06.119377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:06.142611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:06.355305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=14 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:06.593879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:06.595220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:06.609569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:06.619732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:06.619732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:06.619732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:06.620539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:06.621585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:06.622229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:06.648258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:06.695767 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-689cae21-ba76-424d-854b-bbed6d4e946e tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.589212 Oct 17 13:13:06.714289 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2418/4674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:06 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:06.727087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:06.731285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:06.745816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:06.746440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:06.746883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:06.747625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:06.748145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:06.748686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:06.825334 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d54e5ea-cd07-4358-b2cb-8a17cbb4de2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.103156 Oct 17 13:13:06.826712 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2419/4675] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:06 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:07.063313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=13 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:07.188128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:07.219080 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd0beafa-0d71-4fa4-b37e-04be30198e68 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1322 microversion: 2.1 time: 0.640030 Oct 17 13:13:07.251404 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2257/4676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:06 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:07.394719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1205953230", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "4a8f12af-2a1e-453c-9da7-f09051d2976e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1239119533", "security_groups": []}, "os:scheduler_hints": {"different_host": ["97db364f-e815-4522-90ee-61887b73aae3"]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:07.494360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] validate_networks() for [('4a8f12af-2a1e-453c-9da7-f09051d2976e', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:13:07.723961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:07.725315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:07.732813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:07.733617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:07.734315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:07.735282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:07.739168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:07.740256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:07.994650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:08.005500 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a7f3f614-2181-4319-8619-addc2ad4b042 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.285460 Oct 17 13:13:08.019599 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2258/4677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:07 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:08.019599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:08.019599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:08.031719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:08.031719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:08.031719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:08.031719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:08.031719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:08.031719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:08.093271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:13:08.093787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:13:08.094574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:13:08.094991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:13:08.095400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:13:08.110601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:08.111090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:08.111523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:08.112260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:08.112715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:08.113138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:08.143400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Getting quotas for project 8096ad9cc4a242b1a3ecf4cdb9a2dcb0. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:13:08.152070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Getting quotas for user efab0c775fd94096912d8844df7457b6 and project 8096ad9cc4a242b1a3ecf4cdb9a2dcb0. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:13:08.167508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:13:08.171196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:13:08.192353 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8c387ad7-12f2-4a65-a723-22c481360e85 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.184947 Oct 17 13:13:08.199872 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2259/4678] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:08 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:08.257289 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f04761a5-a4fd-4531-a2ba-83a54710c689 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.867351 Oct 17 13:13:08.259935 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2420/4679] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:13:07 2022] POST /compute/v2.1/servers => generated 361 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:13:08.271473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:08.272165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f84e237-ee43-4958-a597-35937c6f8b61 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:08.273039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f84e237-ee43-4958-a597-35937c6f8b61 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:08.274556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:08.299065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:08.299565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:08.300015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:08.300746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:08.301803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:08.302282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:08.382596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f84e237-ee43-4958-a597-35937c6f8b61 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:08.402341 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f84e237-ee43-4958-a597-35937c6f8b61 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1242 microversion: 2.1 time: 0.131494 Oct 17 13:13:08.403282 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2421/4680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:08 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1242 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:08.698910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:08.708098 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa635568-859d-411c-923e-50eb576a52f4 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1322 microversion: 2.1 time: 0.458970 Oct 17 13:13:08.709354 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2260/4681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:08 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:09.047455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:09.048520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:09.063200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:09.063867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:09.064505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:09.065342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:09.066059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:09.066651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:09.208825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:09.212289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:09.221226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:09.223463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:09.224160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:09.225006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:09.226094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:09.226602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:09.227212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:09.309245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2358e97c-ce71-4ad8-a8dc-8356fcc1818a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.104810 Oct 17 13:13:09.315335 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2261/4682] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:09 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:09.335033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:09.363540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf8de62e-ffa2-4532-bb34-6516eb2ca3de tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.326014 Oct 17 13:13:09.365568 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2422/4683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:09 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:09.439944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:09.441563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:09.454376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:09.455203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:09.455840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:09.457390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:09.458056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:09.458710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:09.543491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:09.552417 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d019445-92b1-4245-8a03-71a5f03e4e29 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1294 microversion: 2.1 time: 0.127566 Oct 17 13:13:09.554383 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2262/4684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:09 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1294 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:09.735193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:09.735833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:09.742765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:09.744133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:09.744562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:09.745481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:09.745945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:09.746577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:09.943406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:09.979251 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2dae816-9124-4b39-9871-af39cad7cbe8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1322 microversion: 2.1 time: 0.244146 Oct 17 13:13:09.980141 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2423/4685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:09 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:10.336348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:10.346122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:10.366647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:10.367549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:10.368176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:10.369810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:10.370495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:10.371317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:10.387356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:10.388021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:10.409276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:10.410072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:10.412588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:10.414036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:10.416169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:10.417886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:10.440581 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-86fd1037-01a1-44df-aaf7-dafa11f1400d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.122318 Oct 17 13:13:10.442409 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2263/4686] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:10 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:10.561973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-63a317cc-ac63-4f06-82e7-81a56938dfdc req-8f98b714-922c-4c0d-8981-52726223dfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0627aa-678d-4424-8ae7-9d9ef5b157e5", "name": "network-vif-plugged", "status": "completed", "tag": "39353df8-7c6d-47cd-a8e8-91de9abb0de3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:10.595389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-63a317cc-ac63-4f06-82e7-81a56938dfdc req-8f98b714-922c-4c0d-8981-52726223dfd2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:10.595794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-63a317cc-ac63-4f06-82e7-81a56938dfdc req-8f98b714-922c-4c0d-8981-52726223dfd2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:10.596242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-63a317cc-ac63-4f06-82e7-81a56938dfdc req-8f98b714-922c-4c0d-8981-52726223dfd2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:10.640096 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-63a317cc-ac63-4f06-82e7-81a56938dfdc req-8f98b714-922c-4c0d-8981-52726223dfd2 service nova] Creating event network-vif-plugged:39353df8-7c6d-47cd-a8e8-91de9abb0de3 for instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 on n-h1-853316-12 Oct 17 13:13:10.650346 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-63a317cc-ac63-4f06-82e7-81a56938dfdc req-8f98b714-922c-4c0d-8981-52726223dfd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093929 Oct 17 13:13:10.651705 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2264/4687] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:10.659926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:10.661044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:10.687733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:10.688531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:10.689033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:10.689801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:10.690292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:10.711800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:10.772499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:10.786066 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-735961e4-54ce-4119-a6c5-cf09735aa9b8 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.402133 Oct 17 13:13:10.788587 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2424/4688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:10 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:11.009307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:11.010398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:11.025031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.025554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.026028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.028665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.029169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.031827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.045198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:11.067097 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e58a47c-61e3-4c98-91d9-de12d7c90e74 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.412299 Oct 17 13:13:11.069716 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2265/4689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:10 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:11.158031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:11.161321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:11.173081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.173586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.174031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.174778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.175243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.182594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.362601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lazy-loading 'services' on Instance uuid 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:11.526780 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-29814ac6-021c-41da-926d-189205f08868 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "DELETE /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments/a7e86591-f285-4bf7-9488-e577d1bfbee3" status: 202 len: 0 microversion: 2.1 time: 0.381266 Oct 17 13:13:11.527776 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2266/4690] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:13:11 2022] DELETE /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments/a7e86591-f285-4bf7-9488-e577d1bfbee3 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:11.539228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:11.546726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:11.577852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.584395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.585019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.585901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.586516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.587609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.662253 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48498657-a5d4-405e-82b5-c243c52f9eca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.132575 Oct 17 13:13:11.663683 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2267/4691] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:11 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:11.677003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:11.684429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:11.700748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.703890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.704500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.705372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.706283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.709850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.766588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:11.784385 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72ecda2d-a0ad-41e4-93c8-640c6318f13b tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1322 microversion: 2.1 time: 0.779082 Oct 17 13:13:11.789029 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2425/4692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:11 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:11.807582 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8c7084c-60db-4b27-b267-594f9906c06a tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138699 Oct 17 13:13:11.815143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:11.815417 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2268/4693] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:13:11 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:11.816226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:11.848691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.850500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.851823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:11.856250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:11.856767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:11.862879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.100918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:12.102006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:12.113278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.114093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.115439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.117176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.118675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.119781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.259543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:12.266996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:12.276460 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec03ebd8-8ab1-4e0a-a564-79483d0d4d9c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1316 microversion: 2.1 time: 0.470784 Oct 17 13:13:12.279860 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34f9088c-0937-4cf3-8648-3bd2d60320c5 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.182967 Oct 17 13:13:12.281078 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2269/4694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:12 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:12.293018 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2426/4695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:11 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:12.676506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:12.680515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:12.704029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-26bc08a0-3caf-420d-b7b5-6307c4cb4dd6 req-7735c460-54dc-41cd-8c7d-79d6b696cb15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47eb26da-f121-42a0-97d5-f71275010785", "name": "network-vif-plugged", "status": "completed", "tag": "5e6c7459-714e-4aad-b591-0fef65fc98d9"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:12.711531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.712607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.713092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.716438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.717955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.718442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.725409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-26bc08a0-3caf-420d-b7b5-6307c4cb4dd6 req-7735c460-54dc-41cd-8c7d-79d6b696cb15 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.728843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-26bc08a0-3caf-420d-b7b5-6307c4cb4dd6 req-7735c460-54dc-41cd-8c7d-79d6b696cb15 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.730834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-26bc08a0-3caf-420d-b7b5-6307c4cb4dd6 req-7735c460-54dc-41cd-8c7d-79d6b696cb15 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.735892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:12.762041 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-26bc08a0-3caf-420d-b7b5-6307c4cb4dd6 req-7735c460-54dc-41cd-8c7d-79d6b696cb15 service nova] Creating event network-vif-plugged:5e6c7459-714e-4aad-b591-0fef65fc98d9 for instance 47eb26da-f121-42a0-97d5-f71275010785 on n-h2-853316-12 Oct 17 13:13:12.776490 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-26bc08a0-3caf-420d-b7b5-6307c4cb4dd6 req-7735c460-54dc-41cd-8c7d-79d6b696cb15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076560 Oct 17 13:13:12.777463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2427/4696] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:13:12.841631 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c2cb55af-f2f3-4942-aa4e-557eb8214728 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 14 microversion: 2.1 time: 0.165970 Oct 17 13:13:12.843381 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2270/4697] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:12 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:13:12.861549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:12.861967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:12.862573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:12.866195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:12.875441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.875940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.876379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.877095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.877550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.878488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.904030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.904986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.905635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.906592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:12.907238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:12.908145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:12.938356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:12.960867 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e28931f0-f746-4ad4-abbd-26ea3f295c69 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109337 Oct 17 13:13:12.967790 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2271/4698] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:13:12 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:13.201591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:13.203013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-987780b3-d921-44aa-87f0-0cf3a282f249 req-78e0673f-5080-4c18-9d13-a3398e14bce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005", "tag": "f2379837-11e3-4990-9f85-eb13fa38805a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:13.217900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-987780b3-d921-44aa-87f0-0cf3a282f249 req-78e0673f-5080-4c18-9d13-a3398e14bce1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:13.218678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-987780b3-d921-44aa-87f0-0cf3a282f249 req-78e0673f-5080-4c18-9d13-a3398e14bce1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:13.219318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-987780b3-d921-44aa-87f0-0cf3a282f249 req-78e0673f-5080-4c18-9d13-a3398e14bce1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:13.224454 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b18906bf-a256-48ed-830c-a6b22a70da42 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1322 microversion: 2.1 time: 0.413153 Oct 17 13:13:13.225764 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2428/4699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:12 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:13.244549 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-987780b3-d921-44aa-87f0-0cf3a282f249 req-78e0673f-5080-4c18-9d13-a3398e14bce1 service nova] Creating event network-changed:f2379837-11e3-4990-9f85-eb13fa38805a for instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 on n-h2-853316-12 Oct 17 13:13:13.251608 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-987780b3-d921-44aa-87f0-0cf3a282f249 req-78e0673f-5080-4c18-9d13-a3398e14bce1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052601 Oct 17 13:13:13.252902 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2272/4700] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:13.305133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:13.306455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:13.314457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:13.315285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:13.315973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:13.316864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:13.317793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:13.320391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:13.320712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:13.321793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:13.331453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:13.332232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:13.332869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:13.333777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:13.334301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:13.334902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:13.592382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:13.614111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aa2a66c9-e95c-43a6-9daf-d4d6e3e0af63 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.312791 Oct 17 13:13:13.615293 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2429/4701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:13 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:13.854938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:13.858560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:13.891397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:13.891913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:13.892361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:13.893092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:13.893554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:13.893983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:14.010098 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00fdc745-02f1-4dee-89c8-3d6be6a55fa9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action" status: 200 len: 8196 microversion: 2.1 time: 0.159004 Oct 17 13:13:14.011682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2430/4702] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:13 2022] POST /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89/action => generated 8196 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:14.020194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:14.025028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:14.042762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:14.043268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:14.043721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:14.044445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:14.044961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:14.045322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:14.137605 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-99079fa4-f72c-40a8-a0d4-2326b05eed7b tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124031 Oct 17 13:13:14.139328 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2431/4703] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:13:14 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:14.149233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:14.151026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:14.185494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:14.186951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:14.187988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:14.189888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:14.191188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:14.192236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:14.567270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:14.582813 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4585df09-4a65-4cd1-a6e8-13c7d7fdbe6f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1504 microversion: 2.1 time: 1.261815 Oct 17 13:13:14.603014 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2273/4704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:13 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1504 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:14.617119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:14.626419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:14.652286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:14.656864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:14.660909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:14.662121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:14.663269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:14.667270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.164261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:15.175288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:15.177058 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b579e920-bbf7-492a-bbef-fa556b5f03e9 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1471 microversion: 2.1 time: 0.572707 Oct 17 13:13:15.178209 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2274/4705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:14 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1471 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:15.188193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:15.189004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:15.189497 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a334411c-7db0-474f-b107-69a2e1190265 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 1.048311 Oct 17 13:13:15.190100 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2432/4706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:14 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:15.198035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.198871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.199711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.201016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.201653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.202310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.215256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:15.215880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:15.243123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.243891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.244342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.245138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.245605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.246036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.330740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9cd111c8-67cf-40b2-8fb5-65644b30a20f tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.147664 Oct 17 13:13:15.338390 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2275/4707] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 17 13:13:15 2022] DELETE /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5/os-server-password => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:15.594914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:15.612103 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87e05caf-8709-4e6b-a4a6-d75c1efaeaa7 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.408723 Oct 17 13:13:15.615463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2433/4708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:15 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:15.633183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:15.638754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:15.662467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.667393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.671787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.675124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.679986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.682073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.782091 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-daf39ac8-a6da-4b88-8d09-f4aa1346e810 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164227 Oct 17 13:13:15.785618 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2434/4709] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:13:15 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:15.791645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:15.792441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:15.800576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:15.803714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:15.813031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.815356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.816130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.816789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.817531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.818616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.819364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.820297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.820969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.823009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.823822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.828545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.874187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lazy-loading 'flavor' on Instance uuid 47eb26da-f121-42a0-97d5-f71275010785 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:15.917560 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0a24654-82a1-436d-8ba6-e4a849bc9fe7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action" status: 200 len: 24566 microversion: 2.1 time: 0.577643 Oct 17 13:13:15.927355 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2276/4710] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:15 2022] POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action => generated 24566 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:13:15.939491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:15.940402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:15.961637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.962544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.968340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.969469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:15.972027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:15.975360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:15.994578 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fb78be0a-4bd3-465c-892b-6126cf1acc7e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785/action" status: 202 len: 0 microversion: 2.1 time: 0.206559 Oct 17 13:13:15.997927 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2435/4711] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:15 2022] POST /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:16.004222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:16.004876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:16.013421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.013918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.014468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.015184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.015708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.016141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.053745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f39ab61-1605-49b6-9293-e566a5646e54 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.057132 Oct 17 13:13:16.054984 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2436/4712] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 17 13:13:15 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5/os-server-password => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:16.063433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:16.063994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:16.095752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.098266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.099099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.104093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.104874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.106129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.227297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:16.236347 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4373ffd0-bdab-4d76-af2b-c8d82f1b36db tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.305886 Oct 17 13:13:16.237294 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2277/4713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:15 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:16.250689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:16.251497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:16.259745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.259745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.260211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.260943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.262787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.262787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.308920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:16.485096 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2da6c7fc-1a4b-4464-b21c-1b6b0b82b8d0 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 204 len: 0 microversion: 2.1 time: 0.245460 Oct 17 13:13:16.485734 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2278/4714] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:16 2022] DELETE /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:16.494837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:16.500981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:16.515968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.516767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.517382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.518325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.518966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.519907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.709842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:16.720942 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fcc805dd-d254-4229-b661-fc69487bfa7f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.233230 Oct 17 13:13:16.731668 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2279/4715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:16 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:16.737628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:16.738494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:16.747129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.748019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.748689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.749651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.750377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.751032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.858048 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c8f1adcb-0d0c-4411-aac0-9099e44e0156 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1632 microversion: 2.1 time: 0.798981 Oct 17 13:13:16.860364 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2437/4716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:16 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1632 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:16.871075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:16.871709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:16.884120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.886955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.891980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:16.892951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:16.893600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:16.894238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.024266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:17.042062 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b88e257d-61d2-466e-9ea4-7d0c9d50f9d3 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1510 microversion: 2.1 time: 0.308710 Oct 17 13:13:17.042814 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2280/4717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:16 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:17.054060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:17.059620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:17.060259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:17.066804 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e15b6cb-e2f6-4583-84f1-9d987f241de8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.205070 Oct 17 13:13:17.067431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.082461 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2438/4718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:16 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:17.082569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.082569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.082569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.082569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.082569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.083043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:17.083375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:17.085420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:17.106489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.106959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.107413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.108143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.108603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.109031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.161751 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7b7b188-5596-469d-abc4-109dbefef07f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092922 Oct 17 13:13:17.162782 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2439/4719] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:13:17 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:17.351213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:17.362065 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2bf85072-b272-4c1c-8ddb-02a7e4919b43 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.314431 Oct 17 13:13:17.363090 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2281/4720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:17 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:17.389170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:17.390050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:17.397116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.397854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.398495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.400109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.401750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.402821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.485135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Locking {{(pid=127540) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 17 13:13:17.613740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:17.623631 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3b9731d-32a6-4dc1-b773-97b3fa16c537 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.239514 Oct 17 13:13:17.634535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:17.635694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:17.639856 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2440/4721] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:17 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:17.643939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.644716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.645337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.646302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.646954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.647429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.887188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:17.892546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:17.896318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:17.912099 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dda1b209-99e4-4fd1-b915-8c91abf80364 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.281150 Oct 17 13:13:17.924014 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2282/4722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:17 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:17.928131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.929291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.929943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.932638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.939385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.939847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:17.943561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c14cb174-7fe6-46a9-b9b4-3169e53a9eb2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:17.966349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c14cb174-7fe6-46a9-b9b4-3169e53a9eb2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:17.967017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c14cb174-7fe6-46a9-b9b4-3169e53a9eb2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:17.967600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c14cb174-7fe6-46a9-b9b4-3169e53a9eb2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.006942 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c14cb174-7fe6-46a9-b9b4-3169e53a9eb2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] HTTP exception thrown: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac is locked Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c14cb174-7fe6-46a9-b9b4-3169e53a9eb2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Request method failure captured: Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action HTTP/1.1 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 15 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVO0glWGLbeBqFYHnI47AkOOv9610GlPB_7XgGni0zy7AQddwFoAeqWQTUaxobD_wa1PiGslzsTtDShlB0fiZHCOQFavnW9yvVr9qLSJZ7jJjhqpvX_ASedHoa_DgK6owv82ZjkbTnFuMc4KqAmgS7gt2C8qTqQ9zmXe2bLIJ8wj_R8 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2ea124fdbff4df4b04a2e969871d8b4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: c71ac2b898f649cdaa99fbace633e738 Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: {"os-stop": {}} Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac is locked Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '66ea9158-6f53-4f79-8a42-69ca056124ac', 'body': {'os-stop': {}}} Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac is locked Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac is locked Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac is locked Oct 17 13:13:18.009591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:18.015727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c14cb174-7fe6-46a9-b9b4-3169e53a9eb2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Returning 409 to user: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac is locked {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:18.017492 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c14cb174-7fe6-46a9-b9b4-3169e53a9eb2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 409 len: 107 microversion: 2.1 time: 0.076968 Oct 17 13:13:18.018605 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2283/4723] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:17 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 107 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:13:18.032014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:18.033574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:18.046742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.047261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.047694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.055257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.055791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.056250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.123405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:18.167672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Unlocking {{(pid=127539) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 17 13:13:18.207421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=7 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:18.268578 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6877f58-34c5-4760-8934-345cae9fbfd8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.245517 Oct 17 13:13:18.269966 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2284/4724] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:18 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:18.281627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:18.282990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:18.286963 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13f969b0-17e5-4a7c-a562-fe95be0b374e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1615 microversion: 2.1 time: 0.403658 Oct 17 13:13:18.298260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.298260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.298260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.298898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.299604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.300277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.313788 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2441/4725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:17 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1615 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:18.319093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:18.320075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:18.328118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.328623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.329275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.330234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.330886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.331521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.397851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:18.440810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:18.449804 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-96d9255e-d947-4f40-a870-2a6c00116eb4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.134480 Oct 17 13:13:18.462830 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2442/4726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:18 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:18.473904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:18.481050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:18.493258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.494090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.495087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.496281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.497343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.498408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.555461 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee31ef3b-face-47c4-b3b4-6209132d68b0 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090086 Oct 17 13:13:18.557430 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2443/4727] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:13:18 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:18.607439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:18.615745 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-987a8e71-e303-452a-b7d6-9db0b338eb0a tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1510 microversion: 2.1 time: 0.344348 Oct 17 13:13:18.632739 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2285/4728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:18 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:18.638558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77df61e4-0506-4cb5-9afa-8adf7fdd2888 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:18.645486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77df61e4-0506-4cb5-9afa-8adf7fdd2888 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.646067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77df61e4-0506-4cb5-9afa-8adf7fdd2888 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.646618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77df61e4-0506-4cb5-9afa-8adf7fdd2888 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.649709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-363517489", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "34373767-0ea8-4cf4-9a72-bd536071abe1"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:18.692792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-77df61e4-0506-4cb5-9afa-8adf7fdd2888 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:13:18.729572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] validate_networks() for [('34373767-0ea8-4cf4-9a72-bd536071abe1', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:13:18.771198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77df61e4-0506-4cb5-9afa-8adf7fdd2888 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.136801 Oct 17 13:13:18.775858 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2286/4729] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:18 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:18.782344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:18.783301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:18.793550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.795085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.795811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:18.796843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:18.797964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:18.798715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.027594 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] HTTP exception thrown: Cannot 'migrate' instance 47eb26da-f121-42a0-97d5-f71275010785 while it is in vm_state suspended Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Request method failure captured: Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785/action HTTP/1.1 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 15 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVTB2QElZXXYQQ0rPWC4Ta6l5YIZtLZJWiXdV4n7Ts43WYj2--qs-siUzRqyE--wGoegI9XdUyRLPcAKGyvFSwIXZ5kxRiAuPhLlxLqDNw_0kDwB_d7A_ofpbC6LbYsTZhsOnOtnNJ2_u15TiTgsQ6Dq3Kh9pccbAClDJRkoP7Oa5WU Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02684267a8034abc810696a1dbfdd319", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02684267a8034abc810696a1dbfdd319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6d030723c8c41fcb4bbf7dcb583f891 Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: {"migrate": {}} Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'migrate' instance 47eb26da-f121-42a0-97d5-f71275010785 while it is in vm_state suspended Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '47eb26da-f121-42a0-97d5-f71275010785', 'body': {'migrate': {}}} Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47eb26da-f121-42a0-97d5-f71275010785 in vm_state suspended. Cannot resize while the instance is in this state. Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:19.029411 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 47eb26da-f121-42a0-97d5-f71275010785 while it is in vm_state suspended Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 47eb26da-f121-42a0-97d5-f71275010785 while it is in vm_state suspended Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Returning 409 to user: Cannot 'migrate' instance 47eb26da-f121-42a0-97d5-f71275010785 while it is in vm_state suspended {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3f40e63c-5ca1-4b06-ba7b-da752cd6f85c tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785/action" status: 409 len: 148 microversion: 2.1 time: 0.254519 Oct 17 13:13:19.037572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2287/4730] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:18 2022] POST /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785/action => generated 148 bytes in 256 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:13:19.046808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:19.046808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:19.067624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.068136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.068594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.069369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.069891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.073300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.419261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:19.430348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:13:19.431082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:13:19.432243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:13:19.433264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:13:19.438983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:13:19.445222 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-23469d48-1ca3-4868-83e4-e655aa49c7ca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.403708 Oct 17 13:13:19.446786 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2288/4731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:19 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:19.453050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef1c314d-fab3-4193-bc88-a7c1b63d9815 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:19.455997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.457158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.457898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.459021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.459845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef1c314d-fab3-4193-bc88-a7c1b63d9815 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Request method failure captured: Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755/action HTTP/1.1 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 39 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVTB2QElZXXYQQ0rPWC4Ta6l5YIZtLZJWiXdV4n7Ts43WYj2--qs-siUzRqyE--wGoegI9XdUyRLPcAKGyvFSwIXZ5kxRiAuPhLlxLqDNw_0kDwB_d7A_ofpbC6LbYsTZhsOnOtnNJ2_u15TiTgsQ6Dq3Kh9pccbAClDJRkoP7Oa5WU Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02684267a8034abc810696a1dbfdd319", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02684267a8034abc810696a1dbfdd319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6d030723c8c41fcb4bbf7dcb583f891 Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: {"os-resetState": {"state": "invalid"}} Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8d7f294a-8b5a-4788-a2d1-e34a1e214755', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:13:19.460356 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef1c314d-fab3-4193-bc88-a7c1b63d9815 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ef1c314d-fab3-4193-bc88-a7c1b63d9815 tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755/action" status: 400 len: 144 microversion: 2.1 time: 0.013671 Oct 17 13:13:19.468186 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2289/4732] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:19 2022] POST /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755/action => generated 144 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:13:19.476853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.480826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-666f87a5-80a4-4488-86a2-46b0ab259eda req-408dcd8d-d3c7-4e05-885a-e1491cf46f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0627aa-678d-4424-8ae7-9d9ef5b157e5", "name": "network-vif-deleted", "tag": "39353df8-7c6d-47cd-a8e8-91de9abb0de3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:19.497781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-666f87a5-80a4-4488-86a2-46b0ab259eda req-408dcd8d-d3c7-4e05-885a-e1491cf46f3b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.498397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-666f87a5-80a4-4488-86a2-46b0ab259eda req-408dcd8d-d3c7-4e05-885a-e1491cf46f3b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.499131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-666f87a5-80a4-4488-86a2-46b0ab259eda req-408dcd8d-d3c7-4e05-885a-e1491cf46f3b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.520719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Getting quotas for project 69cb388b118547d09e0ba768e5f2853d. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:13:19.520978 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-666f87a5-80a4-4488-86a2-46b0ab259eda req-408dcd8d-d3c7-4e05-885a-e1491cf46f3b service nova] Creating event network-vif-deleted:39353df8-7c6d-47cd-a8e8-91de9abb0de3 for instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 on n-h1-853316-12 Oct 17 13:13:19.528162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Getting quotas for user 60c19e661cc54085bf188002527ec75c and project 69cb388b118547d09e0ba768e5f2853d. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:13:19.532231 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-666f87a5-80a4-4488-86a2-46b0ab259eda req-408dcd8d-d3c7-4e05-885a-e1491cf46f3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065333 Oct 17 13:13:19.536662 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2290/4733] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:19.543467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b498932e-da52-4b1f-92c7-995b11eaaf2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b498932e-da52-4b1f-92c7-995b11eaaf2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Request method failure captured: Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755/action HTTP/1.1 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 31 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVTB2QElZXXYQQ0rPWC4Ta6l5YIZtLZJWiXdV4n7Ts43WYj2--qs-siUzRqyE--wGoegI9XdUyRLPcAKGyvFSwIXZ5kxRiAuPhLlxLqDNw_0kDwB_d7A_ofpbC6LbYsTZhsOnOtnNJ2_u15TiTgsQ6Dq3Kh9pccbAClDJRkoP7Oa5WU Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02684267a8034abc810696a1dbfdd319", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02684267a8034abc810696a1dbfdd319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: a6d030723c8c41fcb4bbf7dcb583f891 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: {"os-resetState": {"state": 1}} Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8d7f294a-8b5a-4788-a2d1-e34a1e214755', 'body': {'os-resetState': {'state': 1}}} Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 1 Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:13:19.547190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b498932e-da52-4b1f-92c7-995b11eaaf2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b498932e-da52-4b1f-92c7-995b11eaaf2e tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755/action" status: 400 len: 120 microversion: 2.1 time: 0.010425 Oct 17 13:13:19.552737 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2291/4734] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:19 2022] POST /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755/action => generated 120 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:13:19.554908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:19.555775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:19.558808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:13:19.563454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:13:19.568599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.569406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.570192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.572217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.573084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.573645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.649163 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-09c043d1-dfa9-4cd6-a169-a2d778ff3af9 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.090141 Oct 17 13:13:19.650643 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2444/4735] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:13:19.661341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7682eaad-83f1-49a7-b67f-20ad4778956f tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:19.667469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7682eaad-83f1-49a7-b67f-20ad4778956f tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Failed to fetch instance by id 999 {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:13:19.669320 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-7682eaad-83f1-49a7-b67f-20ad4778956f tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7682eaad-83f1-49a7-b67f-20ad4778956f tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Request method failure captured: Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 37 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVTB2QElZXXYQQ0rPWC4Ta6l5YIZtLZJWiXdV4n7Ts43WYj2--qs-siUzRqyE--wGoegI9XdUyRLPcAKGyvFSwIXZ5kxRiAuPhLlxLqDNw_0kDwB_d7A_ofpbC6LbYsTZhsOnOtnNJ2_u15TiTgsQ6Dq3Kh9pccbAClDJRkoP7Oa5WU Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02684267a8034abc810696a1dbfdd319", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02684267a8034abc810696a1dbfdd319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02684267a8034abc810696a1dbfdd319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 02684267a8034abc810696a1dbfdd319 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2024063814 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: a6d030723c8c41fcb4bbf7dcb583f891 Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2024063814-project-admin Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: {"os-resetState": {"state": "error"}} Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 999 could not be found. Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:19.676836 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:19.685127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:19.685127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 17 13:13:19.685127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:19.685127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7682eaad-83f1-49a7-b67f-20ad4778956f tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:19.685127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7682eaad-83f1-49a7-b67f-20ad4778956f tempest-ServersAdminNegativeTestJSON-2024063814 tempest-ServersAdminNegativeTestJSON-2024063814-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.030480 Oct 17 13:13:19.688946 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2445/4736] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Oct 17 13:13:19 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:13:19.713758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:19.717333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:19.733060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:19.735482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.735942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.736948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.737312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.737906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.739341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.746789 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-42389ff7-07e4-4c70-9626-f048f52bfafc tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.196535 Oct 17 13:13:19.747373 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2292/4737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:19 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:19.756238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:19.756867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:19.772367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.773334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.774240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.776138 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b1445ee7-b6b7-473e-a8ea-367fab5b8ff2 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085780 Oct 17 13:13:19.776958 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2446/4738] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:13:19 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:19.777684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.778191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.778643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.783413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf4ba673-19cd-467b-a735-a9a395aa21e5 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:19.784916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bf4ba673-19cd-467b-a735-a9a395aa21e5 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:19.862950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.863639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.864220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.864974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lazy-loading 'fault' on Instance uuid 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:19.891281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bf4ba673-19cd-467b-a735-a9a395aa21e5 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:19.906939 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bf4ba673-19cd-467b-a735-a9a395aa21e5 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1224 microversion: 2.1 time: 0.128427 Oct 17 13:13:19.911943 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2447/4739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:19 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:19.923915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:19.926451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:19.935214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d31fdb269b4bcf98b2c9f83fa97b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a80389f0004e0f85121d42d25c1eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:19.937390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.937897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.938373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.939094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.942308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:19.942805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:19.944738 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-07f44c82-ae09-4d51-96f5-4e6fe9a97f00 tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 200 len: 1306 microversion: 2.1 time: 0.196087 Oct 17 13:13:19.945545 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2293/4740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:19 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 1306 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:19.987808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:19.990208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:19.998846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:19.999442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.000005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.000857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.001471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.002064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.004577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:20.035541 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Cannot 'reboot' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da/action HTTP/1.1 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 28 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: {"reboot": {"type": "HARD"}} Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'reboot' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '95e865e2-5b1d-4c6c-81c7-d099f6ef45da', 'body': {'reboot': {'type': 'HARD'}}} Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:13:20.037428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 409 to user: Cannot 'reboot' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:20.046104 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e1da7ad4-d56d-4df0-9f3f-3fc8d3a62c8c tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da/action" status: 409 len: 145 microversion: 2.1 time: 0.095337 Oct 17 13:13:20.050365 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2294/4741] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:19 2022] POST /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da/action => generated 145 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:13:20.057672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fd63c8d8-fe4f-413d-a323-8a6225ce87c7 req-495f05fc-8f30-4b81-bf3c-18ba560b5579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005", "name": "network-vif-plugged", "status": "completed", "tag": "f2379837-11e3-4990-9f85-eb13fa38805a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:20.071913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd63c8d8-fe4f-413d-a323-8a6225ce87c7 req-495f05fc-8f30-4b81-bf3c-18ba560b5579 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.072426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd63c8d8-fe4f-413d-a323-8a6225ce87c7 req-495f05fc-8f30-4b81-bf3c-18ba560b5579 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.073219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd63c8d8-fe4f-413d-a323-8a6225ce87c7 req-495f05fc-8f30-4b81-bf3c-18ba560b5579 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.087780 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fd63c8d8-fe4f-413d-a323-8a6225ce87c7 req-495f05fc-8f30-4b81-bf3c-18ba560b5579 service nova] Creating event network-vif-plugged:f2379837-11e3-4990-9f85-eb13fa38805a for instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 on n-h2-853316-12 Oct 17 13:13:20.094096 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fd63c8d8-fe4f-413d-a323-8a6225ce87c7 req-495f05fc-8f30-4b81-bf3c-18ba560b5579 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041596 Oct 17 13:13:20.095128 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2295/4742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:20.103398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:20.108775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:20.120439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.121504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.122415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.123594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.124311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.124987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.137066 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-76a6b2e3-8d67-400e-9154-56815edc32cf tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "DELETE /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 204 len: 0 microversion: 2.1 time: 0.223549 Oct 17 13:13:20.137670 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2448/4743] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:19 2022] DELETE /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:20.156926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:20.158503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:20.168812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.170112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.170953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.173765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.173979 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Cannot 'rebuild' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued Oct 17 13:13:20.174519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.175254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da/action HTTP/1.1 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 65 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'rebuild' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '95e865e2-5b1d-4c6c-81c7-d099f6ef45da', 'body': {'rebuild': {'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f'}}} Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:20.177383 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued Oct 17 13:13:20.181962 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:20.184876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 409 to user: Cannot 'rebuild' instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da while it is in vm_state rescued {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:20.185972 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1b32bdf-2843-47c4-bbc6-463b73062204 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "POST /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da/action" status: 409 len: 146 microversion: 2.1 time: 0.089460 Oct 17 13:13:20.187209 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2296/4744] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:20 2022] POST /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da/action => generated 146 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:13:20.198437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:20.200145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:20.208017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.209460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.210120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.211381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.212106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.212736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.279737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:20.408530 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c98dba5-2b22-4656-ab6d-c6ed4d7bb635 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "DELETE /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 204 len: 0 microversion: 2.1 time: 0.215264 Oct 17 13:13:20.409728 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2297/4745] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:20 2022] DELETE /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:13:20.424266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:20.426898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:20.440774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.441422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.442098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.442349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:20.442953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.444705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.444705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.458753 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ca8089d-c40f-4a80-a556-ed8b61696b1d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1468 microversion: 2.1 time: 0.313931 Oct 17 13:13:20.459659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2449/4746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:20 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1468 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:20.488723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:20.490258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:20.504334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.505533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.507102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.510190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.511492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.512173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.665767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:20.675276 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3b3de201-d38f-48d4-9159-0df3e9e3c304 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1689 microversion: 2.1 time: 0.260950 Oct 17 13:13:20.676465 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2298/4747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:20 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1689 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:20.715054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:20.724069 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65b283ba-2ae4-4bbb-95e6-499fc5b4e70c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.248526 Oct 17 13:13:20.724650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2450/4748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:20 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:20.770573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:20.771286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:20.779033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.779806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.780261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.781465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.781633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.783348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.912635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:20.922027 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-efc2ebca-1dda-46d4-a522-179b689e09d1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.155369 Oct 17 13:13:20.925196 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2299/4749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:20 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:20.948805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:20.949517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:20.956204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.956799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.957462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.958377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:20.958845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:20.959305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:20.995908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:20.996736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] [instance: 2f0627aa-678d-4424-8ae7-9d9ef5b157e5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:21.015476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.015914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.016360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.017106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.017571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.018045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.044693 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] HTTP exception thrown: Instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 could not be found. Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Request method failure captured: Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 HTTP/1.1 Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVTRAqadLywu_uZn7IczLpb0ivL9PDfFKXAUj7QHEhpYD8qFKMhvmdv5erdI5Vy3p3ZlskLwn9Bcdol8LAsXVB1s0ERIqfelZFwZSvoqsCBhhZpLfssZVw_c8Z4EewqigqTQ0_GH7_1_0W8TIDb62fPR0gOB4qJPZZgtjlZqkdBZWXg Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10a80389f0004e0f85121d42d25c1eea Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerPasswordTestJSON-1707142569 Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10a80389f0004e0f85121d42d25c1eea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10a80389f0004e0f85121d42d25c1eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10a80389f0004e0f85121d42d25c1eea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10a80389f0004e0f85121d42d25c1eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerPasswordTestJSON-1707142569 Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10a80389f0004e0f85121d42d25c1eea Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1707142569 Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerPasswordTestJSON-1707142569-project Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 61d31fdb269b4bcf98b2c9f83fa97b3b Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerPasswordTestJSON-1707142569-project Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 could not be found. Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '2f0627aa-678d-4424-8ae7-9d9ef5b157e5'} Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 could not be found. Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 could not be found. Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:21.046452 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 could not be found. Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] Returning 404 to user: Instance 2f0627aa-678d-4424-8ae7-9d9ef5b157e5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:21.050736 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e51a9d7-03ba-4425-a668-30a4d46b826c tempest-ServerPasswordTestJSON-1707142569 tempest-ServerPasswordTestJSON-1707142569-project] 10.222.0.27 "GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5" status: 404 len: 111 microversion: 2.1 time: 0.057133 Oct 17 13:13:21.052247 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2300/4750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:20 2022] GET /compute/v2.1/servers/2f0627aa-678d-4424-8ae7-9d9ef5b157e5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:21.055888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:21.068385 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07886060-09ef-43a3-87b1-ecc53227b9b4 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1276 microversion: 2.1 time: 0.127018 Oct 17 13:13:21.069665 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2451/4751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:20 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:21.496021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:21.496021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:21.512667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.513176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.513624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.514575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.515183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.515637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.711778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:21.713392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:21.727355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.728431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.729158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.730063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.730748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.732292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.899667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:21.900502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:21.911073 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9338f9b1-f5e2-4a4a-b3ee-563bfae54d94 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1468 microversion: 2.1 time: 0.425697 Oct 17 13:13:21.911883 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2301/4752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:21 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1468 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:21.920751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:21.921951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:21.927411 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29f59f5e-2b49-4bca-8f25-821ab0a09a03 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1689 microversion: 2.1 time: 0.219672 Oct 17 13:13:21.930807 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2452/4753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:21 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:21.931519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.932139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.932934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.934145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.934939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.935605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.954054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:21.954725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:21.964435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.964938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.965384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:21.965515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:21.966601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:21.967706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:21.967818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:22.099627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:22.109004 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd3942e5-d64c-434a-9f56-3220c88e8130 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.158770 Oct 17 13:13:22.110553 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2453/4754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:21 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:22.120846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:22.121771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:22.131596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:22.132098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:22.132545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:22.133266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:22.133764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:22.134415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:22.207505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:22.219431 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae24a8a4-91ea-4fe0-a5db-6d5cddfaacdb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1282 microversion: 2.1 time: 0.107164 Oct 17 13:13:22.220355 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2454/4755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:22 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:22.262776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:22.271448 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ec19f267-d2db-4dec-8e99-fa45d5209789 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.357901 Oct 17 13:13:22.272088 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2302/4756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:21 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:22.938408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:22.940087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:22.954868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:22.955901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:22.956491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:22.956655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:22.958591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:22.960591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:22.962481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:22.963440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:22.978782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:22.979577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:22.981662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:22.983137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:22.983964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:22.989371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:23.167741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:23.182937 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b60551ca-b181-49bb-a47c-8b048e8bae60 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1468 microversion: 2.1 time: 0.248222 Oct 17 13:13:23.183942 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2455/4757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:22 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:23.189236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:23.189881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:23.203780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:23.204385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:23.204850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:23.205807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:23.206512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:23.207124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:23.334531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:23.341943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:23.350627 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b14a3ad-eeaa-484e-903f-316c285c24b1 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.165427 Oct 17 13:13:23.358041 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-865c170a-2e21-490a-b84a-075ec9164248 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1689 microversion: 2.1 time: 0.405854 Oct 17 13:13:23.375278 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2303/4758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:22 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1689 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:23.382476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:23.383475 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2456/4759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:23 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:23.384221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:23.394043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:23.395963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:23.396430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:23.397183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:23.397767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:23.399960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:23.401986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:23.411114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:23.419605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:23.420939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:23.422649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:23.423562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:23.428936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:23.429853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:23.637121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:23.651820 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a07dc531-6125-4649-ba46-891519bfa3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.266051 Oct 17 13:13:23.652594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2457/4760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:23 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:23.800379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:23.813632 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e487828-9a3d-4206-984f-9af09b0f5266 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.436923 Oct 17 13:13:23.816718 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2304/4761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:23 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:24.218406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:24.219678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:24.229261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.229671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.230266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.231359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.232871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.232871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.260453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:24.392416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:24.393789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:24.407291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.408186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.408995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.410891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.411959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.412862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.439415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:24.457799 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1cd11d4a-1a5f-46b7-aa26-24f7bef83642 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1468 microversion: 2.1 time: 0.245722 Oct 17 13:13:24.474782 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2458/4762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:24 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1468 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:24.484669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:24.484669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:24.490029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.490450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.490894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.491912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.492064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.492506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.612466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:24.628113 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b8add47c-c2c2-4540-8f3a-b4582eb14576 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.152044 Oct 17 13:13:24.630959 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2459/4763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:24 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:24.681591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:24.682367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:24.693413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.693929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.694417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.695150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.695613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.696113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.806015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:24.819177 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-780b6c08-1486-43e1-bf06-21816576ca05 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1689 microversion: 2.1 time: 0.433322 Oct 17 13:13:24.830200 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2305/4764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:24 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1689 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:24.851811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:24.853451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:24.860713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:24.863637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.864485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.865149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:24.866075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:24.866733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:24.867330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:25.109201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:25.133369 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc95756c-a018-4f7c-8e95-f37a7251275e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.449228 Oct 17 13:13:25.151151 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2460/4765] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:24 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:25.462760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:25.471263 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1c48eed4-ee5c-461d-9b57-ea57e8fc84bf tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.623130 Oct 17 13:13:25.472271 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2306/4766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:24 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:25.489626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:25.490602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:25.500853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:25.503811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:25.504620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:25.507489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:25.508214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:25.509218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:25.659874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:25.660656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:25.679207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:25.680667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:25.683008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:25.687995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:25.694374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:25.695657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:25.978863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:25.990078 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a216fac4-e9e3-442c-a752-65d33dd958b4 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1300 microversion: 2.1 time: 0.334162 Oct 17 13:13:25.991141 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2307/4767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:25 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1300 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:25.996217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:25.997165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:26.003601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:26.004208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:26.004717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:26.005512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:26.006027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:26.006559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:26.025372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:26.035735 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2262411a-a845-4a7f-bc11-3af62fe2d1f8 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1468 microversion: 2.1 time: 0.550591 Oct 17 13:13:26.036331 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2461/4768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:25 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1468 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:26.165803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:26.167095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:26.177258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:26.179230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:26.180082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:26.181388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:26.182382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:26.183985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:26.184716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:26.200305 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd67b508-b09a-49f2-be82-3294ece74214 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1621 microversion: 2.1 time: 0.207791 Oct 17 13:13:26.222283 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2308/4769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:25 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1621 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:26.455821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2262f2d5-c23c-4105-ac49-e0abc3e0546e req-a7746415-49cf-4ca3-abba-ab92d8701090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ca72ce-c82a-4daa-93bc-1ad80dea90f1", "name": "network-vif-deleted", "tag": "bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:26.498427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2262f2d5-c23c-4105-ac49-e0abc3e0546e req-a7746415-49cf-4ca3-abba-ab92d8701090 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:26.499379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2262f2d5-c23c-4105-ac49-e0abc3e0546e req-a7746415-49cf-4ca3-abba-ab92d8701090 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:26.499379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2262f2d5-c23c-4105-ac49-e0abc3e0546e req-a7746415-49cf-4ca3-abba-ab92d8701090 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:26.539332 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2262f2d5-c23c-4105-ac49-e0abc3e0546e req-a7746415-49cf-4ca3-abba-ab92d8701090 service nova] Creating event network-vif-deleted:bcc26ee2-f35d-41e0-a4d0-67ce8b8714c4 for instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 on n-h2-853316-12 Oct 17 13:13:26.569976 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2262f2d5-c23c-4105-ac49-e0abc3e0546e req-a7746415-49cf-4ca3-abba-ab92d8701090 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123266 Oct 17 13:13:26.571607 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2309/4770] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:26.588543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:26.591796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:26.609702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:26.609923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:26.610390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:26.621980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:26.625404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:26.626134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:26.655521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:26.677407 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b03a9ccf-6f48-4183-9a6d-b9613020b72f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.517242 Oct 17 13:13:26.696640 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2462/4771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:26 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:26.712980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-31a4f683-f57e-4c11-99af-00d8902988af req-4727787b-4b9a-4096-a6f6-acdede53d328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c4a1fa4-8594-43bf-bca9-c65b5f126260", "tag": "ee57ccd2-28d5-4c72-af8f-85fd7ec278ab"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:26.732877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-31a4f683-f57e-4c11-99af-00d8902988af req-4727787b-4b9a-4096-a6f6-acdede53d328 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:26.733539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-31a4f683-f57e-4c11-99af-00d8902988af req-4727787b-4b9a-4096-a6f6-acdede53d328 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:26.734079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-31a4f683-f57e-4c11-99af-00d8902988af req-4727787b-4b9a-4096-a6f6-acdede53d328 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:26.751899 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-31a4f683-f57e-4c11-99af-00d8902988af req-4727787b-4b9a-4096-a6f6-acdede53d328 service nova] Creating event network-changed:ee57ccd2-28d5-4c72-af8f-85fd7ec278ab for instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 on n-h1-853316-12 Oct 17 13:13:26.764458 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-31a4f683-f57e-4c11-99af-00d8902988af req-4727787b-4b9a-4096-a6f6-acdede53d328 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060738 Oct 17 13:13:26.767148 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2463/4772] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:27.015692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.016808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:27.024874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.025841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.026448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.027642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.028343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.028925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.153578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:27.162111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc39e2ab-b91d-4042-b29c-dd5940e1372c tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1472 microversion: 2.1 time: 0.151580 Oct 17 13:13:27.178813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:27.178813 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f15d5721-f76f-446f-b17e-96d1f5264c38 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.604287 Oct 17 13:13:27.182501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2464/4773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:27.194401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.195047 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2310/4774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:26 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:27.195449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:27.202157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.202902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.203513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.205334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.206206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.206839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.218626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.220465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:27.247997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.248771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.249412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.258450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.259456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.260677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.261815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lazy-loading 'fault' on Instance uuid 47eb26da-f121-42a0-97d5-f71275010785 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:27.264327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.264815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.265720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.360345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:27.371601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b2b799c5-7033-422f-a075-8c1dea576707 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 200 len: 1312 microversion: 2.1 time: 0.183562 Oct 17 13:13:27.372840 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2465/4775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:27.386897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.390100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:27.416685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.417453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.417720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.418954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.418954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.419381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.474552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.475336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.475885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.476684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lazy-loading 'fault' on Instance uuid 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:27.554668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:27.562917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4c5f4067-2fd4-4692-adb9-d22a1729bbbe tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 200 len: 1336 microversion: 2.1 time: 0.189008 Oct 17 13:13:27.564385 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2466/4776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 1336 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:27.617918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:27.629123 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd82aae1-e453-474b-aca0-2a4411fa0886 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1472 microversion: 2.1 time: 0.432884 Oct 17 13:13:27.629727 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2311/4777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:27.655011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.655802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:27.662962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.663468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.664053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.665182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.666080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.666818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.708119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.709236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:27.723631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.724364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.724983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.726024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.726798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.727701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.771087 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-14a6ae54-089a-4307-b4df-dbd16218a54f tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1625 microversion: 2.1 time: 0.121465 Oct 17 13:13:27.776342 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2467/4778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1625 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:27.804899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.806345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:27.815760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.816704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.817648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.819293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.820284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.821777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.013609 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9d5855f0-cb4c-40c1-985a-0785e95fe9a9 tempest-TestSecurityGroupsBasicOps-1657521648 tempest-TestSecurityGroupsBasicOps-1657521648-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1913 microversion: 2.1 time: 0.213269 Oct 17 13:13:28.014225 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2468/4779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1913 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:28.103175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.104354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:28.109134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:28.111807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.112308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.112749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.113468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.114123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.114645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.127437 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf54474b-99cc-4b5a-b852-d2a9e44dcd2f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.422453 Oct 17 13:13:28.128609 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2312/4780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:28.181045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:28.209199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.210014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:28.221050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.221932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.222092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.230997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.231103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.231492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.342566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c57a848-649c-409a-a4e4-dee039064b27 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 204 len: 0 microversion: 2.1 time: 0.243498 Oct 17 13:13:28.347544 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2469/4781] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:28 2022] DELETE /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:13:28.357759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.359382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:28.371807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.372533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.373215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.374054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.374645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.375179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.422706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:28.434751 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b984d0c8-94cf-43db-a819-12eeb1475f99 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.227832 Oct 17 13:13:28.435685 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2313/4782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:28 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:28.445956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.447126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 47eb26da-f121-42a0-97d5-f71275010785] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:28.456389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.457164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.457784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.458750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.459385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.459979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.481487 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] HTTP exception thrown: Instance 47eb26da-f121-42a0-97d5-f71275010785 could not be found. Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Request method failure captured: Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 HTTP/1.1 Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVTAwauceHv-x_J5lMpoeHSdSqYrpaCKWyoNv7BD5gz9Z6PYTKt0Jytk-u2jxtNmBLKKWj-5sOWBHOjvHdkC0bKI_oP9bUcgiEB18UE2Ew92e_XUEbKkAFJv7Ww02aQ1NoDu0mQCa-aWuHz_ki6ph8T5qGRqVqDjKM2J_4kQD2wTUZY Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 34f04048d29f458881da0063c9cd501f Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-559504856 Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f04048d29f458881da0063c9cd501f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f04048d29f458881da0063c9cd501f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f04048d29f458881da0063c9cd501f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f04048d29f458881da0063c9cd501f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-559504856 Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 34f04048d29f458881da0063c9cd501f Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-559504856 Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersAdminNegativeTestJSON-559504856-project Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 35bc5b1329eb489d8f4099cb45dea020 Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-559504856-project Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 47eb26da-f121-42a0-97d5-f71275010785 could not be found. Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '47eb26da-f121-42a0-97d5-f71275010785'} Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47eb26da-f121-42a0-97d5-f71275010785 could not be found. Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47eb26da-f121-42a0-97d5-f71275010785 could not be found. Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.484546 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:28.490068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.490068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:28.490068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:28.490068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:28.490068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:28.490068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:28.490068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47eb26da-f121-42a0-97d5-f71275010785 could not be found. Oct 17 13:13:28.490068 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.492663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Returning 404 to user: Instance 47eb26da-f121-42a0-97d5-f71275010785 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:28.495008 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4b06a795-ece9-4f21-8f1d-d51a771f40ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785" status: 404 len: 111 microversion: 2.1 time: 0.058001 Oct 17 13:13:28.501382 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2314/4783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:28 2022] GET /compute/v2.1/servers/47eb26da-f121-42a0-97d5-f71275010785 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:28.509366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.510101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:28.511999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:28.519892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.520699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.521328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.522409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.523043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.523848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.527520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c19f77f6-3b22-4e8f-baeb-cea7bf9a85ab tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1478 microversion: 2.1 time: 0.177476 Oct 17 13:13:28.532902 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2470/4784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:28 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1478 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:28.569268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:28.589426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.590403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 37ca72ce-c82a-4daa-93bc-1ad80dea90f1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:28.597490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.601090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.601556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.602353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.603366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.603801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.641760 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 could not be found. Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 HTTP/1.1 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 could not be found. Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '37ca72ce-c82a-4daa-93bc-1ad80dea90f1'} Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 could not be found. Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 could not be found. Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.647514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 could not be found. Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 404 to user: Instance 37ca72ce-c82a-4daa-93bc-1ad80dea90f1 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-66f39475-06e2-4353-adca-9d1db38eb28f tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1" status: 404 len: 111 microversion: 2.1 time: 0.064527 Oct 17 13:13:28.657488 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2471/4785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:28 2022] GET /compute/v2.1/servers/37ca72ce-c82a-4daa-93bc-1ad80dea90f1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:28.665426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e46f70c-2a7d-4764-8144-b3e9e04571a5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '.version_select at 0x7fa820a49ee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.704506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e46f70c-2a7d-4764-8144-b3e9e04571a5 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002004053" status: 202 len: 0 microversion: 2.1 time: 0.047590 Oct 17 13:13:28.705745 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2472/4786] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002004053 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:28.732519 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-37f79644-5295-439c-9d86-71ebf1556312 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 204 len: 0 microversion: 2.1 time: 0.227767 Oct 17 13:13:28.733117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2315/4787] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:28 2022] DELETE /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:28.747377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.748295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:28.757283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:28.774115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.777308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.777888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.778912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.781764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.782695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.808912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e5e585b5-7415-4548-9b09-e5e383164232 req-af334ae0-bc70-447d-a382-871d85dbb85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47eb26da-f121-42a0-97d5-f71275010785", "name": "network-vif-deleted", "tag": "5e6c7459-714e-4aad-b591-0fef65fc98d9"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:28.826237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e5e585b5-7415-4548-9b09-e5e383164232 req-af334ae0-bc70-447d-a382-871d85dbb85d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:28.829506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e5e585b5-7415-4548-9b09-e5e383164232 req-af334ae0-bc70-447d-a382-871d85dbb85d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:28.831193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e5e585b5-7415-4548-9b09-e5e383164232 req-af334ae0-bc70-447d-a382-871d85dbb85d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:28.851751 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e5e585b5-7415-4548-9b09-e5e383164232 req-af334ae0-bc70-447d-a382-871d85dbb85d service nova] Creating event network-vif-deleted:5e6c7459-714e-4aad-b591-0fef65fc98d9 for instance 47eb26da-f121-42a0-97d5-f71275010785 on n-h2-853316-12 Oct 17 13:13:28.862496 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e5e585b5-7415-4548-9b09-e5e383164232 req-af334ae0-bc70-447d-a382-871d85dbb85d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058966 Oct 17 13:13:28.863901 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2316/4788] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:13:29.027946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:29.036899 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2b953edb-0305-4310-a374-18c386428675 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1478 microversion: 2.1 time: 0.299254 Oct 17 13:13:29.042270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2473/4789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:28 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1478 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:29.154963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:29.155670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:29.162536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:29.163028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:29.163538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:29.164285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:29.164742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:29.165213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:29.459483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:29.460306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:29.473171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:29.475494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:29.478069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:29.479960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:29.481877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:29.483330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:29.496454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:29.710144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:29.726646 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45635c5d-d28e-45d2-af87-51f129e26eb0 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.270664 Oct 17 13:13:29.728804 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2474/4790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:29 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:29.738351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:29.739826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:29.757145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:29.758103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:29.759420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:29.761192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:29.762013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:29.762826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:29.770252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:29.860989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:29.870000 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1725a24f-5d7d-4e0e-abe1-8558a78828d3 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1478 microversion: 2.1 time: 0.138615 Oct 17 13:13:29.870796 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2475/4791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:29 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1478 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:29.886043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:29.898432 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-173c480a-0caa-4344-9f29-3bee473f7be2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.749013 Oct 17 13:13:29.899002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2317/4792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:29 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:30.064652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:30.065738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:30.068466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:30.076351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.077094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.077728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:30.078641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.079256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.079850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:30.243236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:30.254487 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d340b49c-6b47-4387-a788-3498a4386a08 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1478 microversion: 2.1 time: 0.196406 Oct 17 13:13:30.255193 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2476/4793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:30 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1478 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:30.751164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:30.751913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:30.759631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.760124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.760829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:30.761805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.762403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.763007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:30.888652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-dee953ad-abc8-49f8-a9e6-26291714b4ac req-301af75d-41a3-46e7-8c6d-b95570a04cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005", "name": "network-vif-deleted", "tag": "f2379837-11e3-4990-9f85-eb13fa38805a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:30.917619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dee953ad-abc8-49f8-a9e6-26291714b4ac req-301af75d-41a3-46e7-8c6d-b95570a04cfb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.920637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dee953ad-abc8-49f8-a9e6-26291714b4ac req-301af75d-41a3-46e7-8c6d-b95570a04cfb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.922362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dee953ad-abc8-49f8-a9e6-26291714b4ac req-301af75d-41a3-46e7-8c6d-b95570a04cfb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:30.948198 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-dee953ad-abc8-49f8-a9e6-26291714b4ac req-301af75d-41a3-46e7-8c6d-b95570a04cfb service nova] Creating event network-vif-deleted:f2379837-11e3-4990-9f85-eb13fa38805a for instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 on n-h2-853316-12 Oct 17 13:13:30.950056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:30.955400 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-dee953ad-abc8-49f8-a9e6-26291714b4ac req-301af75d-41a3-46e7-8c6d-b95570a04cfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070359 Oct 17 13:13:30.956561 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2477/4794] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:13:30.961488 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa7ef284-c413-425f-848a-e28da545e518 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.214209 Oct 17 13:13:30.963484 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2318/4795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:30 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:30.969248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:30.970067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:30.977874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.979331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.980043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:30.980955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.981555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.982147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:30.985293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:30.986141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:30.992894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.993889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.994620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:30.995606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:30.997807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:30.998579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:31.004309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:31.069009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:31.069666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:31.070234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:31.070807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lazy-loading 'fault' on Instance uuid 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:31.131064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:31.156194 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f94bd6a-4956-4c39-9e44-cd2af5367189 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 200 len: 1332 microversion: 2.1 time: 0.198170 Oct 17 13:13:31.156777 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2478/4796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:30 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 1332 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:31.233229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:31.242195 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80cda51e-f7bf-4050-af6e-93b2dfb0bb51 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1653 microversion: 2.1 time: 0.277261 Oct 17 13:13:31.244534 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2319/4797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:30 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1653 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:31.268157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d697d65-cf5f-4b73-bc97-780ef3ff2e93 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:31.280508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:31.280508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:31.286342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d697d65-cf5f-4b73-bc97-780ef3ff2e93 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:31.286840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d697d65-cf5f-4b73-bc97-780ef3ff2e93 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:31.287279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d697d65-cf5f-4b73-bc97-780ef3ff2e93 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:31.295942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:31.296440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:31.296904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:31.297586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:31.298045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:31.298700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:31.348162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d697d65-cf5f-4b73-bc97-780ef3ff2e93 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Going to try to start instance {{(pid=127540) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:13:31.435617 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d697d65-cf5f-4b73-bc97-780ef3ff2e93 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.170928 Oct 17 13:13:31.440615 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2479/4798] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:31 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:13:31.449020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:31.449951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:31.458523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:31.459045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:31.459622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:31.460489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:31.461097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:31.462201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:31.488007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:31.500480 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4fa1854a-6c83-4922-9ead-2e94f6d3e067 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1478 microversion: 2.1 time: 0.226664 Oct 17 13:13:31.501465 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2320/4799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:31 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1478 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:31.705527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:31.726073 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de8ada09-a393-40c1-a8b8-0c15f0b2f5a6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1662 microversion: 2.1 time: 0.279585 Oct 17 13:13:31.727204 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2480/4800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:31 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1662 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:31.988975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:31.990352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:31.998495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:31.999343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:31.999987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:32.001230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:32.001935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:32.002596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:32.183977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:32.185315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:32.205926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:32.206767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:32.207398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:32.208310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:32.208955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:32.209568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:32.237024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] HTTP exception thrown: Instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 could not be found. Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Request method failure captured: Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 HTTP/1.1 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVRhu117pFQ0bdZSE_Rrinzpd_BWhO-WZdBtF7BSZJ_sxsehvjRLlOXvzqCzapxIaixJ1wPBay21i0lBN0tTqQycRucv9458wQUN1zCSZZPGQ7qA6hiuJ4xuKjb4B89I5Yu2GoR5NpmWc8MklP7KBxoZ0_welpgV8vx_2G6ABuizPOw Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 8096ad9cc4a242b1a3ecf4cdb9a2dcb0 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-679056250 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8096ad9cc4a242b1a3ecf4cdb9a2dcb0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8096ad9cc4a242b1a3ecf4cdb9a2dcb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8096ad9cc4a242b1a3ecf4cdb9a2dcb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8096ad9cc4a242b1a3ecf4cdb9a2dcb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestSecurityGroupsBasicOps-679056250 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 8096ad9cc4a242b1a3ecf4cdb9a2dcb0 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-679056250 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestSecurityGroupsBasicOps-679056250-project Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: efab0c775fd94096912d8844df7457b6 Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestSecurityGroupsBasicOps-679056250-project Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 could not be found. Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005'} Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 could not be found. Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 could not be found. Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:32.251401 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:32.256359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:32.256359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:32.256359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:32.256359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:32.256359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:32.256359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 could not be found. Oct 17 13:13:32.256359 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:32.256359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Returning 404 to user: Instance 4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:32.257567 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-57a229cf-59a0-4bbc-9c20-1217035a0d88 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005" status: 404 len: 111 microversion: 2.1 time: 0.079374 Oct 17 13:13:32.258270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2481/4801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:32 2022] GET /compute/v2.1/servers/4f4fa7ce-f7b2-4de7-9c5f-cc2db3dd2005 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:13:32.526560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:32.527847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:32.543884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:32.544817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:32.545508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:32.546479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:32.547156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:32.547802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:32.698827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:32.709837 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-201cd544-92cf-400e-b11b-6d2d846d9a66 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.724551 Oct 17 13:13:32.717893 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2321/4802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:31 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:32.750519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:32.751474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:32.769777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:32.770570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:32.771192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:32.772110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:32.772745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:32.773362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:32.842554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:32.856884 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eeadb52d-4a65-431d-b321-4310192200c6 tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1478 microversion: 2.1 time: 0.335718 Oct 17 13:13:32.862416 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2482/4803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:32 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1478 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:33.744123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:33.744787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:33.757202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:33.762041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:33.762524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:33.765838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:33.766355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:33.766797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:33.899463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:33.912095 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e61fab6-2e07-4b05-9220-6c58a80b5283 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1662 microversion: 2.1 time: 1.165560 Oct 17 13:13:33.913572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2322/4804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:32 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1662 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:33.929534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:33.930908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:33.946646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:33.951136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:33.957645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:33.958726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:33.959371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:33.960198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:34.178861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:34.190473 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2e472b9-1201-49b7-8da4-df0dd9660e8b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.452678 Oct 17 13:13:34.192510 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2483/4805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:33 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:34.941361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:34.942343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:34.970656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:34.971460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:34.972067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:34.973481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:34.974219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:34.974841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:35.035655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:35.045828 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-324cc49d-109b-43fd-b0ff-78c122d2391d tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1478 microversion: 2.1 time: 1.129366 Oct 17 13:13:35.046453 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2323/4806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:33 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1478 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:35.221026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:35.221968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:35.234527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:35.238121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:35.240286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:35.242593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:35.243379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:35.245431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:35.323476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:35.334349 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d38b78d-f5f9-446f-91e4-f3d39aea8f7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1662 microversion: 2.1 time: 0.397233 Oct 17 13:13:35.343529 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2484/4807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:34 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1662 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:35.749726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-684a6bbb-f4cf-4223-a3b2-1e25ef85d17f req-232a4ffe-50d3-4776-b000-7d1372f36035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4a1fa4-8594-43bf-bca9-c65b5f126260", "name": "network-vif-plugged", "status": "completed", "tag": "ee57ccd2-28d5-4c72-af8f-85fd7ec278ab"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:35.767750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-684a6bbb-f4cf-4223-a3b2-1e25ef85d17f req-232a4ffe-50d3-4776-b000-7d1372f36035 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:35.771650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-684a6bbb-f4cf-4223-a3b2-1e25ef85d17f req-232a4ffe-50d3-4776-b000-7d1372f36035 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:35.775674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-684a6bbb-f4cf-4223-a3b2-1e25ef85d17f req-232a4ffe-50d3-4776-b000-7d1372f36035 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:35.839498 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-684a6bbb-f4cf-4223-a3b2-1e25ef85d17f req-232a4ffe-50d3-4776-b000-7d1372f36035 service nova] Creating event network-vif-plugged:ee57ccd2-28d5-4c72-af8f-85fd7ec278ab for instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 on n-h1-853316-12 Oct 17 13:13:35.858623 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-684a6bbb-f4cf-4223-a3b2-1e25ef85d17f req-232a4ffe-50d3-4776-b000-7d1372f36035 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123265 Oct 17 13:13:35.859244 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2485/4808] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 17 13:13:35.885065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-900672c2-3b1a-436a-b4dd-919e35a4eaa5 req-bab1f1d4-60b1-4e59-87df-9ef4e02644b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7f294a-8b5a-4788-a2d1-e34a1e214755", "name": "network-vif-deleted", "tag": "62c86613-669f-4cc1-a0af-fea9a5fc2d30"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:35.931937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-900672c2-3b1a-436a-b4dd-919e35a4eaa5 req-bab1f1d4-60b1-4e59-87df-9ef4e02644b0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:35.932427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-900672c2-3b1a-436a-b4dd-919e35a4eaa5 req-bab1f1d4-60b1-4e59-87df-9ef4e02644b0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:35.943285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-900672c2-3b1a-436a-b4dd-919e35a4eaa5 req-bab1f1d4-60b1-4e59-87df-9ef4e02644b0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:35.945580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:35.975460 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fc4423a2-b679-4042-8c11-0a28a4c14233 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.758548 Oct 17 13:13:35.978719 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2324/4809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:35 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:35.989204 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-900672c2-3b1a-436a-b4dd-919e35a4eaa5 req-bab1f1d4-60b1-4e59-87df-9ef4e02644b0 service nova] Creating event network-vif-deleted:62c86613-669f-4cc1-a0af-fea9a5fc2d30 for instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 on n-h1-853316-12 Oct 17 13:13:36.006088 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-900672c2-3b1a-436a-b4dd-919e35a4eaa5 req-bab1f1d4-60b1-4e59-87df-9ef4e02644b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133097 Oct 17 13:13:36.012122 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2486/4810] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:36.072858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:36.073747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:36.101951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:36.103355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:36.104056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:36.114839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:36.117289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:36.117794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:36.251076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:36.251767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:36.252359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:36.252899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lazy-loading 'fault' on Instance uuid 8d7f294a-8b5a-4788-a2d1-e34a1e214755 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:36.370043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:36.371058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:36.398643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:36.400108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:36.400683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:36.413451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:36.414115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:36.414598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:36.539835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bc5b1329eb489d8f4099cb45dea020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04048d29f458881da0063c9cd501f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:36.550091 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75b46a17-0286-4f67-a8eb-10e159471f3e tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 200 len: 1312 microversion: 2.1 time: 0.482848 Oct 17 13:13:36.551597 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2325/4811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:36 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:36.890918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:36.902912 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55f92dc3-38bd-498a-a688-cdeacef5db9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.538522 Oct 17 13:13:36.918550 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2487/4812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:36 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:36.932596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:36.933222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:36.948638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:36.948978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:36.949430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:36.950186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:36.952791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:36.953245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.003827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:37.004967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:37.025848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:37.026288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:37.026740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.027462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:37.041445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:37.045387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.416651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:37.429755 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44b67e54-9196-481f-9b1e-bf698a29979b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.502175 Oct 17 13:13:37.433090 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2326/4813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:36 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:37.465670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:37.466438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:37.476613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:37.478945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:37.479429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.483093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:37.483602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:37.484043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.584324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Unlocking {{(pid=127539) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 17 13:13:37.683502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:37.691727 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-47d007a8-980b-46d2-b8ff-0f59c2a597d2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.236588 Oct 17 13:13:37.693603 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b105550c-df72-4bfd-b2db-3c8f8ae38e4c tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 0.695881 Oct 17 13:13:37.694225 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2488/4814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:36 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:37.703501 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2327/4815] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:37 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:37.713066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:37.717918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] [instance: 8d7f294a-8b5a-4788-a2d1-e34a1e214755] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:37.724563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:37.729508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:37.732183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:37.732975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:37.733614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.736312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:37.737219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:37.739070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.750124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:37.750731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:37.751480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.752678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:37.753151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:37.753659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:37.758348 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] HTTP exception thrown: Instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 could not be found. Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Request method failure captured: Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 HTTP/1.1 Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVTAwauceHv-x_J5lMpoeHSdSqYrpaCKWyoNv7BD5gz9Z6PYTKt0Jytk-u2jxtNmBLKKWj-5sOWBHOjvHdkC0bKI_oP9bUcgiEB18UE2Ew92e_XUEbKkAFJv7Ww02aQ1NoDu0mQCa-aWuHz_ki6ph8T5qGRqVqDjKM2J_4kQD2wTUZY Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 34f04048d29f458881da0063c9cd501f Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-559504856 Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f04048d29f458881da0063c9cd501f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f04048d29f458881da0063c9cd501f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f04048d29f458881da0063c9cd501f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f04048d29f458881da0063c9cd501f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-559504856 Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 34f04048d29f458881da0063c9cd501f Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-559504856 Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersAdminNegativeTestJSON-559504856-project Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 35bc5b1329eb489d8f4099cb45dea020 Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-559504856-project Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 could not be found. Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '8d7f294a-8b5a-4788-a2d1-e34a1e214755'} Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 could not be found. Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 could not be found. Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:37.760946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:37.765581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:37.765581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:37.765581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:37.765581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:37.765581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:37.765581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:37.765581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 could not be found. Oct 17 13:13:37.765581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:37.767219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] Returning 404 to user: Instance 8d7f294a-8b5a-4788-a2d1-e34a1e214755 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:37.768283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a462eec8-c6d1-4127-b7be-d202aeaf88ef tempest-ServersAdminNegativeTestJSON-559504856 tempest-ServersAdminNegativeTestJSON-559504856-project] 10.222.0.27 "GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755" status: 404 len: 111 microversion: 2.1 time: 0.070827 Oct 17 13:13:37.769484 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2489/4816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:37 2022] GET /compute/v2.1/servers/8d7f294a-8b5a-4788-a2d1-e34a1e214755 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:38.178314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:38.216923 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.507612 Oct 17 13:13:38.232595 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2328/4817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:37 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:38.251560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:38.253025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:38.265145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:38.268717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:38.269338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:38.272267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:38.273788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:38.286410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:38.646886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:38.648475 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0caaac75-fcb4-46a0-b1fb-1272f9740c44 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001962 Oct 17 13:13:38.648996 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2329/4818] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 17 13:13:38 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 13:13:38.666986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:38.677386 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dff06f7d-10a6-4b4d-912f-feb711aee7d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.437092 Oct 17 13:13:38.684855 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2490/4819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:38 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:38.725309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:38.725928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:38.731552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:38.732637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:38.746805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:38.749374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:38.750677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:38.752298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:38.753429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:38.754467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:38.765811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:38.768418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:38.768418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:38.771501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:38.776459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:38.778413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:39.869764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:39.884743 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c154ad0f-3a59-4564-9bc7-47f975ac1449 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 1.178507 Oct 17 13:13:39.887483 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2330/4820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:38 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:39.899009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:39.899592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:39.915733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:39.916254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:39.916705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:39.917454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:39.917917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:39.925202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:39.983054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:40.005968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:40.021942 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b1c836a8-eaa2-4ff6-a9ac-230cdf21d055 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1324 microversion: 2.1 time: 1.302653 Oct 17 13:13:40.035166 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2491/4821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:38 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1324 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:40.046102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:40.046978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:40.054548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:40.055448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:40.056218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:40.057185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:40.057875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:40.058561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:40.206335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:40.234058 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0bc681e-9be4-4a58-9b1b-71c499d162c3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.195137 Oct 17 13:13:40.236370 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2492/4822] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:40 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:40.247325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-337e1da4-ee73-42dd-a4e3-331fbc0a05f3 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "DELETE /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 204 len: 0 microversion: 2.1 time: 0.351635 Oct 17 13:13:40.248230 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2331/4823] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:39 2022] DELETE /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:40.285371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:40.286109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:40.296878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:40.297781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:40.320614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:40.324231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:40.324785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:40.325547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:40.326023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:40.327299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:40.327799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:40.328242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:40.332116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:40.335342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:40.338737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:40.341055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:40.417825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:40.785952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:40.795481 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-83f2d111-e591-4095-bf46-20937c989fd0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1671 microversion: 2.1 time: 0.554925 Oct 17 13:13:40.799347 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2493/4824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:40 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1671 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:40.954893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:40.964902 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10f89a7f-f92d-42f5-b13e-312c45843a78 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1508 microversion: 2.1 time: 0.708946 Oct 17 13:13:40.965517 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2332/4825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:40 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1508 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:41.050290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:41.052262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:41.071271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:41.073989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:41.073989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:41.074737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:41.075511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:41.076078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:41.834691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:41.835324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:41.844851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:41.845356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:41.845776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:41.851187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:41.851892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:41.852868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:42.147367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:42.162939 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-edfd98ba-11d9-4e5c-ad48-2c84e94bdb29 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1521 microversion: 2.1 time: 1.116488 Oct 17 13:13:42.163563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2494/4826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:41 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1521 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:42.182193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:42.193783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:42.226949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:42.227817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:42.228670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:42.229574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:42.230029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:42.237966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:42.306953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:42.327499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-046477f1-1d3d-4f7b-a8f3-1f46b0185090 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1671 microversion: 2.1 time: 0.506674 Oct 17 13:13:42.342195 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2333/4827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:41 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1671 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:42.342195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:42.342195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:42.363734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:42.369317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:42.370181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:42.371135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:42.371764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:42.372366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:42.423834 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] HTTP exception thrown: Instance is not a member of specified network Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Request method failure captured: Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260/ips/invalid HTTP/1.1 Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVTtOF-mD0B3vE9p3VBBDGqBzP4YGB7Q8Z4mmsmh8YMzj7hHWxt_k7qcM5W8Y0ac6_EJb7fAqpNK43J73Hc68pTWfVT9rYB215iHCi8JyqgEksyagoRH1xzKbPhyQqtXz4_iR73ttM6R8kG8pAbPkxTIkQrZYWCl0_RgSqO7q3RwecE Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 69cb388b118547d09e0ba768e5f2853d Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69cb388b118547d09e0ba768e5f2853d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 69cb388b118547d09e0ba768e5f2853d Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerAddressesNegativeTestJSON-372476070-project Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 60c19e661cc54085bf188002527ec75c Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-372476070-project Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance is not a member of specified network Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '1c4a1fa4-8594-43bf-bca9-c65b5f126260', 'id': 'invalid'} Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 17 13:13:42.448906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:42.453744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:42.453744 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f93434a-650e-4235-b632-0b7c25818c3b tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.120325 Oct 17 13:13:42.453744 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2334/4828] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:13:42 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260/ips/invalid => generated 91 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:13:42.463317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d749c9de-7019-4c3c-af4e-71a4add2c089 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:42.464064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d749c9de-7019-4c3c-af4e-71a4add2c089 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Failed to fetch instance by id 999 {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:13:42.465718 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d749c9de-7019-4c3c-af4e-71a4add2c089 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] HTTP exception thrown: Instance 999 could not be found. Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d749c9de-7019-4c3c-af4e-71a4add2c089 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Request method failure captured: Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVTtOF-mD0B3vE9p3VBBDGqBzP4YGB7Q8Z4mmsmh8YMzj7hHWxt_k7qcM5W8Y0ac6_EJb7fAqpNK43J73Hc68pTWfVT9rYB215iHCi8JyqgEksyagoRH1xzKbPhyQqtXz4_iR73ttM6R8kG8pAbPkxTIkQrZYWCl0_RgSqO7q3RwecE Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 69cb388b118547d09e0ba768e5f2853d Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69cb388b118547d09e0ba768e5f2853d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 69cb388b118547d09e0ba768e5f2853d Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerAddressesNegativeTestJSON-372476070-project Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 60c19e661cc54085bf188002527ec75c Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-372476070-project Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 999 could not be found. Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '999'} Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 17 13:13:42.467715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:42.473830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d749c9de-7019-4c3c-af4e-71a4add2c089 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:42.475082 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d749c9de-7019-4c3c-af4e-71a4add2c089 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.016615 Oct 17 13:13:42.476122 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2335/4829] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 13:13:42 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:13:42.486891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:42.487691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:42.506905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:42.507868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:42.508484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:42.510486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:42.511170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:42.511776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:42.572465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:42.759340 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-535ddd98-968b-4852-9de5-37c999a4e671 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 204 len: 0 microversion: 2.1 time: 0.275705 Oct 17 13:13:42.763317 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2336/4830] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:42 2022] DELETE /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:42.773449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:42.777802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:42.792018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:42.792516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:42.792954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:42.793669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:42.801613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:42.802099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:43.003787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:43.021486 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4941bc3f-5b99-4a04-9693-82ef89a6ab74 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1508 microversion: 2.1 time: 0.856735 Oct 17 13:13:43.022076 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2495/4831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:42 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1508 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:43.357336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:43.358234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:43.398367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:43.408807 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-118a0965-a710-4776-8250-1a2acbd3705a tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1527 microversion: 2.1 time: 0.641264 Oct 17 13:13:43.409410 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2337/4832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:42 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1527 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:43.424493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:43.424493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:43.424493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:43.424493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:43.424493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:43.424493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:43.512967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-122e47aa-8166-4f7c-9c51-07f67352b7ce req-7f978842-fc0d-471b-99e0-3adf268c685e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e865e2-5b1d-4c6c-81c7-d099f6ef45da", "name": "network-vif-deleted", "tag": "11832097-8c07-471c-8b03-630fac07e882"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:43.550423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-122e47aa-8166-4f7c-9c51-07f67352b7ce req-7f978842-fc0d-471b-99e0-3adf268c685e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:43.550423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-122e47aa-8166-4f7c-9c51-07f67352b7ce req-7f978842-fc0d-471b-99e0-3adf268c685e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:43.550423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-122e47aa-8166-4f7c-9c51-07f67352b7ce req-7f978842-fc0d-471b-99e0-3adf268c685e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:43.602784 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-122e47aa-8166-4f7c-9c51-07f67352b7ce req-7f978842-fc0d-471b-99e0-3adf268c685e service nova] Creating event network-vif-deleted:11832097-8c07-471c-8b03-630fac07e882 for instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da on n-h1-853316-12 Oct 17 13:13:43.621399 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-122e47aa-8166-4f7c-9c51-07f67352b7ce req-7f978842-fc0d-471b-99e0-3adf268c685e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113649 Oct 17 13:13:43.622007 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2338/4833] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:13:43.848334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:43.863530 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6259a73-ae60-4e89-91ad-c0adab30365b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1651 microversion: 2.1 time: 0.511377 Oct 17 13:13:43.875330 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2496/4834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:43 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1651 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:43.893760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:43.894436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:43.910050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:43.911998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:43.913571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:43.914389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:43.917069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:43.917525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.031069 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8518afb3-48d4-4dc7-8687-5a7f589a5ee6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.140123 Oct 17 13:13:44.033299 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2339/4835] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:43 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:44.042396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.043375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:44.052912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.053879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.054623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.055645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.056600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.057639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.062429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.066249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:44.085007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.085539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.089009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.089829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.091637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.094149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.145366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.146467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.148805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.150259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lazy-loading 'fault' on Instance uuid 95e865e2-5b1d-4c6c-81c7-d099f6ef45da {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:44.206199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:44.218117 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79640d0d-5dc2-4c84-9694-35b3b5e66df8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1312 microversion: 2.1 time: 0.167265 Oct 17 13:13:44.219441 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2340/4836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:44.369286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1eaf0d3a-298c-4fd2-a619-7a3c8fe8f391 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.373377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eaf0d3a-298c-4fd2-a619-7a3c8fe8f391 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.373852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eaf0d3a-298c-4fd2-a619-7a3c8fe8f391 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.374572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eaf0d3a-298c-4fd2-a619-7a3c8fe8f391 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.375560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eaf0d3a-298c-4fd2-a619-7a3c8fe8f391 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.376081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eaf0d3a-298c-4fd2-a619-7a3c8fe8f391 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.376594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eaf0d3a-298c-4fd2-a619-7a3c8fe8f391 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.402591 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1eaf0d3a-298c-4fd2-a619-7a3c8fe8f391 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.181939 Oct 17 13:13:44.409337 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2341/4837] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/os-services => generated 949 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:44.416381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-86ca4eb3-2392-4f4d-a896-0e3151153a7f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.420105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ca4eb3-2392-4f4d-a896-0e3151153a7f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.420629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ca4eb3-2392-4f4d-a896-0e3151153a7f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.421079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ca4eb3-2392-4f4d-a896-0e3151153a7f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.422081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ca4eb3-2392-4f4d-a896-0e3151153a7f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.422629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ca4eb3-2392-4f4d-a896-0e3151153a7f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.423065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ca4eb3-2392-4f4d-a896-0e3151153a7f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.454214 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-86ca4eb3-2392-4f4d-a896-0e3151153a7f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.041387 Oct 17 13:13:44.454790 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2342/4838] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:44.468326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.468959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:44.482354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:44.490664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.491521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.492396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.494546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.496077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.496923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.528836 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc3a65ff-6e91-4b69-be79-960028c25e40 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1658 microversion: 2.1 time: 0.491293 Oct 17 13:13:44.533087 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2497/4839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1658 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:44.558015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72c04f7c-5719-4750-bbd9-1fd4b2a78ebb tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.564945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72c04f7c-5719-4750-bbd9-1fd4b2a78ebb tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.565994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72c04f7c-5719-4750-bbd9-1fd4b2a78ebb tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.568388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72c04f7c-5719-4750-bbd9-1fd4b2a78ebb tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.569519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72c04f7c-5719-4750-bbd9-1fd4b2a78ebb tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.570258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72c04f7c-5719-4750-bbd9-1fd4b2a78ebb tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.571310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72c04f7c-5719-4750-bbd9-1fd4b2a78ebb tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.628271 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72c04f7c-5719-4750-bbd9-1fd4b2a78ebb tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.070636 Oct 17 13:13:44.630425 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2498/4840] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/os-services => generated 949 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:44.658389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3b33850-079e-4d17-8996-ecdf13d00cb8 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.662561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3b33850-079e-4d17-8996-ecdf13d00cb8 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.667325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3b33850-079e-4d17-8996-ecdf13d00cb8 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.667325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3b33850-079e-4d17-8996-ecdf13d00cb8 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.668135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3b33850-079e-4d17-8996-ecdf13d00cb8 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.668795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3b33850-079e-4d17-8996-ecdf13d00cb8 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.669432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3b33850-079e-4d17-8996-ecdf13d00cb8 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.737544 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3b33850-079e-4d17-8996-ecdf13d00cb8 tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-853316-12&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.096954 Oct 17 13:13:44.738602 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2499/4841] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/os-services?host=n-d-853316-12&binary=xxx => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:44.754424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b16099f-bcb0-400a-91a7-6734086997ac tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.764132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b16099f-bcb0-400a-91a7-6734086997ac tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.764633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b16099f-bcb0-400a-91a7-6734086997ac tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.765081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b16099f-bcb0-400a-91a7-6734086997ac tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.768069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b16099f-bcb0-400a-91a7-6734086997ac tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.768582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b16099f-bcb0-400a-91a7-6734086997ac tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.769048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b16099f-bcb0-400a-91a7-6734086997ac tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.816992 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b16099f-bcb0-400a-91a7-6734086997ac tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.069178 Oct 17 13:13:44.827694 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2500/4842] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/os-services => generated 949 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:13:44.833436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-98e09c44-87d6-4cf8-bcf6-50630b2e2b4f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:44.838908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e09c44-87d6-4cf8-bcf6-50630b2e2b4f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.839607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e09c44-87d6-4cf8-bcf6-50630b2e2b4f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.840244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e09c44-87d6-4cf8-bcf6-50630b2e2b4f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.841164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e09c44-87d6-4cf8-bcf6-50630b2e2b4f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:44.842452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e09c44-87d6-4cf8-bcf6-50630b2e2b4f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:44.843140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e09c44-87d6-4cf8-bcf6-50630b2e2b4f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:44.906420 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-98e09c44-87d6-4cf8-bcf6-50630b2e2b4f tempest-ServicesAdminNegativeTestJSON-172995113 tempest-ServicesAdminNegativeTestJSON-172995113-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.077245 Oct 17 13:13:44.907298 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2501/4843] 10.222.0.27 () {58 vars in 1198 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:45.051976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:45.064768 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a2de44d5-ac0f-4c20-87d9-99094ffa4fe7 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1527 microversion: 2.1 time: 0.608682 Oct 17 13:13:45.065737 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2343/4844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1527 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:45.077784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f4f3403-db61-45ef-b49a-8337331c8441 tempest-ServicesAdminNegativeTestJSON-1172736142 tempest-ServicesAdminNegativeTestJSON-1172736142-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:45.081661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4f4f3403-db61-45ef-b49a-8337331c8441 tempest-ServicesAdminNegativeTestJSON-1172736142 tempest-ServicesAdminNegativeTestJSON-1172736142-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b3d8aee5368a4f98b85c6c95262f8cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1846da34494c36874722d6bbcd925c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f4f3403-db61-45ef-b49a-8337331c8441 tempest-ServicesAdminNegativeTestJSON-1172736142 tempest-ServicesAdminNegativeTestJSON-1172736142-project] Request method failure captured: Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVUGSvIjlmgte-yQjH-xCD4fRCscK9CNhfs9S8Ca6PKQ-SL7_v7PN4PNu4Zc1qh7OmkzeN90VTOmvjRwX3oXI1c9TIiErmRVkKFu3JpwlNnyfzXuXoG_jFUJ4rUUFZVSDTkzIVMXuy8iBSq5DY1QO0WzEO5U0M7Y3LFcDv4b1gBbyZc Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 6b1846da34494c36874722d6bbcd925c Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1172736142 Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b1846da34494c36874722d6bbcd925c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1846da34494c36874722d6bbcd925c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b1846da34494c36874722d6bbcd925c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b1846da34494c36874722d6bbcd925c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1172736142 Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 6b1846da34494c36874722d6bbcd925c Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1172736142 Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServicesAdminNegativeTestJSON-1172736142-project Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: b3d8aee5368a4f98b85c6c95262f8cd8 Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1172736142-project Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: action_args: {} Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:13:45.083439 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f4f3403-db61-45ef-b49a-8337331c8441 tempest-ServicesAdminNegativeTestJSON-1172736142 tempest-ServicesAdminNegativeTestJSON-1172736142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4f4f3403-db61-45ef-b49a-8337331c8441 tempest-ServicesAdminNegativeTestJSON-1172736142 tempest-ServicesAdminNegativeTestJSON-1172736142-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.167724 Oct 17 13:13:45.088496 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2502/4845] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:13:44 2022] GET /compute/v2.1/os-services => generated 112 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:45.241556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:45.242691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:45.260625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:45.265854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:45.270567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:45.272706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:45.274944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:45.275898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:45.349173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:45.356183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:45.356958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:45.358515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:45.359239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lazy-loading 'fault' on Instance uuid 95e865e2-5b1d-4c6c-81c7-d099f6ef45da {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:45.554563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:45.561728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:45.565451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:45.590532 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c0d74c9c-94fd-49d8-9852-86c5c258abb9 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 200 len: 1312 microversion: 2.1 time: 0.333201 Oct 17 13:13:45.591432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2344/4846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:45 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:45.596411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:45.596940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:45.597411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:45.598154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:45.607367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:45.607939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:45.703480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d7b2a2b3-95f4-4a8d-bf8b-af3ac238269b req-6b05e35f-ddc8-4e60-a37c-5464f189661f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4a1fa4-8594-43bf-bca9-c65b5f126260", "name": "network-vif-deleted", "tag": "ee57ccd2-28d5-4c72-af8f-85fd7ec278ab"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:45.727981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7b2a2b3-95f4-4a8d-bf8b-af3ac238269b req-6b05e35f-ddc8-4e60-a37c-5464f189661f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:45.729720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7b2a2b3-95f4-4a8d-bf8b-af3ac238269b req-6b05e35f-ddc8-4e60-a37c-5464f189661f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:45.732109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7b2a2b3-95f4-4a8d-bf8b-af3ac238269b req-6b05e35f-ddc8-4e60-a37c-5464f189661f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:45.752308 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d7b2a2b3-95f4-4a8d-bf8b-af3ac238269b req-6b05e35f-ddc8-4e60-a37c-5464f189661f service nova] Creating event network-vif-deleted:ee57ccd2-28d5-4c72-af8f-85fd7ec278ab for instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 on n-h1-853316-12 Oct 17 13:13:45.759460 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d7b2a2b3-95f4-4a8d-bf8b-af3ac238269b req-6b05e35f-ddc8-4e60-a37c-5464f189661f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060397 Oct 17 13:13:45.764304 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2345/4847] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:13:46.094770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:46.095645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:46.120863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.121858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.122489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.123682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.124728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.125426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.133196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:46.144579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3a679c3b-1732-490b-9f32-5c5c544510d5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.587556 Oct 17 13:13:46.146845 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2503/4848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:45 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:46.170198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.170845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.171426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.171974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lazy-loading 'fault' on Instance uuid 1c4a1fa4-8594-43bf-bca9-c65b5f126260 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:13:46.176962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:46.177622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:46.184452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.185220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.185990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.186836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.187294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.187724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.258305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c19e661cc54085bf188002527ec75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cb388b118547d09e0ba768e5f2853d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:46.271369 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d764862e-a4b9-4a71-aba7-5643fed1f665 tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 200 len: 1314 microversion: 2.1 time: 0.185723 Oct 17 13:13:46.272835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2346/4849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:46 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:46.608318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:46.617019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:46.619623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: 95e865e2-5b1d-4c6c-81c7-d099f6ef45da] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:46.625244 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fa1b7ad7-3428-4fd7-9753-51fa3152bbac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.455481 Oct 17 13:13:46.626145 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2504/4850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:46 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:46.628670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.629152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.637981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.639244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.639885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.640479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.650599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:46.652185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:46.658649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.659699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.660451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.662112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.662931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.663778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.673830 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da could not be found. Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da HTTP/1.1 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da could not be found. Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '95e865e2-5b1d-4c6c-81c7-d099f6ef45da'} Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da could not be found. Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da could not be found. Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:46.675773 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da could not be found. Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 404 to user: Instance 95e865e2-5b1d-4c6c-81c7-d099f6ef45da could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e0f261a5-0ce8-4672-b011-103292ac4e16 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da" status: 404 len: 111 microversion: 2.1 time: 0.064414 Oct 17 13:13:46.684934 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2347/4851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:46 2022] GET /compute/v2.1/servers/95e865e2-5b1d-4c6c-81c7-d099f6ef45da => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:46.694853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:46.695405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:46.710689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.712140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.713402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.714367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.714926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.715378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.753312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:46.825604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:46.942564 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b22f768f-7d02-4ac0-b145-6e58b8ef8db8 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 204 len: 0 microversion: 2.1 time: 0.258705 Oct 17 13:13:46.945079 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2348/4852] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:46 2022] DELETE /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:46.957638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:46.960403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:46.969395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.970428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.971198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:46.972172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:46.973495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:46.974217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.009274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:13:47.026002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:47.041680 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a771e8d-61b8-4382-b652-92341a45d2dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.396612 Oct 17 13:13:47.063795 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2505/4853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:46 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:47.072935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-723430a1-a972-4984-96f3-8046e2b7bd9a req-60f42405-1842-4abf-af8e-c6588ad4fbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97db364f-e815-4522-90ee-61887b73aae3", "tag": "5454a97f-6776-477b-ab04-5ad3b99c6ee5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:47.093111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-723430a1-a972-4984-96f3-8046e2b7bd9a req-60f42405-1842-4abf-af8e-c6588ad4fbd1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.093605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-723430a1-a972-4984-96f3-8046e2b7bd9a req-60f42405-1842-4abf-af8e-c6588ad4fbd1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.094054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-723430a1-a972-4984-96f3-8046e2b7bd9a req-60f42405-1842-4abf-af8e-c6588ad4fbd1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.111719 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-723430a1-a972-4984-96f3-8046e2b7bd9a req-60f42405-1842-4abf-af8e-c6588ad4fbd1 service nova] Creating event network-changed:5454a97f-6776-477b-ab04-5ad3b99c6ee5 for instance 97db364f-e815-4522-90ee-61887b73aae3 on n-h1-853316-12 Oct 17 13:13:47.120886 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-723430a1-a972-4984-96f3-8046e2b7bd9a req-60f42405-1842-4abf-af8e-c6588ad4fbd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054687 Oct 17 13:13:47.121843 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2506/4854] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:47.129323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:47.138388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:47.145215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.145988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.146632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.147529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.148327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.148920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.205009 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0eb4d69a-8e63-433b-aecf-63985edbc5ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "DELETE /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 204 len: 0 microversion: 2.1 time: 0.256317 Oct 17 13:13:47.205923 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2349/4855] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:13:46 2022] DELETE /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:47.217551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:47.218503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:47.235919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.236414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.236861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.237571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.243143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.243602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.483207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:47.510756 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1235f0a-2202-4712-b949-423d9314d3dc tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.301506 Oct 17 13:13:47.531494 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2350/4856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:47 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:47.541368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:47.543630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:47.562965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.566314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.567093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.568392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.569104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.570018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.588841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:47.601304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4318ea90-02dd-4174-b1bf-4f5028f1efea tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.478044 Oct 17 13:13:47.603687 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2507/4857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:47 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:47.631548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:47.634500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] [instance: 1c4a1fa4-8594-43bf-bca9-c65b5f126260] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:47.648822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.650672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.651441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.652421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.653116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.653536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.672200 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] HTTP exception thrown: Instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 could not be found. Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Request method failure captured: Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 HTTP/1.1 Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVTtOF-mD0B3vE9p3VBBDGqBzP4YGB7Q8Z4mmsmh8YMzj7hHWxt_k7qcM5W8Y0ac6_EJb7fAqpNK43J73Hc68pTWfVT9rYB215iHCi8JyqgEksyagoRH1xzKbPhyQqtXz4_iR73ttM6R8kG8pAbPkxTIkQrZYWCl0_RgSqO7q3RwecE Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 69cb388b118547d09e0ba768e5f2853d Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69cb388b118547d09e0ba768e5f2853d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69cb388b118547d09e0ba768e5f2853d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 69cb388b118547d09e0ba768e5f2853d Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-372476070 Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerAddressesNegativeTestJSON-372476070-project Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 60c19e661cc54085bf188002527ec75c Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-372476070-project Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 could not be found. Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1c4a1fa4-8594-43bf-bca9-c65b5f126260'} Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 could not be found. Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 could not be found. Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:47.674288 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:47.678635 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:47.678635 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:47.678635 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:47.678635 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:47.678635 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:47.678635 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:47.678635 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 could not be found. Oct 17 13:13:47.678635 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:47.681364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] Returning 404 to user: Instance 1c4a1fa4-8594-43bf-bca9-c65b5f126260 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:47.682581 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dda058d6-b635-463b-b25d-35ca3be9d3eb tempest-ServerAddressesNegativeTestJSON-372476070 tempest-ServerAddressesNegativeTestJSON-372476070-project] 10.222.0.27 "GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260" status: 404 len: 111 microversion: 2.1 time: 0.076599 Oct 17 13:13:47.688259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2508/4858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:47 2022] GET /compute/v2.1/servers/1c4a1fa4-8594-43bf-bca9-c65b5f126260 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:47.694628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:47.696676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:47.704765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.705552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.706271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.707210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:47.707868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:47.708496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:47.962705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:47.975677 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2fdf71ba-6963-4148-8754-28ffb64cd3c8 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1766 microversion: 2.1 time: 0.441361 Oct 17 13:13:47.993155 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2351/4859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:47 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1766 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:48.141229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:48.155349 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-baa2e244-894d-4bdf-823f-cfe623d0b1e7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.465411 Oct 17 13:13:48.156202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2509/4860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:47 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:48.178571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:48.179029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:48.221218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:48.224775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:48.225595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:48.227189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:48.228462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:48.229385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:48.627588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:48.629124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:48.651242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:48.652662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:48.655074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:48.657131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:48.666192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:48.666680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:48.978224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:48.989565 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0d21e99-65f9-40eb-9c08-583d8c74fd4e tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.366143 Oct 17 13:13:48.993016 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2510/4861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:48 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:49.015263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:49.017591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:49.032722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:49.035244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:49.035757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:49.038594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:49.039099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:49.039549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:49.165813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:49.175746 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74b4b1e9-057d-4d6d-a12a-84a68b05a3ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 1.001146 Oct 17 13:13:49.191568 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2352/4862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:48 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:49.417438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:49.429223 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50aa6802-6767-4b90-92ae-db999606452d tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1766 microversion: 2.1 time: 0.424465 Oct 17 13:13:49.435707 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2511/4863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:49 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1766 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:49.888346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15a033db-df6f-45dd-9de7-4fc63c06d2a5 tempest-FlavorsV2NegativeTest-1420641289 tempest-FlavorsV2NegativeTest-1420641289-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:49.896475 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15a033db-df6f-45dd-9de7-4fc63c06d2a5 tempest-FlavorsV2NegativeTest-1420641289 tempest-FlavorsV2NegativeTest-1420641289-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.243642 Oct 17 13:13:49.897259 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2353/4864] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:13:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:50.019715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:50.020472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:50.033853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:50.034641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:50.036651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:50.038412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:50.038881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:50.039308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:50.307380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:50.316120 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2eb2ac9b-4533-4f38-86b3-04ef2e8cfc91 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1522 microversion: 2.1 time: 0.300247 Oct 17 13:13:50.317113 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2512/4865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:50 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:50.466076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:50.466739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:50.475179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:50.475676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:50.476115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:50.477036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:50.478776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:50.479161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:50.631341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7594a173-2b35-4a69-9bed-0fcaddb5f39e req-14a7232f-f4e2-4b89-867c-62715bf4f1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97db364f-e815-4522-90ee-61887b73aae3", "name": "network-vif-deleted", "tag": "5454a97f-6776-477b-ab04-5ad3b99c6ee5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:50.635198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efab0c775fd94096912d8844df7457b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8096ad9cc4a242b1a3ecf4cdb9a2dcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:50.646653 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71b48e65-4b74-41ae-b58a-93193d924060 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 200 len: 1646 microversion: 2.1 time: 0.187020 Oct 17 13:13:50.648665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7594a173-2b35-4a69-9bed-0fcaddb5f39e req-14a7232f-f4e2-4b89-867c-62715bf4f1f9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:50.650195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7594a173-2b35-4a69-9bed-0fcaddb5f39e req-14a7232f-f4e2-4b89-867c-62715bf4f1f9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:50.651263 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2354/4866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:50 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 1646 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:50.654341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7594a173-2b35-4a69-9bed-0fcaddb5f39e req-14a7232f-f4e2-4b89-867c-62715bf4f1f9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:50.680976 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7594a173-2b35-4a69-9bed-0fcaddb5f39e req-14a7232f-f4e2-4b89-867c-62715bf4f1f9 service nova] Creating event network-vif-deleted:5454a97f-6776-477b-ab04-5ad3b99c6ee5 for instance 97db364f-e815-4522-90ee-61887b73aae3 on n-h1-853316-12 Oct 17 13:13:50.693543 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7594a173-2b35-4a69-9bed-0fcaddb5f39e req-14a7232f-f4e2-4b89-867c-62715bf4f1f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065606 Oct 17 13:13:50.694550 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2513/4867] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:50.772364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fe5a280-abc4-4f51-9210-0dda99abc049 tempest-FlavorsV2NegativeTest-1420641289 tempest-FlavorsV2NegativeTest-1420641289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1861370226", "imageRef": "cecd5132-ed5d-4785-aab6-2afa1cdbe1ad", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:50.874784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-3fe5a280-abc4-4f51-9210-0dda99abc049 tempest-FlavorsV2NegativeTest-1420641289 tempest-FlavorsV2NegativeTest-1420641289-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:13:51.343748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:51.346992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:51.359575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:51.360128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:51.361186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:51.361314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:51.361734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:51.372716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:51.477744 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-3fe5a280-abc4-4f51-9210-0dda99abc049 tempest-FlavorsV2NegativeTest-1420641289 tempest-FlavorsV2NegativeTest-1420641289-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fe5a280-abc4-4f51-9210-0dda99abc049 tempest-FlavorsV2NegativeTest-1420641289 tempest-FlavorsV2NegativeTest-1420641289-project] Request method failure captured: Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 143 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUNZfow5YTRRkm9iESkKNFme8nyTazGo18zEtyeH0caQNS2b8CEGj2Ob4__HdNigWOQS0VVpv-6YJFqns-fPON8bV0PNYWAHgK77tI4up2dv7H-pcnJyWnnX2_J7w99YDSP8N2Gdb8s6MI2Euv_6CznfA-zBsuqId4OdSHWLdyduko Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 176b9d4d18bd492f97df46062c72ad58 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-FlavorsV2NegativeTest-1420641289 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_176b9d4d18bd492f97df46062c72ad58", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/176b9d4d18bd492f97df46062c72ad58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/176b9d4d18bd492f97df46062c72ad58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/176b9d4d18bd492f97df46062c72ad58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-FlavorsV2NegativeTest-1420641289 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 176b9d4d18bd492f97df46062c72ad58 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1420641289 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-FlavorsV2NegativeTest-1420641289-project Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: c5e3e515fbba4bb3937fb2f9651b03f9 Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-FlavorsV2NegativeTest-1420641289-project Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1861370226", "imageRef": "cecd5132-ed5d-4785-aab6-2afa1cdbe1ad", "flavorRef": "452"}} Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: exception: Flavor's memory is too small for requested image. Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1861370226', 'imageRef': 'cecd5132-ed5d-4785-aab6-2afa1cdbe1ad', 'flavorRef': '452'}}} Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:51.479799 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 17 13:13:51.485256 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.487076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fe5a280-abc4-4f51-9210-0dda99abc049 tempest-FlavorsV2NegativeTest-1420641289 tempest-FlavorsV2NegativeTest-1420641289-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:51.487999 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3fe5a280-abc4-4f51-9210-0dda99abc049 tempest-FlavorsV2NegativeTest-1420641289 tempest-FlavorsV2NegativeTest-1420641289-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.720072 Oct 17 13:13:51.488598 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2355/4868] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:13:50 2022] POST /compute/v2.1/servers => generated 93 bytes in 721 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:13:51.520881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e452d90f659446db23827a290a819f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d82cd61ac94563ab7bd8b9c13a0a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:51.530833 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43a46633-4311-45ce-a54e-ec3cc4e39a55 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 200 len: 1480 microversion: 2.1 time: 0.193747 Oct 17 13:13:51.531442 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2514/4869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:51 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 1480 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:51.676780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:51.677399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] [instance: 97db364f-e815-4522-90ee-61887b73aae3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:51.691219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:51.691711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:51.694691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:51.696240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:51.697463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:51.697902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:51.721521 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] HTTP exception thrown: Instance 97db364f-e815-4522-90ee-61887b73aae3 could not be found. Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Request method failure captured: Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 HTTP/1.1 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVRhu117pFQ0bdZSE_Rrinzpd_BWhO-WZdBtF7BSZJ_sxsehvjRLlOXvzqCzapxIaixJ1wPBay21i0lBN0tTqQycRucv9458wQUN1zCSZZPGQ7qA6hiuJ4xuKjb4B89I5Yu2GoR5NpmWc8MklP7KBxoZ0_welpgV8vx_2G6ABuizPOw Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8096ad9cc4a242b1a3ecf4cdb9a2dcb0 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-679056250 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8096ad9cc4a242b1a3ecf4cdb9a2dcb0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8096ad9cc4a242b1a3ecf4cdb9a2dcb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8096ad9cc4a242b1a3ecf4cdb9a2dcb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8096ad9cc4a242b1a3ecf4cdb9a2dcb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestSecurityGroupsBasicOps-679056250 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8096ad9cc4a242b1a3ecf4cdb9a2dcb0 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-679056250 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestSecurityGroupsBasicOps-679056250-project Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: efab0c775fd94096912d8844df7457b6 Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestSecurityGroupsBasicOps-679056250-project Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 97db364f-e815-4522-90ee-61887b73aae3 could not be found. Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '97db364f-e815-4522-90ee-61887b73aae3'} Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97db364f-e815-4522-90ee-61887b73aae3 could not be found. Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97db364f-e815-4522-90ee-61887b73aae3 could not be found. Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:51.723155 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97db364f-e815-4522-90ee-61887b73aae3 could not be found. Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Returning 404 to user: Instance 97db364f-e815-4522-90ee-61887b73aae3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2be3b3d6-a19c-4da7-be97-63bde4f865ac tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3" status: 404 len: 111 microversion: 2.1 time: 0.052879 Oct 17 13:13:51.732864 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2356/4870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:51 2022] GET /compute/v2.1/servers/97db364f-e815-4522-90ee-61887b73aae3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:52.562778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:52.565638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] [instance: b27ca706-6340-4995-a586-b1ee6276bece] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:52.580469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:52.581634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:52.582487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:52.583822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:52.584529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:52.585139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:52.592331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:52.614264 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] HTTP exception thrown: Instance b27ca706-6340-4995-a586-b1ee6276bece could not be found. Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Request method failure captured: Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece HTTP/1.1 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVP106052V9px1GLlw1nbFSwd13oSS6p-jcN041G4TQBayekdyBjBerNvW6Abe3Tp1RGSmipCT3IoZ7mCM0WC-xvIkotKjRg6docuj866Icw5z1W54dKlD31yblQzbL0QHyQ-TnibMq_dNMHUKU8d7ci2n5r8EbiWcUEQfo64WPiJIo Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15d82cd61ac94563ab7bd8b9c13a0a06", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15d82cd61ac94563ab7bd8b9c13a0a06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 15d82cd61ac94563ab7bd8b9c13a0a06 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1579304486 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 3e452d90f659446db23827a290a819f1 Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1579304486-project Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance b27ca706-6340-4995-a586-b1ee6276bece could not be found. Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b27ca706-6340-4995-a586-b1ee6276bece'} Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27ca706-6340-4995-a586-b1ee6276bece could not be found. Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27ca706-6340-4995-a586-b1ee6276bece could not be found. Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:52.616354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:13:52.621800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:52.621800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:13:52.621800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:13:52.621800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:13:52.621800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:13:52.621800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:13:52.621800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27ca706-6340-4995-a586-b1ee6276bece could not be found. Oct 17 13:13:52.621800 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:13:52.624764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] Returning 404 to user: Instance b27ca706-6340-4995-a586-b1ee6276bece could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:13:52.625850 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-726aaccb-a9e6-4855-9729-2086c79da614 tempest-ServerRescueNegativeTestJSON-1579304486 tempest-ServerRescueNegativeTestJSON-1579304486-project] 10.222.0.27 "GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece" status: 404 len: 111 microversion: 2.1 time: 0.073981 Oct 17 13:13:52.627053 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2515/4871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:52 2022] GET /compute/v2.1/servers/b27ca706-6340-4995-a586-b1ee6276bece => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:13:52.744144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-001c5b41-f68e-42d9-a23c-aaec6f7623cc req-267021e2-fb30-4281-9e38-cef2e0c1a517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27ca706-6340-4995-a586-b1ee6276bece", "name": "network-vif-deleted", "tag": "6027d840-b7f7-4bf8-b272-66db08cf031f"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:52.755851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-001c5b41-f68e-42d9-a23c-aaec6f7623cc req-267021e2-fb30-4281-9e38-cef2e0c1a517 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:52.756667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-001c5b41-f68e-42d9-a23c-aaec6f7623cc req-267021e2-fb30-4281-9e38-cef2e0c1a517 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:52.757275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-001c5b41-f68e-42d9-a23c-aaec6f7623cc req-267021e2-fb30-4281-9e38-cef2e0c1a517 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:52.770782 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-001c5b41-f68e-42d9-a23c-aaec6f7623cc req-267021e2-fb30-4281-9e38-cef2e0c1a517 service nova] Creating event network-vif-deleted:6027d840-b7f7-4bf8-b272-66db08cf031f for instance b27ca706-6340-4995-a586-b1ee6276bece on n-h2-853316-12 Oct 17 13:13:52.776230 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-001c5b41-f68e-42d9-a23c-aaec6f7623cc req-267021e2-fb30-4281-9e38-cef2e0c1a517 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036401 Oct 17 13:13:52.777491 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2357/4872] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:54.871497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:55.077949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:55.078720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:55.094379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:55.095291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:55.096152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:55.098054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:55.099621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:55.101117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:55.506931 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f076eeb8-7b0a-4df9-8d2c-6278fe8bed9d tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1837 microversion: 2.1 time: 0.913040 Oct 17 13:13:55.507507 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2516/4873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:54 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1837 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:13:55.536766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:55.538707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:55.546411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:55.554592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:55.556198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:55.557502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:55.558490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:55.559158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:55.560428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:55.905286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:55.915809 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d2dc6a8-25ab-4b18-8a17-62fac8929c23 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1684 microversion: 2.1 time: 0.386219 Oct 17 13:13:55.919693 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2358/4874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:55 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1684 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:56.256669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:56.265106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:56.284555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:56.294248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:56.298773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:56.299824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:56.308173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:56.311465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:56.472457 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d08dd8b2-1a42-454e-b626-c78f3d512038 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action" status: 200 len: 32633 microversion: 2.1 time: 0.219697 Oct 17 13:13:56.483343 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2517/4875] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:56 2022] POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action => generated 32633 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:13:56.629926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:56.630570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:56.653071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:56.654024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:56.654909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:56.656067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:56.656533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:56.660341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:56.732791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e7ac72f0a40c48a2aee2a029d0235012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712e443870d344e29d86b6a14cfb887c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:56.736936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] flavor_id is None. Assuming migration. {{(pid=127539) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 13:13:56.740033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127539) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:13:56.813552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2afcc592-0c4c-46d8-bcf7-519e6a1086ea tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Calling method '.version_select at 0x7fa820aadca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:56.916427 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2afcc592-0c4c-46d8-bcf7-519e6a1086ea tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f" status: 200 len: 636 microversion: 2.1 time: 0.106700 Oct 17 13:13:56.919009 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2518/4876] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 17 13:13:56 2022] GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f => generated 636 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:56.934468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c985306-697c-48d5-a884-b62b3bd73da2 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'update_all', calling method: .version_select at 0x7fa820f41040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:57.036001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2c985306-697c-48d5-a884-b62b3bd73da2 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:13:57.049971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:57.058151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-2c985306-697c-48d5-a884-b62b3bd73da2 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:13:57.457721 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-83b7dc14-aa14-44aa-b433-18639462338e tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action" status: 202 len: 0 microversion: 2.1 time: 0.840351 Oct 17 13:13:57.465580 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2359/4877] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:13:56 2022] POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:13:57.481699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:57.482376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:57.509481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:57.510101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:57.515656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:57.516569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:57.517058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:57.525387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:57.702291 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c985306-697c-48d5-a884-b62b3bd73da2 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.773030 Oct 17 13:13:57.703187 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2519/4878] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:13:56 2022] PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 61 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:13:57.715537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ef290a2-c3ce-4b63-b41a-59d777e4b9ea tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Calling method '.version_select at 0x7fa820123280>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:58.032038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:13:58.042073 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6a2797ea-1176-416c-91a4-9862e60ed0a9 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1693 microversion: 2.1 time: 0.572255 Oct 17 13:13:58.048693 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2360/4879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:57 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1693 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:58.187732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ef290a2-c3ce-4b63-b41a-59d777e4b9ea tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "DELETE /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.478272 Oct 17 13:13:58.188311 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2520/4880] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 17 13:13:57 2022] DELETE /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata/os_version => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:13:58.197064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c9c8036-45de-4d47-bac0-aa108ab6a18b tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Calling method '.version_select at 0x7fa81bdf7790>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:58.268297 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c9c8036-45de-4d47-bac0-aa108ab6a18b tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 37 microversion: 2.1 time: 0.075660 Oct 17 13:13:58.270406 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2361/4881] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:13:58 2022] GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 37 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:58.283258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ceb267ec-253e-4a3a-b69e-2c9c771f1c50 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'update_all', calling method: .version_select at 0x7fa820913c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:58.376506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-ceb267ec-253e-4a3a-b69e-2c9c771f1c50 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:13:58.382347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-ceb267ec-253e-4a3a-b69e-2c9c771f1c50 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:13:58.829929 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ceb267ec-253e-4a3a-b69e-2c9c771f1c50 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.550540 Oct 17 13:13:58.835610 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2521/4882] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:13:58 2022] PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 61 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:13:58.847669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26e00131-bf52-4ebf-8c29-c2901e13505b tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Calling method '.version_select at 0x7fa81bdab820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:58.957906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-26e00131-bf52-4ebf-8c29-c2901e13505b tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.121005 Oct 17 13:13:58.958593 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2362/4883] 10.222.0.27 () {58 vars in 1290 bytes} [Mon Oct 17 13:13:58 2022] GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata/os_distro => generated 33 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:58.973706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d35f824-4a50-44a6-b64c-d06917443c76 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'update_all', calling method: .version_select at 0x7fa820913670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:59.077394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:59.078017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:13:59.079283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5d35f824-4a50-44a6-b64c-d06917443c76 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:13:59.086730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:59.089062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:59.090729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:59.092260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-5d35f824-4a50-44a6-b64c-d06917443c76 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:13:59.096407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:59.097231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:59.097900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:59.379086 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d35f824-4a50-44a6-b64c-d06917443c76 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.411207 Oct 17 13:13:59.384648 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2522/4884] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:13:58 2022] PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 61 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:59.390420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-651f90f5-8f88-4069-a8b5-ad5dd94d33f6 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Calling method '.version_select at 0x7fa820ab60d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:59.465797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-651f90f5-8f88-4069-a8b5-ad5dd94d33f6 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.079818 Oct 17 13:13:59.466433 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2523/4885] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:13:59 2022] GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 61 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:59.493694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5efeeba-8273-40dd-91e3-6cc8e1e23c7f tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'update_all', calling method: .version_select at 0x7fa82092b040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:13:59.594078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a5efeeba-8273-40dd-91e3-6cc8e1e23c7f tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:13:59.602780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a5efeeba-8273-40dd-91e3-6cc8e1e23c7f tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:13:59.981275 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a5efeeba-8273-40dd-91e3-6cc8e1e23c7f tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.505842 Oct 17 13:13:59.986310 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2524/4886] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:13:59 2022] PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 61 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:13:59.996450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97f44aa5-2af2-434f-a431-21904d8d2084 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'update_all', calling method: .version_select at 0x7fa820913280>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:00.095068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-97f44aa5-2af2-434f-a431-21904d8d2084 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:00.114340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-97f44aa5-2af2-434f-a431-21904d8d2084 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:00.222139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:00.258005 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cb1f16fa-0396-49db-9ad8-f532db55d62e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1693 microversion: 2.1 time: 1.182971 Oct 17 13:14:00.259868 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2363/4887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:13:59 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1693 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:00.712180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97f44aa5-2af2-434f-a431-21904d8d2084 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.723612 Oct 17 13:14:00.713770 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2525/4888] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:13:59 2022] PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 64 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:14:00.725577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c8a0134b-351a-4717-8311-a3dab3045839 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Calling method '.version_select at 0x7fa820416040>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:00.858994 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c8a0134b-351a-4717-8311-a3dab3045839 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.130369 Oct 17 13:14:00.859988 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2364/4889] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:14:00 2022] GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 64 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:14:00.878408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ac81a27-89c0-4da0-be67-1b67915e5a61 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'update_all', calling method: .version_select at 0x7fa820907160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:01.015413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3ac81a27-89c0-4da0-be67-1b67915e5a61 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:01.025514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3ac81a27-89c0-4da0-be67-1b67915e5a61 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:01.289619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:01.292467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:01.325174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:01.330154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:01.330666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:01.332565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:01.341766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:01.342283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:01.996645 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ac81a27-89c0-4da0-be67-1b67915e5a61 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 61 microversion: 2.1 time: 1.125927 Oct 17 13:14:02.006197 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2526/4890] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:14:00 2022] PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 61 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:14:02.012509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0bcedc5f-705d-4c12-af08-609fefbfb901 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'update', calling method: .version_select at 0x7fa82096a1f0>, body: {"meta": {"os_version": "alt"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:02.036588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:02.055018 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-875c8e33-4434-4ec5-ae68-2fb478265421 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1693 microversion: 2.1 time: 0.773683 Oct 17 13:14:02.072693 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2365/4891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:01 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1693 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:02.117221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-0bcedc5f-705d-4c12-af08-609fefbfb901 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:02.132238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-0bcedc5f-705d-4c12-af08-609fefbfb901 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:02.484829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c219c29e-e7c8-4cb8-af80-eb0c5aa45318 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'create', calling method: .version_select at 0x7fa81bd09a60>, body: {"keypair": {"name": "tempest-keypair-1593243049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy3cNcdpo57v3mEfFL05PIYcBpNmINt8L79Q53Cpk3Qki2THslhk97IxYE7JnqlMgJGhQgbCtgWpFcdmp9hHNjavt/we5pT+SoUFjZGBXPKgnr40DISOkKksHUYRFZmww=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:02.535601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c219c29e-e7c8-4cb8-af80-eb0c5aa45318 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Getting quotas for project 26f98949744c40cca4df9d331462cd0d. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:02.556457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c219c29e-e7c8-4cb8-af80-eb0c5aa45318 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Getting quotas for user 28c5de5f487848a8a91ab2669a81149a and project 26f98949744c40cca4df9d331462cd0d. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:02.641845 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c219c29e-e7c8-4cb8-af80-eb0c5aa45318 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.457846 Oct 17 13:14:02.644756 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2366/4892] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 13:14:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 461 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 17 13:14:02.753671 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0bcedc5f-705d-4c12-af08-609fefbfb901 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.744930 Oct 17 13:14:02.754504 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2527/4893] 10.222.0.27 () {60 vars in 1313 bytes} [Mon Oct 17 13:14:02 2022] PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata/os_version => generated 31 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:14:02.768722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4eadff8b-e599-4cf6-b4db-91c1e5460688 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Calling method '.version_select at 0x7fa81bccbb80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:02.850734 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4eadff8b-e599-4cf6-b4db-91c1e5460688 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 58 microversion: 2.1 time: 0.089751 Oct 17 13:14:02.852002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2367/4894] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:14:02 2022] GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 58 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:14:02.862565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a7bf2ed-bf09-4c4b-a3bc-125f8c056a80 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'update_all', calling method: .version_select at 0x7fa81bd01670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:02.988857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2a7bf2ed-bf09-4c4b-a3bc-125f8c056a80 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:02.996956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-2a7bf2ed-bf09-4c4b-a3bc-125f8c056a80 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:03.185537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2127920461", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": "none"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:03.348443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:14:03.349004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:14:03.349556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:14:03.350019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:14:03.350688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:14:03.372674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:03.375050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:03.375518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:03.376287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:03.376893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:03.378726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:03.451014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Getting quotas for project 330e93904ccc489c997444723d58a2aa. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:03.467007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Getting quotas for user 24c9e915e6594a3786125d280ff925e6 and project 330e93904ccc489c997444723d58a2aa. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:03.496361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:14:03.499513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:14:03.564865 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a7bf2ed-bf09-4c4b-a3bc-125f8c056a80 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.706256 Oct 17 13:14:03.565617 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2368/4895] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:14:02 2022] PUT /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 61 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:14:03.569171 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-790b424e-98f5-4d69-b482-0e7643ddbeda tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.719054 Oct 17 13:14:03.569171 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2528/4896] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 13:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:14:03.581714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:03.582738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:03.585434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f821d990-960f-4fcc-b0c5-ead24120f800 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Action: 'create', calling method: .version_select at 0x7fa8209b4c10>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:03.604082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:03.605090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:03.616871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:03.617971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:03.618261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:03.627897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:03.698144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f821d990-960f-4fcc-b0c5-ead24120f800 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:03.731117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-f821d990-960f-4fcc-b0c5-ead24120f800 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Getting quotas for user baaf334572d94ec5bdc3d946676d2cb3 and project 233054e005664996b6267e23e3cd0294. Resources: dict_keys(['metadata_items']) {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:04.387744 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f821d990-960f-4fcc-b0c5-ead24120f800 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "POST /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.813669 Oct 17 13:14:04.392766 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2529/4897] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 17 13:14:03 2022] POST /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 85 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:14:04.398435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e922025-a88a-4219-857a-fdb30c272590 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:04.399784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e922025-a88a-4219-857a-fdb30c272590 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:04.537372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e922025-a88a-4219-857a-fdb30c272590 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:04.549063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e922025-a88a-4219-857a-fdb30c272590 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:04.551106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e922025-a88a-4219-857a-fdb30c272590 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:04.552643 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e922025-a88a-4219-857a-fdb30c272590 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 200 len: 1278 microversion: 2.47 time: 0.158443 Oct 17 13:14:04.570514 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2530/4898] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:04 2022] GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:04.597334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bbdb9c63-b71e-476b-a168-adc7522e0369 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] Calling method '.version_select at 0x7fa82096af70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:04.695658 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bbdb9c63-b71e-476b-a168-adc7522e0369 tempest-ImagesMetadataTestJSON-22734096 tempest-ImagesMetadataTestJSON-22734096-project] 10.222.0.27 "GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.112684 Oct 17 13:14:04.697593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2531/4899] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:14:04 2022] GET /compute/v2.1/images/2e2a65ac-7895-4ec9-8342-138a62514d6f/metadata => generated 85 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:14:04.735000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-657432527", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": "none"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:04.862126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:14:04.862620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:14:04.866113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:14:04.866579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:14:04.867006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:14:04.894978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:04.899107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:04.899816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:04.902457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:04.903154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:04.905058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:04.978347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Getting quotas for project 330e93904ccc489c997444723d58a2aa. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:05.000034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Getting quotas for user 24c9e915e6594a3786125d280ff925e6 and project 330e93904ccc489c997444723d58a2aa. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:05.046036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:14:05.051645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:14:05.143749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fac677c7-593c-4450-8981-f00b51573e5d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.436146 Oct 17 13:14:05.146570 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2532/4900] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 13:14:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:14:05.159155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c39989f-c836-45ef-94cc-56aeb369143e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:05.178119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c39989f-c836-45ef-94cc-56aeb369143e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:05.191103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:05.269598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c39989f-c836-45ef-94cc-56aeb369143e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "PUT /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 991 microversion: 2.47 time: 0.115284 Oct 17 13:14:05.270704 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2533/4901] 10.222.0.27 () {62 vars in 1297 bytes} [Mon Oct 17 13:14:05 2022] PUT /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 991 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:14:05.301911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aac41a24-c10d-4097-84b7-df9b5cbf0a65 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:05.303081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aac41a24-c10d-4097-84b7-df9b5cbf0a65 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:05.442385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:05.452428 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a742c23b-5daa-4862-8b1b-ad5de12b1d6f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1693 microversion: 2.1 time: 1.880032 Oct 17 13:14:05.453025 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2369/4902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:03 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1693 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:05.486237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aac41a24-c10d-4097-84b7-df9b5cbf0a65 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:05.496466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aac41a24-c10d-4097-84b7-df9b5cbf0a65 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:05.498840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aac41a24-c10d-4097-84b7-df9b5cbf0a65 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:05.500089 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aac41a24-c10d-4097-84b7-df9b5cbf0a65 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1277 microversion: 2.47 time: 0.209841 Oct 17 13:14:05.500668 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2534/4903] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:05 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:05.939711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-263b8469-8ef0-4573-b633-4588769f7962 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] Calling method '.version_select at 0x7fa81bd9b670>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:06.004398 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-263b8469-8ef0-4573-b633-4588769f7962 tempest-TestSecurityGroupsBasicOps-679056250 tempest-TestSecurityGroupsBasicOps-679056250-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1239119533" status: 202 len: 0 microversion: 2.1 time: 0.070546 Oct 17 13:14:06.005548 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2370/4904] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 17 13:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1239119533 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:06.477641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:06.478413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:06.499279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:06.500745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:06.501378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:06.502339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:06.502982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:06.503625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:06.529889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:06.531267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:06.537809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:06.549005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:06.551445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:06.552209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:06.554434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:06.554883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:06.773597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:06.789181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:06.793257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:06.794865 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e6f989b-14d6-4f1c-b0ea-5916e060223c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1273 microversion: 2.47 time: 0.268641 Oct 17 13:14:06.826505 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2371/4905] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:06 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:06.893306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:06.908307 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e39ec611-1a43-4a18-81d2-6f1621010cdc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.435141 Oct 17 13:14:06.912072 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2535/4906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:06 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:07.474300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-819930015", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "379d38e3-eed4-4313-9734-01a14db67615"}], "security_groups": [{"name": "tempest-securitygroup--1033667445"}], "key_name": "tempest-keypair-1593243049", "user_data": "}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:07.801411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] validate_networks() for [('379d38e3-eed4-4313-9734-01a14db67615', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:14:07.826355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:07.827869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:07.862263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:07.863083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:07.863712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:07.864513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:07.864975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:07.865501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:08.036547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:08.048120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:08.054251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:08.056356 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-612b7eaa-1333-4321-acfe-023992c0cf30 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1347 microversion: 2.47 time: 0.236697 Oct 17 13:14:08.066345 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2536/4907] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:07 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1347 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:08.094199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:08.097457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:08.111571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:08.115536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:08.116556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:08.117312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:08.120407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:08.121844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:08.368934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:08.380363 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-775a0786-caa4-4903-8db5-47a02ac0ee30 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.289816 Oct 17 13:14:08.381127 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2537/4908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:08 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:08.584171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:14:08.584936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:14:08.585611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:14:08.586386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:14:08.587037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:14:08.632936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:08.633492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:08.633936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:08.635585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:08.636087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:08.636518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:08.657288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:08.672758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Getting quotas for project 26f98949744c40cca4df9d331462cd0d. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:08.679995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Getting quotas for user 28c5de5f487848a8a91ab2669a81149a and project 26f98949744c40cca4df9d331462cd0d. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:08.697049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:14:08.700016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:14:08.816674 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-26c44874-e5ad-4b16-98c6-7c576b73c36e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.351693 Oct 17 13:14:08.819226 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2372/4909] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 13:14:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:14:08.831353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74414637-a641-40ec-b19a-07ea1a649c4f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:08.832443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74414637-a641-40ec-b19a-07ea1a649c4f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:08.849108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:09.038513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74414637-a641-40ec-b19a-07ea1a649c4f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:09.051854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74414637-a641-40ec-b19a-07ea1a649c4f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:09.055557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74414637-a641-40ec-b19a-07ea1a649c4f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:09.060986 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74414637-a641-40ec-b19a-07ea1a649c4f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1281 microversion: 2.20 time: 0.231218 Oct 17 13:14:09.062365 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2373/4910] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:08 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:09.096156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:09.096773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:09.105515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:09.106600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:09.107249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:09.108149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:09.108796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:09.109405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:09.203784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:09.215524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6007fb38-9fb4-45f7-8978-76f03d084d31 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Calling method '.version_select at 0x7fa820cbef70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:09.225883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:09.227962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:09.229193 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-88c5aea3-8705-4b2c-af7c-f9fbb00410b7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1335 microversion: 2.47 time: 0.136879 Oct 17 13:14:09.234865 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2374/4911] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:09 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:09.247636 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-6007fb38-9fb4-45f7-8978-76f03d084d31 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] HTTP exception thrown: Image not found. Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6007fb38-9fb4-45f7-8978-76f03d084d31 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Request method failure captured: Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/images/74a94cba-446c-420b-aba2-5c3861786bd7/metadata/os_distro HTTP/1.1 Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVUgFsxlFBL39vZX9S4WvI7NUW1jVl6DEF2HHSFMnRF8uCMi-PJxUFyyOPkEjsL8cYiJ57OTOLkCEiY_8k87Nxvf8qen5IBOLoaS8KJlHgs9_pRaK9DH66-7LqT1wWdNbiGu9pYHfOEJhmdUrtJzdEcp2bubv0yoEpc_X-GkeZEvdHk Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_821b7cfb57c1404eaac651cded87d32c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 943d135555794eb7b223c531fb359fac Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'image_id': '74a94cba-446c-420b-aba2-5c3861786bd7', 'id': 'os_distro'} Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 74a94cba-446c-420b-aba2-5c3861786bd7 Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:14:09.256053 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 74a94cba-446c-420b-aba2-5c3861786bd7 could not be found. Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6007fb38-9fb4-45f7-8978-76f03d084d31 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6007fb38-9fb4-45f7-8978-76f03d084d31 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] 10.222.0.27 "DELETE /compute/v2.1/images/74a94cba-446c-420b-aba2-5c3861786bd7/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.609576 Oct 17 13:14:09.264036 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2538/4912] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 17 13:14:08 2022] DELETE /compute/v2.1/images/74a94cba-446c-420b-aba2-5c3861786bd7/metadata/os_distro => generated 62 bytes in 611 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:14:09.276171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-054f6fb7-23ab-4e68-b6da-7ae150738fdb tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Calling method '.version_select at 0x7fa81bccb310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:09.305129 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-054f6fb7-23ab-4e68-b6da-7ae150738fdb tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] HTTP exception thrown: Image not found. Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-054f6fb7-23ab-4e68-b6da-7ae150738fdb tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Request method failure captured: Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/images/f1659cfd-080a-42cc-8ccf-782bbad8d032/metadata/os_version HTTP/1.1 Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUgFsxlFBL39vZX9S4WvI7NUW1jVl6DEF2HHSFMnRF8uCMi-PJxUFyyOPkEjsL8cYiJ57OTOLkCEiY_8k87Nxvf8qen5IBOLoaS8KJlHgs9_pRaK9DH66-7LqT1wWdNbiGu9pYHfOEJhmdUrtJzdEcp2bubv0yoEpc_X-GkeZEvdHk Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_821b7cfb57c1404eaac651cded87d32c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 943d135555794eb7b223c531fb359fac Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'image_id': 'f1659cfd-080a-42cc-8ccf-782bbad8d032', 'id': 'os_version'} Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f1659cfd-080a-42cc-8ccf-782bbad8d032 Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:14:09.309052 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1659cfd-080a-42cc-8ccf-782bbad8d032 could not be found. Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-054f6fb7-23ab-4e68-b6da-7ae150738fdb tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-054f6fb7-23ab-4e68-b6da-7ae150738fdb tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] 10.222.0.27 "GET /compute/v2.1/images/f1659cfd-080a-42cc-8ccf-782bbad8d032/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.042760 Oct 17 13:14:09.314655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2375/4913] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 17 13:14:09 2022] GET /compute/v2.1/images/f1659cfd-080a-42cc-8ccf-782bbad8d032/metadata/os_version => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:14:09.339211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81430c57-5bc9-4abd-92f9-2d948837bd28 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Calling method '.version_select at 0x7fa820873ee0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:09.367029 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-81430c57-5bc9-4abd-92f9-2d948837bd28 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] HTTP exception thrown: Image not found. Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81430c57-5bc9-4abd-92f9-2d948837bd28 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Request method failure captured: Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/images/3d0d8dff-3688-4c73-9784-969bfee937c1/metadata HTTP/1.1 Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVUgFsxlFBL39vZX9S4WvI7NUW1jVl6DEF2HHSFMnRF8uCMi-PJxUFyyOPkEjsL8cYiJ57OTOLkCEiY_8k87Nxvf8qen5IBOLoaS8KJlHgs9_pRaK9DH66-7LqT1wWdNbiGu9pYHfOEJhmdUrtJzdEcp2bubv0yoEpc_X-GkeZEvdHk Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_821b7cfb57c1404eaac651cded87d32c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 943d135555794eb7b223c531fb359fac Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: exception: Image not found. Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'image_id': '3d0d8dff-3688-4c73-9784-969bfee937c1'} Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3d0d8dff-3688-4c73-9784-969bfee937c1 Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:14:09.369319 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3d0d8dff-3688-4c73-9784-969bfee937c1 could not be found. Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81430c57-5bc9-4abd-92f9-2d948837bd28 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Returning 404 to user: Image not found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81430c57-5bc9-4abd-92f9-2d948837bd28 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] 10.222.0.27 "GET /compute/v2.1/images/3d0d8dff-3688-4c73-9784-969bfee937c1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050057 Oct 17 13:14:09.374354 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2539/4914] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:14:09 2022] GET /compute/v2.1/images/3d0d8dff-3688-4c73-9784-969bfee937c1/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:14:09.382849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0315429c-7934-40e3-b683-87be3126a1d6 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Action: 'update_all', calling method: .version_select at 0x7fa81bd75af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:09.405847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:09.406568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:09.413386 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0315429c-7934-40e3-b683-87be3126a1d6 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] HTTP exception thrown: Image not found. Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0315429c-7934-40e3-b683-87be3126a1d6 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Request method failure captured: Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: request: PUT /compute/v2.1/images/c6496933-d86f-4a4c-9c8e-92ece05fc9fc/metadata HTTP/1.1 Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 57 Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUgFsxlFBL39vZX9S4WvI7NUW1jVl6DEF2HHSFMnRF8uCMi-PJxUFyyOPkEjsL8cYiJ57OTOLkCEiY_8k87Nxvf8qen5IBOLoaS8KJlHgs9_pRaK9DH66-7LqT1wWdNbiGu9pYHfOEJhmdUrtJzdEcp2bubv0yoEpc_X-GkeZEvdHk Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_821b7cfb57c1404eaac651cded87d32c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 943d135555794eb7b223c531fb359fac Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'image_id': 'c6496933-d86f-4a4c-9c8e-92ece05fc9fc', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c6496933-d86f-4a4c-9c8e-92ece05fc9fc Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:14:09.415908 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c6496933-d86f-4a4c-9c8e-92ece05fc9fc could not be found. Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0315429c-7934-40e3-b683-87be3126a1d6 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:09.420916 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0315429c-7934-40e3-b683-87be3126a1d6 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] 10.222.0.27 "PUT /compute/v2.1/images/c6496933-d86f-4a4c-9c8e-92ece05fc9fc/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040092 Oct 17 13:14:09.425002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2376/4915] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:14:09 2022] PUT /compute/v2.1/images/c6496933-d86f-4a4c-9c8e-92ece05fc9fc/metadata => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:14:09.427574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:09.427574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:09.428001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:09.429328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5331dddd-cf8d-45aa-8a27-3ace47bd5c80 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Action: 'update', calling method: .version_select at 0x7fa81bd75280>, body: {"meta": {"os_distro": "alt"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:09.430278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:09.433265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:09.435119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:09.460313 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-5331dddd-cf8d-45aa-8a27-3ace47bd5c80 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] HTTP exception thrown: Image not found. Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5331dddd-cf8d-45aa-8a27-3ace47bd5c80 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Request method failure captured: Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: request: PUT /compute/v2.1/images/65d850bb-c30f-4c0c-be07-94d1c1bc5b28/metadata/os_distro HTTP/1.1 Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 30 Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUgFsxlFBL39vZX9S4WvI7NUW1jVl6DEF2HHSFMnRF8uCMi-PJxUFyyOPkEjsL8cYiJ57OTOLkCEiY_8k87Nxvf8qen5IBOLoaS8KJlHgs9_pRaK9DH66-7LqT1wWdNbiGu9pYHfOEJhmdUrtJzdEcp2bubv0yoEpc_X-GkeZEvdHk Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_821b7cfb57c1404eaac651cded87d32c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 943d135555794eb7b223c531fb359fac Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: {"meta": {"os_distro": "alt"}} Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'image_id': '65d850bb-c30f-4c0c-be07-94d1c1bc5b28', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 65d850bb-c30f-4c0c-be07-94d1c1bc5b28 Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:14:09.464365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65d850bb-c30f-4c0c-be07-94d1c1bc5b28 could not be found. Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5331dddd-cf8d-45aa-8a27-3ace47bd5c80 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:09.470633 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5331dddd-cf8d-45aa-8a27-3ace47bd5c80 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] 10.222.0.27 "PUT /compute/v2.1/images/65d850bb-c30f-4c0c-be07-94d1c1bc5b28/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.044032 Oct 17 13:14:09.486601 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2377/4916] 10.222.0.27 () {60 vars in 1310 bytes} [Mon Oct 17 13:14:09 2022] PUT /compute/v2.1/images/65d850bb-c30f-4c0c-be07-94d1c1bc5b28/metadata/os_distro => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:14:09.486601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0bc73064-8c46-4506-97f0-628b037029f7 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Action: 'create', calling method: .version_select at 0x7fa8204ba430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:09.526377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0bc73064-8c46-4506-97f0-628b037029f7 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] HTTP exception thrown: Image not found. Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0bc73064-8c46-4506-97f0-628b037029f7 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Request method failure captured: Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/images/177019a6-098e-492f-93ac-7a66a9197396/metadata HTTP/1.1 Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 57 Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUgFsxlFBL39vZX9S4WvI7NUW1jVl6DEF2HHSFMnRF8uCMi-PJxUFyyOPkEjsL8cYiJ57OTOLkCEiY_8k87Nxvf8qen5IBOLoaS8KJlHgs9_pRaK9DH66-7LqT1wWdNbiGu9pYHfOEJhmdUrtJzdEcp2bubv0yoEpc_X-GkeZEvdHk Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_821b7cfb57c1404eaac651cded87d32c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/821b7cfb57c1404eaac651cded87d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 821b7cfb57c1404eaac651cded87d32c Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-414609167 Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 943d135555794eb7b223c531fb359fac Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-414609167-project Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: exception: Image not found. Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'image_id': '177019a6-098e-492f-93ac-7a66a9197396', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 177019a6-098e-492f-93ac-7a66a9197396 Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:14:09.529814 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 177019a6-098e-492f-93ac-7a66a9197396 could not be found. Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:14:09.535008 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:09.545594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0bc73064-8c46-4506-97f0-628b037029f7 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] Returning 404 to user: Image not found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:09.546642 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0bc73064-8c46-4506-97f0-628b037029f7 tempest-ImagesMetadataNegativeTestJSON-414609167 tempest-ImagesMetadataNegativeTestJSON-414609167-project] 10.222.0.27 "POST /compute/v2.1/images/177019a6-098e-492f-93ac-7a66a9197396/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069179 Oct 17 13:14:09.552954 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2378/4917] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 17 13:14:09 2022] POST /compute/v2.1/images/177019a6-098e-492f-93ac-7a66a9197396/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:14:09.832010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:09.843920 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-576a75df-1ca2-4034-9fef-ba79e2665288 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.442208 Oct 17 13:14:09.844918 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2540/4918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:09 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:10.090212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:10.090902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:10.107164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.107713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.108968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.109713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.110196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.110654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.146059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39af4653-4e8a-4c5d-83cd-d8bfb2adbda9 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Action: 'create', calling method: .version_select at 0x7fa81bd9bee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1452672531", "metadata": {"Type": "work"}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39af4653-4e8a-4c5d-83cd-d8bfb2adbda9 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Request method failure captured: Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 122 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUh6y-DJ0GU45jaKGlfHo6s_24g2vTiumetA7NgVMT2lkWOHa9Le5NM25tjMpA7wz2fpx9dOXk2Gd_8TEw7gXqiWyw4ZYmVogiv95fH3tSMQxqdQ4uTqjaIaU4-TbpTHE0J_bhZvv4GlPLgBgtvZ9EKao4_vA7XYZqzUQVRMf90-W4 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cf922dea45e245e5a8697ffc366ec02d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ff38581fa67147b38aded45ff9388ec3 Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1452672531", "metadata": {"Type": "work"}}} Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1452672531', 'metadata': {'Type': 'work'}}}} Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:14:10.153128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39af4653-4e8a-4c5d-83cd-d8bfb2adbda9 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:10.158128 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-39af4653-4e8a-4c5d-83cd-d8bfb2adbda9 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.392908 Oct 17 13:14:10.161531 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2379/4919] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 17 13:14:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:14:10.167555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0e39ac06-8c2a-45aa-a010-f299aa706f4a tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Action: 'create', calling method: .version_select at 0x7fa81bd75ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-109017870", "metadata": {"Type": "work"}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0e39ac06-8c2a-45aa-a010-f299aa706f4a tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Request method failure captured: Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 119 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUh6y-DJ0GU45jaKGlfHo6s_24g2vTiumetA7NgVMT2lkWOHa9Le5NM25tjMpA7wz2fpx9dOXk2Gd_8TEw7gXqiWyw4ZYmVogiv95fH3tSMQxqdQ4uTqjaIaU4-TbpTHE0J_bhZvv4GlPLgBgtvZ9EKao4_vA7XYZqzUQVRMf90-W4 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cf922dea45e245e5a8697ffc366ec02d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ff38581fa67147b38aded45ff9388ec3 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-109017870", "metadata": {"Type": "work"}}} Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-109017870', 'metadata': {'Type': 'work'}}}} Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi '0' Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:14:10.171722 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0e39ac06-8c2a-45aa-a010-f299aa706f4a tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0e39ac06-8c2a-45aa-a010-f299aa706f4a tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010595 Oct 17 13:14:10.176682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2380/4920] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 17 13:14:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:14:10.185017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4346ac1a-30eb-45fc-95b5-2ca0f783b087 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Action: 'create', calling method: .version_select at 0x7fa81bcd3430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1821276960", "metadata": {"Type": "work"}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4346ac1a-30eb-45fc-95b5-2ca0f783b087 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Request method failure captured: Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 119 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUh6y-DJ0GU45jaKGlfHo6s_24g2vTiumetA7NgVMT2lkWOHa9Le5NM25tjMpA7wz2fpx9dOXk2Gd_8TEw7gXqiWyw4ZYmVogiv95fH3tSMQxqdQ4uTqjaIaU4-TbpTHE0J_bhZvv4GlPLgBgtvZ9EKao4_vA7XYZqzUQVRMf90-W4 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cf922dea45e245e5a8697ffc366ec02d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ff38581fa67147b38aded45ff9388ec3 Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1821276960", "metadata": {"Type": "work"}}} Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1821276960', 'metadata': {'Type': 'work'}}}} Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi '' Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:14:10.190535 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4346ac1a-30eb-45fc-95b5-2ca0f783b087 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:10.195274 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4346ac1a-30eb-45fc-95b5-2ca0f783b087 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015130 Oct 17 13:14:10.200507 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2381/4921] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 17 13:14:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:14:10.208391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5cb55c6b-a5b4-461a-be2f-3a5c8b852273 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Calling method '.version_select at 0x7fa81bd01ca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:10.225133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:10.236720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:10.238782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:10.241278 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b62be29-e2c9-4a12-89a0-3c0459663273 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1333 microversion: 2.20 time: 0.155686 Oct 17 13:14:10.242709 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2541/4922] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:10 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1333 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:10.256607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-5cb55c6b-a5b4-461a-be2f-3a5c8b852273 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] HTTP exception thrown: Volume tempest-invalid-1991498992 could not be found. Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5cb55c6b-a5b4-461a-be2f-3a5c8b852273 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Request method failure captured: Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1991498992 HTTP/1.1 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUh6y-DJ0GU45jaKGlfHo6s_24g2vTiumetA7NgVMT2lkWOHa9Le5NM25tjMpA7wz2fpx9dOXk2Gd_8TEw7gXqiWyw4ZYmVogiv95fH3tSMQxqdQ4uTqjaIaU4-TbpTHE0J_bhZvv4GlPLgBgtvZ9EKao4_vA7XYZqzUQVRMf90-W4 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cf922dea45e245e5a8697ffc366ec02d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ff38581fa67147b38aded45ff9388ec3 Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: exception: Volume tempest-invalid-1991498992 could not be found. Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'tempest-invalid-1991498992'} Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1991498992 could not be found. (HTTP 404) (Request-ID: req-49b7e2d0-7f7f-45d9-a78f-3538d564e808) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:14:10.259602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1991498992 could not be found. Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1991498992 could not be found. Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1991498992 could not be found. Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5cb55c6b-a5b4-461a-be2f-3a5c8b852273 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Returning 404 to user: Volume tempest-invalid-1991498992 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:10.264493 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5cb55c6b-a5b4-461a-be2f-3a5c8b852273 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1991498992" status: 404 len: 99 microversion: 2.1 time: 0.056885 Oct 17 13:14:10.268117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2382/4923] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 13:14:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1991498992 => generated 99 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:14:10.276724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3f9d4cc6-5f4e-44de-9eab-6177ab20c59e tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003808 Oct 17 13:14:10.279124 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2383/4924] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 17 13:14:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:14:10.284878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:10.285741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:10.294957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.295765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.296413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.297354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.298019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.298850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.299785 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-135ab859-ccfb-4e83-83df-dea305dc6356 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013213 Oct 17 13:14:10.304664 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2384/4925] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:14:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:14:10.326847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26062184-3489-4e16-b8eb-be18a508044f tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Calling method '.version_select at 0x7fa81bd75d30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:10.372404 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-26062184-3489-4e16-b8eb-be18a508044f tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] HTTP exception thrown: Volume 889af0cc-11bb-4ee7-9efe-0a5d338e5b43 could not be found. Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26062184-3489-4e16-b8eb-be18a508044f tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Request method failure captured: Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/os-volumes/889af0cc-11bb-4ee7-9efe-0a5d338e5b43 HTTP/1.1 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUh6y-DJ0GU45jaKGlfHo6s_24g2vTiumetA7NgVMT2lkWOHa9Le5NM25tjMpA7wz2fpx9dOXk2Gd_8TEw7gXqiWyw4ZYmVogiv95fH3tSMQxqdQ4uTqjaIaU4-TbpTHE0J_bhZvv4GlPLgBgtvZ9EKao4_vA7XYZqzUQVRMf90-W4 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cf922dea45e245e5a8697ffc366ec02d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ff38581fa67147b38aded45ff9388ec3 Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: exception: Volume 889af0cc-11bb-4ee7-9efe-0a5d338e5b43 could not be found. Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '889af0cc-11bb-4ee7-9efe-0a5d338e5b43'} Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 889af0cc-11bb-4ee7-9efe-0a5d338e5b43 could not be found. (HTTP 404) (Request-ID: req-2da0130e-6248-46f0-a7bb-99321428b6d1) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:14:10.374737 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 889af0cc-11bb-4ee7-9efe-0a5d338e5b43 could not be found. Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 889af0cc-11bb-4ee7-9efe-0a5d338e5b43 could not be found. Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 889af0cc-11bb-4ee7-9efe-0a5d338e5b43 could not be found. Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26062184-3489-4e16-b8eb-be18a508044f tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Returning 404 to user: Volume 889af0cc-11bb-4ee7-9efe-0a5d338e5b43 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-26062184-3489-4e16-b8eb-be18a508044f tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/889af0cc-11bb-4ee7-9efe-0a5d338e5b43" status: 404 len: 109 microversion: 2.1 time: 0.060949 Oct 17 13:14:10.379105 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2385/4926] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:14:10 2022] DELETE /compute/v2.1/os-volumes/889af0cc-11bb-4ee7-9efe-0a5d338e5b43 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:14:10.388467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-247e7531-d2ff-4678-9359-07e6e48521c8 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Calling method '.version_select at 0x7fa81bccb550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:10.426107 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-247e7531-d2ff-4678-9359-07e6e48521c8 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] HTTP exception thrown: Volume 5e89a78a-b69a-4193-9454-4b141d645342 could not be found. Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-247e7531-d2ff-4678-9359-07e6e48521c8 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Request method failure captured: Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-volumes/5e89a78a-b69a-4193-9454-4b141d645342 HTTP/1.1 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUh6y-DJ0GU45jaKGlfHo6s_24g2vTiumetA7NgVMT2lkWOHa9Le5NM25tjMpA7wz2fpx9dOXk2Gd_8TEw7gXqiWyw4ZYmVogiv95fH3tSMQxqdQ4uTqjaIaU4-TbpTHE0J_bhZvv4GlPLgBgtvZ9EKao4_vA7XYZqzUQVRMf90-W4 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cf922dea45e245e5a8697ffc366ec02d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cf922dea45e245e5a8697ffc366ec02d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: cf922dea45e245e5a8697ffc366ec02d Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesNegativeTest-1639834627 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ff38581fa67147b38aded45ff9388ec3 Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesNegativeTest-1639834627-project Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: exception: Volume 5e89a78a-b69a-4193-9454-4b141d645342 could not be found. Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5e89a78a-b69a-4193-9454-4b141d645342'} Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e89a78a-b69a-4193-9454-4b141d645342 could not be found. (HTTP 404) (Request-ID: req-a9d3696f-2b42-470b-9bd3-8c64a7572d87) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:14:10.428281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e89a78a-b69a-4193-9454-4b141d645342 could not be found. Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e89a78a-b69a-4193-9454-4b141d645342 could not be found. Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e89a78a-b69a-4193-9454-4b141d645342 could not be found. Oct 17 13:14:10.433966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:10.439328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-247e7531-d2ff-4678-9359-07e6e48521c8 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] Returning 404 to user: Volume 5e89a78a-b69a-4193-9454-4b141d645342 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:10.439328 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-247e7531-d2ff-4678-9359-07e6e48521c8 tempest-VolumesNegativeTest-1639834627 tempest-VolumesNegativeTest-1639834627-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/5e89a78a-b69a-4193-9454-4b141d645342" status: 404 len: 109 microversion: 2.1 time: 0.054539 Oct 17 13:14:10.439328 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2386/4927] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:14:10 2022] GET /compute/v2.1/os-volumes/5e89a78a-b69a-4193-9454-4b141d645342 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:14:10.448241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:10.458755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:10.460501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:10.461835 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49a15d46-5a7f-4987-91ec-67e7d26688f0 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1356 microversion: 2.47 time: 0.182001 Oct 17 13:14:10.462584 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2542/4928] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:10 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:10.490104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:10.494361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:10.504763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.505800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.506876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.512139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.513041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.513877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.627854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:14:10.634826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:14:10.636755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:14:10.637180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:14:10.637851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:14:10.801546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:10.822122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.824082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.824572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.825324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.825808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.831990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.873314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:10.874295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:10.890740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.896368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.897976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.900126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:10.904153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:10.906843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:10.944646 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a8d320a7-f3d5-489e-bb55-0904aeb1dbfa tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "POST /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df/action" status: 202 len: 1078 microversion: 2.47 time: 0.456444 Oct 17 13:14:10.949187 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2387/4929] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 13:14:10 2022] POST /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df/action => generated 1078 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 13:14:10.980585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:10.981767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:11.003530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:11.014838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:11.020960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:11.024327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:11.026418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:11.030238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:11.236288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:11.252886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:11.257467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:11.261229 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44dc2f4a-cec1-45ec-8d4b-b8e8b42e965d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.292631 Oct 17 13:14:11.263418 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2388/4930] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:10 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:11.280078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:11.281073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:11.294494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:11.296273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:11.299933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:11.300973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:11.301745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:11.304926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:11.308452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:11.319436 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea2f9cb7-5857-4f8f-b65f-6bb5482a2015 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.451422 Oct 17 13:14:11.336071 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2543/4931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:10 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:11.434997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:11.451835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:11.455490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:11.464096 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c26c947a-e99a-4569-808f-05e37f977bee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1339 microversion: 2.20 time: 0.197288 Oct 17 13:14:11.467926 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2389/4932] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:11 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1339 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:12.297280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:12.298099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:12.317707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:12.318354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:12.318645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:12.319349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:12.319982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:12.320403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:12.372518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:12.378677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:12.406424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:12.408862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:12.409326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:12.412724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:12.413239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:12.417839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:12.612985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:12.625132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:12.627793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:12.629855 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9cadb845-ee0d-4f6e-8078-c157cc59cfea tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.341820 Oct 17 13:14:12.631621 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2544/4933] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:12 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:12.637970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:12.639000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:12.651204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:12.652148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:12.653061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:12.654246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:12.659470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:12.660139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:12.793702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:12.814009 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9241c69-69ec-4222-9d7d-120f1e814834 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.465986 Oct 17 13:14:12.844350 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2390/4934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:12 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:12.967114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:12.986936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:12.991558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:12.994324 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-373ed16e-685c-4cda-8399-6e4294bbb615 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 0.359942 Oct 17 13:14:12.995712 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2545/4935] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:12 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:13.677428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:13.683068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:13.694068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:13.694973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:13.696934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:13.698096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:13.699023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:13.700367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:13.842946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:13.851682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:13.854430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:13.854656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:13.857251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:13.859004 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-53c3c19d-bea7-49f2-8d6d-43ec4e62d6f3 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.197884 Oct 17 13:14:13.869389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:13.870904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:13.871189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2391/4936] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:13 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:13.872088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:13.875793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:13.876489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:13.877258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:14.033485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:14.035856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:14.050244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:14.054853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:14.056518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:14.057502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:14.059579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:14.061202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:14.157947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:14.171001 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-76e88121-a91a-4145-87e3-f05256082189 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.327815 Oct 17 13:14:14.174590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2546/4937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:13 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:14.271516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f72542f1-81dd-4fa2-9bc5-a670648f6019 req-4e288cca-d94f-42ef-b4b4-13b44b989043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3001998-79dc-4411-aec7-cd86e6c72deb", "tag": "dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:14.294434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f72542f1-81dd-4fa2-9bc5-a670648f6019 req-4e288cca-d94f-42ef-b4b4-13b44b989043 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:14.295111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f72542f1-81dd-4fa2-9bc5-a670648f6019 req-4e288cca-d94f-42ef-b4b4-13b44b989043 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:14.295564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f72542f1-81dd-4fa2-9bc5-a670648f6019 req-4e288cca-d94f-42ef-b4b4-13b44b989043 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:14.335893 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f72542f1-81dd-4fa2-9bc5-a670648f6019 req-4e288cca-d94f-42ef-b4b4-13b44b989043 service nova] Creating event network-changed:dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e for instance f3001998-79dc-4411-aec7-cd86e6c72deb on n-h1-853316-12 Oct 17 13:14:14.363307 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f72542f1-81dd-4fa2-9bc5-a670648f6019 req-4e288cca-d94f-42ef-b4b4-13b44b989043 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095686 Oct 17 13:14:14.365659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2547/4938] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:14:14.739045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:14.757750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:14.764658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:14.765972 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-523529cb-c967-43c9-a09b-790d24e08884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 0.746920 Oct 17 13:14:14.769098 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2392/4939] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:14 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:14.890026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:14.890749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:14.918044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:14.918765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:14.920087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:14.920804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:14.921192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:14.921898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:14.948345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:15.199348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:15.200059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:15.210132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:15.214824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:15.215527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:15.216497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:15.217368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:15.217904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:15.344568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:15.359692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:15.361153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:15.362396 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da2d4e6a-596d-41cc-9bf4-4f9425bf492a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.478118 Oct 17 13:14:15.362968 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2548/4940] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:14 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:15.478450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:15.489821 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8c94c66c-debf-476d-a89d-27504605d732 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.294881 Oct 17 13:14:15.491039 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2393/4941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:15 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:15.794073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:15.794740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:15.796738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=48 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:15.810864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:15.810864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:15.811638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:15.813732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:15.815739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:15.818889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:16.261388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:16.272945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:16.278977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:16.285904 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd8230f5-94ad-4a07-8343-c3117132efdd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 0.496730 Oct 17 13:14:16.286806 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2549/4942] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:15 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:16.389937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:16.390588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:16.399573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:16.400590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:16.401744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:16.402688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:16.403318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:16.403917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:16.515398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:16.516757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:16.525551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:16.529772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:16.531067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:16.531995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:16.533483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:16.534286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:16.569462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:16.589016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:16.594371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:16.599814 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc023cc1-0ff6-4982-a687-45b15e67a52e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.212673 Oct 17 13:14:16.601871 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2394/4943] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:16 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:16.866111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:16.887324 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-844c84cc-01cc-4a90-98d2-0854bdf53fee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.363170 Oct 17 13:14:16.890733 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2550/4944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:16 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:17.316305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:17.317053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:17.332689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:17.336889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:17.340789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:17.344431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:17.349226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:17.350677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:17.632263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:17.633842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:17.658471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:17.659446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:17.660125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:17.661179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:17.661896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:17.662624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:17.903144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:17.920059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:17.923420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:17.925275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:17.927572 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a53253d6-ce69-4eb4-b6bf-d575eca6545f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 0.615463 Oct 17 13:14:17.930863 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2395/4945] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:17 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:17.932231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:17.938710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:17.941727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:17.942227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:17.942427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:17.944263 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7aaff34-9f3b-4ce4-8107-23a7d68e4714 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.316815 Oct 17 13:14:17.952244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:17.953025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:17.953996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:17.954990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:17.956065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:17.956666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:17.963803 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2551/4946] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:17 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:18.345824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:18.359318 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e1b226ce-4a3f-4a65-bd8a-13e4c1bd8d5f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.427202 Oct 17 13:14:18.364085 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2396/4947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:17 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:18.977086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:18.980322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:18.984873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:18.987935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:19.017380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:19.017940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:19.020023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:19.020897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:19.021273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:19.025133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:19.031226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:19.048189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=16 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:19.056021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:19.057767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:19.058519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:19.060021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:19.060929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:19.062128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:19.187799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:19.206460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:19.210412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:19.216528 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1acb13d8-0cb6-4fe9-ac6d-22ef102c0b7d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.242195 Oct 17 13:14:19.219665 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2397/4948] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:18 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:19.394180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:19.401414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:19.423206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:19.424119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:19.427001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:19.434113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:19.445287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:19.451606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:19.816591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:19.828821 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4d451396-0092-4924-8309-93c10b29268d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.447441 Oct 17 13:14:19.830228 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2398/4949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:19 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:20.057427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:20.068481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:20.070473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:20.072536 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7dd5395f-8183-4cd6-b0a6-e59ba0c298ca tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 1.117408 Oct 17 13:14:20.073299 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2552/4950] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:18 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:20.249650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:20.250371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:20.261089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:20.261585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:20.262053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:20.262805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:20.263260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:20.263684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:20.398360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:20.415218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:20.421377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:20.422672 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2b9f5c2c-81ef-4302-b68f-bf16f5d776bd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.177492 Oct 17 13:14:20.423256 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2399/4951] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:20 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:20.853913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:20.854907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:20.861707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:20.872165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:20.873201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:20.874541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:20.875305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:20.875745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:21.101291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:21.102457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:21.114851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:21.116906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:21.134634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:21.141295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:21.142682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:21.143140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:21.214502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:21.368687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:21.377224 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01cfc8da-62ae-43a6-925a-b63ef727ad09 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.527962 Oct 17 13:14:21.377823 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2553/4952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:20 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:21.453211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:21.453823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:21.460923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:21.469580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:21.470073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:21.470660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:21.473869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:21.477356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:21.480189 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ced6477-b466-412d-b64c-ceea9b89c658 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 0.384258 Oct 17 13:14:21.480345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:21.480748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:21.481250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:21.501757 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2400/4953] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:21 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:21.766333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:21.785867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:21.795980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:21.799566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae8c82b3-9374-4aa0-82cf-91d23da58430 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.347754 Oct 17 13:14:21.800825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2554/4954] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:21 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:22.407589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:22.408739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:22.428550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:22.429212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:22.431856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:22.441364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:22.441364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:22.441364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:22.621231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4260265-f9da-41da-95a2-1c27a528f4a0 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa81bccbca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-270589487", "description": "tempest-description-662675168"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:22.705100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:22.722412 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31c71b53-8ac6-4e55-8b35-792a87d43adb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.319494 Oct 17 13:14:22.730619 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2555/4955] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:22 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:22.743567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:22.744212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:22.760084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:22.760714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:22.761177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:22.762090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:22.762599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:22.763037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:23.053854 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4260265-f9da-41da-95a2-1c27a528f4a0 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.909254 Oct 17 13:14:23.056056 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2401/4956] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:14:22 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:23.076684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:23.079626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:23.096407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:23.097172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:23.098847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:23.102676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:23.103677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:23.104601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:23.140087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:23.164533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:23.174639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:23.175985 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-190acd1d-a927-49b4-a9fa-14b1f2cf7767 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 0.443743 Oct 17 13:14:23.181742 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2556/4957] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:22 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:23.191319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-64ee705c-1f9f-42c8-85db-eb89a4d17fa7 req-60ccc831-b6f8-4080-ba05-8efb729921ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3001998-79dc-4411-aec7-cd86e6c72deb", "name": "network-vif-plugged", "status": "completed", "tag": "dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:23.204812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-64ee705c-1f9f-42c8-85db-eb89a4d17fa7 req-60ccc831-b6f8-4080-ba05-8efb729921ff service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:23.206131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-64ee705c-1f9f-42c8-85db-eb89a4d17fa7 req-60ccc831-b6f8-4080-ba05-8efb729921ff service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:23.206564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-64ee705c-1f9f-42c8-85db-eb89a4d17fa7 req-60ccc831-b6f8-4080-ba05-8efb729921ff service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:23.228879 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-64ee705c-1f9f-42c8-85db-eb89a4d17fa7 req-60ccc831-b6f8-4080-ba05-8efb729921ff service nova] Creating event network-vif-plugged:dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e for instance f3001998-79dc-4411-aec7-cd86e6c72deb on n-h1-853316-12 Oct 17 13:14:23.238059 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-64ee705c-1f9f-42c8-85db-eb89a4d17fa7 req-60ccc831-b6f8-4080-ba05-8efb729921ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053675 Oct 17 13:14:23.239620 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2557/4958] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:23.254350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14e11c49-f5fe-46b8-be47-189b3c207eaa tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa8208e0820>, body: {"security_group_rule": {"parent_group_id": "e3c5a218-ed16-45d6-8e23-9ab61f66fb30", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:23.269798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:23.282224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:23.285866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:23.288655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-960dacc6-67f2-4844-8415-9a1d5ac773da tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.230534 Oct 17 13:14:23.289882 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2402/4959] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:23 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:23.637176 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-14e11c49-f5fe-46b8-be47-189b3c207eaa tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.395603 Oct 17 13:14:23.639653 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2558/4960] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:14:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:23.652869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb39a739-1e39-4aca-b9a6-c8939f70f4e3 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa81bccbca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2040397584", "description": "tempest-description-707648227"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:23.752842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:23.753971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:23.767060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:23.767818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:23.768755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:23.771033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:23.772918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:23.774381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:23.926548 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb39a739-1e39-4aca-b9a6-c8939f70f4e3 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.277437 Oct 17 13:14:23.927402 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2403/4961] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:14:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:23.941720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4bc39bbf-5b8b-4a8f-b056-06a3b2a7ed2c tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa81bca33a0>, body: {"security_group_rule": {"parent_group_id": "8a862cfa-ced8-48a9-b59f-126dd69f7c8c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:24.183873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:24.193839 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f4e923b-847e-4e8a-a335-a9814026b364 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1698 microversion: 2.1 time: 0.445440 Oct 17 13:14:24.194891 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2559/4962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:23 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1698 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:24.210034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:24.212083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:24.225476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:24.226398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:24.227823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:24.229341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:24.230023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:24.230724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:24.349935 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4bc39bbf-5b8b-4a8f-b056-06a3b2a7ed2c tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.412147 Oct 17 13:14:24.363938 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2404/4963] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:14:23 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:14:24.374774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:24.375494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:24.385752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:24.386659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:24.387685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:24.388586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:24.389219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:24.389962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:24.525350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:24.549109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:24.556975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:24.558445 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4c6a75b6-cd7a-471d-bbaf-85f9a671b134 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.191086 Oct 17 13:14:24.568094 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2405/4964] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:24 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:24.574887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fecf66f4-5e58-4f3e-bf40-e67adcb80251 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa81bdf7040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1735004449", "description": "tempest-description-473175133"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:24.681434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:24.731700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:24.738034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:24.739691 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff818286-7e9c-43ff-8fac-bf57efa23334 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 0.534693 Oct 17 13:14:24.743437 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2560/4965] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:24 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:25.037795 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fecf66f4-5e58-4f3e-bf40-e67adcb80251 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.469600 Oct 17 13:14:25.046371 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2406/4966] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:14:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:25.066377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f0f9bc0-eb85-4d63-8111-bdfcedfefffe tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa820d3bee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1888696932", "description": "tempest-description-1672072278"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:25.226364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:25.227810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:25.241346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:25.241896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:25.243633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:25.244745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:25.246899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:25.248019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:25.378228 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f0f9bc0-eb85-4d63-8111-bdfcedfefffe tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.316296 Oct 17 13:14:25.378899 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2561/4967] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:14:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:25.395175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0fef3e99-ba66-4d3d-a344-26e498516e22 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa8208e0ee0>, body: {"security_group_rule": {"parent_group_id": "ed1b453b-d7d4-4de3-8b2e-9d1ee3ed5826", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d9f88612-914c-45ad-86f4-870adb11b542"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:25.663827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:25.695484 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-24522515-47d3-4e77-a57f-b704cd1722ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1697 microversion: 2.1 time: 0.475051 Oct 17 13:14:25.697315 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2407/4968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:25 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1697 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:25.707685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:25.710935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:25.726303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:25.729232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:25.730102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:25.731179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:25.734684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:25.735574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:25.890337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:25.907212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:25.919910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:25.921223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3607a764-93d7-4d53-b4eb-5e35bdb59fd4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.219650 Oct 17 13:14:25.921839 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2408/4969] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:25 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:25.926904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:25.931057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:25.940456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:25.941236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:25.942522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:25.943417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:25.944088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:25.944690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:26.241978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0fef3e99-ba66-4d3d-a344-26e498516e22 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.853294 Oct 17 13:14:26.247971 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2562/4970] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:14:25 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:26.268012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f238e42-93ca-47bd-acbf-da2286a2d89a tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa82096a550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1431449827", "description": "tempest-description-205345641"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:26.277310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:26.292754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:26.294558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:26.295952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff83b6e1-ed13-4147-920c-12a16350ebee tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1407 microversion: 2.20 time: 0.372906 Oct 17 13:14:26.315597 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2409/4971] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:25 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:26.659936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e7fbb6cd-33df-40f8-97c2-b8a9dc6b58f0 req-7ede8d30-fd54-4e75-b475-6bbe30138a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "name": "network-vif-unplugged", "status": "completed", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:26.678586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7fbb6cd-33df-40f8-97c2-b8a9dc6b58f0 req-7ede8d30-fd54-4e75-b475-6bbe30138a43 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:26.679433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7fbb6cd-33df-40f8-97c2-b8a9dc6b58f0 req-7ede8d30-fd54-4e75-b475-6bbe30138a43 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:26.680361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7fbb6cd-33df-40f8-97c2-b8a9dc6b58f0 req-7ede8d30-fd54-4e75-b475-6bbe30138a43 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:26.698376 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e7fbb6cd-33df-40f8-97c2-b8a9dc6b58f0 req-7ede8d30-fd54-4e75-b475-6bbe30138a43 service nova] Creating event network-vif-unplugged:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h2-853316-12 Oct 17 13:14:26.712856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-e7fbb6cd-33df-40f8-97c2-b8a9dc6b58f0 req-7ede8d30-fd54-4e75-b475-6bbe30138a43 service nova] Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:14:26.739578 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e7fbb6cd-33df-40f8-97c2-b8a9dc6b58f0 req-7ede8d30-fd54-4e75-b475-6bbe30138a43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083214 Oct 17 13:14:26.741094 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2410/4972] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:14:26.751187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:26.752787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:26.767958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:26.768701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:26.769342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:26.770508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:26.771150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:26.772950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:26.893117 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f238e42-93ca-47bd-acbf-da2286a2d89a tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.633189 Oct 17 13:14:26.894073 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2563/4973] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:14:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:26.908949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56e211b1-743d-4b29-b073-bb079801816a tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa820d3b670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1870404188", "description": "tempest-description-548346017"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:27.223535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:27.225684 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56e211b1-743d-4b29-b073-bb079801816a tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.321567 Oct 17 13:14:27.226625 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2564/4974] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:14:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:27.251673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:27.253879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:27.257669 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-edb92d3a-043f-4339-873a-983a266208a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1697 microversion: 2.1 time: 0.514091 Oct 17 13:14:27.264051 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2411/4975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:26 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1697 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:27.269026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:27.269893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:27.270620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:27.271530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:27.272148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:27.272798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:27.283103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0fdf6705-9d68-4929-ad5c-1c4b07fe61f5 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa81bd75550>, body: {"security_group_rule": {"parent_group_id": "73748e37-1ddb-40b6-bb78-a788369c5639", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "89b3de09-9fae-4bfc-a650-50b8aed6f601"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:27.454347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:27.478948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:27.481036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:27.488611 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3ee863b-7745-4639-9b18-07ad07445080 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.245660 Oct 17 13:14:27.492960 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2565/4976] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:27 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:27.519225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:27.520252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:27.529502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:27.530347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:27.531040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:27.532101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:27.532765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:27.533390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:27.963728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:27.987191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:27.991165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:27.996680 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c59ba8eb-1f1c-40b3-8bb5-9dc34038a17c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1600 microversion: 2.20 time: 0.487437 Oct 17 13:14:27.999243 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2566/4977] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:27 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1600 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:28.032089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:28.032619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:28.056979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:28.058457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:28.060355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:28.062257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:28.063934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:28.064596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:28.402272 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0fdf6705-9d68-4929-ad5c-1c4b07fe61f5 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.135388 Oct 17 13:14:28.403667 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2412/4978] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:14:27 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:28.409691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:28.413912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:28.429362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:28.435143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:28.439822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:28.440599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:28.441362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:28.441800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:28.491902 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be57fe38-6ac9-4851-87a3-2bd99f3ef480 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.466610 Oct 17 13:14:28.501799 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2567/4979] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 13:14:28 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-interface => generated 285 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:14:28.504749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d44a0246-9fc3-4795-9582-1a90beb692fb tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa82091bd30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:28.972239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:28.983388 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-66c1707f-1468-46d4-a385-e34c3b3dff55 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1697 microversion: 2.1 time: 0.577370 Oct 17 13:14:28.998716 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2413/4980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:28 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1697 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:29.006883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:29.007845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:29.015042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:29.015845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:29.016495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:29.017648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:29.018392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:29.019099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:29.133468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:29.142131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:29.145026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:29.146289 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1788e63d-2b61-4896-9e20-ecc8c5090d87 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.146377 Oct 17 13:14:29.158123 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2414/4981] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:28 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:29.168788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9134b0b2-c66f-4a60-8e18-f855465de5e1 req-b1dc0c56-9f7a-44df-a8c5-dffb7c4d57d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:29.179219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9134b0b2-c66f-4a60-8e18-f855465de5e1 req-b1dc0c56-9f7a-44df-a8c5-dffb7c4d57d8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:29.179708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9134b0b2-c66f-4a60-8e18-f855465de5e1 req-b1dc0c56-9f7a-44df-a8c5-dffb7c4d57d8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:29.180739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9134b0b2-c66f-4a60-8e18-f855465de5e1 req-b1dc0c56-9f7a-44df-a8c5-dffb7c4d57d8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:29.196553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9134b0b2-c66f-4a60-8e18-f855465de5e1 req-b1dc0c56-9f7a-44df-a8c5-dffb7c4d57d8 service nova] Creating event network-changed:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h2-853316-12 Oct 17 13:14:29.204082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-9134b0b2-c66f-4a60-8e18-f855465de5e1 req-b1dc0c56-9f7a-44df-a8c5-dffb7c4d57d8 service nova] Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:14:29.221613 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9134b0b2-c66f-4a60-8e18-f855465de5e1 req-b1dc0c56-9f7a-44df-a8c5-dffb7c4d57d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060414 Oct 17 13:14:29.223305 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2415/4982] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:30.012167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:30.012880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:30.022479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:30.023159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:30.026380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:30.027416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:30.028009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:30.028555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:30.224509 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d44a0246-9fc3-4795-9582-1a90beb692fb tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/89b3de09-9fae-4bfc-a650-50b8aed6f601" status: 202 len: 0 microversion: 2.1 time: 1.724532 Oct 17 13:14:30.230573 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2568/4983] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:14:28 2022] DELETE /compute/v2.1/os-security-groups/89b3de09-9fae-4bfc-a650-50b8aed6f601 => generated 0 bytes in 1732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:30.239615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:30.240380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:30.255401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:30.257583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:30.258054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:30.259021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:30.262570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:30.263676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:30.471985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:30.488924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:30.490442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:30.491786 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2d7dd3fb-05c1-4aa4-a2d4-931bbb58ae9f tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.260181 Oct 17 13:14:30.499808 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2569/4984] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:30 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:30.505196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-774792ce-5654-462b-a8ed-19c26505e492 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa8201cd1f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:30.652103 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-774792ce-5654-462b-a8ed-19c26505e492 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/73748e37-1ddb-40b6-bb78-a788369c5639" status: 200 len: 247 microversion: 2.1 time: 0.149979 Oct 17 13:14:30.654713 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2570/4985] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 13:14:30 2022] GET /compute/v2.1/os-security-groups/73748e37-1ddb-40b6-bb78-a788369c5639 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:30.673786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bfc7a3d-2390-41d5-9c36-37d542376e82 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa8209509d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1968335529", "description": "tempest-description-1166043492"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:30.829824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:30.844830 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a2c8a296-1682-470e-ac24-6b0e0762e7dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1695 microversion: 2.1 time: 0.836143 Oct 17 13:14:30.863235 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2416/4986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:30 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1695 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:31.322017 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9bfc7a3d-2390-41d5-9c36-37d542376e82 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.653019 Oct 17 13:14:31.344852 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2571/4987] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 17 13:14:30 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:31.350360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-211f42aa-1a08-425e-85d6-f511585a107e tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa81bc95790>, body: {"security_group_rule": {"parent_group_id": "5452a64e-7991-42eb-b5e3-08b86d32e127", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:31.381976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c60568ca-73f1-4272-ba4f-99b781eb0f8c req-91409d63-3e04-4792-8137-a01c3b56658e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3001998-79dc-4411-aec7-cd86e6c72deb", "tag": "dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:31.394926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c60568ca-73f1-4272-ba4f-99b781eb0f8c req-91409d63-3e04-4792-8137-a01c3b56658e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:31.396307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c60568ca-73f1-4272-ba4f-99b781eb0f8c req-91409d63-3e04-4792-8137-a01c3b56658e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:31.397027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c60568ca-73f1-4272-ba4f-99b781eb0f8c req-91409d63-3e04-4792-8137-a01c3b56658e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:31.412483 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c60568ca-73f1-4272-ba4f-99b781eb0f8c req-91409d63-3e04-4792-8137-a01c3b56658e service nova] Creating event network-changed:dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e for instance f3001998-79dc-4411-aec7-cd86e6c72deb on n-h1-853316-12 Oct 17 13:14:31.420054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c60568ca-73f1-4272-ba4f-99b781eb0f8c req-91409d63-3e04-4792-8137-a01c3b56658e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041337 Oct 17 13:14:31.427140 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2572/4988] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:14:31.533371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:31.534208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:31.558045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:31.559369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:31.560125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:31.561483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:31.562414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:31.563207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:31.685641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:31.697291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:31.699402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:31.700828 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e71be7f7-d9f3-4aa4-a038-b87a8573b1ad tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.173505 Oct 17 13:14:31.701912 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2573/4989] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:31 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:31.875062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:31.875955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:31.888277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:31.891370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:31.892094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:31.893146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:31.895097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:31.895817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:32.099345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:32.109006 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9417098e-6b3d-45ec-8c7d-455d1f89aed3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1692 microversion: 2.1 time: 0.239527 Oct 17 13:14:32.109606 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2574/4990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:31 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1692 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:32.149393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:32.153960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:32.176342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:32.177593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:32.179610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:32.183271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:32.184614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:32.186585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:32.408763 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6079a7c9-a762-425e-a273-898e6b28ee94 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action" status: 202 len: 0 microversion: 2.1 time: 0.270952 Oct 17 13:14:32.416309 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2575/4991] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:14:32 2022] POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:32.432665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:32.433772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:32.448290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:32.448795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:32.449509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:32.452735 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-211f42aa-1a08-425e-85d6-f511585a107e tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.114587 Oct 17 13:14:32.462705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:32.462969 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2417/4992] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:14:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:32.463272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:32.463995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:32.476195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4b3a4d87-a4df-41c3-b139-9ac9679b07a2 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Action: 'create', calling method: .version_select at 0x7fa81bcbc310>, body: {"security_group_rule": {"parent_group_id": "5452a64e-7991-42eb-b5e3-08b86d32e127", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:32.529339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:32.799820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:32.808650 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d706ad2a-3948-4516-b55f-e07017c9e3a0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.390918 Oct 17 13:14:32.809254 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2576/4993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:32 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:32.826600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:32.827584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:32.848137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:32.848939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:32.849380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:32.850182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:32.850662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:32.851074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:33.012645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:33.025790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:33.031150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:33.032471 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad51670f-8952-4678-8c5e-7f1e77af9096 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.222265 Oct 17 13:14:33.033060 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2577/4994] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:32 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:33.655637 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4b3a4d87-a4df-41c3-b139-9ac9679b07a2 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.190776 Oct 17 13:14:33.657090 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2418/4995] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 17 13:14:32 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:33.670868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1aee80f2-91c8-4f45-b63d-3a7f8cf84fcf tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa8208e0820>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:33.799316 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1aee80f2-91c8-4f45-b63d-3a7f8cf84fcf tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/5452a64e-7991-42eb-b5e3-08b86d32e127" status: 200 len: 665 microversion: 2.1 time: 0.132879 Oct 17 13:14:33.811411 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2578/4996] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 13:14:33 2022] GET /compute/v2.1/os-security-groups/5452a64e-7991-42eb-b5e3-08b86d32e127 => generated 665 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:33.814928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c903bd7f-145b-4465-a559-0e23b478f607 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa81bc955e0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:33.838050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:33.838833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:33.848025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:33.848500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:33.848933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:33.849651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:33.850100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:33.850552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:34.110100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:34.127357 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd564d20-801b-4041-9245-52786b813935 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.291343 Oct 17 13:14:34.129089 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2579/4997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:33 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:34.140628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:34.141580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:34.151724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:34.153592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:34.155388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:34.156315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:34.159374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:34.161588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:34.292563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:34.302497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:34.306009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:34.307672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4403b47e-13e7-4d78-8409-9c5bd2f12af7 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.177297 Oct 17 13:14:34.308434 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2580/4998] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:34 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:34.409004 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c903bd7f-145b-4465-a559-0e23b478f607 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/22b176fa-2db7-4db6-8a0b-d01dec35c94e" status: 202 len: 0 microversion: 2.1 time: 0.598020 Oct 17 13:14:34.409597 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2419/4999] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 17 13:14:33 2022] DELETE /compute/v2.1/os-security-group-rules/22b176fa-2db7-4db6-8a0b-d01dec35c94e => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:34.419677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ab5fde1-e28c-4bfa-802c-9a20c8447102 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa82096aa60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:34.610620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:34.612986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:34.629849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:34.630786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:34.632026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:34.633114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:34.633923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:34.634562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:34.803578 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ab5fde1-e28c-4bfa-802c-9a20c8447102 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5452a64e-7991-42eb-b5e3-08b86d32e127" status: 202 len: 0 microversion: 2.1 time: 0.387989 Oct 17 13:14:34.814426 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2581/5000] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:14:34 2022] DELETE /compute/v2.1/os-security-groups/5452a64e-7991-42eb-b5e3-08b86d32e127 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:34.832194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-917466ef-3505-4df2-b810-1b6b24b1c834 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa82092a670>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:34.850871 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-781aaa94-fae1-40af-a585-8ed3b2c3f573 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.222473 Oct 17 13:14:34.851617 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2420/5001] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:14:34 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:14:34.863990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:34.864707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:34.875138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:34.875638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:34.878619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:34.880143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:34.883631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:34.886931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:34.890886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG neutronclient.v2_0.client [None req-917466ef-3505-4df2-b810-1b6b24b1c834 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 does not exist", "detail": ""}} {{(pid=127540) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:14:34.891697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-917466ef-3505-4df2-b810-1b6b24b1c834 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Neutron security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 not found {{(pid=127540) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:14:34.892520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-917466ef-3505-4df2-b810-1b6b24b1c834 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] HTTP exception thrown: Security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 does not exist Oct 17 13:14:34.892520 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-61910867-1da2-4f9c-9700-dbd14a9e9410'] Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-917466ef-3505-4df2-b810-1b6b24b1c834 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Request method failure captured: Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-security-groups/89b3de09-9fae-4bfc-a650-50b8aed6f601 HTTP/1.1 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVUuBdt0F_3FP3zfodEKjXWlFpXXKLbzQeDwAesAXTXSnTjSrPAcqBhnALk4B-XxuHZrOXAu-ySD2tj3DWh2vtB28naG2HnLx46mBLhCXcdGUhEzx_A9jt4dUnDVOjnjCBNHULlwqhDTH2s6WK2r8QmVicyyy3RUCClcKNAiMhPVWPc Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a45e1033ef854118ab31d652308de670 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-990863137 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a45e1033ef854118ab31d652308de670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a45e1033ef854118ab31d652308de670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a45e1033ef854118ab31d652308de670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a45e1033ef854118ab31d652308de670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-SecurityGroupRulesTestJSON-990863137 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a45e1033ef854118ab31d652308de670 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-990863137 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-SecurityGroupRulesTestJSON-990863137-project Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f677d8a030474b068383bcaf92e99026 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-SecurityGroupRulesTestJSON-990863137-project Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: exception: Security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 does not exist Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-61910867-1da2-4f9c-9700-dbd14a9e9410'] Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '89b3de09-9fae-4bfc-a650-50b8aed6f601'} Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:14:34.895245 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 does not exist Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61910867-1da2-4f9c-9700-dbd14a9e9410'] Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 does not exist Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61910867-1da2-4f9c-9700-dbd14a9e9410'] Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 does not exist Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61910867-1da2-4f9c-9700-dbd14a9e9410'] Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 does not exist Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61910867-1da2-4f9c-9700-dbd14a9e9410'] Oct 17 13:14:34.900503 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:34.906495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-917466ef-3505-4df2-b810-1b6b24b1c834 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Returning 404 to user: Security group 89b3de09-9fae-4bfc-a650-50b8aed6f601 does not exist Oct 17 13:14:34.906495 n-d-853316-12 devstack@n-api.service[127540]: Neutron server returns request_ids: ['req-61910867-1da2-4f9c-9700-dbd14a9e9410'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:34.906495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-917466ef-3505-4df2-b810-1b6b24b1c834 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/89b3de09-9fae-4bfc-a650-50b8aed6f601" status: 404 len: 194 microversion: 2.1 time: 0.087168 Oct 17 13:14:34.907313 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2582/5002] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:14:34 2022] DELETE /compute/v2.1/os-security-groups/89b3de09-9fae-4bfc-a650-50b8aed6f601 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:14:34.931380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d6afbec-50a4-4a93-bc41-a9646cc88fe1 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa820a783a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:35.172520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d6afbec-50a4-4a93-bc41-a9646cc88fe1 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/73748e37-1ddb-40b6-bb78-a788369c5639" status: 202 len: 0 microversion: 2.1 time: 0.261691 Oct 17 13:14:35.173963 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2583/5003] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:14:34 2022] DELETE /compute/v2.1/os-security-groups/73748e37-1ddb-40b6-bb78-a788369c5639 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:35.182245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:35.183260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:35.189899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:35.190900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:35.191533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:35.194331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:35.195234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:35.202137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:35.422425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:35.459218 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-305342f1-10cd-4434-ad91-0860fe9188de tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.283938 Oct 17 13:14:35.464776 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2584/5004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:35 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:35.494473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b6dacba-ca90-45b3-bf7c-0129d95abed1 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa82091b3a0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:35.550436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:35.559509 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee2f7e41-9d97-4262-8639-f7a7a28360da tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1668 microversion: 2.1 time: 0.699727 Oct 17 13:14:35.563786 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2421/5005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:34 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1668 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:35.569587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:35.570694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:35.577365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:35.581106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:35.581767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:35.587458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:35.588329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:35.588962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:35.760007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:35.770857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:35.772332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:35.773548 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f30e1259-0bb3-4a01-a6e3-6300ccbe7513 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.208544 Oct 17 13:14:35.775765 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2422/5006] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:35 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:35.781226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6f3b65c2-89d4-45c0-bef3-ba8ec71f0b81 req-e70416f7-6545-4e7a-bbdf-05cf46b71db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "name": "network-vif-plugged", "status": "completed", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:35.815101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f3b65c2-89d4-45c0-bef3-ba8ec71f0b81 req-e70416f7-6545-4e7a-bbdf-05cf46b71db4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:35.815594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f3b65c2-89d4-45c0-bef3-ba8ec71f0b81 req-e70416f7-6545-4e7a-bbdf-05cf46b71db4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:35.816034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f3b65c2-89d4-45c0-bef3-ba8ec71f0b81 req-e70416f7-6545-4e7a-bbdf-05cf46b71db4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:35.832059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6f3b65c2-89d4-45c0-bef3-ba8ec71f0b81 req-e70416f7-6545-4e7a-bbdf-05cf46b71db4 service nova] Creating event network-vif-plugged:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h2-853316-12 Oct 17 13:14:35.835303 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b6dacba-ca90-45b3-bf7c-0129d95abed1 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d9f88612-914c-45ad-86f4-870adb11b542" status: 202 len: 0 microversion: 2.1 time: 0.355197 Oct 17 13:14:35.836186 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2585/5007] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:14:35 2022] DELETE /compute/v2.1/os-security-groups/d9f88612-914c-45ad-86f4-870adb11b542 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:35.841109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-6f3b65c2-89d4-45c0-bef3-ba8ec71f0b81 req-e70416f7-6545-4e7a-bbdf-05cf46b71db4 service nova] Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:14:35.847780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0613bbd-bcbd-4cb5-82c9-da62e37fc395 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa82008fca0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:35.875674 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6f3b65c2-89d4-45c0-bef3-ba8ec71f0b81 req-e70416f7-6545-4e7a-bbdf-05cf46b71db4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098273 Oct 17 13:14:35.877000 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2423/5008] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:36.147820 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0613bbd-bcbd-4cb5-82c9-da62e37fc395 tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ed1b453b-d7d4-4de3-8b2e-9d1ee3ed5826" status: 202 len: 0 microversion: 2.1 time: 0.306695 Oct 17 13:14:36.151784 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2586/5009] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:14:35 2022] DELETE /compute/v2.1/os-security-groups/ed1b453b-d7d4-4de3-8b2e-9d1ee3ed5826 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:36.161783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84987b5e-254f-4254-82cb-c45fd04ffa8d tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa81bcd3430>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:36.490979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:36.491813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:36.500955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=86 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:36.505274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:36.510810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:36.511363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:36.512383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:36.513383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:36.513936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:36.734625 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84987b5e-254f-4254-82cb-c45fd04ffa8d tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8a862cfa-ced8-48a9-b59f-126dd69f7c8c" status: 202 len: 0 microversion: 2.1 time: 0.577725 Oct 17 13:14:36.736165 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2424/5010] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:14:36 2022] DELETE /compute/v2.1/os-security-groups/8a862cfa-ced8-48a9-b59f-126dd69f7c8c => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:14:36.744330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:36.745479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:36.759420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:36.760185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:36.760631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:36.761313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:36.762292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:36.762959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:36.763595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:36.787940 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2914e22c-0b7c-4c82-a216-ca2cbec9d19e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.300021 Oct 17 13:14:36.790209 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2587/5011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:36 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:36.798801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01773c82-5fa4-47b6-8cbb-68e022418efa tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] Calling method '.version_select at 0x7fa82008f790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:37.060958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:37.087526 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ed793bf-d546-43b4-bffc-0eecb3499583 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1673 microversion: 2.1 time: 0.348572 Oct 17 13:14:37.098681 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2425/5012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:36 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1673 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:37.099301 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01773c82-5fa4-47b6-8cbb-68e022418efa tempest-SecurityGroupRulesTestJSON-990863137 tempest-SecurityGroupRulesTestJSON-990863137-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e3c5a218-ed16-45d6-8e23-9ab61f66fb30" status: 202 len: 0 microversion: 2.1 time: 0.306983 Oct 17 13:14:37.100784 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2588/5013] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:14:36 2022] DELETE /compute/v2.1/os-security-groups/e3c5a218-ed16-45d6-8e23-9ab61f66fb30 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:14:37.105523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:37.106248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:37.140575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:37.142302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:37.142834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:37.143741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:37.144296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:37.147553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:37.167230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:37.343206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:37.356854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:37.358475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:37.359712 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-287b8ae9-26f7-433f-8222-0adebeae624d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1365 microversion: 2.47 time: 0.258982 Oct 17 13:14:37.362915 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2426/5014] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:37 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:37.491185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-463c25da-6273-4eb5-b192-45e6c6788085 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:37.493414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463c25da-6273-4eb5-b192-45e6c6788085 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:37.494000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463c25da-6273-4eb5-b192-45e6c6788085 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:37.494510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463c25da-6273-4eb5-b192-45e6c6788085 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:37.495254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463c25da-6273-4eb5-b192-45e6c6788085 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:37.496147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463c25da-6273-4eb5-b192-45e6c6788085 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:37.496147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-463c25da-6273-4eb5-b192-45e6c6788085 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:37.574099 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-463c25da-6273-4eb5-b192-45e6c6788085 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.266522 Oct 17 13:14:37.575841 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2589/5015] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 17 13:14:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:37.737185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2123027687", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "availability_zone": "nova:n-h2-853316-12", "networks": [{"uuid": "90197976-6c9a-4290-80ec-61aed614c2fe"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:37.811650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] validate_networks() for [('90197976-6c9a-4290-80ec-61aed614c2fe', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:14:37.816829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:37.817743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:37.831857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:37.832384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:37.833050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:37.834612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:37.835819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:37.836880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:38.070876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:38.090629 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9d7a14ee-0749-4477-bfdf-85c0fc9db6cc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.277107 Oct 17 13:14:38.109784 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2590/5016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:37 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:38.118543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:38.119807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:38.127352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:38.128003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:38.128457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:38.129842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:38.130514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:38.130956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:38.353646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:38.368732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a5aba0e-ace6-47dd-ba22-818337037a04 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.256197 Oct 17 13:14:38.388274 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2591/5017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:38 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:38.396943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:38.399282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:38.411895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:38.412631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:38.413277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:38.414234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:38.415656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:38.416390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:38.500648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:38.511067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:38.512980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:38.514846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dbb32edd-ff15-44b4-9632-17f88140d341 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1371 microversion: 2.47 time: 0.125067 Oct 17 13:14:38.515576 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2592/5018] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:38 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:38.682225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:14:38.683389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:14:38.684038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:14:38.685493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:14:38.685917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:14:38.703006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:38.704171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:38.704782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:38.706028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:38.706693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:38.707291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:38.733727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Getting quotas for project 7747e464a94d42539f47b1483f0ba8eb. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:38.740426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Getting quotas for user fb8fce29071946229f0bdae835435ec4 and project 7747e464a94d42539f47b1483f0ba8eb. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:38.758002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:14:38.760701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:14:38.832472 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9de7c4e3-99cc-4622-a4ba-14c2568617a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099653 Oct 17 13:14:38.834204 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2427/5019] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:14:38.844681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-70a57d40-2911-4e75-99ef-fe6aa33bc3c1 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:38.846090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-70a57d40-2911-4e75-99ef-fe6aa33bc3c1 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:38.983373 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-70a57d40-2911-4e75-99ef-fe6aa33bc3c1 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1329 microversion: 2.1 time: 0.141197 Oct 17 13:14:39.000452 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2593/5020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:38 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1329 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:39.116822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:39.119213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:39.157372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:39.159133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:39.159631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:39.160072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:39.160777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:39.161230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:39.161650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:39.543925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:39.545140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:39.558273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:39.560343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:39.562752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:39.565093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:39.573461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:39.574611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:39.775537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:39.794277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:39.796392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:39.798292 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18282588-bcb5-4646-9160-87b79f6487ae tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1371 microversion: 2.47 time: 0.259299 Oct 17 13:14:39.799013 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2594/5021] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:39 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:40.009524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:40.010530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:40.025010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:40.026857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:40.028529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:40.031212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:40.032032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:40.034834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:40.204554 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9f2ee2b8-a32e-4ef8-ab0c-e76ea27a4dc4 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1346 microversion: 2.1 time: 0.199334 Oct 17 13:14:40.205855 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2595/5022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:40 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:40.624308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:40.636382 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2c2a48e5-63e7-4015-bb92-36440f25723c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 1.525480 Oct 17 13:14:40.639712 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2428/5023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:39 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:40.839270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:40.840404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:40.847048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:40.847644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:40.848188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:40.849149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:40.849687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:40.850214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:40.970869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:40.982324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:40.984103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:40.985706 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-846ee106-1383-4905-9327-4a9afef87634 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1371 microversion: 2.47 time: 0.162009 Oct 17 13:14:40.986659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2596/5024] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:40 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:41.232748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:41.233373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:41.262893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:41.263958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:41.264772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:41.265810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:41.275527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:41.278320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:41.667184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:41.667802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:41.677535 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a497e651-24b5-40f0-8214-be90b7169e62 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1418 microversion: 2.1 time: 0.448367 Oct 17 13:14:41.684731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2429/5025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:41 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1418 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:41.704445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:41.705722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:41.706182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:41.711204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:41.711701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:41.712153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.014783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:42.015409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:42.021332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.021826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.022291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.031523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.032291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.032909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.134770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:42.145160 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc54ca80-65c6-4354-b60d-161120745fbc tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.482915 Oct 17 13:14:42.145758 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2597/5026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:41 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:42.310049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:42.343102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:42.349140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:42.353681 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ea5e6eb-076b-4bd0-ad1a-abf76ccaed42 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1356 microversion: 2.47 time: 0.343455 Oct 17 13:14:42.355308 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2430/5027] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:42 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1356 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:42.385256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:42.390263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:42.395540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Searching by: {'deleted': False, 'project_id': '330e93904ccc489c997444723d58a2aa'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:14:42.402801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-faa37f97-50c9-4493-8084-88604facdd29 req-97993478-2bed-49d7-9882-aed6cd72ac16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "name": "network-vif-unplugged", "status": "completed", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:42.418334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-faa37f97-50c9-4493-8084-88604facdd29 req-97993478-2bed-49d7-9882-aed6cd72ac16 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.419820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.420316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.420768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.421025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-faa37f97-50c9-4493-8084-88604facdd29 req-97993478-2bed-49d7-9882-aed6cd72ac16 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.424258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-faa37f97-50c9-4493-8084-88604facdd29 req-97993478-2bed-49d7-9882-aed6cd72ac16 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.427033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.429241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.431231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.450698 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-faa37f97-50c9-4493-8084-88604facdd29 req-97993478-2bed-49d7-9882-aed6cd72ac16 service nova] Creating event network-vif-unplugged:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h1-853316-12 Oct 17 13:14:42.468617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-faa37f97-50c9-4493-8084-88604facdd29 req-97993478-2bed-49d7-9882-aed6cd72ac16 service nova] Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:14:42.498253 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-faa37f97-50c9-4493-8084-88604facdd29 req-97993478-2bed-49d7-9882-aed6cd72ac16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097529 Oct 17 13:14:42.500169 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2431/5028] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:14:42.640199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:14:42.713140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:42.714524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:42.725955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.728870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.729518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.734547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.735371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.736006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.844286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:42.853906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.854526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.855059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.868172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:42.870074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:42.886032 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c92fad61-cb1a-4595-9fa2-3d0e44eab192 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1424 microversion: 2.1 time: 0.173003 Oct 17 13:14:42.887014 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2432/5029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:42 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1424 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:42.927250 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7703523-07c1-4219-b8c8-44542f6df1d5 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.546974 Oct 17 13:14:42.928107 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2598/5030] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 17 13:14:42 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:42.965417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:42.966679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:42.974919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.975675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.977011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:42.978610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:42.979269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:42.980032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:43.012398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:14:43.171961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:43.172984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:43.189724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31e15879-0595-40d0-b800-8277cce4696e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 204 len: 0 microversion: 2.47 time: 0.232234 Oct 17 13:14:43.190488 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2433/5031] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:14:42 2022] DELETE /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:14:43.202202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:43.205546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:43.215914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:43.216466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:43.216938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:43.219094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:43.220629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:43.221453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:43.225432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:43.229830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:43.232249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:43.233419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:43.235700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:43.236361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:43.474828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:43.489157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:43.491904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:43.496191 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-852bc423-e6bc-41e9-8f76-662e63301c3a tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1362 microversion: 2.47 time: 0.301210 Oct 17 13:14:43.498356 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2434/5032] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:43 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:43.558133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:43.585804 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc765f8e-efda-4385-ad8d-4561271a17b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.417352 Oct 17 13:14:43.587816 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2599/5033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:43 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:43.912391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:43.915216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:43.922982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:43.923696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:43.924554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:43.925875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:43.926931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:43.927587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:44.395430 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-caab5e94-65c7-4d26-9083-c9520f60cf0e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.487068 Oct 17 13:14:44.396023 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2435/5034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:43 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:44.530307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:44.531028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:44.546382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:44.546885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:44.547328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:44.548048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:44.548507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:44.548933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:44.612992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:44.613624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:44.630070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:44.630554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:44.630983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:44.631696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:44.632156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:44.632584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:44.923537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:44.963222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:44.968090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:44.969807 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2d709236-acae-4330-a968-8cdc9d405c4e tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 200 len: 1362 microversion: 2.47 time: 0.444451 Oct 17 13:14:44.972265 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2600/5035] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:44 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:44.980829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-711b5116-9f59-464e-b960-abf06b85da79 req-f6840f95-b5b3-4dfd-8268-30ec4b47582b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:45.015234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-711b5116-9f59-464e-b960-abf06b85da79 req-f6840f95-b5b3-4dfd-8268-30ec4b47582b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:45.015819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-711b5116-9f59-464e-b960-abf06b85da79 req-f6840f95-b5b3-4dfd-8268-30ec4b47582b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:45.016257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-711b5116-9f59-464e-b960-abf06b85da79 req-f6840f95-b5b3-4dfd-8268-30ec4b47582b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:45.034561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:45.037804 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-711b5116-9f59-464e-b960-abf06b85da79 req-f6840f95-b5b3-4dfd-8268-30ec4b47582b service nova] Creating event network-changed:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h1-853316-12 Oct 17 13:14:45.047285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-711b5116-9f59-464e-b960-abf06b85da79 req-f6840f95-b5b3-4dfd-8268-30ec4b47582b service nova] Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:14:45.076774 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-711b5116-9f59-464e-b960-abf06b85da79 req-f6840f95-b5b3-4dfd-8268-30ec4b47582b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088616 Oct 17 13:14:45.077487 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2601/5036] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:45.399107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:45.409436 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15d2e713-937a-4085-af95-2a5273ad0702 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.800239 Oct 17 13:14:45.411387 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2436/5037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:44 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:45.421367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:45.422075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:45.432487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:45.436978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:45.439747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:45.440890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:45.441465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:45.441905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.002205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:46.003271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 2d93635d-29d4-42cc-a7d1-2755dc4520df] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:46.011241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:46.012147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:46.012680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.013646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:46.014367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:46.015043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.032744 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] HTTP exception thrown: Instance 2d93635d-29d4-42cc-a7d1-2755dc4520df could not be found. Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Request method failure captured: Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df HTTP/1.1 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUax7xdvDkwvRVCWJiJtjgGTXeTYylUWNgDgUBYg7YR7Sakun7ynsbcQ_OjTJ8FUwIpEwZNVrjNvI17URF3sQjtk5uBwl9wd850kVdp-UACmutH5hlp8nVFuAsWQW6n4aAL2_oDN-smM2SdjY_P8cgXKbII0Ip77J7Rl52jLNxSFYI Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 330e93904ccc489c997444723d58a2aa Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerShowV247Test-206152107 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_330e93904ccc489c997444723d58a2aa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/330e93904ccc489c997444723d58a2aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/330e93904ccc489c997444723d58a2aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/330e93904ccc489c997444723d58a2aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerShowV247Test-206152107 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 330e93904ccc489c997444723d58a2aa Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerShowV247Test-206152107 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerShowV247Test-206152107-project Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 24c9e915e6594a3786125d280ff925e6 Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerShowV247Test-206152107-project Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 2d93635d-29d4-42cc-a7d1-2755dc4520df could not be found. Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '2d93635d-29d4-42cc-a7d1-2755dc4520df'} Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d93635d-29d4-42cc-a7d1-2755dc4520df could not be found. Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d93635d-29d4-42cc-a7d1-2755dc4520df could not be found. Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:46.035966 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d93635d-29d4-42cc-a7d1-2755dc4520df could not be found. Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Returning 404 to user: Instance 2d93635d-29d4-42cc-a7d1-2755dc4520df could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:46.043214 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b0df0c9-3d0e-4d11-9495-82a8fec3f4cc tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df" status: 404 len: 111 microversion: 2.47 time: 0.040827 Oct 17 13:14:46.044866 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2437/5038] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:45 2022] GET /compute/v2.1/servers/2d93635d-29d4-42cc-a7d1-2755dc4520df => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:14:46.055613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:46.056261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:46.062538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:46.063143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:46.063969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.064991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:46.065725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:46.066409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.096462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:14:46.129503 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3ebe9cc-36ab-44e2-a81a-64789265fc54 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.709036 Oct 17 13:14:46.144361 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2602/5039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:45 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:46.216799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-20825de9-e4c0-47a3-8d8a-efe3d8d9e6db tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "DELETE /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 204 len: 0 microversion: 2.47 time: 0.161625 Oct 17 13:14:46.219488 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2438/5040] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:14:46 2022] DELETE /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:14:46.228016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:46.228739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:46.235330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:46.236088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:46.236848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.237788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:46.238579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:46.239093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.419343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:46.430835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:46.439334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:46.440658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:46.449663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:46.450604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:46.451570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.452535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:46.453207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:46.453372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:46.454133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:46.459195 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-441308db-b78e-4a72-95ee-d2fac9184cec tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 200 len: 1363 microversion: 2.47 time: 0.235579 Oct 17 13:14:46.466721 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2603/5041] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:46 2022] GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:46.889556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:46.900739 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2df28555-8143-41d6-91ba-541bd6ae510a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.466186 Oct 17 13:14:46.917885 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2439/5042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:46 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:47.101108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5c8c7252-0268-4da9-9be8-9842e7feef6a req-daa66deb-638f-4a00-88e7-d5ef1152b1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6d584b-a94f-444f-b398-02bbc12b5597", "tag": "1928b4e5-aa07-445a-b6d7-402b50914b40"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:47.122532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c8c7252-0268-4da9-9be8-9842e7feef6a req-daa66deb-638f-4a00-88e7-d5ef1152b1d5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:47.124132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c8c7252-0268-4da9-9be8-9842e7feef6a req-daa66deb-638f-4a00-88e7-d5ef1152b1d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:47.124666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c8c7252-0268-4da9-9be8-9842e7feef6a req-daa66deb-638f-4a00-88e7-d5ef1152b1d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:47.154589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:47.154999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:47.165349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:47.165848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:47.166317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:47.169525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:47.170003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:47.170462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:47.172037 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5c8c7252-0268-4da9-9be8-9842e7feef6a req-daa66deb-638f-4a00-88e7-d5ef1152b1d5 service nova] Creating event network-changed:1928b4e5-aa07-445a-b6d7-402b50914b40 for instance af6d584b-a94f-444f-b398-02bbc12b5597 on n-h2-853316-12 Oct 17 13:14:47.184863 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5c8c7252-0268-4da9-9be8-9842e7feef6a req-daa66deb-638f-4a00-88e7-d5ef1152b1d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084884 Oct 17 13:14:47.186962 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2604/5043] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:47.354799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa22edc8-f1ec-4da2-a9ab-60425c4ee00a tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.204766 Oct 17 13:14:47.355386 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2440/5044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:47 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:47.502765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:47.504352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:47.513169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:47.514226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:47.514834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:47.516486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:47.516953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:47.517381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:47.601147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:47.612483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:47.614005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:47.616345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b5604d5-5904-4323-89b7-fc3d9c2862cd tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 200 len: 1363 microversion: 2.47 time: 0.120307 Oct 17 13:14:47.634875 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2605/5045] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:47 2022] GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:47.926820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:47.927434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:47.935623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:47.936111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:47.936737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:47.937665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:47.938319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:47.938912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:47.943987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:48.106132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:48.113732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2938388b-97e3-497f-a1ed-e97a15fbf684 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.190725 Oct 17 13:14:48.114455 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2441/5046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:47 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:48.379385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:48.380021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:48.388392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:48.389267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:48.389877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:48.390684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:48.391313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:48.391906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:48.546415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-347600ba-aa06-46ce-a837-c9e7f4f13448 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.165830 Oct 17 13:14:48.559300 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2606/5047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:48 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:48.649593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:48.650553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:48.660474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:48.661308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:48.661999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:48.662967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:48.663664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:48.664393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:48.722097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:48.749518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:48.755008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:48.766154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:48.767684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:48.769040 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89109220-7ada-48eb-9a70-e722324a2a51 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 200 len: 1363 microversion: 2.47 time: 0.125364 Oct 17 13:14:48.769895 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2442/5048] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:48 2022] GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 1363 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:49.139720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:49.142582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:49.151958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:49.152599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:49.153060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:49.153974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:49.154466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:49.155555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:49.311400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:49.321124 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db3544c5-556e-4d20-b790-e93796f5cba7 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.185976 Oct 17 13:14:49.334552 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2607/5049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:49 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:49.572498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:49.573078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:49.580712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:49.581316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:49.581949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:49.582690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:49.583498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:49.584117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:49.798797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:49.800256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:49.807718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:49.808514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:49.809207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:49.810125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:49.810883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:49.811582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:49.908795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:49.919671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:49.921794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:49.923540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bfa66da7-77b0-4362-aebb-59e0b67eb86d tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 200 len: 1363 microversion: 2.47 time: 0.128857 Oct 17 13:14:49.924508 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2608/5050] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:49 2022] GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 1363 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:14:50.318400 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2b038cd0-5e73-4e08-9d40-3505746fa787 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.750543 Oct 17 13:14:50.319610 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2443/5051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:49 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:50.349162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:50.349890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:50.358906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:50.359891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:50.360411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:50.361316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:50.361985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:50.362637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:50.581633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:50.595639 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-122e23c7-7e93-4260-939f-5e52a9e5e91e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1691 microversion: 2.1 time: 0.250612 Oct 17 13:14:50.596903 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2609/5052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:50 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1691 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:50.950962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:50.952201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:50.960495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:50.961851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:50.962957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:50.963718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:50.964447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:50.964920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:51.124878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:51.136214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:51.138042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:51.139730 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c3c66d71-2615-4e94-b087-c33dec3c45a4 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 200 len: 1363 microversion: 2.47 time: 0.194323 Oct 17 13:14:51.140517 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2444/5053] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:50 2022] GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:51.349654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:51.350911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:51.358806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:51.359846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:51.360455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:51.361328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:51.363458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:51.364075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:51.636690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:51.637499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:51.653545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:51.657160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:51.657887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:51.659234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:51.663093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:51.666543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:51.694804 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bcc32f71-5bf4-432c-9214-c565334dd95e tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.354548 Oct 17 13:14:51.711339 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2610/5054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:51 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:52.052565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:52.070023 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-94fc81ac-4249-404f-9412-663e9ed00878 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1684 microversion: 2.1 time: 0.444756 Oct 17 13:14:52.072067 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2445/5055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:51 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1684 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:52.165701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:52.166347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:52.183847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:52.184898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:52.184898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:52.185505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:52.185958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:52.186413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:52.306862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:52.307272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:52.307812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:52.308155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lazy-loading 'fault' on Instance uuid 196ac814-7cd3-473e-8a3f-c4a4ca6169b0 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:14:52.395172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:52.407198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:52.409079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24c9e915e6594a3786125d280ff925e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e93904ccc489c997444723d58a2aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:52.410576 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-28314b34-bfb9-49c9-b425-802745b68971 tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 200 len: 1368 microversion: 2.47 time: 0.249624 Oct 17 13:14:52.421100 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2611/5056] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:52 2022] GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:52.719667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:52.720577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:52.730516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:52.731944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:52.732608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:52.734068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:52.734758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:52.735408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:53.128792 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-806b4528-ea3b-45df-bd6b-7ce7790235d7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.413048 Oct 17 13:14:53.130921 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2446/5057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:52 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:53.440097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:53.441317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] [instance: 196ac814-7cd3-473e-8a3f-c4a4ca6169b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:53.450328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:53.451677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:53.457742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:53.458697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:53.459393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:53.461522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:53.462453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:53.463136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:53.490353 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] HTTP exception thrown: Instance 196ac814-7cd3-473e-8a3f-c4a4ca6169b0 could not be found. Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Request method failure captured: Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 HTTP/1.1 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVUax7xdvDkwvRVCWJiJtjgGTXeTYylUWNgDgUBYg7YR7Sakun7ynsbcQ_OjTJ8FUwIpEwZNVrjNvI17URF3sQjtk5uBwl9wd850kVdp-UACmutH5hlp8nVFuAsWQW6n4aAL2_oDN-smM2SdjY_P8cgXKbII0Ip77J7Rl52jLNxSFYI Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 330e93904ccc489c997444723d58a2aa Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerShowV247Test-206152107 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_330e93904ccc489c997444723d58a2aa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/330e93904ccc489c997444723d58a2aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/330e93904ccc489c997444723d58a2aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/330e93904ccc489c997444723d58a2aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerShowV247Test-206152107 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 330e93904ccc489c997444723d58a2aa Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerShowV247Test-206152107 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerShowV247Test-206152107-project Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c9e915e6594a3786125d280ff925e6 Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerShowV247Test-206152107-project Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 196ac814-7cd3-473e-8a3f-c4a4ca6169b0 could not be found. Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '196ac814-7cd3-473e-8a3f-c4a4ca6169b0'} Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 196ac814-7cd3-473e-8a3f-c4a4ca6169b0 could not be found. Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 196ac814-7cd3-473e-8a3f-c4a4ca6169b0 could not be found. Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:14:53.494059 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:53.498935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:14:53.498935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:14:53.498935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:14:53.498935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:14:53.498935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:14:53.498935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 196ac814-7cd3-473e-8a3f-c4a4ca6169b0 could not be found. Oct 17 13:14:53.498935 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:14:53.501515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] Returning 404 to user: Instance 196ac814-7cd3-473e-8a3f-c4a4ca6169b0 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:14:53.502804 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-235780bb-7c53-4f8b-b140-bc6920752c2c tempest-ServerShowV247Test-206152107 tempest-ServerShowV247Test-206152107-project] 10.222.0.27 "GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0" status: 404 len: 111 microversion: 2.47 time: 0.066700 Oct 17 13:14:53.503832 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2612/5058] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:14:53 2022] GET /compute/v2.1/servers/196ac814-7cd3-473e-8a3f-c4a4ca6169b0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:14:54.003949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d995969b-d883-48d0-973b-536f0a2a32d6 req-8ea8bb01-e47f-4ac8-8737-0a284751311c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6d584b-a94f-444f-b398-02bbc12b5597", "name": "network-vif-plugged", "status": "completed", "tag": "1928b4e5-aa07-445a-b6d7-402b50914b40"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:54.017674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d995969b-d883-48d0-973b-536f0a2a32d6 req-8ea8bb01-e47f-4ac8-8737-0a284751311c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:54.018152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d995969b-d883-48d0-973b-536f0a2a32d6 req-8ea8bb01-e47f-4ac8-8737-0a284751311c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:54.018603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d995969b-d883-48d0-973b-536f0a2a32d6 req-8ea8bb01-e47f-4ac8-8737-0a284751311c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:54.051040 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d995969b-d883-48d0-973b-536f0a2a32d6 req-8ea8bb01-e47f-4ac8-8737-0a284751311c service nova] Creating event network-vif-plugged:1928b4e5-aa07-445a-b6d7-402b50914b40 for instance af6d584b-a94f-444f-b398-02bbc12b5597 on n-h2-853316-12 Oct 17 13:14:54.061252 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d995969b-d883-48d0-973b-536f0a2a32d6 req-8ea8bb01-e47f-4ac8-8737-0a284751311c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059718 Oct 17 13:14:54.064758 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2447/5059] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:14:54.156894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:54.158103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:54.181932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:54.182722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:54.183354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:54.184247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:54.190354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:54.191284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:54.424705 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f507fe79-aa78-4deb-bfcf-2b4c08fc5614 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.273613 Oct 17 13:14:54.425807 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2613/5060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:54 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:55.468937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:55.473111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:55.484787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:55.485367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:55.486251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:55.487372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:55.487901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:55.488480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:55.853236 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a63b6a05-5ba0-4049-a2da-ac469caf3d78 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1466 microversion: 2.1 time: 0.405471 Oct 17 13:14:55.853851 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2448/5061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:55 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1466 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:56.098455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f5f195cd-12c5-48b3-ae20-80dae4a4d396 req-3a4937e6-7b90-41ea-8681-acc7db8906ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "name": "network-vif-plugged", "status": "completed", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:56.116485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f5f195cd-12c5-48b3-ae20-80dae4a4d396 req-3a4937e6-7b90-41ea-8681-acc7db8906ac service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:56.117580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f5f195cd-12c5-48b3-ae20-80dae4a4d396 req-3a4937e6-7b90-41ea-8681-acc7db8906ac service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:56.118528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f5f195cd-12c5-48b3-ae20-80dae4a4d396 req-3a4937e6-7b90-41ea-8681-acc7db8906ac service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:56.130851 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f5f195cd-12c5-48b3-ae20-80dae4a4d396 req-3a4937e6-7b90-41ea-8681-acc7db8906ac service nova] Creating event network-vif-plugged:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h1-853316-12 Oct 17 13:14:56.137811 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f5f195cd-12c5-48b3-ae20-80dae4a4d396 req-3a4937e6-7b90-41ea-8681-acc7db8906ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045657 Oct 17 13:14:56.153899 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2614/5062] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:14:56.858084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1173710810", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e6961d90-c691-4862-9018-60bca57213f2"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:56.877577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:56.878449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:56.896055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:56.897329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:56.898984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:56.901806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:56.904808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:56.905520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:56.927990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] validate_networks() for [('e6961d90-c691-4862-9018-60bca57213f2', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:14:57.124605 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-380c8804-22fb-42e6-a1e6-fd32c45305cd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1650 microversion: 2.1 time: 0.251043 Oct 17 13:14:57.125192 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2615/5063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:56 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1650 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:57.150340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:57.151285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:57.157892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:57.158989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:57.160082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:57.160991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:57.161673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:57.162297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:57.407984 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8970a06-f10a-4bbe-bb8b-71b2e863ef65 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1650 microversion: 2.1 time: 0.262756 Oct 17 13:14:57.409334 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2616/5064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:57 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1650 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:57.440830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:57.441490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:57.465954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:57.466571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:57.467029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:57.468408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:57.468939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:57.469412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:57.683666 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-09cfeebe-1d6c-4fb9-aea5-86144ec31023 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1650 microversion: 2.1 time: 0.247652 Oct 17 13:14:57.689549 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2617/5065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:57 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1650 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:14:57.749864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:14:57.750681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:14:57.751400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:14:57.752170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:14:57.752962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:14:57.770544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:57.771051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:57.771493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:57.774666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:57.775152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:57.781855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:57.840164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:57.851264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for user 24c6068b196d4cc398176b22196bd5b1 and project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:57.878067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:14:57.880596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:14:57.887008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-41182006", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "availability_zone": "nova:n-h1-853316-12", "networks": [{"uuid": "90197976-6c9a-4290-80ec-61aed614c2fe"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:14:57.950064 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7ba8d97-4972-41dd-913f-3f0bf1132414 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271896 Oct 17 13:14:57.951073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2449/5066] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:14:57.983321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f09bf4ee-64a6-402a-a81e-976392ad275b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:57.983960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f09bf4ee-64a6-402a-a81e-976392ad275b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:58.005528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] validate_networks() for [('90197976-6c9a-4290-80ec-61aed614c2fe', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:14:58.187089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f09bf4ee-64a6-402a-a81e-976392ad275b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:58.197819 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f09bf4ee-64a6-402a-a81e-976392ad275b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1215 microversion: 2.1 time: 0.229403 Oct 17 13:14:58.208353 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2450/5067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:57 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:58.732042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:14:58.732627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:14:58.733203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:14:58.733755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:14:58.734329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:14:58.753222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:58.755697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:58.757416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:58.759661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:58.760484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:58.762421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:58.811037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Getting quotas for project 7747e464a94d42539f47b1483f0ba8eb. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:14:58.827546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Getting quotas for user fb8fce29071946229f0bdae835435ec4 and project 7747e464a94d42539f47b1483f0ba8eb. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:14:58.847058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:14:58.850293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:14:58.939725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19c9e5a3-715e-4eaa-be53-1f1f10532804 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053661 Oct 17 13:14:58.940607 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2618/5068] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:14:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:14:58.954767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad9d6648-ecee-472e-8e46-e050bd4b21a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:58.956755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad9d6648-ecee-472e-8e46-e050bd4b21a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:59.110226 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad9d6648-ecee-472e-8e46-e050bd4b21a9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1327 microversion: 2.1 time: 0.158847 Oct 17 13:14:59.114943 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2451/5069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:58 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:14:59.222879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:14:59.223731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:14:59.237376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:59.238773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:59.241920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:59.243402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:59.245750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:59.246503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:59.385092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:14:59.397552 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-735f36b1-99f4-4471-a85f-7905b08ae003 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1211 microversion: 2.1 time: 0.179029 Oct 17 13:14:59.416997 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2619/5070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:14:59 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:00.140254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:00.141635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:00.161421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:00.162699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:00.163481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:00.164566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:00.165408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:00.166072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:00.396868 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-336a31b8-debc-4107-8a94-6a60653234b9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1336 microversion: 2.1 time: 0.263448 Oct 17 13:15:00.400653 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2452/5071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:00 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1336 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:00.429186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:00.429877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:00.455593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:00.457355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:00.457817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:00.459754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:00.460232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:00.460683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:00.502527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:00.662890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:00.675808 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f89631a-5b18-4df4-af26-b640164623b8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1273 microversion: 2.1 time: 0.251635 Oct 17 13:15:00.677268 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2620/5072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:00 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1273 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:01.432390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:01.434494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:01.458017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:01.458907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:01.460476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:01.463473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:01.464229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:01.466098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:01.701975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:01.703603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:01.720409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:01.721327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:01.722138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:01.723290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:01.724912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:01.725573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:01.919366 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3654fecf-9146-49d3-a491-8472704a2aee tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1424 microversion: 2.1 time: 0.493791 Oct 17 13:15:01.922515 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2453/5073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:01 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1424 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:01.933897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:01.951673 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b97f626-8f1f-4ac8-9218-e58f6c77a246 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1273 microversion: 2.1 time: 0.253942 Oct 17 13:15:01.956068 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2621/5074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:01 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:02.946562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:02.947183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:02.964272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:02.964902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:02.965354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:02.966082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:02.966589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:02.967123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:02.980897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:02.981511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:03.011832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:03.012277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:03.012731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:03.014947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:03.019537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:03.020768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:03.252699 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-02f9fc66-c7d7-4d79-8be7-86fb0a7c5e10 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1422 microversion: 2.1 time: 0.309440 Oct 17 13:15:03.255623 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2454/5075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:02 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1422 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:03.392882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:03.410010 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6acced2c-99d5-4d23-a604-8d1ba1a03417 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.428469 Oct 17 13:15:03.411091 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2622/5076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:02 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:04.278845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.280262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:04.294118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.296909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.301287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.305812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.306679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.311880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.435418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.436043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:04.447278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.453600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.454418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.455385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.457459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.458093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.778555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:04.799993 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f89281c3-eaf7-4e32-acb5-6187da843643 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.524778 Oct 17 13:15:04.800595 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2455/5077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:04.806721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f6b20a16-8feb-4f7a-a1f4-2121782f5140 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.363516 Oct 17 13:15:04.807920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2623/5078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:04.976228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-06057f30-3deb-4345-9c5f-50422b6e0216 req-cc779c47-a6a4-4010-9cfd-c60dc3364897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006e7d34-4751-4b4c-9e9b-8be014839e20", "tag": "a28401e5-788d-47de-963d-184ac2a01cf3"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:04.987465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-06057f30-3deb-4345-9c5f-50422b6e0216 req-cc779c47-a6a4-4010-9cfd-c60dc3364897 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.988282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-06057f30-3deb-4345-9c5f-50422b6e0216 req-cc779c47-a6a4-4010-9cfd-c60dc3364897 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.988895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-06057f30-3deb-4345-9c5f-50422b6e0216 req-cc779c47-a6a4-4010-9cfd-c60dc3364897 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:05.007213 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-06057f30-3deb-4345-9c5f-50422b6e0216 req-cc779c47-a6a4-4010-9cfd-c60dc3364897 service nova] Creating event network-changed:a28401e5-788d-47de-963d-184ac2a01cf3 for instance 006e7d34-4751-4b4c-9e9b-8be014839e20 on n-h1-853316-12 Oct 17 13:15:05.015184 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-06057f30-3deb-4345-9c5f-50422b6e0216 req-cc779c47-a6a4-4010-9cfd-c60dc3364897 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041985 Oct 17 13:15:05.016659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2624/5079] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:05.161041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1519756779", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:05.218988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] validate_networks() for [('b0c544df-5aaa-4cad-b34a-395590c4eb94', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:15:05.834225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.834939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:05.855556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:05.855978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:05.856422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:05.857195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:05.857984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:05.858622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:06.078420 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cff72533-0acb-4cc8-a018-af9533a57c5d tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.245893 Oct 17 13:15:06.080877 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2625/5080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:05 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:06.090674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.094387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:06.099918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:06.113431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:06.113950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:06.114762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:06.116033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:06.116775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:06.118083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:06.321310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:06.334057 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44af8b29-cc21-4774-8040-a10f357d4cb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.251787 Oct 17 13:15:06.334950 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2626/5081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:06.471562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:06.472281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:06.473103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:06.473800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:06.474581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:06.486312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:06.486932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:06.487447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:06.488272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:06.488802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:06.489301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:06.507314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Getting quotas for project dafd87325a094e1ca41e18cc1bde5593. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:06.512629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Getting quotas for user 1cc9096896f74f5da7b8cc3649dfce8b and project dafd87325a094e1ca41e18cc1bde5593. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:06.525534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:06.527877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:06.549734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:06.587382 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dd67fb04-9da7-4317-8d6e-5e0287bf7159 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660166 Oct 17 13:15:06.588040 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2456/5082] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:15:06.598886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81e8dba2-1688-4f53-b2be-93d4adf95b9f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.599488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-81e8dba2-1688-4f53-b2be-93d4adf95b9f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:06.657512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-81e8dba2-1688-4f53-b2be-93d4adf95b9f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:06.666263 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81e8dba2-1688-4f53-b2be-93d4adf95b9f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1217 microversion: 2.1 time: 0.071057 Oct 17 13:15:06.682372 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2627/5083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:07.041259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c1ad65f8-b955-48dc-ab60-9ba51e3595f7 req-5e9209a4-4473-45aa-af7a-106b4f3e7347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3860e838-dce2-4a20-aa21-e1eb77b4b3b0", "tag": "1629609d-0407-4316-b06c-6a3505e2a6b1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:07.052622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c1ad65f8-b955-48dc-ab60-9ba51e3595f7 req-5e9209a4-4473-45aa-af7a-106b4f3e7347 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.053242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c1ad65f8-b955-48dc-ab60-9ba51e3595f7 req-5e9209a4-4473-45aa-af7a-106b4f3e7347 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.053776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c1ad65f8-b955-48dc-ab60-9ba51e3595f7 req-5e9209a4-4473-45aa-af7a-106b4f3e7347 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.066025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c1ad65f8-b955-48dc-ab60-9ba51e3595f7 req-5e9209a4-4473-45aa-af7a-106b4f3e7347 service nova] Creating event network-changed:1629609d-0407-4316-b06c-6a3505e2a6b1 for instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 on n-h1-853316-12 Oct 17 13:15:07.071318 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c1ad65f8-b955-48dc-ab60-9ba51e3595f7 req-5e9209a4-4473-45aa-af7a-106b4f3e7347 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034590 Oct 17 13:15:07.072330 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2457/5084] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:07.106134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.107393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:07.115372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.115938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.116444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.117530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.118063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.118644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.277853 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c621aec0-70ad-4fdb-8d64-2aa255161bde tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.176547 Oct 17 13:15:07.293627 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2628/5085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:07.359325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.360021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:07.368628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.369114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.369548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.370271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.370721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.371143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.529652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:07.540600 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f0212571-9033-489e-a4be-766fc6be4a02 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.185766 Oct 17 13:15:07.541657 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2458/5086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:07.689497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.690220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:07.697191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.697914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.698495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.699331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.700159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.700840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.770185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:07.785766 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-584050b0-19fe-4d65-ba2a-13e227b7f22c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1269 microversion: 2.1 time: 0.100082 Oct 17 13:15:07.786643 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2629/5087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.308074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.308874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:08.319531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.320423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.321076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.325796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.326535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.326979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.563404 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5e94aa9-254e-4fbf-b60c-a7c50ff33383 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.259681 Oct 17 13:15:08.564764 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2459/5088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.568880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.569525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:08.581641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.582424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.583460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.585021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.586142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.587583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.776266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:08.779922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:08.791351 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0019f35d-6171-4668-97f5-ee338b28b0f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.230469 Oct 17 13:15:08.806203 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2630/5089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:08.819115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.819950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:08.829538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.830043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.830519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.831239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.831702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.832135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:09.361722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:09.377758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee7a6ec3-9d20-4b0d-a80d-362c1182b056 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1317 microversion: 2.1 time: 0.563313 Oct 17 13:15:09.380062 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2460/5090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:09.592684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:09.593770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:09.614458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:09.615182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:09.615480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:09.616212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:09.617021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:09.618589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:09.818665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:09.820121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:09.839318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:09.841103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:09.841735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:09.847240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:09.847964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:09.848610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:09.869806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd5142a2-e310-4596-80ce-310662e13044 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.281753 Oct 17 13:15:09.871008 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2631/5091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:09 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:10.119995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:10.130121 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-206aafb1-820d-41e0-b810-0022f5241cd8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.315153 Oct 17 13:15:10.135941 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2461/5092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:09 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:10.406956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:10.407595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:10.414818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:10.415071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:10.415420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:10.416133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:10.416585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:10.417014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:10.462879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:10.552645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d883af09-58e8-4366-aa25-48684a0f0a06 req-00d45f8e-1921-4dc2-a9b0-16959fac5b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e8edfd5-201d-4c59-b87c-b9b987ac6996", "tag": "d5781fa1-d3fb-4668-acdd-398634e6693e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:10.563286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d883af09-58e8-4366-aa25-48684a0f0a06 req-00d45f8e-1921-4dc2-a9b0-16959fac5b24 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:10.563893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d883af09-58e8-4366-aa25-48684a0f0a06 req-00d45f8e-1921-4dc2-a9b0-16959fac5b24 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:10.566630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d883af09-58e8-4366-aa25-48684a0f0a06 req-00d45f8e-1921-4dc2-a9b0-16959fac5b24 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:10.587496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d883af09-58e8-4366-aa25-48684a0f0a06 req-00d45f8e-1921-4dc2-a9b0-16959fac5b24 service nova] Creating event network-changed:d5781fa1-d3fb-4668-acdd-398634e6693e for instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 on n-h2-853316-12 Oct 17 13:15:10.595354 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d883af09-58e8-4366-aa25-48684a0f0a06 req-00d45f8e-1921-4dc2-a9b0-16959fac5b24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247931 Oct 17 13:15:10.596301 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2632/5093] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:10.899371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:10.900678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:10.912777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:10.913491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:10.914151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:10.915246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:10.915879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:10.916478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:11.065298 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-36eb9bc3-2161-431d-ba46-de00d2cd10b5 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.173803 Oct 17 13:15:11.065983 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2633/5094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:10 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:11.105762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:11.114531 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41b365a1-9207-4dab-a666-3ca48bc04eb5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1317 microversion: 2.1 time: 0.711322 Oct 17 13:15:11.115420 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2462/5095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:10 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:11.157684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:11.158550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:11.165178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:11.165665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:11.166105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:11.166836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:11.167284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:11.167701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:11.325966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:11.335363 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3de60b5-df33-4054-b901-7b12c597606a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.181545 Oct 17 13:15:11.335980 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2634/5096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:11 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:11.668140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-103ff3b6-875e-4100-945d-857312246c7f req-8671980b-ea86-4928-8bc7-fac509e6ef32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006e7d34-4751-4b4c-9e9b-8be014839e20", "name": "network-vif-plugged", "status": "completed", "tag": "a28401e5-788d-47de-963d-184ac2a01cf3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:11.678621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-103ff3b6-875e-4100-945d-857312246c7f req-8671980b-ea86-4928-8bc7-fac509e6ef32 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:11.679106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-103ff3b6-875e-4100-945d-857312246c7f req-8671980b-ea86-4928-8bc7-fac509e6ef32 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:11.679589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-103ff3b6-875e-4100-945d-857312246c7f req-8671980b-ea86-4928-8bc7-fac509e6ef32 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:11.695786 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-103ff3b6-875e-4100-945d-857312246c7f req-8671980b-ea86-4928-8bc7-fac509e6ef32 service nova] Creating event network-vif-plugged:a28401e5-788d-47de-963d-184ac2a01cf3 for instance 006e7d34-4751-4b4c-9e9b-8be014839e20 on n-h1-853316-12 Oct 17 13:15:11.703577 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-103ff3b6-875e-4100-945d-857312246c7f req-8671980b-ea86-4928-8bc7-fac509e6ef32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194103 Oct 17 13:15:11.704660 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2463/5097] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:12.090697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:12.091667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:12.099127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.099690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.100259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.100951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.102780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.103342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.137478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:12.138202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:12.144669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.145418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.146074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.147060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.147751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.148959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.329543 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b98f162d-4231-4d97-a3c7-a58bd1e6ffa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.244107 Oct 17 13:15:12.331230 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2635/5098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:12 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:12.359031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:12.359749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:12.365793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.366407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.367153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.368340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.368840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.369276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.380744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:12.390781 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90eb8d71-2f3d-4132-8ba8-925e1225820d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1317 microversion: 2.1 time: 0.257546 Oct 17 13:15:12.391712 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2464/5099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:12 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:12.540179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:12.549574 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86defcaa-30c4-4944-9104-ca5373cf6e8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.194576 Oct 17 13:15:12.550495 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2636/5100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:12 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:13.355079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:13.356299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:13.366363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.367718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.368432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.369615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.370933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.371861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.417921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:13.418560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:13.426066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.426746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.427015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.427869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.428329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.428754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.536783 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0e5ec1d0-3925-4d64-86af-cdc19c4ea75f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.182741 Oct 17 13:15:13.537952 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2465/5101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:13 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:13.575860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:13.576531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:13.583245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.583778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.584234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.585047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.585559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.586785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.637251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:13.646292 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ed78f36-b4c5-4ef2-bd02-4e3b1306a766 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1317 microversion: 2.1 time: 0.233960 Oct 17 13:15:13.647128 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2637/5102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:13 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:13.761711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:13.769914 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-76e1bcdd-ab10-4b63-9db0-78009cf65b2d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1315 microversion: 2.1 time: 0.200394 Oct 17 13:15:13.770521 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2466/5103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:13 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:14.563289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:14.563899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:14.571296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.571789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.572236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:14.572948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.573402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.573826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:14.674763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:14.675418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:14.683796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.684360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.685050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:14.685790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.686583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.687096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:14.717880 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe1a9fd8-d93d-4bb2-a088-c096d3424df9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.158321 Oct 17 13:15:14.718488 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2638/5104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:14 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:14.793258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:14.793887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:14.800480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.800969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.801593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:14.802338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.802800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.803224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:14.830510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.835685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:14.840696 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba6ef19c-3820-4e54-bc8e-ec537b8d5e61 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1317 microversion: 2.1 time: 0.171420 Oct 17 13:15:14.841479 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2467/5105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:14 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:14.998010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:15.006297 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8538dfd0-f89a-487e-a582-3ff138304e91 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1503 microversion: 2.1 time: 0.217194 Oct 17 13:15:15.006867 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2639/5106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:14 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:15.031457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:15.032035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:15.038383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.040200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.040836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.041577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.042030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.042482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.071562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:15:15.153644 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-877499bd-f07a-4753-80c2-341c9246b149 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 204 len: 0 microversion: 2.1 time: 0.125586 Oct 17 13:15:15.154155 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2468/5107] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:15:15 2022] DELETE /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:15:15.165846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:15.166724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:15.173478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.174043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.174627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.175391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.176224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.176646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.342720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:15.354045 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21015085-6f4d-4cce-9782-86bac1350abf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1509 microversion: 2.1 time: 0.195757 Oct 17 13:15:15.354836 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2640/5108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:15 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:15.519925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-576f031d-14b6-49ff-8f56-30fc0181091c req-9b68049c-d6a4-4509-8108-46cde1f972d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3860e838-dce2-4a20-aa21-e1eb77b4b3b0", "name": "network-vif-plugged", "status": "completed", "tag": "1629609d-0407-4316-b06c-6a3505e2a6b1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:15.534282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-576f031d-14b6-49ff-8f56-30fc0181091c req-9b68049c-d6a4-4509-8108-46cde1f972d4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.535529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-576f031d-14b6-49ff-8f56-30fc0181091c req-9b68049c-d6a4-4509-8108-46cde1f972d4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.536620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-576f031d-14b6-49ff-8f56-30fc0181091c req-9b68049c-d6a4-4509-8108-46cde1f972d4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.552840 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-576f031d-14b6-49ff-8f56-30fc0181091c req-9b68049c-d6a4-4509-8108-46cde1f972d4 service nova] Creating event network-vif-plugged:1629609d-0407-4316-b06c-6a3505e2a6b1 for instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 on n-h1-853316-12 Oct 17 13:15:15.558688 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-576f031d-14b6-49ff-8f56-30fc0181091c req-9b68049c-d6a4-4509-8108-46cde1f972d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044376 Oct 17 13:15:15.559508 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2469/5109] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:15.743711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:15.744438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:15.753156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.753790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.754415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.755646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.756205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.756997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.865629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:15.867079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:15.874460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.875061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.875603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.876376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.876888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.877538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.916996 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2b7e8c51-32c4-464a-94fe-56b0e28d2583 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.178870 Oct 17 13:15:15.917469 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2641/5110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:15 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:16.041322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:16.050972 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dbf57c2b-b515-40da-b2ff-8515d4b3652c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1317 microversion: 2.1 time: 0.190494 Oct 17 13:15:16.051801 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2470/5111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:15 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:16.377005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:16.377614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:16.384238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.385108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.385556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.386295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.386750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.387176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.529651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:16.538462 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-175830cb-84dd-4eed-8220-ce33a9c21298 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1509 microversion: 2.1 time: 0.165212 Oct 17 13:15:16.540126 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2642/5112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:16 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:16.940587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:16.941306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:16.943297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:16.944381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=16 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:16.951492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.951977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.952414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.953113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.953569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.953995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.076876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:17.077623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:17.081838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:17.089534 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-987bd4c8-13ee-456e-9ff7-2dcb9687190f tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1464 microversion: 2.1 time: 0.152574 Oct 17 13:15:17.090117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2471/5113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:16 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:17.097918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.098688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.099223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.100051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.100601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.101122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.241115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:17.251133 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc7c8fcf-5aa0-4923-8011-02e644bae8f2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1317 microversion: 2.1 time: 0.180030 Oct 17 13:15:17.251928 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2643/5114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:17 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:17.563945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:17.565431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:17.572320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.573446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.573889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.574615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.575516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.575942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.699688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-346a465d-596a-4738-a0fd-d19b203ad569 req-9daedbaf-9205-4779-915c-f3d151535f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8edfd5-201d-4c59-b87c-b9b987ac6996", "name": "network-vif-plugged", "status": "completed", "tag": "d5781fa1-d3fb-4668-acdd-398634e6693e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:17.710260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-346a465d-596a-4738-a0fd-d19b203ad569 req-9daedbaf-9205-4779-915c-f3d151535f51 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.711714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-346a465d-596a-4738-a0fd-d19b203ad569 req-9daedbaf-9205-4779-915c-f3d151535f51 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.712215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-346a465d-596a-4738-a0fd-d19b203ad569 req-9daedbaf-9205-4779-915c-f3d151535f51 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.725079 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-346a465d-596a-4738-a0fd-d19b203ad569 req-9daedbaf-9205-4779-915c-f3d151535f51 service nova] Creating event network-vif-plugged:d5781fa1-d3fb-4668-acdd-398634e6693e for instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 on n-h2-853316-12 Oct 17 13:15:17.730643 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-346a465d-596a-4738-a0fd-d19b203ad569 req-9daedbaf-9205-4779-915c-f3d151535f51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037044 Oct 17 13:15:17.732051 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2644/5115] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:18.121221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:18.123115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:18.131874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:18.141665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.142593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.143685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.144148 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67c4c89a-8940-4bcc-a87f-9e4d5f06c2bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1509 microversion: 2.1 time: 0.583976 Oct 17 13:15:18.144795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.151944 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2472/5116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:17 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1509 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:18.152861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.153333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.276621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:18.277522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:18.286670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.287680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.288563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.290449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.291317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.291920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.430065 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-93a9a6d1-fecc-4cb7-9a9b-a7b663800e86 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1648 microversion: 2.1 time: 0.319562 Oct 17 13:15:18.430976 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2645/5117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:18 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1648 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:18.454487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:18.455420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:18.462684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.463728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.464344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.465140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.465628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.466092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.495711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:18.505408 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f0b80087-9383-4fb6-935a-a4e306849547 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1317 microversion: 2.1 time: 0.232696 Oct 17 13:15:18.506340 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2473/5118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:18 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:18.623214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c0f3fa79-c474-47eb-85cf-a5a157e62c6b req-55cc884f-ee75-413f-87dd-cd5b1c821c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006e7d34-4751-4b4c-9e9b-8be014839e20", "name": "network-vif-deleted", "tag": "a28401e5-788d-47de-963d-184ac2a01cf3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:18.636913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c0f3fa79-c474-47eb-85cf-a5a157e62c6b req-55cc884f-ee75-413f-87dd-cd5b1c821c2a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.637680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c0f3fa79-c474-47eb-85cf-a5a157e62c6b req-55cc884f-ee75-413f-87dd-cd5b1c821c2a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.638119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c0f3fa79-c474-47eb-85cf-a5a157e62c6b req-55cc884f-ee75-413f-87dd-cd5b1c821c2a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.651320 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c0f3fa79-c474-47eb-85cf-a5a157e62c6b req-55cc884f-ee75-413f-87dd-cd5b1c821c2a service nova] Creating event network-vif-deleted:a28401e5-788d-47de-963d-184ac2a01cf3 for instance 006e7d34-4751-4b4c-9e9b-8be014839e20 on n-h1-853316-12 Oct 17 13:15:18.658880 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c0f3fa79-c474-47eb-85cf-a5a157e62c6b req-55cc884f-ee75-413f-87dd-cd5b1c821c2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043311 Oct 17 13:15:18.660063 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2474/5119] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:18.790922 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8cfdaf1c-bac2-4704-b9e3-ba2807a18033 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1648 microversion: 2.1 time: 0.341420 Oct 17 13:15:18.791645 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2646/5120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:18 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1648 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:18.818706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:18.819389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:18.827252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.828631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.829909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.830669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.831129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.831704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.168412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:19.169252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:19.175873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.179971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.180712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.181330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.181802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.182337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.221223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.221722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.222189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.222647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'fault' on Instance uuid 006e7d34-4751-4b4c-9e9b-8be014839e20 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:15:19.292535 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74d8b3d0-4767-4ff1-84db-9563a02daccd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1648 microversion: 2.1 time: 0.477952 Oct 17 13:15:19.293623 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2475/5121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:18 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1648 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:19.318103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:19.318625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:19.326605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:19.327438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.327943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.328386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.329290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.330507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.330973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.338583 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8085a121-2206-4929-96b3-c9c35e688bf0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 200 len: 1305 microversion: 2.1 time: 0.173216 Oct 17 13:15:19.339820 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2647/5122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:19 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 1305 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:19.389739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:15:19.498597 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f720e92a-f869-4edf-a742-328ac8abaffc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 204 len: 0 microversion: 2.1 time: 0.184072 Oct 17 13:15:19.499191 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2476/5123] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:15:19 2022] DELETE /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:15:19.507786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:19.509224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:19.515188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.515738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.516174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.516876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.517326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.517750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.530436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:19.531148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:19.538674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.539303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.539750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.541445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.541445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.541445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.662582 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97dcb4d4-9691-4fbf-9192-7f079db621d3 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1654 microversion: 2.1 time: 0.158944 Oct 17 13:15:19.663188 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2648/5124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:19 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:19.799956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:19.803611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:19.809529 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19c232b0-2240-4efd-8214-000650c38e82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.283756 Oct 17 13:15:19.810229 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2477/5125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:19 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:19.932152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203748924", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:19.993816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] validate_networks() for [('b0c544df-5aaa-4cad-b34a-395590c4eb94', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:15:20.364446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:20.365163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:20.374670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.375282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.376187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.377168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.377735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.378453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.394251 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 HTTP/1.1 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '006e7d34-4751-4b4c-9e9b-8be014839e20'} Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:20.396292 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c21c6748-2c9a-4a3b-a4ba-0160f0a3d073 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 404 len: 111 microversion: 2.1 time: 0.038260 Oct 17 13:15:20.403794 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2478/5126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:20 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:15:20.418830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:20.428061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:20.428675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:20.430213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:20.430783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:20.443247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.443729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.444161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.444892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.445369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.445793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.466937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Getting quotas for project dafd87325a094e1ca41e18cc1bde5593. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:20.473161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Getting quotas for user 1cc9096896f74f5da7b8cc3649dfce8b and project dafd87325a094e1ca41e18cc1bde5593. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:20.492870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:20.495765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:20.527403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-649592628", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e6961d90-c691-4862-9018-60bca57213f2"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:20.550909 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-215bff6c-0a74-4378-b451-2e1ee1df89db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622469 Oct 17 13:15:20.551998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2649/5127] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:15:20.575369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0743f65-344a-4364-8bdd-bca1d9a3785e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:20.576549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f0743f65-344a-4364-8bdd-bca1d9a3785e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:20.589789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] validate_networks() for [('e6961d90-c691-4862-9018-60bca57213f2', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:15:20.693957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f0743f65-344a-4364-8bdd-bca1d9a3785e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:20.705223 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0743f65-344a-4364-8bdd-bca1d9a3785e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1217 microversion: 2.1 time: 0.138635 Oct 17 13:15:20.719060 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2650/5128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:20 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:20.723020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:20.724689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:20.733952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.734498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.734936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.735633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.736075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.736771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.916465 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8f8ce117-be86-40d0-b075-f4364d21b1dc tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1654 microversion: 2.1 time: 0.203223 Oct 17 13:15:20.920164 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2651/5129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:20 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1654 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:21.108556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:21.109322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:21.110071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:21.110877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:21.111527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:21.125001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.125789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.126559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.127563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.128388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.129036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.150096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:21.158191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for user 24c6068b196d4cc398176b22196bd5b1 and project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:21.172696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:21.175243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:21.238208 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8618b404-e7ce-474e-b42e-7e8e77bcb0c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715645 Oct 17 13:15:21.238993 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2479/5130] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:15:21.251363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f2e867c9-dc9b-4a6f-8649-6bcb0218de4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:21.252353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f2e867c9-dc9b-4a6f-8649-6bcb0218de4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:21.324216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f2e867c9-dc9b-4a6f-8649-6bcb0218de4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:21.338707 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f2e867c9-dc9b-4a6f-8649-6bcb0218de4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1214 microversion: 2.1 time: 0.088475 Oct 17 13:15:21.339868 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2652/5131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:21 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:21.739808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:21.743128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:21.755771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.756947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.757231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4bcba504-833f-4a26-b149-8d3a12bed0c5 req-fdbc6a39-873f-4cde-a044-c1751ced946f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3860e838-dce2-4a20-aa21-e1eb77b4b3b0", "name": "network-vif-deleted", "tag": "1629609d-0407-4316-b06c-6a3505e2a6b1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:21.758843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.760617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.761557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.762359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.778652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4bcba504-833f-4a26-b149-8d3a12bed0c5 req-fdbc6a39-873f-4cde-a044-c1751ced946f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.779730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4bcba504-833f-4a26-b149-8d3a12bed0c5 req-fdbc6a39-873f-4cde-a044-c1751ced946f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.780412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4bcba504-833f-4a26-b149-8d3a12bed0c5 req-fdbc6a39-873f-4cde-a044-c1751ced946f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.816724 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4bcba504-833f-4a26-b149-8d3a12bed0c5 req-fdbc6a39-873f-4cde-a044-c1751ced946f service nova] Creating event network-vif-deleted:1629609d-0407-4316-b06c-6a3505e2a6b1 for instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 on n-h1-853316-12 Oct 17 13:15:21.833096 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4bcba504-833f-4a26-b149-8d3a12bed0c5 req-fdbc6a39-873f-4cde-a044-c1751ced946f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077899 Oct 17 13:15:21.833737 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2653/5132] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:21.867642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:21.879245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7095302e-b213-4b41-a309-3f0c895465e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1269 microversion: 2.1 time: 0.147656 Oct 17 13:15:21.887501 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2480/5133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:21 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:21.942897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:21.943742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:21.951167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.952994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.953825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.967662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.969181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.969799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.058802 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-acd924af-539d-4496-a070-d772bb6bab95 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 200 len: 1449 microversion: 2.1 time: 0.121261 Oct 17 13:15:22.059591 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2654/5134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:21 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 1449 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:22.363530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:22.364466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:22.370950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.371712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.372692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.373718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.374590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.375204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.477445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:22.485848 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dd8744d1-8db6-4a25-a4cb-bf98ebd644cf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1210 microversion: 2.1 time: 0.126309 Oct 17 13:15:22.487722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2481/5135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:22 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:22.912331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:22.913385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:22.922357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.923468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.924105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.925709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.926542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.927168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.083559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.084739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: 3860e838-dce2-4a20-aa21-e1eb77b4b3b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:23.097736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.103311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.103781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.106659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.107148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.110465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.154353 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] HTTP exception thrown: Instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 could not be found. Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Request method failure captured: Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 HTTP/1.1 Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVU9pSw7oYMY-WABn5-pQtVKcvcMVuaC9VQbnxuUUVzeWLqaR7u5clCU8St0yzg9W-vA5PL7I7fYolWtJFLp4j-UJ29Kigq12KuH3odBR0RLUK4gN1GRj7m22-yiz0slyLTDS5DwSyBgQcRAnsudJeiCYctRb-LnIwzzkoNr2ucT8nk Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 7747e464a94d42539f47b1483f0ba8eb Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestServerMultinode-1785098359 Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7747e464a94d42539f47b1483f0ba8eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7747e464a94d42539f47b1483f0ba8eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7747e464a94d42539f47b1483f0ba8eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7747e464a94d42539f47b1483f0ba8eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestServerMultinode-1785098359 Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 7747e464a94d42539f47b1483f0ba8eb Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestServerMultinode-1785098359 Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestServerMultinode-1785098359-project-admin Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: fb8fce29071946229f0bdae835435ec4 Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestServerMultinode-1785098359-project-admin Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 could not be found. Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '3860e838-dce2-4a20-aa21-e1eb77b4b3b0'} Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 could not be found. Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 could not be found. Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:23.157667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 could not be found. Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Returning 404 to user: Instance 3860e838-dce2-4a20-aa21-e1eb77b4b3b0 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:23.165156 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9bb6f01a-3bc6-4bbf-ad3a-03e0581687e2 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0" status: 404 len: 111 microversion: 2.1 time: 0.082375 Oct 17 13:15:23.166728 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2482/5136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:23 2022] GET /compute/v2.1/servers/3860e838-dce2-4a20-aa21-e1eb77b4b3b0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:15:23.173685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:23.176428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.176944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:23.185039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.185541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.186221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.187264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.188202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.188857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.190891 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-30403606-bc48-4197-984c-be119e088683 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.283612 Oct 17 13:15:23.197909 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2655/5137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:22 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:23.221156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:15:23.514778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.516510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:23.527032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.527878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.529032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.530056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.530748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.531521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.628878 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d56b6fa1-0ac7-4722-9347-46d4b57025e9 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 204 len: 0 microversion: 2.1 time: 0.459971 Oct 17 13:15:23.629403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:23.630787 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2483/5138] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:15:23 2022] DELETE /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:15:23.640298 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fdc6deee-350a-4ae2-9e6a-c7a992c6c0bd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1274 microversion: 2.1 time: 0.131238 Oct 17 13:15:23.640896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2656/5139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:23 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:23.648534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.651624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:23.662844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.663342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.664309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.665158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.665471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.665897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.065679 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4e75801d-b815-454a-9c3f-8c9ceb888aa7 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1656 microversion: 2.1 time: 0.429568 Oct 17 13:15:24.066669 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2484/5140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:23 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1656 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:24.218740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:24.219587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:24.233667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:24.234999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:24.235789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.237085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:24.237667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:24.238092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.435649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:24.443977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da8b2c8e-77bf-4853-91e2-5f33239ad05f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.230906 Oct 17 13:15:24.444552 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2657/5141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:24 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:24.665288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:24.666154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:24.673740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:24.674266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:24.674700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.676715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:24.677332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:24.677987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.760884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:24.769919 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cedbbefb-99d2-4010-a313-f784e9a05381 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1272 microversion: 2.1 time: 0.108825 Oct 17 13:15:24.770536 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2485/5142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:24 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:25.024925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a44f7b8b-b659-42b7-902b-b06bec2b2b6c req-64b8340e-3c67-40cc-a4f9-9a3b976337d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1f8fb2-8451-4008-8dd8-80246250c2af", "tag": "9d110086-d887-48fb-ab07-361626bcbd2b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:25.040465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a44f7b8b-b659-42b7-902b-b06bec2b2b6c req-64b8340e-3c67-40cc-a4f9-9a3b976337d6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.041689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a44f7b8b-b659-42b7-902b-b06bec2b2b6c req-64b8340e-3c67-40cc-a4f9-9a3b976337d6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.042822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a44f7b8b-b659-42b7-902b-b06bec2b2b6c req-64b8340e-3c67-40cc-a4f9-9a3b976337d6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.063562 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a44f7b8b-b659-42b7-902b-b06bec2b2b6c req-64b8340e-3c67-40cc-a4f9-9a3b976337d6 service nova] Creating event network-changed:9d110086-d887-48fb-ab07-361626bcbd2b for instance 1e1f8fb2-8451-4008-8dd8-80246250c2af on n-h1-853316-12 Oct 17 13:15:25.072774 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a44f7b8b-b659-42b7-902b-b06bec2b2b6c req-64b8340e-3c67-40cc-a4f9-9a3b976337d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052327 Oct 17 13:15:25.074657 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2658/5143] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:25.094464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:25.094464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:25.096478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.097183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.097806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.098750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.099218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.099654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.469630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:25.471226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:25.479304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.479881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.480579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.481382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.481900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.482423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.662723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:25.673163 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-acb6ad9f-3406-4ee5-af99-c7dd879ad4fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.208598 Oct 17 13:15:25.673753 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2659/5144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:25 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:25.795164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:25.795950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:25.802560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.803365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.805486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.806611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.807233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.807819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.827455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:25.857152 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ee74805-0cf6-42e9-a91b-4366332a70dd tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1656 microversion: 2.1 time: 0.771986 Oct 17 13:15:25.866896 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2486/5145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:25 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1656 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:26.284797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:26.294745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-762e91f2-7262-4088-80bf-edd69a2c9d75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.503428 Oct 17 13:15:26.295615 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2660/5146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:25 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:26.697162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:26.697876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:26.707842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.708416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.708944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.709702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.710765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.717747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.884684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:26.886307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:26.897672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.898990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.900223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.903072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.904493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.906672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.965732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.966886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.967592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.968486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lazy-loading 'fault' on Instance uuid af6d584b-a94f-444f-b398-02bbc12b5597 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:15:27.008218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:27.030667 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8a654c9-648f-472e-9e7a-137127f1cf8b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.337478 Oct 17 13:15:27.033628 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9f45ad9c-a8a8-4359-95d8-075c6a003e74 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 200 len: 1456 microversion: 2.1 time: 0.154670 Oct 17 13:15:27.034461 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2487/5147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:26 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:27.050277 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2661/5148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:26 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 1456 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:27.161258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a5472ee3-12d5-4276-af5f-0716773ed059 req-0cfc086b-5f93-4836-92dc-2aa88cc3d557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6d584b-a94f-444f-b398-02bbc12b5597", "name": "network-vif-deleted", "tag": "1928b4e5-aa07-445a-b6d7-402b50914b40"}, {"name": "network-changed", "server_uuid": "6c51dfd5-737b-4962-a56f-a0190dbca4ca", "tag": "d157f0e1-b686-4131-9dfb-4b880eda92d0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:27.174105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a5472ee3-12d5-4276-af5f-0716773ed059 req-0cfc086b-5f93-4836-92dc-2aa88cc3d557 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:27.174854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a5472ee3-12d5-4276-af5f-0716773ed059 req-0cfc086b-5f93-4836-92dc-2aa88cc3d557 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:27.175286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a5472ee3-12d5-4276-af5f-0716773ed059 req-0cfc086b-5f93-4836-92dc-2aa88cc3d557 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:27.187742 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a5472ee3-12d5-4276-af5f-0716773ed059 req-0cfc086b-5f93-4836-92dc-2aa88cc3d557 service nova] Creating event network-vif-deleted:1928b4e5-aa07-445a-b6d7-402b50914b40 for instance af6d584b-a94f-444f-b398-02bbc12b5597 on n-h2-853316-12 Oct 17 13:15:27.188325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a5472ee3-12d5-4276-af5f-0716773ed059 req-0cfc086b-5f93-4836-92dc-2aa88cc3d557 service nova] Creating event network-changed:d157f0e1-b686-4131-9dfb-4b880eda92d0 for instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca on n-h1-853316-12 Oct 17 13:15:27.197767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a5472ee3-12d5-4276-af5f-0716773ed059 req-0cfc086b-5f93-4836-92dc-2aa88cc3d557 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048316 Oct 17 13:15:27.198509 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2488/5149] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:27.321061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:27.322087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:27.328907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:27.329509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:27.330188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:27.330986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:27.331602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:27.332086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:27.465546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:27.473556 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a98ee7a5-414b-438a-a31c-aeb3562ece86 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.157686 Oct 17 13:15:27.474125 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2662/5150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:27 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:28.059506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:28.060215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:28.065127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:28.065765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] [instance: af6d584b-a94f-444f-b398-02bbc12b5597] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:28.067326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.067734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.068171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.068859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.069455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.069789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.073007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.073693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.074141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.074872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.075595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.076022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.090078 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] HTTP exception thrown: Instance af6d584b-a94f-444f-b398-02bbc12b5597 could not be found. Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Request method failure captured: Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 HTTP/1.1 Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVU9pSw7oYMY-WABn5-pQtVKcvcMVuaC9VQbnxuUUVzeWLqaR7u5clCU8St0yzg9W-vA5PL7I7fYolWtJFLp4j-UJ29Kigq12KuH3odBR0RLUK4gN1GRj7m22-yiz0slyLTDS5DwSyBgQcRAnsudJeiCYctRb-LnIwzzkoNr2ucT8nk Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 7747e464a94d42539f47b1483f0ba8eb Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestServerMultinode-1785098359 Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7747e464a94d42539f47b1483f0ba8eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7747e464a94d42539f47b1483f0ba8eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7747e464a94d42539f47b1483f0ba8eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7747e464a94d42539f47b1483f0ba8eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestServerMultinode-1785098359 Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 7747e464a94d42539f47b1483f0ba8eb Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestServerMultinode-1785098359 Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestServerMultinode-1785098359-project-admin Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: fb8fce29071946229f0bdae835435ec4 Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestServerMultinode-1785098359-project-admin Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance af6d584b-a94f-444f-b398-02bbc12b5597 could not be found. Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'af6d584b-a94f-444f-b398-02bbc12b5597'} Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6d584b-a94f-444f-b398-02bbc12b5597 could not be found. Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6d584b-a94f-444f-b398-02bbc12b5597 could not be found. Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:28.091741 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6d584b-a94f-444f-b398-02bbc12b5597 could not be found. Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] Returning 404 to user: Instance af6d584b-a94f-444f-b398-02bbc12b5597 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b13b2c59-364c-4114-ae31-97d8eb035866 tempest-TestServerMultinode-1785098359 tempest-TestServerMultinode-1785098359-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597" status: 404 len: 111 microversion: 2.1 time: 0.031735 Oct 17 13:15:28.096692 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2663/5151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:28 2022] GET /compute/v2.1/servers/af6d584b-a94f-444f-b398-02bbc12b5597 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:28.295620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:28.303945 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f57a2626-c7b7-4f0c-b864-d79d293865f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.248752 Oct 17 13:15:28.305282 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2489/5152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:28 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:28.497434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:28.498388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:28.500352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:28.506521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.507014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.507976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.508915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.509375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.509818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.706221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:28.718439 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e9dce684-fd9d-42e5-9659-df5ccf59dd3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.224645 Oct 17 13:15:28.719249 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2664/5153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:28 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:29.328189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:29.328989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:29.338557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:29.344472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:29.345326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:29.349871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:29.351622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:29.352517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:29.359313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:29.745981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:29.748173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:29.778518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:29.779926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:29.780799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:29.783274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:29.786720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:29.787436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:30.103862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:30.117497 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b88da98-6a3f-48fc-a46b-93b30138f5d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.377952 Oct 17 13:15:30.119141 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2665/5154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:29 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:30.382079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:30.390479 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-616edabb-c865-499a-9de7-36538f7cf4e5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 1.066455 Oct 17 13:15:30.402577 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2490/5155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:29 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:30.425884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:30.430577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:30.437660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:30.438468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:30.439030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:30.439937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:30.440499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:30.442746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:30.471381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:30.567862 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d44f57f1-a81e-4999-8dbe-f54f05484472 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action" status: 200 len: 62938 microversion: 2.1 time: 0.144815 Oct 17 13:15:30.575972 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2666/5156] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:15:30 2022] POST /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2/action => generated 62938 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:15:31.142052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:31.143040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:31.145801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:31.159890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.160669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.166558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.167544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.168194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.168813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.169673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:31.419206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:31.419935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:31.428516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:31.431863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.432904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.433547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.435102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.436144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.436643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.487563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:31.497077 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2536ea8-79e5-4372-aa24-23674d30f1f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.358871 Oct 17 13:15:31.497993 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2491/5157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:31 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:31.826867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:31.843997 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00b0a0df-5c9c-4046-98ca-55831b3c39f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.432780 Oct 17 13:15:31.844779 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2667/5158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:31 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:32.524634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:32.525558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:32.532831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.533427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.533975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:32.534834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.535673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.536285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:32.751925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:32.760481 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f7c4a0e-bfe3-49ee-800e-611bd6e7cfbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.241044 Oct 17 13:15:32.761068 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2492/5159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:32 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:32.776441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0611af7a-160d-461c-872e-f9ece0f92b23 req-d3632625-fd10-48d7-b977-a37e68617719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1f8fb2-8451-4008-8dd8-80246250c2af", "name": "network-vif-plugged", "status": "completed", "tag": "9d110086-d887-48fb-ab07-361626bcbd2b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:32.795943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0611af7a-160d-461c-872e-f9ece0f92b23 req-d3632625-fd10-48d7-b977-a37e68617719 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.796547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0611af7a-160d-461c-872e-f9ece0f92b23 req-d3632625-fd10-48d7-b977-a37e68617719 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.797074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0611af7a-160d-461c-872e-f9ece0f92b23 req-d3632625-fd10-48d7-b977-a37e68617719 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:32.824577 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0611af7a-160d-461c-872e-f9ece0f92b23 req-d3632625-fd10-48d7-b977-a37e68617719 service nova] Creating event network-vif-plugged:9d110086-d887-48fb-ab07-361626bcbd2b for instance 1e1f8fb2-8451-4008-8dd8-80246250c2af on n-h1-853316-12 Oct 17 13:15:32.841585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0611af7a-160d-461c-872e-f9ece0f92b23 req-d3632625-fd10-48d7-b977-a37e68617719 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086761 Oct 17 13:15:32.843181 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2668/5160] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:32.869351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:32.870244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:32.879447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.880608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.881255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:32.882913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.883810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.884601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:33.030269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:33.039518 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f5785273-96d3-4dfb-ba57-381f831f544e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.173317 Oct 17 13:15:33.040123 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2493/5161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:32 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:33.784783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:33.785480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:33.795106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:33.801500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:33.801955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:33.802879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:33.803332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:33.804085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:34.062617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:34.063544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:34.071424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:34.072208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:34.072845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:34.073733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:34.074388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:34.074983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:34.111631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:34.123732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d4e938b2-6b57-463e-89da-caa98c867069 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.343676 Oct 17 13:15:34.124780 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2669/5162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:33 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:34.439007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:34.451360 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31e4ca03-c3a1-4f60-9c52-e1527716ed58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.390860 Oct 17 13:15:34.453690 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2494/5163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:34 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:35.152667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.154925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:35.162897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:35.164068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:35.164513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:35.165411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:35.166060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:35.166680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:35.445932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.459893 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a70fdda9-32b7-4592-a0fb-dfbcbe87d4b0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.314150 Oct 17 13:15:35.461606 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2670/5164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:35 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:35.475885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.476581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:35.489821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:35.490364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:35.490815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:35.491544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:35.492048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:35.492482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:35.536358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:35.892707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.905788 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee8af152-b2ca-4317-a645-c9a74c4b676b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1317 microversion: 2.1 time: 0.433779 Oct 17 13:15:35.906784 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2495/5165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:35 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:36.484970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:36.485737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:36.496555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.502089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.502903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.504740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.506107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.508197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.651236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:36.674443 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9e423d70-36bc-4ce2-9467-53766d832d10 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.193527 Oct 17 13:15:36.675617 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2671/5166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:36 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:36.928978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:36.930600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:36.941439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.942252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.942917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.943832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.944470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.945624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.290614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.299552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2870de1a-4bd4-46bf-b3d2-ed7a5f281d0c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1506 microversion: 2.1 time: 0.374504 Oct 17 13:15:37.300691 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2496/5167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:36 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:37.323546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:37.324038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:37.337105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.337749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.338123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.339609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.345383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.346398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.380729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:15:37.527281 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-657cac8b-8903-46d8-a15d-35efa51812a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 204 len: 0 microversion: 2.1 time: 0.207691 Oct 17 13:15:37.532422 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2672/5168] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:15:37 2022] DELETE /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:15:37.536689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:37.537313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:37.551073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.551608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.552003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.552893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.553537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.554336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.700876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:37.701576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:37.707437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.708004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.708491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.709247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.709763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.710205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.856067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.864637 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd582645-5bb1-45e8-831c-f7d4857e110b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.168479 Oct 17 13:15:37.865369 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2673/5169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:37 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:37.890791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.904914 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7ce1ef52-64fc-443a-b77b-a7577fa59e0a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1512 microversion: 2.1 time: 0.372231 Oct 17 13:15:37.905995 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2497/5170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:37 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:38.303554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-71dbbbfb-eb0c-4d38-85cd-7f5c731b70c2 req-20ef1c08-27f5-42b6-ab5c-087f56e2dc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c51dfd5-737b-4962-a56f-a0190dbca4ca", "name": "network-vif-plugged", "status": "completed", "tag": "d157f0e1-b686-4131-9dfb-4b880eda92d0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:38.341051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-71dbbbfb-eb0c-4d38-85cd-7f5c731b70c2 req-20ef1c08-27f5-42b6-ab5c-087f56e2dc95 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:38.341554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-71dbbbfb-eb0c-4d38-85cd-7f5c731b70c2 req-20ef1c08-27f5-42b6-ab5c-087f56e2dc95 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:38.341993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-71dbbbfb-eb0c-4d38-85cd-7f5c731b70c2 req-20ef1c08-27f5-42b6-ab5c-087f56e2dc95 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:38.361739 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-71dbbbfb-eb0c-4d38-85cd-7f5c731b70c2 req-20ef1c08-27f5-42b6-ab5c-087f56e2dc95 service nova] Creating event network-vif-plugged:d157f0e1-b686-4131-9dfb-4b880eda92d0 for instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca on n-h1-853316-12 Oct 17 13:15:38.371222 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-71dbbbfb-eb0c-4d38-85cd-7f5c731b70c2 req-20ef1c08-27f5-42b6-ab5c-087f56e2dc95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072501 Oct 17 13:15:38.372018 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2674/5171] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:38.895154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:38.896640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:38.904319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:38.904974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:38.905523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:38.906544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:38.907114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:38.907664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:38.932569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:38.933186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:38.946984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:38.952964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:38.956573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:38.957721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:38.961248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:38.962310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:39.260893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:39.268855 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a278ebd4-6211-4bbd-aea8-8c129bc83e4f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1512 microversion: 2.1 time: 0.343469 Oct 17 13:15:39.283165 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2675/5172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:38 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:39.344469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:39.354065 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-92b874f7-ae77-4d2a-bd0a-94d28cbe636e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.469354 Oct 17 13:15:39.355417 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2498/5173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:38 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:40.298956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:40.299373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:40.311083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.312197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.312862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.314782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.315670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.316597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.363295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-ec4c4f15-4d54-4473-9d7f-a09d4564f17b req-42498ecc-95b2-479a-9cc9-13f80fbb7f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1f8fb2-8451-4008-8dd8-80246250c2af", "name": "network-vif-deleted", "tag": "9d110086-d887-48fb-ab07-361626bcbd2b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:40.376329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ec4c4f15-4d54-4473-9d7f-a09d4564f17b req-42498ecc-95b2-479a-9cc9-13f80fbb7f3e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.377924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ec4c4f15-4d54-4473-9d7f-a09d4564f17b req-42498ecc-95b2-479a-9cc9-13f80fbb7f3e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.386196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ec4c4f15-4d54-4473-9d7f-a09d4564f17b req-42498ecc-95b2-479a-9cc9-13f80fbb7f3e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.409119 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-ec4c4f15-4d54-4473-9d7f-a09d4564f17b req-42498ecc-95b2-479a-9cc9-13f80fbb7f3e service nova] Creating event network-vif-deleted:9d110086-d887-48fb-ab07-361626bcbd2b for instance 1e1f8fb2-8451-4008-8dd8-80246250c2af on n-h1-853316-12 Oct 17 13:15:40.434035 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-ec4c4f15-4d54-4473-9d7f-a09d4564f17b req-42498ecc-95b2-479a-9cc9-13f80fbb7f3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074461 Oct 17 13:15:40.435409 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2499/5174] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:40.442490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:40.443239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:40.450099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.450839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.451285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.452335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.452806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.453245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.475589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:40.496108 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f586dc0-dc16-450d-857d-83d5c8d825f4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1470 microversion: 2.1 time: 0.205893 Oct 17 13:15:40.518574 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2676/5175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:40 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:40.633399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:40.642884 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-87c24039-20c9-420f-9559-0bd22243c102 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1314 microversion: 2.1 time: 0.205631 Oct 17 13:15:40.643479 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2500/5176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:40 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:41.523394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:41.524953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:41.541291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.542132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.542800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.543810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.544516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.545183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.598020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:41.653948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.654498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.655058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.655409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lazy-loading 'fault' on Instance uuid 1e1f8fb2-8451-4008-8dd8-80246250c2af {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:15:41.667933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:41.669452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:41.693468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.694327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.695018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.695947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.696615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.697231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.731913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:41.740044 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e605e3fc-2b95-4add-8eac-6b2688f24c02 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 200 len: 1307 microversion: 2.1 time: 0.220642 Oct 17 13:15:41.757883 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2677/5177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:41 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:41.935108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:41.943724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82015a48-de28-4ae1-bf1f-94b7935423ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1502 microversion: 2.1 time: 0.281180 Oct 17 13:15:41.944309 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2501/5178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:41 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1502 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:42.767104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:42.767692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:42.787703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.788278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.808848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:42.810511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.811259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.813346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:42.832703 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af HTTP/1.1 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1e1f8fb2-8451-4008-8dd8-80246250c2af'} Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:42.834866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:42.840806 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:42.840806 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:42.840806 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:42.840806 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:42.840806 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:42.840806 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:15:42.840806 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:42.842470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:42.845794 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-825c88be-199f-4af3-b3b6-96ca453cb0dd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 404 len: 111 microversion: 2.1 time: 0.084735 Oct 17 13:15:42.850457 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2678/5179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:42 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:42.860707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:42.861525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:42.886923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.887461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.887935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:42.888694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.889169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.894953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.182510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:43.200859 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e8e23305-81a9-4615-b6ad-48bacd5d563b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.344538 Oct 17 13:15:43.202299 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2502/5180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:42 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:43.353146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1ff7d2c-4115-47d9-9b77-ea7b2df3862a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1ff7d2c-4115-47d9-9b77-ea7b2df3862a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 163 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": 12345, "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 12345 Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:15:43.363605 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:15:43.370228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:43.374100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1ff7d2c-4115-47d9-9b77-ea7b2df3862a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:43.375283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b1ff7d2c-4115-47d9-9b77-ea7b2df3862a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.029249 Oct 17 13:15:43.380884 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2679/5181] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:43 2022] POST /compute/v2.1/servers => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:43.395719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:43.397072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:43.412561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:43.413878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:43.414700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.415663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:43.416335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:43.417212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.806923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:43.819203 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-45691c55-63b5-4d39-82b4-d6bd109a4ab5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.431428 Oct 17 13:15:43.820434 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2503/5182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:43 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:43.847319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:43.848436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:43.863446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:43.864986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:43.879761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:43.880722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:43.882090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.883616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:43.885656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:43.886204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:43.887089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:43.887864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.891438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.892871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:43.900087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:43.900542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:44.329087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:44.334540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:44.342634 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d280213-d6e6-4d7d-9e18-bc5d2fb1a285 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.483467 Oct 17 13:15:44.344472 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2504/5183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:43 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:44.347618 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e23ef894-63d2-44a8-9456-57a00af148b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.506550 Oct 17 13:15:44.350636 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2680/5184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:43 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:44.374196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:44.374888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:44.396683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:44.397676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:44.399568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:44.400568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:44.401255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:44.402151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:44.711532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:44.719719 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-26f76cc0-abd3-4043-b23b-74db61febf1f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.353824 Oct 17 13:15:44.727110 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2505/5185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:44 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:44.759300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61d4a2c8-867c-40b0-9292-a390b677224b"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:44.760650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:44.761453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:44.771847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:44.777986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:44.783169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:44.783823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:44.784955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:44.785738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:44.787216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:44.788930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:44.789670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:44.791889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:44.794594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:44.795459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:44.797905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.161037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:45.178634 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bfcc5a83-07e6-42f3-9df3-8f059e8eb20a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.422999 Oct 17 13:15:45.181021 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2681/5186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:44 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:45.204175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:45.205043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:45.224800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.225539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.227460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.228611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.229280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.230121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.371224 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-16da7c59-16b4-4765-b22d-0d4aaf97377a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618330 Oct 17 13:15:45.375763 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2506/5187] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:15:44 2022] POST /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:45.407535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:45.408478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:45.418285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.419136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.419805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.421343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.422035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.422880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.468697 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c625ab7-2dda-4ce5-b0cd-34cd436f4b37 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/ips" status: 200 len: 153 microversion: 2.20 time: 0.065759 Oct 17 13:15:45.473014 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2507/5188] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Oct 17 13:15:45 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/ips => generated 153 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:15:46.064261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:46.064261 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0f5e4484-33d9-4ff4-b513-e43cbbf7d1ce tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.813492 Oct 17 13:15:46.064261 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2682/5189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:45 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:46.296341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1992034807", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:46.410719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] validate_networks() for [('24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:15:47.657325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6cd8df8-d8eb-421b-85be-304095b9451f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-217907846", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dc6d5efc-75f6-4b63-9bcb-1490fa86ee86", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:47.844073 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-b6cd8df8-d8eb-421b-85be-304095b9451f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Block Device dc6d5efc-75f6-4b63-9bcb-1490fa86ee86 is not bootable. Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6cd8df8-d8eb-421b-85be-304095b9451f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 357 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-217907846", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dc6d5efc-75f6-4b63-9bcb-1490fa86ee86", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: exception: Block Device dc6d5efc-75f6-4b63-9bcb-1490fa86ee86 is not bootable. Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-217907846', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'dc6d5efc-75f6-4b63-9bcb-1490fa86ee86'}], 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device dc6d5efc-75f6-4b63-9bcb-1490fa86ee86 is not bootable. Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:47.853514 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device dc6d5efc-75f6-4b63-9bcb-1490fa86ee86 is not bootable. Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device dc6d5efc-75f6-4b63-9bcb-1490fa86ee86 is not bootable. Oct 17 13:15:47.856325 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:47.859407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6cd8df8-d8eb-421b-85be-304095b9451f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Block Device dc6d5efc-75f6-4b63-9bcb-1490fa86ee86 is not bootable. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:47.860491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6cd8df8-d8eb-421b-85be-304095b9451f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.214053 Oct 17 13:15:47.861315 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2683/5190] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:47.871853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:47.872923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:47.885397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.886492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.887166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.888427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.894192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.895315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.121571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:48.133629 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ef90d98-fc66-43e1-ab2d-fb37ee84590c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.265517 Oct 17 13:15:48.134846 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2684/5191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:47 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:48.167717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:48.168969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:48.179857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.181463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.182838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.185282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.185983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.189486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.282545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:48.283144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:48.285544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:48.290516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:48.291104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:48.303553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.304477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.305168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.307656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.308424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.312522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.351836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:48.359125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for user c71ac2b898f649cdaa99fbace633e738 and project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:48.377933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:48.381027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:48.451543 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62542171-9a0b-4bb7-93d5-723f7341bcdf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.157731 Oct 17 13:15:48.454041 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2508/5192] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:15:48.466746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d21845d-7d2e-460b-81d0-346ddad150a3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:48.467558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d21845d-7d2e-460b-81d0-346ddad150a3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:48.548667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d21845d-7d2e-460b-81d0-346ddad150a3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:48.561325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d21845d-7d2e-460b-81d0-346ddad150a3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1215 microversion: 2.1 time: 0.096298 Oct 17 13:15:48.590973 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2509/5193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:48 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:48.720721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:48.729538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:48.731421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:48.744997 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac1e5f30-00ad-40d9-a6c9-ae2770d5a3b4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.583467 Oct 17 13:15:48.750655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.754098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.755021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.756948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.760288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.760751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.771560 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2685/5194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:48 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:48.818794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lazy-loading 'flavor' on Instance uuid f3001998-79dc-4411-aec7-cd86e6c72deb {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:15:49.294130 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da5787a4-1081-46a7-925b-062d812a98dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/action" status: 202 len: 0 microversion: 2.20 time: 0.578900 Oct 17 13:15:49.311824 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2510/5195] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 13:15:48 2022] POST /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:15:49.322873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:49.323814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:49.342482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:49.345518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:49.347498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:49.348366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:49.348961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:49.349436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:49.587805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:49.589527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:49.597348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:49.599135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:49.599861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:49.601406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:49.602125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:49.602802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:49.633359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:49.710062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:49.719882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:49.732141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:49.735820 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a2fb13a-9d2b-4ae6-a918-76e51779352f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.419560 Oct 17 13:15:49.741215 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2686/5196] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:49 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:50.133398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:50.168023 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f27e5d36-1737-4d6d-9e36-f0ddb7f8d3f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1219 microversion: 2.1 time: 0.575733 Oct 17 13:15:50.184102 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2511/5197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:49 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1219 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:50.778236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:50.779519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:50.812618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:50.813203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:50.813657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:50.814438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:50.814893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:50.815321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.198869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:51.199489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:51.205718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.212893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:51.214740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:51.218762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.220908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.221737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:51.222428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:51.222878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.228128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.231536 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2a910a2a-3fa1-4e6f-95e1-ac190790c354 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.464494 Oct 17 13:15:51.234494 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2687/5198] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:50 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:51.468588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.493669 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89064854-2e35-44df-a34b-3988449eadf0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1273 microversion: 2.1 time: 0.299753 Oct 17 13:15:51.495728 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2512/5199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:51 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:51.963981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb54296f-eaac-456d-8426-c0208fa88606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-168879912", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "destination_type": "local"}, {"source_type": "volume", "uuid": "8e66420e-31e6-458e-9a58-8ddbb8a1b7bc", "destination_type": "invalid"}], "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb54296f-eaac-456d-8426-c0208fa88606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 494 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-168879912", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "destination_type": "local"}, {"source_type": "volume", "uuid": "8e66420e-31e6-458e-9a58-8ddbb8a1b7bc", "destination_type": "invalid"}], "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-168879912', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '8e66420e-31e6-458e-9a58-8ddbb8a1b7bc', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:51.969875 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:15:51.973737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:51.979530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb54296f-eaac-456d-8426-c0208fa88606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:51.980647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bb54296f-eaac-456d-8426-c0208fa88606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.021023 Oct 17 13:15:51.983259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2688/5200] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:51 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:51.992347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:51.993171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:52.031127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.036667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.040998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.046411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.048171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.048691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.267144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:52.267933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:52.280609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.281383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.282692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.283845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.284474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.285077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.524153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:52.535594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:52.537048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:52.538242 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c86795e-367e-4a89-a9cc-77e59bce787d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.276877 Oct 17 13:15:52.554200 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2689/5201] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:52 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:52.559852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:52.560889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:52.578018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.578928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.579114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.579876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.580741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.581367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.704936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:52.714207 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae4e76f7-4a2c-4c77-8044-c4ba4f1e33be tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1273 microversion: 2.1 time: 0.162175 Oct 17 13:15:52.715835 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2690/5202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:52 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:52.915929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:52.927886 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2905532-6a89-4529-8bc8-df2c037587a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.940342 Oct 17 13:15:52.931590 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2513/5203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:51 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:52.959567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:52.962133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:52.970284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.971737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.972458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.974147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.975133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.980146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.260118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:53.277066 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9cd38dce-0bef-486e-a75b-e547b0c762fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.322335 Oct 17 13:15:53.280092 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2691/5204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:52 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:53.568533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:53.569342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:53.582412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6546ab1e-d681-42c6-838f-7113a16f6ab2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-929814846", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:53.590776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6546ab1e-d681-42c6-838f-7113a16f6ab2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 491 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-929814846", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-929814846', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:53.591582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:15:53.593797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:53.595270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6546ab1e-d681-42c6-838f-7113a16f6ab2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:53.595947 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6546ab1e-d681-42c6-838f-7113a16f6ab2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.017919 Oct 17 13:15:53.598812 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2692/5205] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:53 2022] POST /compute/v2.1/servers => generated 624 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:53.608041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.609479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.610758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.610889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:53.611575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.611678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:53.612547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.641018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.641523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.642062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.642803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.646411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.654920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.021324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.032027 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3839dc11-a447-4e32-a046-dcec71380227 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.427884 Oct 17 13:15:54.032602 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2693/5206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:53 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:54.063141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:54.064127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:54.073947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:54.084106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:54.084838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.085903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:54.086719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:54.087364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.347700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.363951 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-74fd5dda-2866-4682-aa79-24c7119be7dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1315 microversion: 2.1 time: 0.323902 Oct 17 13:15:54.365479 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2694/5207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:54 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:54.382590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:54.384456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:54.396398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:54.397167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:54.398784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.400615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:54.401647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:54.402602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.567400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.577041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.582849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.587925 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-baeb7f11-ba64-4c7f-aec9-ee3ccc4e24f8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 1.024227 Oct 17 13:15:54.588722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2514/5208] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:53 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:54.825949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.841393 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44d69b6c-e8fa-40aa-982b-5cbffffbf3f7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.469706 Oct 17 13:15:54.842366 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2695/5209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:54 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:54.955305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f5e8f60-4ad3-4c5d-a087-ffeff0e9311c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f5e8f60-4ad3-4c5d-a087-ffeff0e9311c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 416 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:54.963026 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:15:54.965485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:54.970191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f5e8f60-4ad3-4c5d-a087-ffeff0e9311c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:54.975103 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1f5e8f60-4ad3-4c5d-a087-ffeff0e9311c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.022337 Oct 17 13:15:54.981401 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2515/5210] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:54 2022] POST /compute/v2.1/servers => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:54.986635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:54.987594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:55.003807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.004619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.005289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.006233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.006944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.008422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.099994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-953903ef-37dd-400a-a480-031744d83781 req-74f43643-5546-4df3-875e-dfb414d936db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03da82a7-7f5c-4389-9b38-04b10e6b8e33", "tag": "42f43daa-57a0-4125-92c9-7123c9b479c8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:55.123732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-953903ef-37dd-400a-a480-031744d83781 req-74f43643-5546-4df3-875e-dfb414d936db service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.124233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-953903ef-37dd-400a-a480-031744d83781 req-74f43643-5546-4df3-875e-dfb414d936db service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.124676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-953903ef-37dd-400a-a480-031744d83781 req-74f43643-5546-4df3-875e-dfb414d936db service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.148789 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-953903ef-37dd-400a-a480-031744d83781 req-74f43643-5546-4df3-875e-dfb414d936db service nova] Creating event network-changed:42f43daa-57a0-4125-92c9-7123c9b479c8 for instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 on n-h2-853316-12 Oct 17 13:15:55.161138 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-953903ef-37dd-400a-a480-031744d83781 req-74f43643-5546-4df3-875e-dfb414d936db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063729 Oct 17 13:15:55.164102 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2516/5211] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:55.395576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.396640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:55.403336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.403981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.404674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.405651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.406241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.406883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.479659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.493392 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11f6735d-8468-4b2e-ae1e-c68b8fc5d403 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.511427 Oct 17 13:15:55.494772 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2696/5212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:54 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:55.520496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.521981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:55.530999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.531723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.532411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.533320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.533976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.534623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.699735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.711527 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e15d17d5-c83f-4af3-9513-49f5ecca1741 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1315 microversion: 2.1 time: 0.318570 Oct 17 13:15:55.711527 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2517/5213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:55 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:55.716999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.718248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:55.725100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.726468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.727046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.729493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.730136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.730743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.929702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.941834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.943579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.946211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6849f90c-7d58-4bb1-aedc-4541b25536dc tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.234366 Oct 17 13:15:55.947294 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2518/5214] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:55 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:55.987479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.997061 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40a9bb07-4534-472f-8ba5-59e1dc009ee5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.481767 Oct 17 13:15:55.998969 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2697/5215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:55 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:56.077556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1d27608-da67-4cfb-a630-be21a72ea799 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-857263493", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": -1, "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:56.091567 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c1d27608-da67-4cfb-a630-be21a72ea799 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Flavor -1 could not be found. Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1d27608-da67-4cfb-a630-be21a72ea799 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 205 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-857263493", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": -1, "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: exception: Flavor -1 could not be found. Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-857263493', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': -1, 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:56.094208 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 17 13:15:56.097676 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.099516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1d27608-da67-4cfb-a630-be21a72ea799 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:56.100499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c1d27608-da67-4cfb-a630-be21a72ea799 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.027809 Oct 17 13:15:56.105165 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2519/5216] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:56 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:15:56.112669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.113339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:56.125085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.128886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.132145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.135337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.135961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.136459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.179752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:56.412934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:56.422987 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a19ddbb2-30d6-457d-b8a3-f8ff4d3731a9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.316538 Oct 17 13:15:56.434888 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2698/5217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:56 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:56.474058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.474578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:56.491895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.492614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.493070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.493797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.494319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.494759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.738721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.739976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:56.751820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.753599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.763048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.763823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.764301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.764732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.809732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:56.819888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71f61610-7af4-4a78-9e53-c5eca772592b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.376997 Oct 17 13:15:56.820540 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2520/5218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:56 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:56.974531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.975502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:56.987394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.988866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.993456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.994966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.995702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.996407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:57.365602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:57.377499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c08e1a6f-5fac-4751-8720-ad8fe3189800 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1315 microversion: 2.1 time: 0.644590 Oct 17 13:15:57.378737 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2699/5219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:56 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:57.388051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cd3e2ab2-a3d1-4004-ab5b-7e258242b96d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1155733105", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cd3e2ab2-a3d1-4004-ab5b-7e258242b96d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 173 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1155733105", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1155733105', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi -1 Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:15:57.406956 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.410508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cd3e2ab2-a3d1-4004-ab5b-7e258242b96d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:57.411180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cd3e2ab2-a3d1-4004-ab5b-7e258242b96d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.030505 Oct 17 13:15:57.411894 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2700/5220] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:57 2022] POST /compute/v2.1/servers => generated 145 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:57.430861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.431711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:57.453610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:57.475725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:57.478664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:57.480250 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-27cab88f-bd05-4087-adc5-945ef9fd291f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.511219 Oct 17 13:15:57.494883 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2521/5221] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:56 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:15:57.902555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:57.903085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:57.903528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:57.904277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:57.904762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:57.905367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.188550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.199747 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d16db24-ade5-402e-ae04-68871394b313 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.784035 Oct 17 13:15:58.200328 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2701/5222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:57 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:58.227757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:58.228430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:58.244454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.245011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.245466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.247639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.248119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.248567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.340218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:58.406493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:58.407121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:58.421471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.422031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.422624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.425071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.425588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.426073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.553597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:58.589782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.601616 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79ce61ae-f380-4750-b598-eed5eaf9d810 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.378212 Oct 17 13:15:58.603991 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2522/5223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:58 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:58.624034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:58.627970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:58.640715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.641698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.642359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.643588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.644255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.645243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.761218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.771656 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9c37680-d4a4-43aa-b665-5dc49340e7fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1315 microversion: 2.1 time: 0.369817 Oct 17 13:15:58.773402 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2702/5224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:58 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:58.797007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11cb5f12-057c-4010-8cc6-44bbd19c1566 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-469621589", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:58.830594 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-11cb5f12-057c-4010-8cc6-44bbd19c1566 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11cb5f12-057c-4010-8cc6-44bbd19c1566 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 215 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-469621589", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-469621589', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:58.832287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:58.837019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:58.837019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:58.837019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:58.837019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:58.837019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:58.837019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:15:58.837019 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:15:58.837019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11cb5f12-057c-4010-8cc6-44bbd19c1566 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:58.856848 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11cb5f12-057c-4010-8cc6-44bbd19c1566 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.082160 Oct 17 13:15:58.857804 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2703/5225] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:58 2022] POST /compute/v2.1/servers => generated 123 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:58.868514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:58.869227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:58.902188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:58.904188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.905646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.907597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.908331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.908799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.909231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.995680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.006121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.008541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.009977 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aadc3a3b-988e-4987-9cf4-d6ed84b7fef5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.404831 Oct 17 13:15:59.010767 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2523/5226] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:58 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:59.216520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.231909 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-22bc7283-aa80-44ce-acb8-e4363b338bf0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.370056 Oct 17 13:15:59.233539 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2704/5227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:58 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:59.257512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.258982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:59.266257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.267139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.268246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.269230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.269917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.270868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.667579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.693015 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c18c8ba0-aa57-4dd9-a914-21b5d2f38ef7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.438658 Oct 17 13:15:59.696270 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2524/5228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:59 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:59.764208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f632a47-a330-4832-a837-0045dea1bc46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-998621785", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-key-907744708", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.798599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.799372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:59.806274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:59.808151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.808996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.809938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.810912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.811633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.812712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.836982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-6f632a47-a330-4832-a837-0045dea1bc46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] validate_networks() for [('b0c544df-5aaa-4cad-b34a-395590c4eb94', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:00.107805 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-6f632a47-a330-4832-a837-0045dea1bc46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Invalid key_name provided. Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f632a47-a330-4832-a837-0045dea1bc46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 245 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-998621785", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-key-907744708", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid key_name provided. Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-998621785', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'key_name': 'tempest-key-907744708', 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-907744708 not found for user 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.109982 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 17 13:16:00.112849 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.115100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f632a47-a330-4832-a837-0045dea1bc46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid key_name provided. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:00.116093 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f632a47-a330-4832-a837-0045dea1bc46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.356434 Oct 17 13:16:00.120814 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2705/5229] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/servers => generated 70 bytes in 362 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:16:00.125838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.126757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:00.134859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.135355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.135792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.136521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.137096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.137507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.234100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.243485 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be70d55d-7ed9-40cc-a472-dbc77e2e2a3c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1315 microversion: 2.1 time: 0.450210 Oct 17 13:16:00.259762 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2525/5230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:59 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:00.270022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.276805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:00.285911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.286687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.287317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.288294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.289080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.289702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.291902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.304038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.305877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.308075 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fcd2074e-2611-441e-bb86-f5cd78ede138 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.185969 Oct 17 13:16:00.308799 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2706/5231] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:00 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:00.566327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.577034 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-254ae61e-10d5-41ad-b5e8-7ac15f29275e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.315393 Oct 17 13:16:00.577835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2526/5232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:00 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:00.606249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.606875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:00.613296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.613807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.614889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.615630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.616094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.617409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.813268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.828642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:00.833386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.841055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.841843 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e05acf76-b028-4771-84a3-c933e3f2c02b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.240895 Oct 17 13:16:00.842299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.842851 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2707/5233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:00 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:00.843331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.844238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.844750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.845133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.998470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4af16ce1-9ef6-46ad-9246-56dd2f4ee97e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1244825382", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:01.137855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.security_group_api [None req-4af16ce1-9ef6-46ad-9246-56dd2f4ee97e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Neutron security group does_not_exist not found {{(pid=127540) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 17 13:16:01.139854 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-4af16ce1-9ef6-46ad-9246-56dd2f4ee97e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4af16ce1-9ef6-46ad-9246-56dd2f4ee97e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 258 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1244825382", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1244825382', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 17 13:16:01.148256 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.155334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4af16ce1-9ef6-46ad-9246-56dd2f4ee97e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:01.157998 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4af16ce1-9ef6-46ad-9246-56dd2f4ee97e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.156156 Oct 17 13:16:01.157998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2708/5234] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:00 2022] POST /compute/v2.1/servers => generated 106 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:16:01.164406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.165252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:01.176176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.177667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.178132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.180155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.180696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.181211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.335735 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c007d97-fd40-4856-ab97-6964f3e16f0a tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1837 microversion: 2.1 time: 0.533937 Oct 17 13:16:01.337085 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2527/5235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:00 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1837 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:01.343175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.344331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:01.351736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.352650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.353953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.355177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.356173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.357020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.599727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.613547 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-989c04ac-6c03-48a5-8daa-8ee2bb969253 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.453700 Oct 17 13:16:01.614200 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2709/5236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:01.643129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.646253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:01.658406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.659365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.660032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.661930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.662691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.663300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.896097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.914093 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a596aae2-54b5-4458-84e8-44c1e073752c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1315 microversion: 2.1 time: 0.575544 Oct 17 13:16:01.915061 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2528/5237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:01.931664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.932759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:01.940523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.941234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.941909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.943088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.943785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.944428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.963561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.980894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.982832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.985366 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3b01a08-a355-4e58-aa7c-77f58f161c9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1746 microversion: 2.20 time: 0.357726 Oct 17 13:16:01.985939 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2710/5238] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1746 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:02.081061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-764f85e9-1eb6-48f6-a5ae-2564132dbb66 req-d704d427-275a-4042-baf9-e330cd7776f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03da82a7-7f5c-4389-9b38-04b10e6b8e33", "name": "network-vif-plugged", "status": "completed", "tag": "42f43daa-57a0-4125-92c9-7123c9b479c8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:02.107540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-764f85e9-1eb6-48f6-a5ae-2564132dbb66 req-d704d427-275a-4042-baf9-e330cd7776f5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.108021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-764f85e9-1eb6-48f6-a5ae-2564132dbb66 req-d704d427-275a-4042-baf9-e330cd7776f5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.108462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-764f85e9-1eb6-48f6-a5ae-2564132dbb66 req-d704d427-275a-4042-baf9-e330cd7776f5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.145236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-764f85e9-1eb6-48f6-a5ae-2564132dbb66 req-d704d427-275a-4042-baf9-e330cd7776f5 service nova] Creating event network-vif-plugged:42f43daa-57a0-4125-92c9-7123c9b479c8 for instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 on n-h2-853316-12 Oct 17 13:16:02.147405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:02.153971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-764f85e9-1eb6-48f6-a5ae-2564132dbb66 req-d704d427-275a-4042-baf9-e330cd7776f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076819 Oct 17 13:16:02.154921 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2711/5239] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:16:02.218151 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d9b89fa-5b85-4559-99c1-b51b70f6e1ca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.296028 Oct 17 13:16:02.225105 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2529/5240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:02.251121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-936e6176-d4f9-4789-8512-a5e6a86319e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.251959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-936e6176-d4f9-4789-8512-a5e6a86319e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: c5a5e5c7-a2ba-4570-861f-a633d5995f20] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:02.259261 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-936e6176-d4f9-4789-8512-a5e6a86319e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance c5a5e5c7-a2ba-4570-861f-a633d5995f20 could not be found. Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-936e6176-d4f9-4789-8512-a5e6a86319e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/c5a5e5c7-a2ba-4570-861f-a633d5995f20 HTTP/1.1 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance c5a5e5c7-a2ba-4570-861f-a633d5995f20 could not be found. Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'c5a5e5c7-a2ba-4570-861f-a633d5995f20'} Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a5e5c7-a2ba-4570-861f-a633d5995f20 could not be found. Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a5e5c7-a2ba-4570-861f-a633d5995f20 could not be found. Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.261227 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:02.265054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.265054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.265054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:02.265054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:02.265054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:02.265054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:02.265054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a5e5c7-a2ba-4570-861f-a633d5995f20 could not be found. Oct 17 13:16:02.265054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.266464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-936e6176-d4f9-4789-8512-a5e6a86319e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance c5a5e5c7-a2ba-4570-861f-a633d5995f20 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:02.267489 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-936e6176-d4f9-4789-8512-a5e6a86319e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c5a5e5c7-a2ba-4570-861f-a633d5995f20" status: 404 len: 111 microversion: 2.1 time: 0.023159 Oct 17 13:16:02.278295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.279162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:02.282316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2712/5241] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:02 2022] DELETE /compute/v2.1/servers/c5a5e5c7-a2ba-4570-861f-a633d5995f20 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:02.286218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.287057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.287687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.288840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.289737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.290637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.430623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.431130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:02.445640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.446519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.447216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.448180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.448925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.449594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.479213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:16:02.566791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:02.573015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:02.593675 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b26f0be2-e846-43ee-b9c8-b3e7f3b8fa8e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.318030 Oct 17 13:16:02.597583 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2530/5242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:02 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:02.633307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.633948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:02.643058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.643929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.644107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.645198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.645866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.646567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.653389 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d8a43fa-fcf0-43d6-a334-8d02160d56d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 204 len: 0 microversion: 2.1 time: 0.226699 Oct 17 13:16:02.654355 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2713/5243] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:02 2022] DELETE /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:16:02.674757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.675818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:02.684899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.685896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.686673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.688241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.689106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.690578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.879050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:02.890022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-53c40172-e0aa-4f2a-a953-019bdd3b7e9e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.269984 Oct 17 13:16:02.903705 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2531/5244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:02 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:02.924737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4765f044-3755-439b-9904-13bbdc6c7d34 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.925476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4765f044-3755-439b-9904-13bbdc6c7d34 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:16:02.928217 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-4765f044-3755-439b-9904-13bbdc6c7d34 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4765f044-3755-439b-9904-13bbdc6c7d34 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 9223372036854775808 could not be found. Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '9223372036854775808'} Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.930422 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:02.933656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:02.933656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:02.933656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:02.933656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 17 13:16:02.933656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.937365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4765f044-3755-439b-9904-13bbdc6c7d34 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:02.943594 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4765f044-3755-439b-9904-13bbdc6c7d34 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.018639 Oct 17 13:16:02.945311 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2532/5245] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 17 13:16:02 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:02.956692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.961840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:02.981898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.982755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.983403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.984355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.985036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.985667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.030651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.039708 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c4cc0b68-5299-44fc-9083-17bb61cf914c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1554 microversion: 2.1 time: 0.380496 Oct 17 13:16:03.040522 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2714/5246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:02 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1554 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:03.059252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.059892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:03.069992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.070837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.071295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.072031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.072503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.072939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.231763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.242962 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-219ac454-48ef-4e8d-82d2-524228d63021 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1315 microversion: 2.1 time: 0.293071 Oct 17 13:16:03.243920 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2533/5247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:02 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:03.251581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.252690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:03.260811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.261647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.262373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.263329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.264070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.265156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.286967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.296890 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8316754a-99e2-4aa6-94e2-f694090c4150 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.255507 Oct 17 13:16:03.297479 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2715/5248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:03 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:03.306367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.306367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:03.319498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.320840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.321285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.322217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.322842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.323424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.356154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:16:03.465695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.477613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.479990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.481712 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6130f481-f3f5-40ec-84a7-9e6959b33f90 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1746 microversion: 2.20 time: 0.236366 Oct 17 13:16:03.482825 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2534/5249] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:03 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1746 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:03.484752 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f698cac2-b07b-405e-af5b-459d1d3fd6dd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 204 len: 0 microversion: 2.1 time: 0.185944 Oct 17 13:16:03.488258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-814a052b-3ee0-47b7-9582-7bc0001d5663 req-44b10c45-d5ae-4fcd-ba6f-a9f46676178b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:03.488832 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2716/5250] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:03 2022] DELETE /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:16:03.500792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-814a052b-3ee0-47b7-9582-7bc0001d5663 req-44b10c45-d5ae-4fcd-ba6f-a9f46676178b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.501648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-814a052b-3ee0-47b7-9582-7bc0001d5663 req-44b10c45-d5ae-4fcd-ba6f-a9f46676178b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.502142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-814a052b-3ee0-47b7-9582-7bc0001d5663 req-44b10c45-d5ae-4fcd-ba6f-a9f46676178b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.505401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.511748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:03.519710 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-814a052b-3ee0-47b7-9582-7bc0001d5663 req-44b10c45-d5ae-4fcd-ba6f-a9f46676178b service nova] Creating event network-changed:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h1-853316-12 Oct 17 13:16:03.520544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.521204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.521963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.525666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.526369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.526753 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-814a052b-3ee0-47b7-9582-7bc0001d5663 req-44b10c45-d5ae-4fcd-ba6f-a9f46676178b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042436 Oct 17 13:16:03.526946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.530334 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2535/5251] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:03.546826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:03.550903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.551708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:03.570744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.571398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.571749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.574311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.576723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.577306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.758614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.768864 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ab56485-0c4f-467e-95a2-213faa28ad5c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.278667 Oct 17 13:16:03.787584 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2717/5252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:03 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:03.796682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7810188-a494-4473-bb47-2c2b426b990b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.797827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e7810188-a494-4473-bb47-2c2b426b990b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Failed to fetch instance by id -1 {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:16:03.798597 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e7810188-a494-4473-bb47-2c2b426b990b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance -1 could not be found. Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7810188-a494-4473-bb47-2c2b426b990b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance -1 could not be found. Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '-1'} Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:03.800702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:03.804885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:03.804885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:03.804885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 17 13:16:03.804885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:03.805916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7810188-a494-4473-bb47-2c2b426b990b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:03.806940 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e7810188-a494-4473-bb47-2c2b426b990b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014710 Oct 17 13:16:03.807994 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2718/5253] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:16:03 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:16:03.818011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.818924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:03.827205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.828231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.828819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.829868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.830513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.831244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.864166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.874884 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62c160bb-882f-47ee-84d5-f8bcc81df3f6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1690 microversion: 2.1 time: 0.340636 Oct 17 13:16:03.875478 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2536/5254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:03 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1690 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:04.045829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.054733 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-10394812-3c66-4492-84c0-72ee0ab9e3fc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.242174 Oct 17 13:16:04.057700 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2719/5255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:03 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:04.065615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.066480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.076745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.082940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.084230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.084964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.087132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.087633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.088890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.089350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.104182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.104692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.105143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.105917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.114362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.114886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.337679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.349866 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-743cd161-ff9f-4383-86a5-3725e0be3d68 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.270292 Oct 17 13:16:04.362654 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2720/5256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:04.378799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.379828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.388403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.389491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.391526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.392793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.393893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.394819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.421624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.443116 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-638db25d-bdef-46cf-bc9d-fcd826b071fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1554 microversion: 2.1 time: 0.382892 Oct 17 13:16:04.444356 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2537/5257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1554 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:04.475588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-59907995-ce80-4920-95cc-b321c86623db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:04.482078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-59907995-ce80-4920-95cc-b321c86623db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 683a5444-54de-475b-8906-a78c49276414] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.497375 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-59907995-ce80-4920-95cc-b321c86623db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 683a5444-54de-475b-8906-a78c49276414 could not be found. Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-59907995-ce80-4920-95cc-b321c86623db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/683a5444-54de-475b-8906-a78c49276414/action HTTP/1.1 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 19 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: {"forceDelete": {}} Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 683a5444-54de-475b-8906-a78c49276414 could not be found. Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '683a5444-54de-475b-8906-a78c49276414', 'body': {'forceDelete': {}}} Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 683a5444-54de-475b-8906-a78c49276414 could not be found. Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 683a5444-54de-475b-8906-a78c49276414 could not be found. Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:04.505079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:04.508947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:04.508947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:04.508947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 683a5444-54de-475b-8906-a78c49276414 could not be found. Oct 17 13:16:04.508947 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:04.508947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-59907995-ce80-4920-95cc-b321c86623db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 683a5444-54de-475b-8906-a78c49276414 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:04.508947 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-59907995-ce80-4920-95cc-b321c86623db tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/683a5444-54de-475b-8906-a78c49276414/action" status: 404 len: 111 microversion: 2.1 time: 0.060438 Oct 17 13:16:04.508947 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2538/5258] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:04 2022] POST /compute/v2.1/servers/683a5444-54de-475b-8906-a78c49276414/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:04.519724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7f5d98c8-1b22-4c7a-ba18-77d6422948a5 req-2bc2bda9-4a9e-458a-b430-196bd30c77b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3001998-79dc-4411-aec7-cd86e6c72deb", "name": "network-vif-plugged", "status": "completed", "tag": "dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:04.553413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7f5d98c8-1b22-4c7a-ba18-77d6422948a5 req-2bc2bda9-4a9e-458a-b430-196bd30c77b7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.554565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7f5d98c8-1b22-4c7a-ba18-77d6422948a5 req-2bc2bda9-4a9e-458a-b430-196bd30c77b7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.555432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7f5d98c8-1b22-4c7a-ba18-77d6422948a5 req-2bc2bda9-4a9e-458a-b430-196bd30c77b7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.572561 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7f5d98c8-1b22-4c7a-ba18-77d6422948a5 req-2bc2bda9-4a9e-458a-b430-196bd30c77b7 service nova] Creating event network-vif-plugged:dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e for instance f3001998-79dc-4411-aec7-cd86e6c72deb on n-h1-853316-12 Oct 17 13:16:04.579838 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7f5d98c8-1b22-4c7a-ba18-77d6422948a5 req-2bc2bda9-4a9e-458a-b430-196bd30c77b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069796 Oct 17 13:16:04.584447 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2539/5259] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:04.591710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.592464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.601937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.602676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.603221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.606830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.606830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.606830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.652282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.661651 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6617f596-a94a-42d3-94f7-71f6271a6bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1501 microversion: 2.1 time: 0.297016 Oct 17 13:16:04.662850 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2721/5260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:04.668553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.669505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.676237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.677016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.677823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.678758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.679663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.680536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.811078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.833885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.837247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.841876 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-311c21fe-94be-4b17-a059-18e2bec14098 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1746 microversion: 2.20 time: 0.255303 Oct 17 13:16:04.842630 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2540/5261] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1746 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:04.853200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:04.853742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.868522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.870466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.871079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.872096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.873574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.874681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.906775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.924854 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a4d744c2-7af6-4255-8402-1d0c28872cb2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.260036 Oct 17 13:16:04.942418 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2722/5262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:04.952619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.953539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.960483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.961374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.962347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.963518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.964216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.964990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.125365 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.network.security_group_api [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Removing security group 27b9e988-c79e-4ef0-b9c6-a16407aef877 from port 42f43daa-57a0-4125-92c9-7123c9b479c8 Oct 17 13:16:05.158028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.168419 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e2137942-7a10-46ce-b698-9a1d5f908bc8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1690 microversion: 2.1 time: 0.224731 Oct 17 13:16:05.169083 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2723/5263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1690 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:05.190940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:05.191752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:05.199788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.200298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.200720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.201683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.202133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.202831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.385282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.393496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c993f360-1e60-4eef-a1ce-c4f0b5e30115 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.206500 Oct 17 13:16:05.394354 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2724/5264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:05 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:05.419232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c693ce3-12c5-48db-b40f-822fe8785cb0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:05.422013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c693ce3-12c5-48db-b40f-822fe8785cb0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: b25f8194-ecb8-435c-a1c9-79770941b37b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:05.428306 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-0c693ce3-12c5-48db-b40f-822fe8785cb0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance b25f8194-ecb8-435c-a1c9-79770941b37b could not be found. Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c693ce3-12c5-48db-b40f-822fe8785cb0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/b25f8194-ecb8-435c-a1c9-79770941b37b/action HTTP/1.1 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 39 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: {"os-getConsoleOutput": {"length": 10}} Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance b25f8194-ecb8-435c-a1c9-79770941b37b could not be found. Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b25f8194-ecb8-435c-a1c9-79770941b37b', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b25f8194-ecb8-435c-a1c9-79770941b37b could not be found. Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b25f8194-ecb8-435c-a1c9-79770941b37b could not be found. Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:05.435094 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b25f8194-ecb8-435c-a1c9-79770941b37b could not be found. Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c693ce3-12c5-48db-b40f-822fe8785cb0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance b25f8194-ecb8-435c-a1c9-79770941b37b could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c693ce3-12c5-48db-b40f-822fe8785cb0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/b25f8194-ecb8-435c-a1c9-79770941b37b/action" status: 404 len: 111 microversion: 2.1 time: 0.023655 Oct 17 13:16:05.438670 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2725/5265] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:05 2022] POST /compute/v2.1/servers/b25f8194-ecb8-435c-a1c9-79770941b37b/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:05.449107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:05.449776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:05.458542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.459039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.459482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.461784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.464237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.464237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.656165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.669214 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bce1b53e-6ea0-47f8-a05d-24e3cf1ceb01 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.225569 Oct 17 13:16:05.690199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2726/5266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:05 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:05.690199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:05.690199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:05.690199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.690199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.690199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.690199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.690759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.690759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.888068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.901642 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a33e154-dd0b-4da4-a152-875256feb6d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1554 microversion: 2.1 time: 0.230397 Oct 17 13:16:05.918337 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2727/5267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:05 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:05.932618 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af6cfb7a-dea3-4f28-abb1-5b3859d9b589 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33/action" status: 202 len: 0 microversion: 2.1 time: 1.087945 Oct 17 13:16:05.934028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:05.934261 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2541/5268] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:04 2022] POST /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33/action => generated 0 bytes in 1091 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:05.936006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:05.939451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:05.940238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:05.952200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.952877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.953391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.958216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.958216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.958216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.959151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.959541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.959812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.960799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.962677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.968978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.196474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:06.213295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9733a1f-0aaa-4de2-9570-4fb4f8f972a5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.293409 Oct 17 13:16:06.227765 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2728/5269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:05 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:06.239926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:06.240642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:06.249884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.255871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.255871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.255871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.255871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.257559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.588038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:06.600264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:06.603573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:06.605794 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7bd1f3c-800e-4697-b34e-edbf2a0701d3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1746 microversion: 2.20 time: 0.670357 Oct 17 13:16:06.609268 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2542/5270] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:05 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1746 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:06.615283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f8fa1f21-46fc-49de-b432-35bf9c4d9734 req-8c322b95-f105-463f-8517-c74a72d182e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03da82a7-7f5c-4389-9b38-04b10e6b8e33", "tag": "42f43daa-57a0-4125-92c9-7123c9b479c8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:06.629883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f8fa1f21-46fc-49de-b432-35bf9c4d9734 req-8c322b95-f105-463f-8517-c74a72d182e9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.631107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f8fa1f21-46fc-49de-b432-35bf9c4d9734 req-8c322b95-f105-463f-8517-c74a72d182e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.631805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f8fa1f21-46fc-49de-b432-35bf9c4d9734 req-8c322b95-f105-463f-8517-c74a72d182e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.650740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f8fa1f21-46fc-49de-b432-35bf9c4d9734 req-8c322b95-f105-463f-8517-c74a72d182e9 service nova] Creating event network-changed:42f43daa-57a0-4125-92c9-7123c9b479c8 for instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 on n-h2-853316-12 Oct 17 13:16:06.657969 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f8fa1f21-46fc-49de-b432-35bf9c4d9734 req-8c322b95-f105-463f-8517-c74a72d182e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046299 Oct 17 13:16:06.659814 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2543/5271] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:06.667920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:06.670422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:06.681264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.682269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.683495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.685200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.686267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.687242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.842812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:06.858869 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a2d4072-c86e-4722-a980-350938033695 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1459 microversion: 2.1 time: 0.639405 Oct 17 13:16:06.860588 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2729/5272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:06 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1459 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:06.870039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8afcc387-2eca-4819-9431-6a9bc5ef0761 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:06.871569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8afcc387-2eca-4819-9431-6a9bc5ef0761 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1d5e96e9-8683-43e0-8b74-6b8cf0dff01d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:06.879085 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8afcc387-2eca-4819-9431-6a9bc5ef0761 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 1d5e96e9-8683-43e0-8b74-6b8cf0dff01d could not be found. Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8afcc387-2eca-4819-9431-6a9bc5ef0761 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/1d5e96e9-8683-43e0-8b74-6b8cf0dff01d HTTP/1.1 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1d5e96e9-8683-43e0-8b74-6b8cf0dff01d could not be found. Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1d5e96e9-8683-43e0-8b74-6b8cf0dff01d'} Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5e96e9-8683-43e0-8b74-6b8cf0dff01d could not be found. Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5e96e9-8683-43e0-8b74-6b8cf0dff01d could not be found. Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:06.881776 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:06.885337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:06.885337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:06.885337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:06.885337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5e96e9-8683-43e0-8b74-6b8cf0dff01d could not be found. Oct 17 13:16:06.885337 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:06.894569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8afcc387-2eca-4819-9431-6a9bc5ef0761 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 1d5e96e9-8683-43e0-8b74-6b8cf0dff01d could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:06.899928 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8afcc387-2eca-4819-9431-6a9bc5ef0761 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1d5e96e9-8683-43e0-8b74-6b8cf0dff01d" status: 404 len: 111 microversion: 2.1 time: 0.037867 Oct 17 13:16:06.901719 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2730/5273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:06 2022] GET /compute/v2.1/servers/1d5e96e9-8683-43e0-8b74-6b8cf0dff01d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:06.908234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:06.908986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:06.917956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.918977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.920176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.920330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.920944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.921610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.232275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:07.243960 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-690d0360-0c70-45ec-b28c-19261af2044a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.339709 Oct 17 13:16:07.245908 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2731/5274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:06 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:07.255745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:07.256316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:07.266718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.267269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.267999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.268728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.269124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.269559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.272109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:07.291701 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db48801c-6f3d-45d7-b3a2-0807b9f134b4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1690 microversion: 2.1 time: 0.630389 Oct 17 13:16:07.307708 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2544/5275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:06 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1690 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:07.317432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:07.319080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:07.331001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.332322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.333395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.334977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.336744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.337897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.678071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:07.696572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b0dd3f1-c3b7-45c5-be8d-aa6903d7132f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.449383 Oct 17 13:16:07.697998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2732/5276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:07 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:07.703540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:07.704430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:07.713291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.714132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.715925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.716982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.718499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.719752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.975483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.005186 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-53501305-b247-4367-90ee-2b9f0494e516 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.305678 Oct 17 13:16:08.005816 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2733/5277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:07 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:08.030459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:08.031103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:08.043458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.045144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.045957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.047010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.048633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.049323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.119613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.128175 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-92bbe5fb-360e-453e-a2be-abcd9265a8ea tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1554 microversion: 2.1 time: 0.819072 Oct 17 13:16:08.129198 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2545/5278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:07 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1554 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:08.150043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:08.150682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:08.164426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.164934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.165621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.166396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.166827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.167455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.446051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.456366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.458461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.461118 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8fb37601-f601-41d5-96cd-35800afbd1bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1746 microversion: 2.20 time: 0.453171 Oct 17 13:16:08.479194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2734/5279] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1746 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:08.492060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:08.493112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:08.501850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.502663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.503315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.504232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.504737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.505633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.739165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.766625 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3633f10b-b24c-4916-9888-4662b1eb816d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.620099 Oct 17 13:16:08.784249 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2546/5280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:08.815579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:08.816213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:08.849593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.851143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.852312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.853374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.854248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.854851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.876564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.886049 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43c5ea63-a02c-440c-9a24-5866b8032576 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.398966 Oct 17 13:16:08.892493 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2735/5281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:08.918867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:08.919595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:08.929958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.939345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.939848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.940618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.941122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.941644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.027137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:09.040362 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a7402788-282f-42ba-ae60-0e54ea38dc28 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 200 len: 1503 microversion: 2.1 time: 0.254321 Oct 17 13:16:09.066847 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2547/5282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:09.088575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fcb41e19-d1f3-4f4b-86d5-86097182e7b0 req-564aca53-db26-4e53-a90c-4e58a2748b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbe6fbc-eeff-454d-8a59-6d3451fabde2", "name": "network-vif-deleted", "tag": "f39b937e-41d4-4937-9e3d-f823e1d949cb"}, {"server_uuid": "6c51dfd5-737b-4962-a56f-a0190dbca4ca", "name": "network-vif-deleted", "tag": "d157f0e1-b686-4131-9dfb-4b880eda92d0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:09.143460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fcb41e19-d1f3-4f4b-86d5-86097182e7b0 req-564aca53-db26-4e53-a90c-4e58a2748b1a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.144620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fcb41e19-d1f3-4f4b-86d5-86097182e7b0 req-564aca53-db26-4e53-a90c-4e58a2748b1a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.146413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fcb41e19-d1f3-4f4b-86d5-86097182e7b0 req-564aca53-db26-4e53-a90c-4e58a2748b1a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.189996 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fcb41e19-d1f3-4f4b-86d5-86097182e7b0 req-564aca53-db26-4e53-a90c-4e58a2748b1a service nova] Creating event network-vif-deleted:f39b937e-41d4-4937-9e3d-f823e1d949cb for instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 on n-h1-853316-12 Oct 17 13:16:09.202022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fcb41e19-d1f3-4f4b-86d5-86097182e7b0 req-564aca53-db26-4e53-a90c-4e58a2748b1a service nova] Creating event network-vif-deleted:d157f0e1-b686-4131-9dfb-4b880eda92d0 for instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca on n-h1-853316-12 Oct 17 13:16:09.213471 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fcb41e19-d1f3-4f4b-86d5-86097182e7b0 req-564aca53-db26-4e53-a90c-4e58a2748b1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.144039 Oct 17 13:16:09.218940 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2548/5283] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:09.233652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89d72f2c-dc14-49b6-be44-22cf91725e1f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2100097754", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89d72f2c-dc14-49b6-be44-22cf91725e1f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 238 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2100097754", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2100097754', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.258114 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:09.262365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89d72f2c-dc14-49b6-be44-22cf91725e1f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:09.265128 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89d72f2c-dc14-49b6-be44-22cf91725e1f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042618 Oct 17 13:16:09.265389 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2549/5284] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:09 2022] POST /compute/v2.1/servers => generated 139 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:16:09.272111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.277994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:09.305446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.311170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.311918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.312947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.313632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.319849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.479311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:09.494929 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9a4b831-f0c4-4034-8673-7d4e1e947e94 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1345 microversion: 2.1 time: 0.228367 Oct 17 13:16:09.501154 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2550/5285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1345 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:09.524805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.528457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:09.556219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.558924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.561026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.563295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.564836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.568628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.637692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:09.652540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dab18a4c-943c-41b9-ace6-c516908697b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.731845 Oct 17 13:16:09.667301 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2736/5286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:09.689387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.690384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:09.702711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.703413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.704054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.705476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.706193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.706778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.710571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:10.107427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.121304 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b5a93bb-547b-41ab-ba45-968c049f9152 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.618994 Oct 17 13:16:10.126012 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2551/5287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:10.146127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1962164274", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:10.164699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.180405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.187445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.189853 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a620e4c-4b1f-4d59-9d7d-90197ca4d0ea tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.521264 Oct 17 13:16:10.202680 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2737/5288] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:10.217991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:10.218982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: dcbe6fbc-eeff-454d-8a59-6d3451fabde2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:10.226020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.227027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.227756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.228772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.229465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.230119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.249480 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] HTTP exception thrown: Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 could not be found. Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Request method failure captured: Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 HTTP/1.1 Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVO8wsZSqmfW49vI1THHOfwL_5j3vM2FktN7RpHbtgow7aDmUW4Pv3BVI8Oy7tO9oSfFgC6rTSlxAHfrY-eM07pY0Umu71X2M6X4Ue9KgT0Ml48iFOxFgBMPMdHbsgVJGlEaT3gitl9BY6UXQ9cLmroOJW8AWk3NApwUBQgRlOKon1A Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: e5d16284093341d980341f1dce38f68b Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5d16284093341d980341f1dce38f68b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5d16284093341d980341f1dce38f68b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5d16284093341d980341f1dce38f68b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5d16284093341d980341f1dce38f68b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: e5d16284093341d980341f1dce38f68b Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestNetworkAdvancedServerOps-497241743-project Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0cee3a8479444aa3a00b2c29407931d9 Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestNetworkAdvancedServerOps-497241743-project Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 could not be found. Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'dcbe6fbc-eeff-454d-8a59-6d3451fabde2'} Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 could not be found. Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 could not be found. Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:10.251536 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:10.255553 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:10.255553 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:10.255553 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:10.255553 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:10.255553 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:10.255553 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:10.255553 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 could not be found. Oct 17 13:16:10.255553 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:10.258475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Returning 404 to user: Instance dcbe6fbc-eeff-454d-8a59-6d3451fabde2 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:10.259669 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e78678dd-085e-40c7-bd2d-04c9cb8b0e69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2" status: 404 len: 111 microversion: 2.1 time: 0.055763 Oct 17 13:16:10.260473 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2738/5289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:10 2022] GET /compute/v2.1/servers/dcbe6fbc-eeff-454d-8a59-6d3451fabde2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:10.265695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:10.267435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:10.271752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] validate_networks() for [('24ec6e1c-7d50-4f3e-a5b0-ce3cb1de5525', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:10.278719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.279819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.280788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.282332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.283064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.283743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.897267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.933124 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3f5afd1-d41a-40a7-a2a5-f3d7b2ae77fa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.671159 Oct 17 13:16:10.942776 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2739/5290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:10 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:10.961370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:10.962430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:10.976928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.979230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.981930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.983435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.989893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.990773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.267524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:11.284835 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f70f4fa-cd42-4841-a029-d63742878d47 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1345 microversion: 2.1 time: 0.338003 Oct 17 13:16:11.285640 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2740/5291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:10 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1345 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:11.313495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ffbbe0f4-3802-4b54-b19c-e88f619a4a6e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-396538577", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ffbbe0f4-3802-4b54-b19c-e88f619a4a6e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 234 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-396538577", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-396538577', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.342966 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:16:11.349360 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:11.367420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ffbbe0f4-3802-4b54-b19c-e88f619a4a6e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:11.369281 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ffbbe0f4-3802-4b54-b19c-e88f619a4a6e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.078097 Oct 17 13:16:11.375134 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2741/5292] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:11 2022] POST /compute/v2.1/servers => generated 133 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:16:11.422038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:11.423892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:11.484318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.485034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.486876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.489127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.490558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.491244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.631435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:11.632217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:11.633183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:11.633756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:11.634367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:11.671580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.676964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.680752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.682546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.687719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.689618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.799239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:11.811194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Getting quotas for user c71ac2b898f649cdaa99fbace633e738 and project c2ea124fdbff4df4b04a2e969871d8b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:11.871552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:16:11.883314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:16:12.016865 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e0ab03c-41b5-4aa3-bbeb-bf432abc805d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889525 Oct 17 13:16:12.019864 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2552/5293] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:16:12.035284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.046136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:12.070823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.071910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.075234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.076488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.080449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.082851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.454358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.471207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.478559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.480216 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44dc55ba-14c3-4688-bfd4-cdb9563dd929 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 1.099669 Oct 17 13:16:12.480954 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2742/5294] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:11 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:12.498387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e1270a5-4e31-464c-a1d9-dbc72d652881 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.499530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2e1270a5-4e31-464c-a1d9-dbc72d652881 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:12.858995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2e1270a5-4e31-464c-a1d9-dbc72d652881 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.886042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e1270a5-4e31-464c-a1d9-dbc72d652881 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1215 microversion: 2.1 time: 0.396517 Oct 17 13:16:12.887091 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2743/5295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1215 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:12.906016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.906943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:12.928079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.928490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.937807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.938955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.940105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.940873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.257433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:13.267569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7b3751b-5e0f-4f4e-9ddc-6e47007c9df3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1345 microversion: 2.1 time: 0.377504 Oct 17 13:16:13.280051 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2744/5296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1345 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:13.303655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:13.318641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68fac6ee-5c20-4869-a826-31a54b660843 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 1.287300 Oct 17 13:16:13.321400 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2553/5297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:13.357543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.358293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:13.396245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.396769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.397564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.398370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.398863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.399322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.514524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.514977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:13.533889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.534432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.534880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.544891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.545476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.545923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.562956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:13.975070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:13.998875 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62d300eb-8555-4445-aefe-7399558fd2e3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.642561 Oct 17 13:16:13.999548 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2745/5298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:14.030097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.031386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:14.039605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.040438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.041297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.042224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.042875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.043512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.196562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.209771 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9e4ab88b-54fb-4912-b217-58527f32638e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1267 microversion: 2.1 time: 0.184764 Oct 17 13:16:14.230538 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2746/5299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:14.251851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ace9780-f311-4177-95bf-f3e225c920fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:14.252542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ace9780-f311-4177-95bf-f3e225c920fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: d850fd0b-e3e1-41f6-95a7-6ddba9b58e26] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:14.269917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-9ace9780-f311-4177-95bf-f3e225c920fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance d850fd0b-e3e1-41f6-95a7-6ddba9b58e26 could not be found. Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ace9780-f311-4177-95bf-f3e225c920fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/d850fd0b-e3e1-41f6-95a7-6ddba9b58e26/action HTTP/1.1 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 13 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: {"pause": {}} Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d850fd0b-e3e1-41f6-95a7-6ddba9b58e26 could not be found. Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd850fd0b-e3e1-41f6-95a7-6ddba9b58e26', 'body': {'pause': {}}} Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d850fd0b-e3e1-41f6-95a7-6ddba9b58e26 could not be found. Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d850fd0b-e3e1-41f6-95a7-6ddba9b58e26 could not be found. Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.277022 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.280813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:14.280813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:14.280813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d850fd0b-e3e1-41f6-95a7-6ddba9b58e26 could not be found. Oct 17 13:16:14.280813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.280813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ace9780-f311-4177-95bf-f3e225c920fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance d850fd0b-e3e1-41f6-95a7-6ddba9b58e26 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.280813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ace9780-f311-4177-95bf-f3e225c920fb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/d850fd0b-e3e1-41f6-95a7-6ddba9b58e26/action" status: 404 len: 111 microversion: 2.1 time: 0.047066 Oct 17 13:16:14.283173 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2747/5300] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:14 2022] POST /compute/v2.1/servers/d850fd0b-e3e1-41f6-95a7-6ddba9b58e26/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:14.301353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.302419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:14.315432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:14.321812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.326481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.327544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.329109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.330925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.335696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.786885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.806419 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e5f2d6ce-7c88-4a1d-b4bb-8c6f38be7c07 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.517677 Oct 17 13:16:14.807282 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2748/5301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:14.843045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.845720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:14.866085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.867936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.870849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.871827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.872611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.875922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.034759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:15.064549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:15.067624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:15.075118 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ebe20043-4014-4ae9-a81a-345b5cb61b4a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 1.566621 Oct 17 13:16:15.081580 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2554/5302] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:15.095683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:15.102877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:15.125199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.125727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.137716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.138828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.139363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.144116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.168118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:15.190449 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe06934d-1f9e-4b0a-b673-21a10fc4dacc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1345 microversion: 2.1 time: 0.363040 Oct 17 13:16:15.199465 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2749/5303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1345 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:15.244369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:15.245412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:15.256283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.261326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.264378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.265527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.268314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.271142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.552808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:15.597527 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4503138b-6499-4b5f-a392-28dd7c954fa2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1273 microversion: 2.1 time: 0.358402 Oct 17 13:16:15.605251 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2750/5304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:15 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1273 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:16.108332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:16.109346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:16.121928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.123881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.126238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.128345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.131918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.134869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.226131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:16.245467 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a70cbcbe-dfa9-472f-a4f1-daf6b5c209f6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 1.156071 Oct 17 13:16:16.249990 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2555/5305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:15 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:16.276308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:16.280620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:16.303405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.314270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.321542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.327115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.329247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.330318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.592067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:16.608590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:16.613704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:16.616714 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d763bd1-da71-40e2-a196-264461781ca4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.512690 Oct 17 13:16:16.622543 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2751/5306] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:16 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:16.632394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:16.637211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:16.651196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.651697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.652136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.652857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.656733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.657309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.814936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:16.833185 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fbcd2d8c-1506-40d5-8913-9857cd5e0ed2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1345 microversion: 2.1 time: 0.579458 Oct 17 13:16:16.834390 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2556/5307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:16 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1345 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:16.850319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:16.851848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:16.867887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.868682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.869571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.871383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.872608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.874007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.964495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f6424de-5cfc-4c27-add8-4fe384467d05 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 202 len: 0 microversion: 2.1 time: 0.340270 Oct 17 13:16:16.972300 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2752/5308] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:16 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:17.030894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:17.031864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:17.043829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:17.057425 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dcf4d639-2a8a-47c2-b192-e8ecf26c5b2a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1273 microversion: 2.1 time: 0.218159 Oct 17 13:16:17.058420 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2557/5309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:16 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:17.062793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:17.068576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:17.069268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:17.075983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:17.078593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:17.081959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:17.581181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:17.598709 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-61dff330-8287-4380-bc54-10aae83e99f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1510 microversion: 2.1 time: 0.618610 Oct 17 13:16:17.602842 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2753/5310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:16 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1510 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:17.654907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:17.656214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:17.702608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:17.703114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:17.703563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:17.704306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:17.704773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:17.705216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:17.868721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:17.869627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:17.888044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:17.895796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:17.899844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:17.901045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:17.902249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:17.902535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:18.264466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:18.304928 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd8c7e60-de8d-42d1-a516-3e7ca3b63da5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1345 microversion: 2.1 time: 0.440721 Oct 17 13:16:18.342109 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2754/5311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:17 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1345 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:18.360546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:18.361199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:18.394270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:18.395019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:18.395473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:18.396204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:18.396662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:18.406850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:18.627012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:18.642588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:18.657532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:18.664590 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-260a77a0-3979-438e-bf66-4d6515db593c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 1.012728 Oct 17 13:16:18.667693 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2558/5312] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:17 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:18.689868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:18.692877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:18.717490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:18.718045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:18.718456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:18.727858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:18.728600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:18.729211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.183045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:19.199733 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b4acdf0d-c097-4eaf-a251-223ef3f89a35 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 0.856107 Oct 17 13:16:19.200736 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2755/5313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:18 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:19.338033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:19.339233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.353374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:19.358809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.364042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.367648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.369123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.370435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.372313 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-803b4aee-b785-4b5c-9bae-c49a76c4db82 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1490 microversion: 2.1 time: 0.703007 Oct 17 13:16:19.373187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.378965 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2559/5314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:18 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1490 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:19.408342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:19.409251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.441782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.442869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.443566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.444582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.446253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.449588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.469822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:19.522323 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Cannot 'pause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state paused Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action HTTP/1.1 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 13 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: {"pause": {}} Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'pause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state paused Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'pause': {}}} Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 in vm_state paused. Cannot pause while the instance is in this state. Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state paused Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:19.527429 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:19.530998 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:19.530998 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:19.530998 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:19.530998 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state paused Oct 17 13:16:19.530998 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.546428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 409 to user: Cannot 'pause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state paused {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:19.547911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-459c125f-a76f-40bd-88ce-73c3da5914d0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 409 len: 143 microversion: 2.1 time: 0.144863 Oct 17 13:16:19.549317 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2560/5315] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:19 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 143 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:19.560163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:19.567651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.578653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.584807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:19.594354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.621438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.623200 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-47697527-ff6a-44ca-b743-aebe539a2911 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1345 microversion: 2.1 time: 0.290056 Oct 17 13:16:19.624424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.626540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.628588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.628917 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2756/5316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:19 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1345 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:19.698530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:19.699410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.731866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.738579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.739235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.740101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.740642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.741942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.888353 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-07cc2abc-abe1-4e79-ab5d-46b96e1e655d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 202 len: 0 microversion: 2.1 time: 0.334356 Oct 17 13:16:19.892373 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2561/5317] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:19 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:16:19.912797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:19.914146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.945797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.946711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.947419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.948461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.950421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.963064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.169777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:20.179978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:20.183250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:20.185298 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21a8826e-4e77-45a1-a74f-0351cd47cba6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.492169 Oct 17 13:16:20.186711 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2757/5318] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:19 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:16:20.229556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:20.230518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:20.243680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.247102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.247812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.250235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.252379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.253261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.629520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:20.651182 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e62d07de-de55-404e-8c85-4e14465cd08e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 0.424178 Oct 17 13:16:20.654576 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2758/5319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:20 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:20.675909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:20.682309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:20.722133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.724717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.745612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.751632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.757886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.763082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.931129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.940201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.940672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.944879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'fault' on Instance uuid 6c51dfd5-737b-4962-a56f-a0190dbca4ca {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:21.082363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:21.099139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e34dd94-6072-4101-8eb3-5bbcedd92503 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 200 len: 1350 microversion: 2.1 time: 0.443012 Oct 17 13:16:21.100432 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2759/5320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:20 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 1350 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:21.231740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:21.233297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:21.252630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:21.267689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:21.282605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:21.288010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:21.302146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:21.303835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:21.306461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:21.335211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-926f6400-b7b8-4406-b016-7d3c50398ee6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1497 microversion: 2.1 time: 1.440851 Oct 17 13:16:21.381970 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2562/5321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:19 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1497 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:21.682369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:21.683017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:21.697491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:21.698064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:21.701795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:21.702517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:21.703068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:21.703510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:21.723283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:21.758822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:21.759735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:21.764147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:21.769501 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62faf246-14bd-4bfc-8813-b6b31f7dfdb4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.543780 Oct 17 13:16:21.773625 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2760/5322] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:21 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:21.851644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:22.140175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.142140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:22.190689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.191920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.192563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.193524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.194344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.198743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.239938 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca HTTP/1.1 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '6c51dfd5-737b-4962-a56f-a0190dbca4ca'} Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:22.261684 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.265808 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.265808 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.265808 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.265808 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:22.265808 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:22.265808 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.265808 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.265808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:22.273533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:22.274393 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-833936cd-2cbb-486e-8692-396e398c47ca tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 404 len: 111 microversion: 2.1 time: 0.136935 Oct 17 13:16:22.275096 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2761/5323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:22.291688 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f14cdbed-b54c-4fb8-8199-978446660395 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 0.615967 Oct 17 13:16:22.296173 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2563/5324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:21 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:22.393311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.394619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:22.416540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.419969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.424688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.430299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.434762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.436234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.501371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.511201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:22.518922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.519753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.520435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.521646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.523191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.524753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.549096 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca/os-volume_attachments HTTP/1.1 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '6c51dfd5-737b-4962-a56f-a0190dbca4ca'} Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:22.555309 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:16:22.560532 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.562043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:22.563087 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79dc2e5b-3992-4725-8fea-1556e418d8e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066098 Oct 17 13:16:22.564275 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2564/5325] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:16:22.700857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:22.712607 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6c1cbee-1d7e-43ab-a509-9490bf234ba2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.325272 Oct 17 13:16:22.713937 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2762/5326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:22.749215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.749843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:22.761588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.762356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.763753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.764685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.765301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.765881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.841330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.842094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:22.861082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.862690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.863505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.864854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.873387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.874814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.875851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:23.342508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:23.355212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:23.367890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:23.374957 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc29fb77-61bb-4916-b9e3-a6a6c9af0b02 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.556870 Oct 17 13:16:23.376624 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2763/5327] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:23.409107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-164103806", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e6961d90-c691-4862-9018-60bca57213f2"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:23.536380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:23.559335 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c80464b-211d-4582-817d-c79de7a394df tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.815245 Oct 17 13:16:23.573051 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2565/5328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:23.573777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] validate_networks() for [('e6961d90-c691-4862-9018-60bca57213f2', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:23.589619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.590558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:23.605614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.606556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.607165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.608807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.609443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.610539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.107461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:24.132924 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a28982b9-440d-43c9-a183-aaa885144867 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 0.546924 Oct 17 13:16:24.136656 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2566/5329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:24.157380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:24.173588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:24.197800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.212612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.214136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.217401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.218722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.220477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.302933 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af/action HTTP/1.1 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 28 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: {"reboot": {"type": "SOFT"}} Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1e1f8fb2-8451-4008-8dd8-80246250c2af', 'body': {'reboot': {'type': 'SOFT'}}} Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:24.304880 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:24.308253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.320274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:24.321354 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-086378d4-d19d-43b1-95df-0ff7c3c5844d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af/action" status: 404 len: 111 microversion: 2.1 time: 0.181632 Oct 17 13:16:24.321966 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2567/5330] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:24 2022] POST /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af/action => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:24.356867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.369664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:24.399521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.400226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.404538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.405990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.407972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.409915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.166667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:25.167777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:25.168543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:25.169124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:25.169810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:25.189980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.193706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.194455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.196978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.200134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.200809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.251925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:25.275053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for user 24c6068b196d4cc398176b22196bd5b1 and project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:25.307407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:16:25.317740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 08ee6e4d-4327-49bb-ab01-61ab4539b474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:16:25.440127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d94bca6a-948e-4b25-964d-005f8e1e798e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.059279 Oct 17 13:16:25.442272 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2764/5331] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:16:25.447767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:25.448978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:25.452018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:25.463215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.464477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.465522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.466630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.467251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.467845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.472558 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-91f9c8fb-8e73-45db-91d4-33c1cc6b549c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 1.138031 Oct 17 13:16:25.494394 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2568/5332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:25.505334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-74b99b08-d1cb-4bff-972d-70f528171396 req-919cadbb-b287-4033-9ce6-1314471d3c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ec4a533-498a-40e2-84e1-931941c16cc1", "tag": "0ca362e1-43ba-45d3-b6eb-1eff56c67772"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:25.556539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-74b99b08-d1cb-4bff-972d-70f528171396 req-919cadbb-b287-4033-9ce6-1314471d3c9e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.557034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-74b99b08-d1cb-4bff-972d-70f528171396 req-919cadbb-b287-4033-9ce6-1314471d3c9e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.557537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-74b99b08-d1cb-4bff-972d-70f528171396 req-919cadbb-b287-4033-9ce6-1314471d3c9e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.593840 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-74b99b08-d1cb-4bff-972d-70f528171396 req-919cadbb-b287-4033-9ce6-1314471d3c9e service nova] Creating event network-changed:0ca362e1-43ba-45d3-b6eb-1eff56c67772 for instance 1ec4a533-498a-40e2-84e1-931941c16cc1 on n-h1-853316-12 Oct 17 13:16:25.635615 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-74b99b08-d1cb-4bff-972d-70f528171396 req-919cadbb-b287-4033-9ce6-1314471d3c9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134918 Oct 17 13:16:25.644772 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2569/5333] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:25.650608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:25.651325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:25.682737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:25.715648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.716158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.716604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.717549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.718957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.721522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.253766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:26.269544 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a8a75aae-37af-4702-a78a-5a72eb93ec78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 0.623382 Oct 17 13:16:26.291567 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2570/5334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:25 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:26.312411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7bc66a81-165c-4121-86a3-d40249b40836 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '.version_select at 0x7fa81bcd5700>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:26.383626 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7bc66a81-165c-4121-86a3-d40249b40836 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-113359504" status: 202 len: 0 microversion: 2.1 time: 0.088075 Oct 17 13:16:26.392659 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2571/5335] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 17 13:16:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-113359504 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:26.408029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf275ed7-e418-40cc-814a-320c60992568 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:26.411168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf275ed7-e418-40cc-814a-320c60992568 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 08ee6e4d-4327-49bb-ab01-61ab4539b474] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:26.546478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf275ed7-e418-40cc-814a-320c60992568 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:26.554509 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf275ed7-e418-40cc-814a-320c60992568 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474" status: 200 len: 1214 microversion: 2.1 time: 0.158866 Oct 17 13:16:26.554959 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2572/5336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:26 2022] GET /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:26.577896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:26.579430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:26.587253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:26.595770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.598394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.602456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.603434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.604081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.605697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.628659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:26.649650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:26.651004 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6151c962-b31b-49b0-9b06-116974ee1dba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 1.207738 Oct 17 13:16:26.658854 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2765/5337] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:25 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:26.681993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c58be936-c3c2-43c9-b74e-18aa6bdcae2b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'create', calling method: .version_select at 0x7fa8208735e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1300379660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXB8v2jfSMWp0vOcKMbAgcjzNqXg1RDu7PVlp7qpuBD1SoPrYP08Sg0pT6EWBTpX7XI5WB9tBonZA9bIJXXDvD2BlopJgEcBwFKkF2J9AwcRCdoKIoOQfQfijOznEhAAQ=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:26.716638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c58be936-c3c2-43c9-b74e-18aa6bdcae2b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for project e5d16284093341d980341f1dce38f68b. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:26.765618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c58be936-c3c2-43c9-b74e-18aa6bdcae2b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for user 0cee3a8479444aa3a00b2c29407931d9 and project e5d16284093341d980341f1dce38f68b. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:26.850500 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c58be936-c3c2-43c9-b74e-18aa6bdcae2b tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.187730 Oct 17 13:16:26.859275 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2766/5338] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:16:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:26.872801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:26.875471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 08ee6e4d-4327-49bb-ab01-61ab4539b474] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:26.911689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.912912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.915620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.916719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.917630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.918331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.955651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:26.984206 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-965197cf-7a6b-4edd-98e0-a405d07ef3d9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.428121 Oct 17 13:16:26.989426 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2573/5339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:26 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:27.013607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7445e34a-ea14-4e84-8c89-0f4c4b984628 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:27.016240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7445e34a-ea14-4e84-8c89-0f4c4b984628 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: c60ca489-49bb-46b6-a120-a504c1e72ab9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:27.046589 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-7445e34a-ea14-4e84-8c89-0f4c4b984628 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance c60ca489-49bb-46b6-a120-a504c1e72ab9 could not be found. Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7445e34a-ea14-4e84-8c89-0f4c4b984628 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/c60ca489-49bb-46b6-a120-a504c1e72ab9/action HTTP/1.1 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 28 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: {"reboot": {"type": "SOFT"}} Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance c60ca489-49bb-46b6-a120-a504c1e72ab9 could not be found. Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c60ca489-49bb-46b6-a120-a504c1e72ab9', 'body': {'reboot': {'type': 'SOFT'}}} Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60ca489-49bb-46b6-a120-a504c1e72ab9 could not be found. Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60ca489-49bb-46b6-a120-a504c1e72ab9 could not be found. Oct 17 13:16:27.048468 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60ca489-49bb-46b6-a120-a504c1e72ab9 could not be found. Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:27.054817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7445e34a-ea14-4e84-8c89-0f4c4b984628 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance c60ca489-49bb-46b6-a120-a504c1e72ab9 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:27.056270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7445e34a-ea14-4e84-8c89-0f4c4b984628 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/c60ca489-49bb-46b6-a120-a504c1e72ab9/action" status: 404 len: 111 microversion: 2.1 time: 0.048711 Oct 17 13:16:27.056884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2574/5340] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:27 2022] POST /compute/v2.1/servers/c60ca489-49bb-46b6-a120-a504c1e72ab9/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:16:27.059685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 08ee6e4d-4327-49bb-ab01-61ab4539b474] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:16:27.077339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:27.078260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:27.080508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.081240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.081875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.091985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.093011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.093631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.094594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.095920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.100387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.108875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'flavor' on Instance uuid 08ee6e4d-4327-49bb-ab01-61ab4539b474 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:27.146547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:27.154009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'system_metadata' on Instance uuid 08ee6e4d-4327-49bb-ab01-61ab4539b474 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:27.328598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'metadata' on Instance uuid 08ee6e4d-4327-49bb-ab01-61ab4539b474 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:27.384469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:27.402628 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e832c1a-4e39-47dd-b25c-5f82e1a9a73a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.336959 Oct 17 13:16:27.403917 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2575/5341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:27 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:27.420049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:27.421109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:27.430802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.431927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.432607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.433654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.434385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.435036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.761319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:27.783191 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0b841712-e705-4b1d-a1e9-844ee4445d30 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 0.372723 Oct 17 13:16:27.787070 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2576/5342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:27 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:27.848396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:27.858894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:27.876288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.876794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.877236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.877956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.878450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.878888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.294850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:28.312382 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-20725c72-a41d-4fe0-b6d5-fe0722eb77ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.524150 Oct 17 13:16:28.313791 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2577/5343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:27 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:28.327705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:28.328604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:28.343249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.343757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.344208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.351069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.351824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.352262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.536479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.scheduler.client.report [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Deleted allocations for instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 Oct 17 13:16:28.589711 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01095280-d2c0-4d92-827e-ad7a4b426abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474" status: 204 len: 0 microversion: 2.1 time: 1.727575 Oct 17 13:16:28.591593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2767/5344] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:26 2022] DELETE /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474 => generated 0 bytes in 1731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:16:28.614701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:28.621784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:28.631456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.632254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.632856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.633738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.634381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.635195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.668977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af/action HTTP/1.1 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 65 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1e1f8fb2-8451-4008-8dd8-80246250c2af', 'body': {'rebuild': {'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f'}}} Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:16:28.674581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:16:28.681393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.683455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:28.684526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:28.684526 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b2b0936-7fc6-434c-865d-0764bb084f46 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af/action" status: 404 len: 111 microversion: 2.1 time: 0.089041 Oct 17 13:16:28.684526 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2768/5345] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:28 2022] POST /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:28.696254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:28.698579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:28.699748 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7c49b0f-2f06-4ea2-b3be-18035fc668f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.384892 Oct 17 13:16:28.701196 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2578/5346] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:28 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:28.708096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:28.709207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:28.713435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:28.714053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 08ee6e4d-4327-49bb-ab01-61ab4539b474] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:28.722183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.722717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.723162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.723894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.726451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.727477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.750472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.751337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.752121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.752979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.753442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.753873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.801208 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474 HTTP/1.1 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '08ee6e4d-4327-49bb-ab01-61ab4539b474'} Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:28.803267 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.807724 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.807724 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:28.807724 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:28.807724 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:28.807724 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:28.807724 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:16:28.807724 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.809955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:28.817472 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7bbf8b46-3c2a-4d98-8984-3bac7663af36 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474" status: 404 len: 111 microversion: 2.1 time: 0.132690 Oct 17 13:16:28.818628 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2769/5347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:28 2022] GET /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:28.827338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:28.828270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:28.845956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.846690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.847324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.848216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.852804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.855946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:29.340904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:29.352566 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd487d64-3abb-4a25-80a3-8796f178a04e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.649770 Oct 17 13:16:29.353398 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2579/5348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:28 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:29.369173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:29.388318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-858262796", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e6961d90-c691-4862-9018-60bca57213f2"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:29.392058 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f5e5ddb-db04-4f0b-a758-395c6d1e56fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 0.570402 Oct 17 13:16:29.406253 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2770/5349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:28 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:29.407021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:29.411615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:29.422824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:29.425591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:29.427492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:29.430561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:29.431299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:29.433586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:29.524075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] validate_networks() for [('e6961d90-c691-4862-9018-60bca57213f2', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:30.263026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:30.272473 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3bad5eca-d53e-4c60-bc10-bb7cd5282d69 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.875644 Oct 17 13:16:30.273050 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2771/5350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:29 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:30.291584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:30.298112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:30.317431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:30.317968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:30.319154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:30.324411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:30.324941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:30.327925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:30.395789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:31.173619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:31.175826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:31.177088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:31.177766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:31.178426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:31.201352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.203848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.206360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.207528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.213292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:31.232468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.233201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.239588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:31.277829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:31.291741 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d7df809-15fa-4058-8092-647381e17713 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 1.017584 Oct 17 13:16:31.292555 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2772/5351] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:30 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:31.328705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17db00a6-0226-4297-959a-f9e327491920 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:31.334133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-17db00a6-0226-4297-959a-f9e327491920 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: d290b045-9045-4b23-91bc-e58534b5796f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:31.348677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:31.351335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-17db00a6-0226-4297-959a-f9e327491920 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance d290b045-9045-4b23-91bc-e58534b5796f could not be found. Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17db00a6-0226-4297-959a-f9e327491920 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/d290b045-9045-4b23-91bc-e58534b5796f/action HTTP/1.1 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 65 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d290b045-9045-4b23-91bc-e58534b5796f could not be found. Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd290b045-9045-4b23-91bc-e58534b5796f', 'body': {'rebuild': {'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f'}}} Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d290b045-9045-4b23-91bc-e58534b5796f could not be found. Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:16:31.359238 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d290b045-9045-4b23-91bc-e58534b5796f could not be found. Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d290b045-9045-4b23-91bc-e58534b5796f could not be found. Oct 17 13:16:31.363228 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:31.367970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17db00a6-0226-4297-959a-f9e327491920 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance d290b045-9045-4b23-91bc-e58534b5796f could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:31.369847 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-17db00a6-0226-4297-959a-f9e327491920 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/d290b045-9045-4b23-91bc-e58534b5796f/action" status: 404 len: 111 microversion: 2.1 time: 0.052849 Oct 17 13:16:31.372739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for user 24c6068b196d4cc398176b22196bd5b1 and project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:31.374797 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2773/5352] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:31 2022] POST /compute/v2.1/servers/d290b045-9045-4b23-91bc-e58534b5796f/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:31.390790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:31.392670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:31.407912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:16:31.410260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.414173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.416569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.417549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.418914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:16:31.423278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.423987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.602483 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db19b352-93e3-4810-9ee3-e40a1469a78c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.213094 Oct 17 13:16:31.606228 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2580/5353] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:16:31.616768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:31.618977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:31.639643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.640521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.641284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.642277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.643671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.646235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:32.276705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:32.323356 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2ea1c0f-a1b1-453f-9fd7-52b02264a493 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.715376 Oct 17 13:16:32.341065 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2581/5354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:31 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:32.369433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-36ced9d4-40cf-4239-b817-7cf4d246e377 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:32.374218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-36ced9d4-40cf-4239-b817-7cf4d246e377 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:32.505252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-36ced9d4-40cf-4239-b817-7cf4d246e377 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:32.525396 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-36ced9d4-40cf-4239-b817-7cf4d246e377 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1214 microversion: 2.1 time: 0.182380 Oct 17 13:16:32.526781 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2582/5355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:32 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:32.536811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:32.539639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:32.559269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:32.579776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:32.582375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:32.587286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:32.605431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:32.607324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:32.824488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:32.843827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b31471ad-998b-428d-a1c4-89a5993851a4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 1.458297 Oct 17 13:16:32.846241 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2774/5356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:31 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:32.863584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:32.864871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:32.903196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:32.904068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:32.905595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:32.916282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:32.917012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:32.917608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.243610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:33.254211 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e678b83-6712-4213-a10c-02850de3ad8d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.406682 Oct 17 13:16:33.258207 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2775/5357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:32 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:33.275979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:33.289039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-458f181b-306f-41ec-901e-8e6905c7c3c6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:33.291207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-458f181b-306f-41ec-901e-8e6905c7c3c6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 4109595c-c600-472c-a6d3-0de62f8ee561] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:33.295714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:33.304449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:33.307621 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-107edd2a-87d9-48cb-adb5-5ceb33bf998d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.779077 Oct 17 13:16:33.316120 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-458f181b-306f-41ec-901e-8e6905c7c3c6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 4109595c-c600-472c-a6d3-0de62f8ee561 could not be found. Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-458f181b-306f-41ec-901e-8e6905c7c3c6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/4109595c-c600-472c-a6d3-0de62f8ee561/action HTTP/1.1 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 15 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: {"restore": {}} Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 4109595c-c600-472c-a6d3-0de62f8ee561 could not be found. Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '4109595c-c600-472c-a6d3-0de62f8ee561', 'body': {'restore': {}}} Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4109595c-c600-472c-a6d3-0de62f8ee561 could not be found. Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4109595c-c600-472c-a6d3-0de62f8ee561 could not be found. Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:33.318942 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:33.323297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:33.323297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:33.323297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4109595c-c600-472c-a6d3-0de62f8ee561 could not be found. Oct 17 13:16:33.323297 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:33.327413 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2583/5358] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:32 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:33.330533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-458f181b-306f-41ec-901e-8e6905c7c3c6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 4109595c-c600-472c-a6d3-0de62f8ee561 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:33.331945 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-458f181b-306f-41ec-901e-8e6905c7c3c6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/4109595c-c600-472c-a6d3-0de62f8ee561/action" status: 404 len: 111 microversion: 2.1 time: 0.051539 Oct 17 13:16:33.333207 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2776/5359] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:33 2022] POST /compute/v2.1/servers/4109595c-c600-472c-a6d3-0de62f8ee561/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:16:33.342982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:33.348857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:33.359202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.359794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.360441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.361405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.362095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.362772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.564948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:33.566133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:33.589529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.590255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.590844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.591715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.592318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.592899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.666630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:33.708245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e89a0554-32b2-4dde-9c0b-94b5a0020aeb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.369044 Oct 17 13:16:33.711139 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2584/5360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:33 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:33.741936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:33.748925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:33.777606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:33.790823 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3bca7d37-f121-405c-9d9e-a966598a4f7e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1266 microversion: 2.1 time: 0.229676 Oct 17 13:16:33.791842 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2777/5361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:33 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:33.798762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.801346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.803997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.805088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.805981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.821866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.887595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:33.888653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:33.904139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.908478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.909150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.910450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.915845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.916370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:34.679974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:34.701778 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7cff495-e535-4a28-a878-fa1128639907 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.963750 Oct 17 13:16:34.705483 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2585/5362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:33 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:34.721066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:34.722498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:34.730877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:34.731637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:34.732240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:34.733308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:34.733984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:34.734642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:34.975651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:34.985688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:34.995823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:34.997751 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6df7f5e3-2665-451a-baf4-f794fd22b343 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.291129 Oct 17 13:16:35.000518 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2586/5363] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:34 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:35.006023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:35.008551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:35.026406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.032765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.034527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.035564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.036211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.037033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.109729 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Cannot 'restore' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:16:35.110339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action HTTP/1.1 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 15 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: {"restore": {}} Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'restore' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'restore': {}}} Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 in vm_state active. Cannot restore while the instance is in this state. Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:35.111757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:35.115515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:35.115515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:35.115515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:35.115515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:16:35.115515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:35.119294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 409 to user: Cannot 'restore' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:35.120560 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-904a4ae0-6391-471d-9679-b986f40aa187 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 409 len: 145 microversion: 2.1 time: 0.118558 Oct 17 13:16:35.122665 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2587/5364] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:35 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 145 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:35.132461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:35.132810 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad788b0c-830d-41ec-a0a3-a31326884af2 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 1.244071 Oct 17 13:16:35.146195 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2778/5365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:33 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:35.152101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-aed62155-98ac-489a-ada7-b32c82eb38fb req-e06a7c64-9c6d-4265-8332-2120bbcf8da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec4a533-498a-40e2-84e1-931941c16cc1", "name": "network-vif-plugged", "status": "completed", "tag": "0ca362e1-43ba-45d3-b6eb-1eff56c67772"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:35.153172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:35.160043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.163575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.167531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.168517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.169139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.169737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.195969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-aed62155-98ac-489a-ada7-b32c82eb38fb req-e06a7c64-9c6d-4265-8332-2120bbcf8da6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.205204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-aed62155-98ac-489a-ada7-b32c82eb38fb req-e06a7c64-9c6d-4265-8332-2120bbcf8da6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.206248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-aed62155-98ac-489a-ada7-b32c82eb38fb req-e06a7c64-9c6d-4265-8332-2120bbcf8da6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.234897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:35.245729 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-aed62155-98ac-489a-ada7-b32c82eb38fb req-e06a7c64-9c6d-4265-8332-2120bbcf8da6 service nova] Creating event network-vif-plugged:0ca362e1-43ba-45d3-b6eb-1eff56c67772 for instance 1ec4a533-498a-40e2-84e1-931941c16cc1 on n-h1-853316-12 Oct 17 13:16:35.254130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-aed62155-98ac-489a-ada7-b32c82eb38fb req-e06a7c64-9c6d-4265-8332-2120bbcf8da6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118505 Oct 17 13:16:35.256348 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2779/5366] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:35.267908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:35.269576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:35.282382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:35.287321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.289047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.290099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.291864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.292992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.294033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.348655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:35.359740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c5adcbb7-3f83-471f-9c1c-a754eefddb1f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1272 microversion: 2.1 time: 0.235090 Oct 17 13:16:35.363917 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2588/5367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:35 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:36.028803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:36.029532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:36.044519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.045018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.045647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.046278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.046743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.047178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.268328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:36.289881 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-efccd185-4e3a-4ce2-ac17-9dd6315ce971 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 1.031121 Oct 17 13:16:36.290909 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2780/5368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:35 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:36.337618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:36.338441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:36.359030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.359816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.360540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.361719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.362475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.363121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.615075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:36.636572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e729c8dd-ab7f-47f3-b9c3-119d6c177760 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1315 microversion: 2.1 time: 0.302781 Oct 17 13:16:36.637668 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2781/5369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:36 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:36.650244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:36.651020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:36.673852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.674630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.675154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.679718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.680486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.681184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.683278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:36.702263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:36.704139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:36.705508 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da59beef-db16-4704-b95d-2dd1c1c3df7f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.680960 Oct 17 13:16:36.713046 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2589/5370] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:36 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:16:36.718055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:36.724356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:36.739257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.744519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.745164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.746224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.746874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.747673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.809115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:37.011710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:37.027266 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e2d9287-71d8-4867-ba3d-718c70f2db2c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.388319 Oct 17 13:16:37.029740 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2782/5371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:36 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:37.060151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-015a909c-7c81-4c73-ac6a-7a57f0235926 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:37.065543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-015a909c-7c81-4c73-ac6a-7a57f0235926 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:37.091391 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-015a909c-7c81-4c73-ac6a-7a57f0235926 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822 could not be found. Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-015a909c-7c81-4c73-ac6a-7a57f0235926 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822/action HTTP/1.1 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 14 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: {"resume": {}} Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822 could not be found. Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822', 'body': {'resume': {}}} Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822 could not be found. Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822 could not be found. Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:37.102720 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:37.107089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:37.107089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:37.107089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822 could not be found. Oct 17 13:16:37.107089 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:37.108272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-015a909c-7c81-4c73-ac6a-7a57f0235926 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:37.109818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-015a909c-7c81-4c73-ac6a-7a57f0235926 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822/action" status: 404 len: 111 microversion: 2.1 time: 0.055163 Oct 17 13:16:37.115260 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2783/5372] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:37 2022] POST /compute/v2.1/servers/c16a6ff9-4ca0-4ad0-bfa4-b6d75578e822/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:16:37.146740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:37.148885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:37.183177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:37.186979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:37.188965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:37.190555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:37.192278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:37.192947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:37.542064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:37.557819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:37.559979 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d55521f4-fc87-45f2-992c-2327e473efb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 0.843676 Oct 17 13:16:37.562255 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2590/5373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:36 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:37.584105 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3654534-f322-4370-981e-f4530d60fc42 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.466825 Oct 17 13:16:37.585926 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2784/5374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:37 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:37.632566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:37.633220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:37.650521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:37.655182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:37.660911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:37.661873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:37.667236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:37.667743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:37.670340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:37.671240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:37.720690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:37.721582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:37.722320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:37.723672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:37.724567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:37.725240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.125859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:38.135219 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e937ba7e-d1fc-4613-9439-c27f83174c7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.507912 Oct 17 13:16:38.138993 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2591/5375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:37 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:38.149737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:38.154829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:38.164816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.165587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.166272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.167571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.168242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.168900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.193314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:38.216049 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d366a11d-6031-4e85-8800-9071557b06ab tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1502 microversion: 2.1 time: 0.554375 Oct 17 13:16:38.220425 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2785/5376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:37 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1502 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:38.250059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:38.251015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:38.273300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.274222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.274989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.276234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.277044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.278335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.372733 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Cannot 'resume' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action HTTP/1.1 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 14 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: {"resume": {}} Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: exception: Cannot 'resume' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'resume': {}}} Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 in vm_state active. Cannot resume while the instance is in this state. Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:38.375824 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 409 to user: Cannot 'resume' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:38.379298 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-955af20a-0429-43ee-a128-57765706e728 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 409 len: 144 microversion: 2.1 time: 0.155837 Oct 17 13:16:38.394261 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2786/5377] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:38 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 144 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:38.407521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:38.408071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:38.421206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.422831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.427252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.430154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.436138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.436943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.627399 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c219a6cc-c135-42bb-ac82-8256b0af178e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1/action" status: 202 len: 0 microversion: 2.1 time: 0.231687 Oct 17 13:16:38.634223 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2787/5378] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:38 2022] POST /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:38.656807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:38.658586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:38.676901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.677625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.678334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.679774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.681066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.681655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.169636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:39.195940 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d00efa74-06a2-4990-b32a-137ce05848c7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.559711 Oct 17 13:16:39.203199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2788/5379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:38 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:39.221978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:39.222989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:39.248720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:39.249680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:39.251905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.255392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:39.256170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:39.258239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.791630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:39.805489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:39.807324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:39.808577 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab736f5e-fb74-404e-8c93-38276e888d09 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 1.668480 Oct 17 13:16:39.818803 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2592/5380] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:38 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:39.825158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:39.826044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:39.843409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:39.849411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:39.850933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.853022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:39.856935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:39.858722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.924044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:39.944941 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85676ecc-b04a-4b53-975c-b201289f7d7b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 0.728625 Oct 17 13:16:39.945769 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2789/5381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:39 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:39.964949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:39.966916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:39.990825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:39.991737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:39.995703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.996875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:39.997691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:39.998453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:40.734106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:40.748981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d66bd5ae-7b57-4a56-aac2-567c3c009490 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.795540 Oct 17 13:16:40.749651 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2790/5382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:39 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:40.859090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:40.859715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:40.879987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:40.884549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:40.885487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:40.887523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:40.893104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:40.893859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:40.999380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:41.012316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:41.020494 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ec9377e-4ede-4f72-9a1d-e93a7ef7a5c5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1487 microversion: 2.1 time: 1.199579 Oct 17 13:16:41.021307 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2593/5383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:39 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1487 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:41.043699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:41.052446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:41.073184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.073681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.074133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.074888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.075355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.075787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.325098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:41.552092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:41.558702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:41.572240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:41.573734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:41.575019 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-34828b82-5af1-4a53-b590-64e3dafae0f9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.722934 Oct 17 13:16:41.582200 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2791/5384] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:40 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:41.606200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:41.606771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:41.638408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.641770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.642337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.648742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.651050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.651759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.750802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lazy-loading 'flavor' on Instance uuid 1ec4a533-498a-40e2-84e1-931941c16cc1 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:42.514285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:42.562339 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d868ff61-abf9-4c30-905d-36097ec095e0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1/action" status: 202 len: 0 microversion: 2.1 time: 0.978610 Oct 17 13:16:42.568012 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2792/5385] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:41 2022] POST /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1/action => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:42.583189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b79e9c42-7923-48b7-80ef-5eac2073e7e6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b79e9c42-7923-48b7-80ef-5eac2073e7e6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 160 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b0c544df-5aaa-4cad-b34a-395590c4eb94"}]}} Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c0b8bbed-67fa-4bc6-93c9-ab1f864c501f', 'flavorRef': '452', 'networks': [{'uuid': 'b0c544df-5aaa-4cad-b34a-395590c4eb94'}]}}} Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi '' Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:16:42.595879 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b79e9c42-7923-48b7-80ef-5eac2073e7e6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:42.599540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b79e9c42-7923-48b7-80ef-5eac2073e7e6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.029709 Oct 17 13:16:42.602244 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2793/5386] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:42 2022] POST /compute/v2.1/servers => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:16:42.615724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e4d9976c-3ab1-4e95-9a86-031ef38d1397 req-6546240f-67f5-41e0-985d-94a7cdd5472f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b3ca2f-65c3-4763-a0b4-fb09db45c4bb", "tag": "df48ce5a-cac1-4200-8f15-ed750a8c6d29"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:42.641547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:42.660376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4d9976c-3ab1-4e95-9a86-031ef38d1397 req-6546240f-67f5-41e0-985d-94a7cdd5472f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.665021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4d9976c-3ab1-4e95-9a86-031ef38d1397 req-6546240f-67f5-41e0-985d-94a7cdd5472f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.668083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4d9976c-3ab1-4e95-9a86-031ef38d1397 req-6546240f-67f5-41e0-985d-94a7cdd5472f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:42.673732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3a026f48-105e-43d1-8c93-c7c9693c1325 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 1.638435 Oct 17 13:16:42.677759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2594/5387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:41 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:42.695821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:42.703488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:42.716317 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e4d9976c-3ab1-4e95-9a86-031ef38d1397 req-6546240f-67f5-41e0-985d-94a7cdd5472f service nova] Creating event network-changed:df48ce5a-cac1-4200-8f15-ed750a8c6d29 for instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb on n-h1-853316-12 Oct 17 13:16:42.721920 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e4d9976c-3ab1-4e95-9a86-031ef38d1397 req-6546240f-67f5-41e0-985d-94a7cdd5472f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118335 Oct 17 13:16:42.724039 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2794/5388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:42.730197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:42.731127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:42.738958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.739779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.740391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.740660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:42.741619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.742301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.742920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:42.746362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.747089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:42.749646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.751505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.752019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:43.647383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:43.658042 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9a4e5d01-bcdb-4fb6-a9ff-65a3ef3bff2d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1493 microversion: 2.1 time: 0.977478 Oct 17 13:16:43.670459 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2595/5389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:42 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1493 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:43.686899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:43.693592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:43.744507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:43.748338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:43.756276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:43.757588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:43.761362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:43.768223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.167850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:44.183558 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ada6232-5544-438b-a4b2-df084b32e8fd tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 1.457906 Oct 17 13:16:44.185954 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2795/5390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:42 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:44.193925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:44.209958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:44.227107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.227779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.229229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.230414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.234148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.234787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.602523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:44.627496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:44.636126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:44.640969 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-01cf647e-0e41-4dde-9aeb-d111df20ff05 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.968591 Oct 17 13:16:44.650423 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2596/5391] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:43 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:44.657871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:44.669485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:44.698822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.703162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.704093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.705276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.706837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.710590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.836367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:44.847636 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af35d782-e943-4a8f-9246-2ee45b87ecd6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 0.657940 Oct 17 13:16:44.864817 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2796/5392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:44 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:44.887655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:44.888327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:44.909841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.910384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.917871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.922884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.929068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.939277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:45.292547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:45.308984 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-abf3cd23-c12b-4292-bec2-6f0f7c16e9e8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.652288 Oct 17 13:16:45.311674 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2597/5393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:44 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:45.342127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4aa3481-3429-4699-a607-f6ffd8516d59 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:45.342997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4aa3481-3429-4699-a607-f6ffd8516d59 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: c9faaa96-262e-4561-9b47-6c56611e911e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:45.358366 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c4aa3481-3429-4699-a607-f6ffd8516d59 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance c9faaa96-262e-4561-9b47-6c56611e911e could not be found. Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4aa3481-3429-4699-a607-f6ffd8516d59 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/c9faaa96-262e-4561-9b47-6c56611e911e/action HTTP/1.1 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 14 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: {"shelve": {}} Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance c9faaa96-262e-4561-9b47-6c56611e911e could not be found. Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c9faaa96-262e-4561-9b47-6c56611e911e', 'body': {'shelve': {}}} Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9faaa96-262e-4561-9b47-6c56611e911e could not be found. Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9faaa96-262e-4561-9b47-6c56611e911e could not be found. Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:45.371184 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:45.375558 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:45.375558 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:45.375558 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9faaa96-262e-4561-9b47-6c56611e911e could not be found. Oct 17 13:16:45.375558 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:16:45.380640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4aa3481-3429-4699-a607-f6ffd8516d59 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance c9faaa96-262e-4561-9b47-6c56611e911e could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:45.386640 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4aa3481-3429-4699-a607-f6ffd8516d59 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/c9faaa96-262e-4561-9b47-6c56611e911e/action" status: 404 len: 111 microversion: 2.1 time: 0.045468 Oct 17 13:16:45.389399 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2598/5394] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:45 2022] POST /compute/v2.1/servers/c9faaa96-262e-4561-9b47-6c56611e911e/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:45.405619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:45.406990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:45.435738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:45.437257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:45.439581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:45.442345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:45.443022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:45.445917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:45.724272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:45.735171 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab59c8be-26dc-4703-b816-2fffe8958b55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1514 microversion: 2.1 time: 0.869099 Oct 17 13:16:45.755801 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2797/5395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:44 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1514 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:45.765243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:45.768800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:45.791227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:45.796296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:45.797632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:45.798447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:45.800924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:45.802620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:46.067090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:46.089687 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-827503a6-528b-4647-88be-f7430ecacdf4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.693985 Oct 17 13:16:46.091005 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2599/5396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:45 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:46.098933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:46.128985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:46.162737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:46.163643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:46.164177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:46.167491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:46.170733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:46.177955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:46.364741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:46.380679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:46.394906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:46.396346 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9a16c88a-cd1f-4b3b-85e1-bcc0d43f4586 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.639317 Oct 17 13:16:46.396949 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2798/5397] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:45 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:46.425611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:46.426391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:46.447657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:46.448419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:46.448419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:46.449163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:46.461437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:46.461984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.065745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:47.082855 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44c9fbd3-c2b7-4313-a181-f754f5b71267 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 0.987985 Oct 17 13:16:47.102809 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2600/5398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:46 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:47.122391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:47.123033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:47.148764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.149334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.149837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.150673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.151095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.151532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.727203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:47.747940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:47.752129 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88743f9b-6511-48b8-b308-02179c3ad9a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 1.343747 Oct 17 13:16:47.766920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2799/5399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:46 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:47.792344 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba2588e3-f2ed-46a3-8164-a2c95aa71df8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1514 microversion: 2.1 time: 0.688041 Oct 17 13:16:47.795198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:47.796092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:47.805936 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2601/5400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:47 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1514 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:47.818011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.818552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.820179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.821077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.821706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.822398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.861854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:47.864382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:47.887361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.888345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.889101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.890072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.895710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.896979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.928275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lazy-loading 'flavor' on Instance uuid 5e8edfd5-201d-4c59-b87c-b9b987ac6996 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:48.411039 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-411526c7-93fc-41e2-96e7-340687e9eece tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 202 len: 0 microversion: 2.1 time: 0.602901 Oct 17 13:16:48.419071 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2602/5401] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:47 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:48.435568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:48.436861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:48.465954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:48.467390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.469336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.469876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.471998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.473641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.475022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.480285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:48.483609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:48.488360 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d1cd77e-960e-4844-9742-8a4a41059c25 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1741 microversion: 2.20 time: 0.719828 Oct 17 13:16:48.518344 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2800/5402] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:47 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1741 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:48.527745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:48.529801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:48.550036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.551002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.551647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.552583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.559401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.560271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.886958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:48.900544 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab259a54-3bb8-465b-9e0a-74d571539cfb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.380161 Oct 17 13:16:48.903723 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2801/5403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:48 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:48.908452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:48.909372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:48.943495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.944698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.945159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.946064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.946760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.947379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:49.325316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:49.369375 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f0fbe389-640f-4cc9-8585-88a9c993ab3e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 0.931292 Oct 17 13:16:49.370207 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2603/5404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:48 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:49.518627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:49.520136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:49.521701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:49.534029 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c9981b4b-99f3-4ffb-b543-bf2123f41732 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1514 microversion: 2.1 time: 0.629162 Oct 17 13:16:49.550270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2802/5405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:48 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1514 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:49.560054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:49.560054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:49.560054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:49.562553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:49.564334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:49.564802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:49.894533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-501025e7-b209-4710-b0a6-a66f7b4da8f8 req-a5b50527-c358-4d82-8b93-348eb79c9f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec4a533-498a-40e2-84e1-931941c16cc1", "name": "network-vif-plugged", "status": "completed", "tag": "0ca362e1-43ba-45d3-b6eb-1eff56c67772"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:49.926885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-501025e7-b209-4710-b0a6-a66f7b4da8f8 req-a5b50527-c358-4d82-8b93-348eb79c9f85 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:49.927552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-501025e7-b209-4710-b0a6-a66f7b4da8f8 req-a5b50527-c358-4d82-8b93-348eb79c9f85 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:49.927862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-501025e7-b209-4710-b0a6-a66f7b4da8f8 req-a5b50527-c358-4d82-8b93-348eb79c9f85 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:49.965140 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-501025e7-b209-4710-b0a6-a66f7b4da8f8 req-a5b50527-c358-4d82-8b93-348eb79c9f85 service nova] Creating event network-vif-plugged:0ca362e1-43ba-45d3-b6eb-1eff56c67772 for instance 1ec4a533-498a-40e2-84e1-931941c16cc1 on n-h1-853316-12 Oct 17 13:16:49.978457 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-501025e7-b209-4710-b0a6-a66f7b4da8f8 req-a5b50527-c358-4d82-8b93-348eb79c9f85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088195 Oct 17 13:16:49.980823 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2803/5406] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:16:49.996460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:49.997624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:50.010474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:50.010885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:50.014822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:50.015675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:50.016160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:50.016590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:50.347760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:50.360766 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d9e29141-65f3-43a9-ad1b-689be97b8b2d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.377514 Oct 17 13:16:50.361374 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2804/5407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:49 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:50.394051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-303885658", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5a381506-d6e5-4240-88de-bd77d1e38fb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb1e7600-e122-4b5e-9526-e08a5b9bce6b"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:50.437426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:50.468161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:50.482293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:50.499113 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad74ede8-e5e2-46b7-9ced-f9e56f9d0d19 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1723 microversion: 2.20 time: 0.980582 Oct 17 13:16:50.501174 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2604/5408] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:49 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1723 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:50.517289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-928747047", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "6f8880b5-3ce0-48fb-bcb4-b95c718a074d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1300379660", "security_groups": [{"name": "tempest-secgroup-smoke-832483468"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:50.627311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] validate_networks() for [('eb1e7600-e122-4b5e-9526-e08a5b9bce6b', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:51.710318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] validate_networks() for [('6f8880b5-3ce0-48fb-bcb4-b95c718a074d', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:51.838456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:51.839495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:51.845409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:51.848177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:51.849475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:51.870271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:51.870271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:51.870695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:51.871551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:51.872123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:51.875448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:51.969964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:51.996440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:52.228590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:16:52.231274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a381506-d6e5-4240-88de-bd77d1e38fb2',volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:16:52.633397 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b2ae002-ff8e-42ec-bfd0-3eea6bdedce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249710 Oct 17 13:16:52.656670 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2805/5409] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:16:52.681653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:52.682695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:52.704756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:52.707618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:52.708194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:52.711319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:52.712469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:52.717195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.059089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:53.060938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:53.061682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:53.062537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:53.063184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:53.082062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:53.105543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.106447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.107215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.112269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.113271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.114084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.145091 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18685cff-fc1a-4f9a-b624-4b884a7a8375 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 0.461297 Oct 17 13:16:53.146119 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2806/5410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:52 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:53.154092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for project e5d16284093341d980341f1dce38f68b. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:53.159925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:53.161778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:53.168597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for user 0cee3a8479444aa3a00b2c29407931d9 and project e5d16284093341d980341f1dce38f68b. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:53.177648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.179216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:53.182109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.189137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.190580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.191712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.192566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.216009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:16:53.227971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:16:53.429828 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-424fe5c3-1e9e-4bf1-a7b3-f61a9c1bfd46 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.926492 Oct 17 13:16:53.430582 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2605/5411] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 2928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:16:53.486943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:53.495378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:53.528297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.539301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.539959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.540808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.545388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.550009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.733092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:53.767872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f167eae-600b-4dc9-9130-6171e831a006 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.617656 Oct 17 13:16:53.770608 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2807/5412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:53 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:53.779433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:53.785557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:53.838154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.848426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.852262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.856474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.864291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.867239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.344294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:54.383759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:54.387472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:54.390929 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d11ac7e-642b-469a-b242-444ff6bee92e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1723 microversion: 2.20 time: 0.617355 Oct 17 13:16:54.392563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2808/5413] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:53 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1723 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:54.399141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:54.406189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:54.428293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.429010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.433121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.434860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.435581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.436263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.484839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:54.611160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:54.621452 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fcec5b3a-803b-45cc-aeeb-e9a08aa5a5a3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 1.174350 Oct 17 13:16:54.636156 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2606/5414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:53 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:54.656401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:54.665018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1da30dd9-61fc-4a90-9017-684032cf495e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:54.665799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1da30dd9-61fc-4a90-9017-684032cf495e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:54.673791 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6de21782-c6a4-4091-97f4-a9bef1f5de9a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1098 microversion: 2.1 time: 0.279249 Oct 17 13:16:54.675992 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2809/5415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:54 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1098 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:54.713311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-ed99af41-17e0-4f55-b5ca-f73220c3e3a9 req-ffabd70d-926a-40eb-8253-37ce573088f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3001998-79dc-4411-aec7-cd86e6c72deb", "name": "network-vif-unplugged", "status": "completed", "tag": "dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:54.738803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ed99af41-17e0-4f55-b5ca-f73220c3e3a9 req-ffabd70d-926a-40eb-8253-37ce573088f1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.740196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ed99af41-17e0-4f55-b5ca-f73220c3e3a9 req-ffabd70d-926a-40eb-8253-37ce573088f1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.740967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ed99af41-17e0-4f55-b5ca-f73220c3e3a9 req-ffabd70d-926a-40eb-8253-37ce573088f1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.771427 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-ed99af41-17e0-4f55-b5ca-f73220c3e3a9 req-ffabd70d-926a-40eb-8253-37ce573088f1 service nova] Creating event network-vif-unplugged:dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e for instance f3001998-79dc-4411-aec7-cd86e6c72deb on n-h1-853316-12 Oct 17 13:16:54.783359 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-ed99af41-17e0-4f55-b5ca-f73220c3e3a9 req-ffabd70d-926a-40eb-8253-37ce573088f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105875 Oct 17 13:16:54.793768 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2810/5416] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:54.808106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:54.809169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:54.829598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.838831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.839662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.841461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.845934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.848973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:55.058366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1da30dd9-61fc-4a90-9017-684032cf495e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:55.072281 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1da30dd9-61fc-4a90-9017-684032cf495e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1266 microversion: 2.1 time: 0.434883 Oct 17 13:16:55.072883 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2607/5417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:54 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1266 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:55.103130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:55.120948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:55.153784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:55.156508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:55.158438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:55.162122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:55.166038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:55.166723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:55.367133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:55.379626 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07fb4603-e734-495e-8a35-d44ad367ffe0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 0.583638 Oct 17 13:16:55.382120 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2811/5418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:54 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:55.426907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:55.427524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:55.469050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:55.469561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:55.479503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:55.482399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:55.484684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:55.485977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:55.944154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:55.969357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:55.977962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:55.979761 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e31346e-4355-4eb0-8699-a37386286bc9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1666 microversion: 2.20 time: 0.559063 Oct 17 13:16:56.003802 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2812/5419] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:55 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1666 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:56.003802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:56.003802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:56.011315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:56.012206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:56.012840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:56.013692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:56.014359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:56.015662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:56.527455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:56.549664 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab86c44e-b9f7-4f93-ad5c-ac72f196c7bc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.560427 Oct 17 13:16:56.576788 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2813/5420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:55 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:56.591878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:56.592198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:56.616573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:56.630711 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-65a12e0b-9306-40db-8f47-82b29fab9eef tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 1.556710 Oct 17 13:16:56.635386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:56.637000 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2608/5421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:55 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:56.639678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:56.642020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:56.643837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:56.646808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:56.651320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:56.660477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "762c005a-acd6-4ff1-8dd4-1e298f196304"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:56.663418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:56.671130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:56.671852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:56.680421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:56.681437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:56.683829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:56.684475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:56.977422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:57.004169 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d68bde2b-1c9f-4823-8d21-955a5e2d5bbb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1172 microversion: 2.1 time: 0.416973 Oct 17 13:16:57.008262 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2814/5422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:56 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1172 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:57.050693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:57.055292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:57.091891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.092494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.092948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.093725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.094455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.095021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.405853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:57.466063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:57.501091 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b2ab577-fc39-410f-8fd5-5346765febf1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1336 microversion: 2.1 time: 0.488492 Oct 17 13:16:57.501950 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2815/5423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:57 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1336 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:57.554734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:57.556187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:57.576695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.577816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.578574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.579546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.580581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.583026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.657130 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-edf22ce0-a320-4a07-9d4c-4b69ec792f7b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.018980 Oct 17 13:16:57.666008 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2609/5424] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 17 13:16:56 2022] POST /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 188 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:57.683443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d7742991-aadd-479a-8d18-bb79e878cec0 req-0dadd37f-957e-42e7-b543-77faa08e57a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b3ca2f-65c3-4763-a0b4-fb09db45c4bb", "name": "network-vif-plugged", "status": "completed", "tag": "df48ce5a-cac1-4200-8f15-ed750a8c6d29"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:57.706795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7742991-aadd-479a-8d18-bb79e878cec0 req-0dadd37f-957e-42e7-b543-77faa08e57a4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.711185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7742991-aadd-479a-8d18-bb79e878cec0 req-0dadd37f-957e-42e7-b543-77faa08e57a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.711949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7742991-aadd-479a-8d18-bb79e878cec0 req-0dadd37f-957e-42e7-b543-77faa08e57a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.751317 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d7742991-aadd-479a-8d18-bb79e878cec0 req-0dadd37f-957e-42e7-b543-77faa08e57a4 service nova] Creating event network-vif-plugged:df48ce5a-cac1-4200-8f15-ed750a8c6d29 for instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb on n-h1-853316-12 Oct 17 13:16:57.761230 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d7742991-aadd-479a-8d18-bb79e878cec0 req-0dadd37f-957e-42e7-b543-77faa08e57a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093642 Oct 17 13:16:57.768516 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2610/5425] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:57.779249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:57.783820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:57.815456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.816414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.817085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.818222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.819503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.823985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:58.363857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:58.377731 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31d3ed85-6b7e-4695-94a9-4aa298e5e6a2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.607612 Oct 17 13:16:58.380982 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2611/5426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:57 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:58.389866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:58.398423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:58.405827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:58.406712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:58.407404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:58.408597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:58.409303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:58.409978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:58.609418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:58.623678 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae55ec1a-d3e0-46d0-ac5b-10ac82bd5e0e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1314 microversion: 2.1 time: 1.096938 Oct 17 13:16:58.642926 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2816/5427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:57 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1314 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:58.655635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:58.656359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:58.666098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:58.666894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:58.667433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:58.668366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:58.668892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:58.669388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:58.852338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:58.866000 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3f407200-95ca-49ae-a50a-0f2929e7573f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.481416 Oct 17 13:16:58.867190 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2612/5428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:58 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:58.881352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:58.884670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:58.912693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:58.917073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:58.917627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:58.921491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:58.923233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:58.927676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:59.082019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127539) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:16:59.261034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:59.275133 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d6e10f39-ceca-40cd-a9bd-097e930f7de7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.628344 Oct 17 13:16:59.279373 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2817/5429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:58 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:59.300190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:59.305141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a73cef84-d039-4c00-8024-db6e8282bb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/action" status: 202 len: 0 microversion: 2.20 time: 0.433588 Oct 17 13:16:59.309616 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2613/5430] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 13:16:58 2022] POST /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:16:59.314253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:59.323998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:59.335561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:59.344808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:59.345318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:59.346833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:59.347687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:59.353129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:59.354016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:59.354553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:59.355006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:59.355339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:59.356687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:59.357716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:59.358744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:59.600087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:59.613177 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f647025-e892-476c-ac81-9a941710ebd2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1324 microversion: 2.1 time: 0.332488 Oct 17 13:16:59.639572 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2818/5431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:59 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:59.657634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:59.658635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:59.679345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:59.680508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:59.681104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:59.682080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:59.684552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:59.685193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:00.055372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:00.076493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:00.090056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:00.096358 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ed48802-5a68-4461-8afa-491521388dd7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1752 microversion: 2.20 time: 0.785196 Oct 17 13:17:00.099814 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2614/5432] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:59 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1752 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:00.105377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:00.176965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:00.213855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:00.229375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:00.229375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:00.229375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:00.229375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:00.229953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:00.606849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:00.619289 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-370974c9-9a1f-4d11-b08d-55495dda96b5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.978297 Oct 17 13:17:00.625762 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2819/5433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:59 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:00.654735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:00.657818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:00.682858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:00.683353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:00.683976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:00.684879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:00.689331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:00.690125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:00.763765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:00.773146 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bfbde6e1-730d-4e0c-b4ce-e8b1d8d71693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1502 microversion: 2.1 time: 0.671727 Oct 17 13:17:00.778062 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2615/5434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:00 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1502 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:00.795679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:00.796711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:00.813109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:00.814009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:00.814751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:00.815927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:00.817622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:00.829300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.293047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:01.296298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:01.301740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82f23e6f-6e6b-4ffe-9382-89709ee12c5e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.522125 Oct 17 13:17:01.302365 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2616/5435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:00 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:01.322924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:01.323549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:01.324277 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bbde724f-e52b-4423-aa8a-50d69f6c453f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.676168 Oct 17 13:17:01.325951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2820/5436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:00 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:01.349905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:01.356980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:01.358014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:01.358676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:01.359140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.363279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:01.364115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:01.364221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.374147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:01.374865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:01.375456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.377218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:01.387615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:01.388305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.599632 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3656bb4c-0eeb-4c25-b2ec-beddeba0782e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.271351 Oct 17 13:17:01.606607 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2821/5437] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:01 2022] POST /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:01.629617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:01.649228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:01.673041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:01.673568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:01.683672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.684804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:01.685611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:01.686875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.913427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:02.019469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:02.084137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:02.108705 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6c6c37c-a9e5-4859-a83a-492326be8c98 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1391 microversion: 2.1 time: 0.793134 Oct 17 13:17:02.113147 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2617/5438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:01 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1391 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:02.128745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:02.129940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:02.150349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.156527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.157403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:02.160308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.160894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.161236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:02.660390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:02.670359 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-45b72aed-f21f-4cee-afa2-3125d1ea6989 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1487 microversion: 2.1 time: 0.555891 Oct 17 13:17:02.675973 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2618/5439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:02 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1487 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:02.682608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-300ba95e-265d-49c4-90c6-6619e5c9c926 req-bcafb64a-7683-4a2b-8eec-9cd55d8aa29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16df401d-cb46-4487-afaa-946d42535d9e", "tag": "1111e5ee-9213-4fb3-8b6a-a8fadf5950ff"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:02.720297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-300ba95e-265d-49c4-90c6-6619e5c9c926 req-bcafb64a-7683-4a2b-8eec-9cd55d8aa29b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.722967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-300ba95e-265d-49c4-90c6-6619e5c9c926 req-bcafb64a-7683-4a2b-8eec-9cd55d8aa29b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.735986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-300ba95e-265d-49c4-90c6-6619e5c9c926 req-bcafb64a-7683-4a2b-8eec-9cd55d8aa29b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:02.755608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:02.776122 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-300ba95e-265d-49c4-90c6-6619e5c9c926 req-bcafb64a-7683-4a2b-8eec-9cd55d8aa29b service nova] Creating event network-changed:1111e5ee-9213-4fb3-8b6a-a8fadf5950ff for instance 16df401d-cb46-4487-afaa-946d42535d9e on n-h2-853316-12 Oct 17 13:17:02.779250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:02.783928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:02.785606 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d8c3c02-5f9c-4e28-99d8-a8a570a9a16a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1752 microversion: 2.20 time: 1.177705 Oct 17 13:17:02.790226 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2822/5440] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:01 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1752 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:02.795313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:02.803998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:02.827438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.827911 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-300ba95e-265d-49c4-90c6-6619e5c9c926 req-bcafb64a-7683-4a2b-8eec-9cd55d8aa29b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149209 Oct 17 13:17:02.839028 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2619/5441] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:02.842756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.843470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:02.847246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:02.847975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:02.848740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.849455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.850114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:02.855793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.856295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.856773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:02.858255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.859467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.860219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:03.139726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:03.306280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:03.317840 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e39cb22-33da-47b2-9ce4-95d24a2df8d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.477454 Oct 17 13:17:03.318578 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2620/5442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:02 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:03.336047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:03.336756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:03.355510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:03.374498 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a5985df2-0f92-42b3-af44-84b6713e0d8f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.573696 Oct 17 13:17:03.377435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:03.377935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:03.378385 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2823/5443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:02 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:03.380430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:03.387766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:03.388587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:03.392048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:03.399925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:03.400873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:03.410976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:03.432236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:03.432745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:03.433184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:03.433897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:03.434389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:03.434815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:03.528351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:17:03.612630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:03.771759 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55f4799e-4eee-449c-b58b-a7359abca14a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 204 len: 0 microversion: 2.1 time: 0.392040 Oct 17 13:17:03.774373 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2824/5444] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:17:03 2022] DELETE /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:03.785212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:03.796448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:03.803790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:03.804612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:03.805257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:03.806441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:03.807118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:03.807733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:04.091058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:04.100877 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-967a1439-bc22-44b7-8452-62e0bd826edb tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.779343 Oct 17 13:17:04.105322 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2621/5445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:03 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:04.503454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4c6a0dd7-7e61-4185-b7d7-946c4cc99aff req-4b8381f7-f938-4b7c-a1df-7631495a66b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a73c36f-0f0a-454b-8a98-de7cdca642cb", "tag": "601c5043-9cee-42c7-8136-f10fb526fa82"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:04.530114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c6a0dd7-7e61-4185-b7d7-946c4cc99aff req-4b8381f7-f938-4b7c-a1df-7631495a66b9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:04.530799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c6a0dd7-7e61-4185-b7d7-946c4cc99aff req-4b8381f7-f938-4b7c-a1df-7631495a66b9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:04.532417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4c6a0dd7-7e61-4185-b7d7-946c4cc99aff req-4b8381f7-f938-4b7c-a1df-7631495a66b9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:04.623086 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4c6a0dd7-7e61-4185-b7d7-946c4cc99aff req-4b8381f7-f938-4b7c-a1df-7631495a66b9 service nova] Creating event network-changed:601c5043-9cee-42c7-8136-f10fb526fa82 for instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb on n-h2-853316-12 Oct 17 13:17:04.641408 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4c6a0dd7-7e61-4185-b7d7-946c4cc99aff req-4b8381f7-f938-4b7c-a1df-7631495a66b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.532035 Oct 17 13:17:04.642049 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2622/5446] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:04.659327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:04.660052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:04.672331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:04.673177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:04.673825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:04.674841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:04.675492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:04.676147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.063464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:05.115500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:05.129683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d8dfe36-72be-4584-a971-ee9302c901e3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1391 microversion: 2.1 time: 1.353986 Oct 17 13:17:05.133297 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2825/5447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:03 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1391 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:05.145268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:05.146230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:05.160706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.163484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.165145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.166273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.168152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.169278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.593718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:05.614617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:05.618353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:05.620988 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ef0ea02-5040-43d9-8804-1ae62010b2ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1754 microversion: 2.20 time: 0.485800 Oct 17 13:17:05.622533 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2826/5448] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:05 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1754 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:05.628021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:05.628860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:05.636063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.636933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.637533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.638512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.639126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.639726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.726068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:05.737756 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-95284e0f-def6-4678-a1ad-d1ee31782ba3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1493 microversion: 2.1 time: 1.094416 Oct 17 13:17:05.741498 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2623/5449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:04 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1493 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:05.756222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:05.762478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:05.793968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.794531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.794981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.795724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.796196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.796631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.878689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:05.896293 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-995d1f4d-cb1e-4b25-8fe0-47d1987df575 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.272472 Oct 17 13:17:05.903139 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2827/5450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:05 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:05.920040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:05.921631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:05.944924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.952944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.953736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.954731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.957805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.958602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:06.235931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:06.255185 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-970f1e2a-35ba-4609-b0d6-e58c6c10e250 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.348445 Oct 17 13:17:06.255835 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2828/5451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:05 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:06.280616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:06.284215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:06.307285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:06.311872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:06.314394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:06.329083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:06.330202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:06.330772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:06.515715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:06.542605 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-864dbad4-a498-48ae-a1ee-39293ce588f5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.787775 Oct 17 13:17:06.545037 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2624/5452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:05 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:06.602795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:06.612149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-82a33065-c3ae-431d-ae1d-a232ca5b96b0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1391 microversion: 2.1 time: 0.353851 Oct 17 13:17:06.630623 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2829/5453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:06 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1391 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:06.658611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:06.663338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:06.672151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:06.673758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:06.674420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:06.685088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:06.686542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:06.687194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:06.784859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:06.785472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:06.802707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:06.802707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:06.802707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:06.802707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:06.802707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:06.803637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.124648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.138492 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8585d56b-974f-4038-bd3b-fcaae876a94f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1493 microversion: 2.1 time: 0.356701 Oct 17 13:17:07.141664 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2830/5454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:06 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1493 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:07.160526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:07.162463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:07.185612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.196092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.197022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.198025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.200127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.201777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.363410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.395914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.411811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.416525 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e1a7117-1dfb-4251-a7c5-d96b3d929d0b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1754 microversion: 2.20 time: 0.768821 Oct 17 13:17:07.424202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2625/5455] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:06 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1754 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:07.455045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:07.466815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:07.495907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.503222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.504016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.505113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.508032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.510118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.596925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:07.673209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.689651 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-98e8fdb3-9aef-48d1-aeae-b25fc01f77f2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.546602 Oct 17 13:17:07.709285 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2831/5456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:07 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:07.735082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e771df95-8719-464f-970b-002708de0841 req-a2c2f72a-1183-4efb-92ae-3a3e86ac885a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b3ca2f-65c3-4763-a0b4-fb09db45c4bb", "name": "network-vif-deleted", "tag": "df48ce5a-cac1-4200-8f15-ed750a8c6d29"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:07.783404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e771df95-8719-464f-970b-002708de0841 req-a2c2f72a-1183-4efb-92ae-3a3e86ac885a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.783906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e771df95-8719-464f-970b-002708de0841 req-a2c2f72a-1183-4efb-92ae-3a3e86ac885a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.784345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e771df95-8719-464f-970b-002708de0841 req-a2c2f72a-1183-4efb-92ae-3a3e86ac885a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.851663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e771df95-8719-464f-970b-002708de0841 req-a2c2f72a-1183-4efb-92ae-3a3e86ac885a service nova] Creating event network-vif-deleted:df48ce5a-cac1-4200-8f15-ed750a8c6d29 for instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb on n-h1-853316-12 Oct 17 13:17:07.860705 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e771df95-8719-464f-970b-002708de0841 req-a2c2f72a-1183-4efb-92ae-3a3e86ac885a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142263 Oct 17 13:17:07.862587 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2832/5457] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:07.870268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:07.871014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:07.877781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.878497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.879111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.879845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.880972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.880972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.073093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:08.089352 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b86ab0f8-8527-4757-8744-dda9510898f5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.663563 Oct 17 13:17:08.106190 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2626/5458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:07 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:08.106559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:08.106679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:08.106679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:08.106971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-187cd815-196e-4bc3-aeba-142ce21581f1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.239550 Oct 17 13:17:08.106971 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2833/5459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:07 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:08.139582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.140076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.140521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.141228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.141683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.142106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.176595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:08.177230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:08.193292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.193802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.194409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.199208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.206800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.207546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.309300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.313612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.314195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.314686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'fault' on Instance uuid 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:08.391735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:08.413417 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ed1329a0-bdfc-4c01-8b24-2399805b56d0 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1391 microversion: 2.1 time: 0.312862 Oct 17 13:17:08.414542 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2627/5460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:08 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1391 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:08.425797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:08.441117 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b4a0d90d-8140-43c0-8a32-b7902d617c1e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 200 len: 1304 microversion: 2.1 time: 0.276007 Oct 17 13:17:08.442729 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2834/5461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:08 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 1304 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:08.458233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:08.459145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:08.467535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.468036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.468481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.469416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.469881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.470506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.714662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:08.729768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:08.734250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:08.736721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:08.737420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:08.740260 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8dd98d1e-c14c-45d6-9df6-b8bb1db14c17 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1754 microversion: 2.20 time: 0.290496 Oct 17 13:17:08.743170 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2628/5462] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:08 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1754 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:08.783297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.783922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.793450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.794384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.801338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.801996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.057952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:09.074433 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-772757fd-74f1-44ad-88d0-4077e692674e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.346407 Oct 17 13:17:09.092180 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2835/5463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:08 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:09.121178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:09.128690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:09.129543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:09.129875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:09.143820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.144911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.145645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.145937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.148281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.148560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.149491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.150525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.152616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.153630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.155861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.156610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.367453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:09.386544 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b4cd8403-559e-4ee5-bf58-942ab410da60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.269534 Oct 17 13:17:09.389489 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2629/5464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:09 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:09.417080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:09.429843 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-34d4611f-2325-4e92-b200-4983a6ebb124 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1532 microversion: 2.1 time: 0.305277 Oct 17 13:17:09.439822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:09.441316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2836/5465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:09 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1532 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:09.442388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:09.458528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.459311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.460729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.462077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.462729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.463344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.468096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:09.470807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:09.481034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.481850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.482444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.483521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.484124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.484661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.532086 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb HTTP/1.1 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '77b3ca2f-65c3-4763-a0b4-fb09db45c4bb'} Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:09.539867 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3681f00-7c9e-4c17-a27b-060e0a9ee920 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 404 len: 111 microversion: 2.1 time: 0.078952 Oct 17 13:17:09.544658 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2837/5466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:09 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:17:09.692205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:09.702633 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be481436-2127-48be-b2e5-ea2d0fe59997 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1391 microversion: 2.1 time: 0.266009 Oct 17 13:17:09.703726 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2630/5467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:09 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:09.732693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-538508897", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e6961d90-c691-4862-9018-60bca57213f2"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:09.770865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:09.771875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:09.785032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.785439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.785934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.787315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:09.790572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:09.791775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.826338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] validate_networks() for [('e6961d90-c691-4862-9018-60bca57213f2', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:17:10.136921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:10.153449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:10.169116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:10.170763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-684b12a4-81ee-4977-ab90-f35df16b32d8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1754 microversion: 2.20 time: 0.403811 Oct 17 13:17:10.182904 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2631/5468] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:09 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1754 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:10.212521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:10.219113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:10.239710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.240412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.242258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.243009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.243475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.243905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.543425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:10.606005 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b6847754-8a1c-4a2b-ace2-f486203e19bf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.393129 Oct 17 13:17:10.623246 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2632/5469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:10 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:10.640846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:10.643965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:10.672042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.674793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.675561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.681679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.682851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.684062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.841246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:17:10.841947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:17:10.842448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:17:10.842616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:17:10.842963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:17:10.864087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.864784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.865153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.866773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.867233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.867676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.907909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:10.914112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for user 24c6068b196d4cc398176b22196bd5b1 and project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:10.929091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:17:10.931692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:17:10.994400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.002752 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-166ad96b-38c4-43bd-989e-a595df7d5c78 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.378091 Oct 17 13:17:11.015152 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2633/5470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:10 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:11.025850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:11.026515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:11.028887 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b01516d-3e8b-4b1f-9cc4-0953e2a8b971 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297199 Oct 17 13:17:11.035563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2838/5471] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:17:11.035735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.035735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.035735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.035735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.035735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.036113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.040356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-da0c53b7-ff3b-43d5-8ef5-b4542615f4ce req-980d2c6a-e1f7-4b99-ae13-0c663a4ebf88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a73c36f-0f0a-454b-8a98-de7cdca642cb", "name": "network-vif-plugged", "status": "completed", "tag": "601c5043-9cee-42c7-8136-f10fb526fa82"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:11.093095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-da0c53b7-ff3b-43d5-8ef5-b4542615f4ce req-980d2c6a-e1f7-4b99-ae13-0c663a4ebf88 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.096693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-da0c53b7-ff3b-43d5-8ef5-b4542615f4ce req-980d2c6a-e1f7-4b99-ae13-0c663a4ebf88 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.099452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-da0c53b7-ff3b-43d5-8ef5-b4542615f4ce req-980d2c6a-e1f7-4b99-ae13-0c663a4ebf88 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.171352 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-da0c53b7-ff3b-43d5-8ef5-b4542615f4ce req-980d2c6a-e1f7-4b99-ae13-0c663a4ebf88 service nova] Creating event network-vif-plugged:601c5043-9cee-42c7-8136-f10fb526fa82 for instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb on n-h2-853316-12 Oct 17 13:17:11.183961 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-da0c53b7-ff3b-43d5-8ef5-b4542615f4ce req-980d2c6a-e1f7-4b99-ae13-0c663a4ebf88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149933 Oct 17 13:17:11.193080 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2839/5472] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:11.216049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:11.219514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:11.316414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.316414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.316414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.317496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.318481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.321992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.494741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.503494 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-06016f3b-34fd-4847-95b8-dabd01feb838 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1532 microversion: 2.1 time: 0.487200 Oct 17 13:17:11.504389 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2634/5473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:11 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1532 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:11.510722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-81e167dd-bb11-4102-9151-17b76ecbb9e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:11.511327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-81e167dd-bb11-4102-9151-17b76ecbb9e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:11.571859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-81e167dd-bb11-4102-9151-17b76ecbb9e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.580870 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-81e167dd-bb11-4102-9151-17b76ecbb9e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1214 microversion: 2.1 time: 0.075399 Oct 17 13:17:11.590195 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2635/5474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:11 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:11.591454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:11.593275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:11.600752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.602190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.603007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.603889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.604507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.605323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.690258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.700833 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fb3cc7b2-ae7f-4e75-9e35-2667c0eaa3c3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1391 microversion: 2.1 time: 0.503382 Oct 17 13:17:11.701426 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2840/5475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:11 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1391 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:11.706557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:11.707168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:11.716897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.717674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.718607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.722271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.722931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.723523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.933491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.942735 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eb445e8b-3792-4ac1-a23d-77887427532d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.239819 Oct 17 13:17:11.946893 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2841/5476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:11 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:11.972786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.985950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.987834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.990419 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-029c856a-2b17-4f46-89d1-aa59814d7e1d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1754 microversion: 2.20 time: 0.406386 Oct 17 13:17:11.991868 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2636/5477] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:11 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1754 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:12.030389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:12.031417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:12.042352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.043115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.043456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.044239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.044992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.045335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.359206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:12.374028 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e735ba55-cb3b-401d-bee3-81fdff509a74 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.348338 Oct 17 13:17:12.390959 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2842/5478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:12 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:12.533017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:12.533922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:12.552738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.555004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.557682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.559358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.561971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.565911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.613739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:12.614798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:12.625368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.628645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.629614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.633121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.634020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.634972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.649665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:12.790117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:12.805463 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7870081-29ac-4e85-a1c4-b730813e6f90 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1266 microversion: 2.1 time: 0.196386 Oct 17 13:17:12.806386 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2843/5479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:12 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:12.814273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:12.815941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:12.832477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.833383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.834079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.836848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.838127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.840707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.965110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:12.973580 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee921d8b-d6e6-4c6b-a62d-b34740e52d08 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.445279 Oct 17 13:17:12.974205 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2637/5480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:12 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:12.999458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:13.001908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:13.028370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:13.029551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:13.031687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:13.034420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:13.036601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:13.038470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:13.153964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.165464 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-26ae97f5-decd-42d8-bc83-3c02f66e4503 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1563 microversion: 2.1 time: 0.357554 Oct 17 13:17:13.190869 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2844/5481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:12 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1563 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:13.197938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:13.198976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:13.212265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:13.213133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:13.214049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:13.215120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:13.215796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:13.216378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:13.647522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.661743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.672509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.676143 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d044990-ab64-41b0-a796-0409cf29ac78 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1754 microversion: 2.20 time: 0.483603 Oct 17 13:17:13.680996 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2845/5482] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:13 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1754 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:13.698931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:13.701041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:13.719177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:13.722070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:13.728896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:13.732206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:13.733250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:13.733936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:13.820236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.859202 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fceb5118-c13f-472a-9c7c-372facab61f0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1214 microversion: 2.1 time: 0.881758 Oct 17 13:17:13.880749 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2638/5483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:12 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1214 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:13.935629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fa48ff3d-7fc9-43e7-be65-2d7cfe3c9ee6 req-6272083a-97da-44b4-bd23-92564b0f18a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8edfd5-201d-4c59-b87c-b9b987ac6996", "name": "network-vif-plugged", "status": "completed", "tag": "d5781fa1-d3fb-4668-acdd-398634e6693e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:13.981823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fa48ff3d-7fc9-43e7-be65-2d7cfe3c9ee6 req-6272083a-97da-44b4-bd23-92564b0f18a3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:13.986318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fa48ff3d-7fc9-43e7-be65-2d7cfe3c9ee6 req-6272083a-97da-44b4-bd23-92564b0f18a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:13.987294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fa48ff3d-7fc9-43e7-be65-2d7cfe3c9ee6 req-6272083a-97da-44b4-bd23-92564b0f18a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.038296 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fa48ff3d-7fc9-43e7-be65-2d7cfe3c9ee6 req-6272083a-97da-44b4-bd23-92564b0f18a3 service nova] Creating event network-vif-plugged:d5781fa1-d3fb-4668-acdd-398634e6693e for instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 on n-h2-853316-12 Oct 17 13:17:14.054578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:14.070804 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fa48ff3d-7fc9-43e7-be65-2d7cfe3c9ee6 req-6272083a-97da-44b4-bd23-92564b0f18a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177997 Oct 17 13:17:14.071894 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0dff3a3a-313f-4318-b110-c539910a4b05 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1563 microversion: 2.1 time: 0.387648 Oct 17 13:17:14.073212 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2846/5484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:13 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1563 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:14.079216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:14.084973 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2639/5485] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:14.085249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:14.098870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.104221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.114877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.117712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:14.118556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:14.121039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.124006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.131482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.165011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.175388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.180639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.188146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.196543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.198699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.468701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:14.481424 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-068b4940-6b03-4c4a-a420-e0024472553d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1272 microversion: 2.1 time: 0.391934 Oct 17 13:17:14.482394 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2640/5486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:14 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1272 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:14.496098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:14.496747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:14.513632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.514702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.517048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.519108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.525241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.527384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.984713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.007620 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6957ad30-82b1-40aa-89e4-d8cc10006b39 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.924068 Oct 17 13:17:15.009574 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2847/5487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:14 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:15.039820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:15.043793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:15.071535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:15.073345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:15.075596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:15.081235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:15.082153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:15.084827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:15.101120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.115526 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-27fc5f2f-a0e1-48b1-bc08-b29a09395d7d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.631912 Oct 17 13:17:15.118602 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2641/5488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:14 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:15.133487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:15.134444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:15.160485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:15.161663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:15.163136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:15.164178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:15.164866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:15.165544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:15.541025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.558023 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e417ad1-e331-4076-91b9-0e3dc587fb54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1202 microversion: 2.1 time: 0.431255 Oct 17 13:17:15.559367 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2642/5489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:15 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1202 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:15.564815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:15.571342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:15.577684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.596587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:15.598349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.601242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:15.604784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:15.606355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.607483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:15.608959 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc03fb6d-f27f-426a-8b51-bff7fb218f07 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1754 microversion: 2.20 time: 0.594085 Oct 17 13:17:15.611636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:15.612349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:15.621237 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2848/5490] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:15 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1754 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:16.037094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:16.037857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:16.076377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:16.094957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:16.096355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:16.097487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:16.098256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:16.099388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:16.591996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:16.619418 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d9f44c1d-c0f4-4af4-8fe6-97ec9ba6ba69 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 1.058717 Oct 17 13:17:16.620690 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2643/5491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:15 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:16.646675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:16.648585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:16.660064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:16.664548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:16.667856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:16.669432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:16.672939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:16.673737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:16.743131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:17.051909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.071299 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d00ff78-31a7-442c-bb7d-c9872e509cde tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.446630 Oct 17 13:17:17.077993 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2644/5492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:16 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:17.096051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:17.097097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:17.112547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:17.113818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:17.114525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:17.115509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:17.117676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:17.118386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:17.485669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.505806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a8a2cdc-d32b-4f5d-aaf6-991cb7099260 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 1.471694 Oct 17 13:17:17.512100 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2849/5493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:16 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:17.532396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:17.539174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:17.559849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:17.561625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:17.562120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:17.564126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:17.564646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:17.566068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:17.656616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.671086 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4be694d0-968a-43a4-a7be-507fdc847230 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1202 microversion: 2.1 time: 0.588603 Oct 17 13:17:17.692990 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2645/5494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:17 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1202 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:17.717871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:17.718850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:17.745190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:17.746530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:17.747061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:17.751170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:17.751658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:17.752387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:17.942626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.953640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.966263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.967553 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3913854-a1d0-43e2-ac4c-5a55bafdc580 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1754 microversion: 2.20 time: 0.451684 Oct 17 13:17:17.968141 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2850/5495] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:17 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1754 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:18.106300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:18.107157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:18.121265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.123879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.124576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.129217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.130276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.132156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.402276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:18.425176 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d11d3b5-abba-4623-805e-ba009cd56f62 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.730915 Oct 17 13:17:18.433442 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2646/5496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:17 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:18.456298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:18.464967 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3696df37-2aa6-468b-88cf-d8f59c9dec67 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.362591 Oct 17 13:17:18.470463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2851/5497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:18 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:18.535407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:18.540317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:18.557384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:18.564073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.568498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.569402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.571982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.579176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.579645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.701778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:18.704798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:18.717772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.721410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.724549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.726675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.727394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.728078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:19.363072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:19.376535 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-76017618-2277-4821-b583-536325af5cde tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.845494 Oct 17 13:17:19.383779 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2647/5498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:18 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:19.395877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:19.400897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:19.429312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:19.432540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:19.433670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:19.435327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:19.437139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:19.439930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:19.440850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:19.474035 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5740982b-6865-4daf-90ea-29a386a71a8f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1202 microversion: 2.1 time: 0.775531 Oct 17 13:17:19.477715 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2852/5499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:18 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1202 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:19.503550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0b3285e9-aa3b-4407-ae18-0ee3fe721c39 req-99c8a779-5ec7-4845-bb15-6573cc5dab2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c84769-498d-4e0b-9cdd-f9569b58f1f8", "tag": "e1736ccb-979b-4c83-b032-f7f4926f64b5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:19.566841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0b3285e9-aa3b-4407-ae18-0ee3fe721c39 req-99c8a779-5ec7-4845-bb15-6573cc5dab2b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:19.567335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0b3285e9-aa3b-4407-ae18-0ee3fe721c39 req-99c8a779-5ec7-4845-bb15-6573cc5dab2b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:19.567775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0b3285e9-aa3b-4407-ae18-0ee3fe721c39 req-99c8a779-5ec7-4845-bb15-6573cc5dab2b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:19.620686 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0b3285e9-aa3b-4407-ae18-0ee3fe721c39 req-99c8a779-5ec7-4845-bb15-6573cc5dab2b service nova] Creating event network-changed:e1736ccb-979b-4c83-b032-f7f4926f64b5 for instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 on n-h1-853316-12 Oct 17 13:17:19.645660 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0b3285e9-aa3b-4407-ae18-0ee3fe721c39 req-99c8a779-5ec7-4845-bb15-6573cc5dab2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166379 Oct 17 13:17:19.646322 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2853/5500] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:19.652348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:19.671286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:19.712373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:19.713001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:19.718989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:19.720277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:19.720941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:19.721553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:19.981509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:19.993438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:20.002420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:20.004879 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5fa65ba-defe-4359-900c-4d8edb756b06 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.617904 Oct 17 13:17:20.005910 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2648/5501] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:19 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:20.022886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:20.027481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:20.058234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:20.059028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:20.061224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:20.062154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:20.063742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:20.065273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:20.394381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:20.416234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-edcd55b8-bf5b-4135-a761-c5a2df3cdd21 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.759495 Oct 17 13:17:20.417239 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2854/5502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:19 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:20.443409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:20.445812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:20.464613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:20.465571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:20.469598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:20.472240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:20.474346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:20.476649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:20.903783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:20.923729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:20.937103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:20.951593 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dfca937a-241d-4f70-9c28-d7cd9ac2a2c1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1563 microversion: 2.1 time: 0.525939 Oct 17 13:17:20.952216 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2855/5503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:20 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1563 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:20.974266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6a3cf18d-2e42-4b04-972c-abb31171fc47 req-2a5c73cc-7157-47e5-8791-1f93399d7fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a73c36f-0f0a-454b-8a98-de7cdca642cb", "tag": "601c5043-9cee-42c7-8136-f10fb526fa82"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:20.997998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a3cf18d-2e42-4b04-972c-abb31171fc47 req-2a5c73cc-7157-47e5-8791-1f93399d7fae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:20.998444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a3cf18d-2e42-4b04-972c-abb31171fc47 req-2a5c73cc-7157-47e5-8791-1f93399d7fae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:20.998893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a3cf18d-2e42-4b04-972c-abb31171fc47 req-2a5c73cc-7157-47e5-8791-1f93399d7fae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.046541 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6a3cf18d-2e42-4b04-972c-abb31171fc47 req-2a5c73cc-7157-47e5-8791-1f93399d7fae service nova] Creating event network-changed:601c5043-9cee-42c7-8136-f10fb526fa82 for instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb on n-h2-853316-12 Oct 17 13:17:21.056945 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6a3cf18d-2e42-4b04-972c-abb31171fc47 req-2a5c73cc-7157-47e5-8791-1f93399d7fae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103157 Oct 17 13:17:21.057845 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2856/5504] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:21.068353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:21.073083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:21.084241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.085891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.086859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.089965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.091113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.091795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.329305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:21.342472 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f58898fe-da34-432f-9a2d-9b08495e67d1 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1506 microversion: 2.1 time: 0.282511 Oct 17 13:17:21.343819 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2857/5505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:21 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:21.349134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:21.350262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:21.366874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.367591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.368292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.378744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.379254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.379873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.576645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:21.611928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:21.621241 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-74ea25ed-2a23-4aa7-a9b8-60a2553f1900 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1202 microversion: 2.1 time: 0.275923 Oct 17 13:17:21.621831 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2858/5506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:21 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1202 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:21.639842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:21.640483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:21.657066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.657576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.658029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.658790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.659251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.659684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.817795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:21.833657 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82b129ed-fc8a-4aac-a00f-f53adaae416c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 1.822233 Oct 17 13:17:21.835674 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2649/5507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:20 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:21.843462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:21.844814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:21.854501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.854988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.855423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.856489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.856950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.857650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:22.000596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:22.043707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:22.051924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:22.079001 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-98864068-e9df-43e8-a614-ba4d6609b6c4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.442570 Oct 17 13:17:22.080952 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2859/5508] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:21 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:22.372834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:22.373790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:22.388567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:22.389749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:22.390420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:22.391325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:22.406551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:22.408207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:22.632950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:22.646332 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c1d65a0-4987-4fe2-b0d8-f21fd705bd19 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.807947 Oct 17 13:17:22.649394 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2650/5509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:21 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:22.657732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:22.668354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:22.681559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:22.682981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:22.684731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:22.687310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:22.688149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:22.690493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:22.819849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:22.836098 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f20da54e-8ded-4a25-9916-568a89b79636 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1506 microversion: 2.1 time: 0.466703 Oct 17 13:17:22.847136 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2860/5510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:22 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:22.869482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:22.870923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:22.881556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:22.883811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:22.884637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:22.885721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:22.886875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:22.887468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:22.894698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:23.085649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.122718 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dffe6c0c-db44-438a-a44e-bc3ce7338c15 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1202 microversion: 2.1 time: 0.461014 Oct 17 13:17:23.139743 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2651/5511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:22 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1202 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:23.145040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:23.145760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:23.214618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:23.215908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:23.216480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:23.217566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:23.218619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:23.219312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:23.510032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.525981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.527494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.528721 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be947931-da2f-464f-be27-80da1dc39fa2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.387904 Oct 17 13:17:23.542192 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2652/5512] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:23 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:23.542192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-27b0ff7f-507a-42c5-8a9a-b05678fa9bbb req-eaccd26c-be4b-4901-b88f-aca367394a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec4a533-498a-40e2-84e1-931941c16cc1", "name": "network-vif-unplugged", "status": "completed", "tag": "0ca362e1-43ba-45d3-b6eb-1eff56c67772"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:23.569597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-27b0ff7f-507a-42c5-8a9a-b05678fa9bbb req-eaccd26c-be4b-4901-b88f-aca367394a32 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:23.570444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-27b0ff7f-507a-42c5-8a9a-b05678fa9bbb req-eaccd26c-be4b-4901-b88f-aca367394a32 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:23.571288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-27b0ff7f-507a-42c5-8a9a-b05678fa9bbb req-eaccd26c-be4b-4901-b88f-aca367394a32 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:23.606001 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-27b0ff7f-507a-42c5-8a9a-b05678fa9bbb req-eaccd26c-be4b-4901-b88f-aca367394a32 service nova] Creating event network-vif-unplugged:0ca362e1-43ba-45d3-b6eb-1eff56c67772 for instance 1ec4a533-498a-40e2-84e1-931941c16cc1 on n-h1-853316-12 Oct 17 13:17:23.613657 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-27b0ff7f-507a-42c5-8a9a-b05678fa9bbb req-eaccd26c-be4b-4901-b88f-aca367394a32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079533 Oct 17 13:17:23.622944 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2653/5513] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:23.693438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:23.695425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:23.711551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:23.712747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:23.714271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:23.715161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:23.720023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:23.720659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:23.756792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.767813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f672f5ca-1e03-46c6-ab8d-95b688f32902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.907967 Oct 17 13:17:23.769200 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2861/5514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:22 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:23.863430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:23.864299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:23.871689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:23.879058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:23.879770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:23.880680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:23.881419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:23.883021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.028448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:24.044265 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5fc0da33-f36a-4f7e-b5e9-5b3637412ed1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.357080 Oct 17 13:17:24.044866 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2654/5515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:23 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:24.167080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:24.172301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.174990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:24.202140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.206789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.207586 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5ac3d37b-e2b9-428c-a689-0c125e1e13dd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1506 microversion: 2.1 time: 0.347981 Oct 17 13:17:24.207787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.210984 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2862/5516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:23 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:24.214386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.218432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.219352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.557652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.558401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:24.564379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:24.575724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b66e3f20-c7c9-4d6b-8a4b-f4bdb62baef5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1202 microversion: 2.1 time: 0.420318 Oct 17 13:17:24.598036 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2655/5517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1202 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:24.603331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:24.610674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.611562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.612599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.613631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.616806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.618097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.798671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.799538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:24.818617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.828128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.828611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.829368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.829859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.830295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.832412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:24.844561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:24.846040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:24.847372 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f907895d-e8e4-4cbc-9f65-cf6c9cd0c3e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.294283 Oct 17 13:17:24.866378 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2863/5518] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:25.070856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:25.071853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:25.085977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.086848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.087592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.089226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.089905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.090636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.267240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:25.279130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eda91296-b07e-4fff-aa3a-910a16d3f546 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.214339 Oct 17 13:17:25.280719 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2864/5519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:25 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:25.301810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:25.302977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:25.313548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.314538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.315191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.316339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.317230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.317888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.398622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:25.407410 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-524e8d07-1b79-4ae1-839e-fe758bbf2061 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.616542 Oct 17 13:17:25.434731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2656/5520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:25.537162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:25.547734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ae49c78-a614-4eab-9c71-cecfa580d7f6 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1506 microversion: 2.1 time: 0.264808 Oct 17 13:17:25.549963 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2865/5521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:25 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:25.611394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:25.612009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:25.621213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.621908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.622733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.623617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.624226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.629485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1e161016-d5d7-4662-9da0-69e721fbf61a req-bcd16d7c-1383-4b93-92bf-6bb4175503ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df401d-cb46-4487-afaa-946d42535d9e", "name": "network-vif-plugged", "status": "completed", "tag": "1111e5ee-9213-4fb3-8b6a-a8fadf5950ff"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:25.637511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.647685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1e161016-d5d7-4662-9da0-69e721fbf61a req-bcd16d7c-1383-4b93-92bf-6bb4175503ba service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.651113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1e161016-d5d7-4662-9da0-69e721fbf61a req-bcd16d7c-1383-4b93-92bf-6bb4175503ba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.651836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1e161016-d5d7-4662-9da0-69e721fbf61a req-bcd16d7c-1383-4b93-92bf-6bb4175503ba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.694808 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1e161016-d5d7-4662-9da0-69e721fbf61a req-bcd16d7c-1383-4b93-92bf-6bb4175503ba service nova] Creating event network-vif-plugged:1111e5ee-9213-4fb3-8b6a-a8fadf5950ff for instance 16df401d-cb46-4487-afaa-946d42535d9e on n-h2-853316-12 Oct 17 13:17:25.707581 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1e161016-d5d7-4662-9da0-69e721fbf61a req-bcd16d7c-1383-4b93-92bf-6bb4175503ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079523 Oct 17 13:17:25.708858 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2866/5522] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:25.879888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:25.881461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:25.900502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.901730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.902804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.914832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.915588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.916640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:26.114702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:26.127045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:26.128897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:26.130394 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e26c11c-bf89-4976-8036-487e9ef1d145 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.257882 Oct 17 13:17:26.146197 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2867/5523] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:25 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:26.305480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.305898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:26.314136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:26.314690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:26.315129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:26.315845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:26.316303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:26.316754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:26.547929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:26.561444 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-01a696c1-0d04-4086-9e68-1ce2e2668555 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1202 microversion: 2.1 time: 0.953900 Oct 17 13:17:26.561986 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2657/5524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:25 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1202 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.565526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:26.580099 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85af9160-49d9-49b0-9f25-753734862abc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.279368 Oct 17 13:17:26.581402 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2868/5525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:26.587656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.589131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:26.596523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:26.597638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:26.599373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:26.600399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:26.601310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:26.601687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.602273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:26.602386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:26.610911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:26.611804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:26.612462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:26.613439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:26.614110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:26.614779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:26.911940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:26.930690 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9372bb51-90a6-4457-93d1-689deaa7a0fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1506 microversion: 2.1 time: 0.347120 Oct 17 13:17:26.942509 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2869/5526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.989763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:27.000872 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e57ced3d-e9ef-4757-b1e6-4a676a6cb4b8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.425907 Oct 17 13:17:27.008221 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2658/5527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:27.157177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:27.157849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:27.165601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.166600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.167983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:27.168661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.169125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.169555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:27.432163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:27.459223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:27.461844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:27.463093 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-616acc04-b93b-4ce9-bbc5-7dbdac9932f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.310135 Oct 17 13:17:27.463991 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2870/5528] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:27 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:27.606464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:27.607286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:27.609172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:27.610040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:27.624224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.624777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.625001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.625519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.626691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:27.627089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:27.628655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.629137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.630436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.630905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.632107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:27.632819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:27.877171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:27.889137 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fc1e484e-75a6-4c7b-a198-f7663e749673 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1202 microversion: 2.1 time: 0.293440 Oct 17 13:17:27.905237 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2659/5529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:27 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1202 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:27.908396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:27.918525 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-325a11dd-34f0-4af7-beeb-44ecab93a9be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.316530 Oct 17 13:17:27.920852 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2871/5530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:27 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:27.977759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:27.978715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:27.986135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.986797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.998859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.002310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.003505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.004874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.034079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:28.035657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:28.073773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.074590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.080893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.083879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.091013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.091809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.361668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.371335 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f22016c-b8d8-4754-96d1-3e746a3875a9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1506 microversion: 2.1 time: 0.402516 Oct 17 13:17:28.374221 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2660/5531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:27 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:28.416554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.426527 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bcccacf8-65f6-4618-818a-3f8dc72ffddb tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.399561 Oct 17 13:17:28.442388 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2872/5532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:28 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:28.495836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:28.496972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:28.508528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.511947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.512705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.514439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.516521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.523114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.809114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.818513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:28.823178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.824660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.825885 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89b25d23-4651-46c0-ac99-320f575a2e88 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.336690 Oct 17 13:17:28.826503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2661/5533] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:28 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:28.918601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:28.920131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:28.932883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.933887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.935344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.936292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.937457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.938557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.955363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:28.956470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:28.980925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.983780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.983780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.983780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.986011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.986011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:29.339781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:29.362729 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca2dfdbb-7ac7-4425-a1c8-fcccff891c40 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1388 microversion: 2.1 time: 0.453452 Oct 17 13:17:29.401342 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2873/5534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:28 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1388 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:29.412083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e9512cf2-1bed-41ac-a820-94b92adde239 req-b10f7963-c9b8-458b-a815-186430ebdd96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c84769-498d-4e0b-9cdd-f9569b58f1f8", "name": "network-vif-plugged", "status": "completed", "tag": "e1736ccb-979b-4c83-b032-f7f4926f64b5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:29.436221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e9512cf2-1bed-41ac-a820-94b92adde239 req-b10f7963-c9b8-458b-a815-186430ebdd96 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.437440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e9512cf2-1bed-41ac-a820-94b92adde239 req-b10f7963-c9b8-458b-a815-186430ebdd96 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.438147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e9512cf2-1bed-41ac-a820-94b92adde239 req-b10f7963-c9b8-458b-a815-186430ebdd96 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:29.484987 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e9512cf2-1bed-41ac-a820-94b92adde239 req-b10f7963-c9b8-458b-a815-186430ebdd96 service nova] Creating event network-vif-plugged:e1736ccb-979b-4c83-b032-f7f4926f64b5 for instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 on n-h1-853316-12 Oct 17 13:17:29.510587 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e9512cf2-1bed-41ac-a820-94b92adde239 req-b10f7963-c9b8-458b-a815-186430ebdd96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105797 Oct 17 13:17:29.520837 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2874/5535] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:29.529165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:29.530244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:29.559463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.561085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.562853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:29.563817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.564912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.567289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:29.777108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:29.792803 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9bcc02a-c337-4a15-8a0c-0294ec4b22b4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.843576 Oct 17 13:17:29.816517 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2662/5536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:28 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:29.846081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:29.853235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:29.903463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.906937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.907694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:29.908731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.930827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.932205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.024700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:30.036887 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-475a6de7-2dd1-48df-b5ae-b254c1045cca tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 200 len: 1509 microversion: 2.1 time: 0.513643 Oct 17 13:17:30.037532 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2875/5537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:29 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 1509 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:30.046448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:30.047428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:30.056831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.060415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.062547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.064381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.065280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.066126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.332523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:30.345428 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0f104f74-997e-405c-a76b-de6581b6adf9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.303658 Oct 17 13:17:30.346021 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2876/5538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:30 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:30.354355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:30.355246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:30.368998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.372764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.373429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.383850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:30.389786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.390956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.392709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.399733 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4c40923-4992-493b-b4b0-47a4a8116b7b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1388 microversion: 2.1 time: 0.581244 Oct 17 13:17:30.426945 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2663/5539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:29 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1388 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:30.443850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:30.446633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:30.455063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.455564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.456008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.471507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.472046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.472496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.011590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.031714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.049685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.051538 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-48501bf2-ca5e-4949-bbdb-f0d6442dc641 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.704127 Oct 17 13:17:31.052300 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2877/5540] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:30 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:31.060501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.083782 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b3cd41d9-4e46-4139-a260-5f868a43cb60 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.659461 Oct 17 13:17:31.086544 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2664/5541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:30 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:31.089127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:31.096055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:31.111239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:31.113440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:31.129697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.135101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.137140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.141794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.144843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.145733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.169782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.171096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.173867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.176259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.181363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.185878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.548617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.567588 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c5027a1-ee4a-4399-9f52-e344d23092d7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1314 microversion: 2.1 time: 0.475378 Oct 17 13:17:31.571022 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2665/5542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:31 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:31.581081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:31.582627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:31.599124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.601080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.601855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.603191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.604085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.605053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.690149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.702082 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be87cd78-e847-4703-80ab-f4ee364cb60d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1388 microversion: 2.1 time: 0.646423 Oct 17 13:17:31.703854 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2878/5543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:31 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1388 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:31.719613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:31.721116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:31.734739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.737367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.739108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.741764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.744247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.745155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.753152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:31.911448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.928829 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db3654e9-9888-47ad-9794-76820351d189 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.352885 Oct 17 13:17:31.929720 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2666/5544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:31 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:31.946917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:31.948087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:31.957740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.958976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.960704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.961660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.962997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.963921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.048707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:17:32.052291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:32.077695 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9d1b0f4c-e7fb-4bc9-8ddd-1881d4013841 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.372523 Oct 17 13:17:32.094305 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2879/5545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:31 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:32.100502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:32.121591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:32.155424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.155841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.156292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.157029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.157500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.158139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.285872 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-934929f5-6e1d-4414-bc22-b47d4b64855b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 204 len: 0 microversion: 2.1 time: 0.340915 Oct 17 13:17:32.286880 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2667/5546] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:17:31 2022] DELETE /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:32.296237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:32.298717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:32.318446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.321127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.323937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.325103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.328887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.329705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.396947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:32.410394 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a609cf7e-9b81-4a00-8689-49a1834368b3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.314341 Oct 17 13:17:32.414561 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2880/5547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:32 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:32.422456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:32.423796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:32.431103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.431844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.432429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.433893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.434563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.435158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.671270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:32.685335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8500bd04-6f33-4ff9-9ca6-e14a8cd5947c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1394 microversion: 2.1 time: 0.269300 Oct 17 13:17:32.687297 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2881/5548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:32 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1394 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:32.693793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:32.695321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:32.703912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.710796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.711519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.713054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.713736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.714348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.870657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:32.889699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:32.897935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:32.899717 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-50d71dfb-c653-4d5a-b067-63d3c32799ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.610602 Oct 17 13:17:32.900835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2668/5549] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:32 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:32.911831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:32.912746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:32.940372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.944833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.945442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.946469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.947025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.947561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.213137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:33.232095 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-edb1f29c-4d12-4d8c-a52e-08ee687a31fe tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.542818 Oct 17 13:17:33.233277 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2882/5550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:32 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:33.248509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:33.250443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:33.253585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:33.265394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.266130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.282337 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad90521d-6f5e-4b78-9787-607ed05c61f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1501 microversion: 2.1 time: 0.378532 Oct 17 13:17:33.282957 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2669/5551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:32 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:33.286425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.289555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.292941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.294715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.296017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-919a084d-b190-4fe9-8819-4fdd30c99d82 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:33.314070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-919a084d-b190-4fe9-8819-4fdd30c99d82 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.314605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-919a084d-b190-4fe9-8819-4fdd30c99d82 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.322914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-919a084d-b190-4fe9-8819-4fdd30c99d82 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.391044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-919a084d-b190-4fe9-8819-4fdd30c99d82 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:17:33.488271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-919a084d-b190-4fe9-8819-4fdd30c99d82 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.204028 Oct 17 13:17:33.489061 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2670/5552] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:33 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:33.506927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:33.507888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:33.522472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.523033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.523482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.524228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.524684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.529188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.548411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:33.570307 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-734c57a3-c81c-4670-a0be-8b2bb79d447a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1527 microversion: 2.1 time: 0.326627 Oct 17 13:17:33.570307 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2883/5553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:33 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1527 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:33.578065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:33.578065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:33.588881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.590259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.592524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.593473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.594541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'flavor' on Instance uuid 71c84769-498d-4e0b-9cdd-f9569b58f1f8 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:33.595236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.595836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.961650 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-950378eb-c3bb-43ac-b6e8-5e8fa8b50df4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8/action" status: 202 len: 0 microversion: 2.1 time: 0.471055 Oct 17 13:17:33.968537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:33.982625 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6500c48-1270-4908-9189-d57e070c4b81 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.411521 Oct 17 13:17:33.982988 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2671/5554] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:33 2022] POST /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:33.988567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:33.989278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:33.995593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2884/5555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:33 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:33.997325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.998075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.998707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.999772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.000499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.001186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.008992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:34.009914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:34.017597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.018371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.018985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.020001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.020623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.021347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.394843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:34.412145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:34.419885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:34.422422 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-074730f9-a1ba-43a9-b97e-60bc59b4bc6c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.424488 Oct 17 13:17:34.424758 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2885/5556] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:33 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:34.455183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:34.456095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:34.466086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.466852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.467919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.469063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.469668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.470278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.594034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:34.607237 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1acd3da8-978b-40ac-8303-b8eef56ee0d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1394 microversion: 2.1 time: 0.622602 Oct 17 13:17:34.644547 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2672/5557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:33 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1394 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:34.655046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:34.656053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:34.673359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.674450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.675194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.676523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.677207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.677799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.939407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:34.950617 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd90ff3a-8475-46ba-a181-81c7cc67da27 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.510384 Oct 17 13:17:34.953978 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2886/5558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:34 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:35.011176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:35.012770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:35.019685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:35.028518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:35.029326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:35.030828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:35.031912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:35.039016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:35.268222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:35.285594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:35.292789 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb55630b-3c42-4645-8363-07843668376c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1509 microversion: 2.1 time: 0.644329 Oct 17 13:17:35.293995 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2673/5559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:34 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1509 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:35.370721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:35.388924 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab5bc00e-fb37-4987-933b-3f1e1d3c0119 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.381888 Oct 17 13:17:35.390605 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2887/5560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:35 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:35.432721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2f4427d1-569c-4dbd-b62f-f0ae8dddce8f req-8c7cff8e-1003-4764-9833-4bcc4ef069d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16df401d-cb46-4487-afaa-946d42535d9e", "name": "network-vif-deleted", "tag": "1111e5ee-9213-4fb3-8b6a-a8fadf5950ff"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:35.449720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2f4427d1-569c-4dbd-b62f-f0ae8dddce8f req-8c7cff8e-1003-4764-9833-4bcc4ef069d1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:35.453374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2f4427d1-569c-4dbd-b62f-f0ae8dddce8f req-8c7cff8e-1003-4764-9833-4bcc4ef069d1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:35.453374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2f4427d1-569c-4dbd-b62f-f0ae8dddce8f req-8c7cff8e-1003-4764-9833-4bcc4ef069d1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:35.461299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:35.469691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:35.491954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:35.494178 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2f4427d1-569c-4dbd-b62f-f0ae8dddce8f req-8c7cff8e-1003-4764-9833-4bcc4ef069d1 service nova] Creating event network-vif-deleted:1111e5ee-9213-4fb3-8b6a-a8fadf5950ff for instance 16df401d-cb46-4487-afaa-946d42535d9e on n-h2-853316-12 Oct 17 13:17:35.500485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:35.504181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:35.507382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:35.507982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:35.508669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:35.520784 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2f4427d1-569c-4dbd-b62f-f0ae8dddce8f req-8c7cff8e-1003-4764-9833-4bcc4ef069d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094575 Oct 17 13:17:35.528599 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2674/5561] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:35.660581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:35.663500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:35.697545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:35.698087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:35.698571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:35.699304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:35.699765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:35.702738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:35.792119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:35.818255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:35.820251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:35.831985 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0af0f5b1-193e-4184-9423-ddd02829b143 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.376120 Oct 17 13:17:35.834983 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2888/5562] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:35 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:35.948100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:35.963237 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-27db2050-8812-4116-b929-803c1d4506fe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1187 microversion: 2.1 time: 0.309568 Oct 17 13:17:35.973429 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2675/5563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:35 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1187 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:35.988440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:35.989596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:35.999064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.000086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.000872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.001930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.003102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.003807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.299567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:36.321639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:36.322735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:36.328111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9be31998-0833-467d-a573-97a0f211e618 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.331794 Oct 17 13:17:36.331025 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2889/5564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:35 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:36.335143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.336021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.336882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.337846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.338741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.339400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.434235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:36.434235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:36.458183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.460459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.461301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.463664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.464856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.465544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.729672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:36.742531 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-86909240-d30b-449c-a554-c86ed52ff967 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1509 microversion: 2.1 time: 0.426655 Oct 17 13:17:36.770488 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2676/5565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:36 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:36.836695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:36.856780 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d854711-15bd-4875-a678-95568291e2b9 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.433896 Oct 17 13:17:36.874716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:36.874716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:36.875108 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2890/5566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:36 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:36.879755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.880699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.892845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.899518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.900062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.900529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.996537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:36.997075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:37.027010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:37.027446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:37.027975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:37.028619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:37.029075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:37.029499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:37.171017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:37.181582 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e5b1d8d1-2250-4b77-b2f4-e47b0795d0a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1187 microversion: 2.1 time: 0.196583 Oct 17 13:17:37.182545 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2891/5567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:36 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1187 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:37.257746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:37.271675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:37.274202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:37.275463 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b25fd2a7-5491-462c-a898-ba41aca8e86b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.415474 Oct 17 13:17:37.278709 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2677/5568] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:36 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:37.355228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:37.355848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:37.373124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:37.374097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:37.374097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:37.374793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:37.375229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:37.375651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:37.640822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:37.652797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c6f2730-d013-457c-af3c-b769109c5f76 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.300432 Oct 17 13:17:37.654092 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2892/5569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:37 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:37.791686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:37.793585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:37.832103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:37.833134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:37.833755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:37.835102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:37.835828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:37.836298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:37.884966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:37.885849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:37.908777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:37.910413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:37.911245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:37.925172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:37.941486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:37.942346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.337700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:38.352831 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf4d0336-a80c-40fd-99fc-712f3d421307 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1509 microversion: 2.1 time: 0.567810 Oct 17 13:17:38.354939 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2678/5570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:37 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1509 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:38.371791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:38.374587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:38.390910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.393489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.394073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.394423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:38.396008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.398406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.400712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.409084 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3cd01d5-a316-4000-97bc-8e5638576f2c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.529221 Oct 17 13:17:38.410776 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2893/5571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:37 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:38.417207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:38.418516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:38.430634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.431654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.432110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.432942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.433447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.433884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.572325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:38.589746 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c174b24e-6640-4d73-b627-5f2877b728ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1187 microversion: 2.1 time: 0.228843 Oct 17 13:17:38.591816 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2679/5572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:38 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1187 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:38.639836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-0677b8c5-9ba9-4e09-b5a4-695b0fbeb5e9 req-9544e426-e7b1-4c99-95a1-8401bd4816a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8edfd5-201d-4c59-b87c-b9b987ac6996", "name": "network-vif-unplugged", "status": "completed", "tag": "d5781fa1-d3fb-4668-acdd-398634e6693e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:38.665034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0677b8c5-9ba9-4e09-b5a4-695b0fbeb5e9 req-9544e426-e7b1-4c99-95a1-8401bd4816a0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.665915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0677b8c5-9ba9-4e09-b5a4-695b0fbeb5e9 req-9544e426-e7b1-4c99-95a1-8401bd4816a0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.668037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0677b8c5-9ba9-4e09-b5a4-695b0fbeb5e9 req-9544e426-e7b1-4c99-95a1-8401bd4816a0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.702571 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-0677b8c5-9ba9-4e09-b5a4-695b0fbeb5e9 req-9544e426-e7b1-4c99-95a1-8401bd4816a0 service nova] Creating event network-vif-unplugged:d5781fa1-d3fb-4668-acdd-398634e6693e for instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 on n-h2-853316-12 Oct 17 13:17:38.721729 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-0677b8c5-9ba9-4e09-b5a4-695b0fbeb5e9 req-9544e426-e7b1-4c99-95a1-8401bd4816a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081115 Oct 17 13:17:38.722797 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2680/5573] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:17:38.751344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:38.753675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:38.768412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.770841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.771363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.773993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.775892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.776393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:38.777755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.791101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:38.793268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:38.794935 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6ff499c-1966-481c-b53b-9550d6c7fb53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.383161 Oct 17 13:17:38.806515 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2894/5574] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:38 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:39.246508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:39.258636 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd85fa1d-5402-417b-9ca9-bdb66ed4af64 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.521879 Oct 17 13:17:39.259920 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2681/5575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:38 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:39.385679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:39.386777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:39.401332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.402349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.403119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.404023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.404797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.405398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.443687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:39.444341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:39.473626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.474590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.479228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.480448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.481089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.481540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.757580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:39.767729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:39.771975 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68b96fe5-a7fc-4e64-9656-dcdde99a94cc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1452 microversion: 2.1 time: 0.391175 Oct 17 13:17:39.774067 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2895/5576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:39 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1452 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:39.780925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:39.782330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:39.797885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.798862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.799569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.805361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.808878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.810403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.862708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:39.885720 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f06f5856-310d-4c42-a8f9-ebd0f6ca5e27 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.452024 Oct 17 13:17:39.890988 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2682/5577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:39 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:39.898728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:39.905840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:39.918518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.919808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.920995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.922667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.923971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.924997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.959889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:39.971565 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc595222-96a7-4864-8d03-11947e88f2c5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1187 microversion: 2.1 time: 0.195621 Oct 17 13:17:39.972913 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2896/5578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:39 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1187 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:39.982047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:39.987820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:39.999063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.999574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.000011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.000716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.009450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.010300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.130138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:40.142004 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-576579d5-2f6d-4a3d-936f-022bf23f2930 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1452 microversion: 2.1 time: 0.249361 Oct 17 13:17:40.143157 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2683/5579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:39 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1452 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:40.154435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:40.160657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:40.177493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.182440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.182440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.182734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.183405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.183862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.267581 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de291216-6d0e-48b3-85d9-3d5896689b80 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb/action" status: 200 len: 24559 microversion: 2.1 time: 0.122607 Oct 17 13:17:40.268266 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2684/5580] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:40 2022] POST /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb/action => generated 24559 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:17:40.278900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:40.278900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:40.283422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.285168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.285168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.285168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.285576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.286108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.316512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lazy-loading 'flavor' on Instance uuid 5e8edfd5-201d-4c59-b87c-b9b987ac6996 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:40.331955 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Cannot 'shelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state shelved_offloaded Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action HTTP/1.1 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 14 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: {"shelve": {}} Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'shelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state shelved_offloaded Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'shelve': {}}} Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:17:40.333746 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state shelved_offloaded Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state shelved_offloaded Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 409 to user: Cannot 'shelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state shelved_offloaded {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b931ed2d-4f1b-493f-bb87-44abc715fe3a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 409 len: 155 microversion: 2.1 time: 0.067384 Oct 17 13:17:40.339461 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2685/5581] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:40 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 155 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:17:40.346482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:40.346482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:40.354285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:40.354720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.355220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.355860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.356789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.357247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.357675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.368773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:40.370516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:40.372147 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d5228ac9-ca06-40b2-a82b-833ae78c4179 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.397982 Oct 17 13:17:40.372607 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2897/5582] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:39 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:40.378453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:40.379240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:40.388078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.388912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.389609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.390522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.391131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.391770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.469411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127540) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:17:40.563947 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2ff70e97-0e3a-4bb2-a61b-6b5458b84d7e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 202 len: 0 microversion: 2.1 time: 0.189658 Oct 17 13:17:40.564573 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2898/5583] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:40 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:40.583573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:40.586895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:40.594977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.595490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.595934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.596677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.597137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.597843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.620505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:40.635009 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ec997ea1-cc15-442b-a721-4026bd7fae99 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.293374 Oct 17 13:17:40.635598 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2686/5584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:40 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:40.847438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:40.857201 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9cd7514b-1f27-4bb8-8132-d872637b4b7c tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1460 microversion: 2.1 time: 0.278400 Oct 17 13:17:40.873929 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2899/5585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:40 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1460 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:40.918209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:40.918209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:40.926761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.927253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.927764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.929885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:40.931039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:40.931543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:40.997344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:40.998093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:41.005321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.008595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.009796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:41.011469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.012015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.012706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:41.152171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:41.173292 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d8d867c-b6a1-4e66-807d-5852fa0595d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1187 microversion: 2.1 time: 0.179714 Oct 17 13:17:41.194693 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2900/5586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:40 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1187 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:41.218914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:41.229602 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad69c21b-964f-4717-9216-7011378217b0 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.317520 Oct 17 13:17:41.243146 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2687/5587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:40 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:41.417047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:41.417944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:41.427382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.428403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.429161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:41.430306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.431203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.431787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:41.635664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:41.652313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:41.653930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:41.658577 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b2d080d6-6c06-4a4c-8408-e8d32c8e51dd tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.251294 Oct 17 13:17:41.661107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:41.662637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:41.667498 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2901/5588] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:41 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:41.670785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.671498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.672155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:41.673103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.673722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.674343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:41.882146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:41.884937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:41.886141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:41.892376 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ae6bcca2-2c5b-45c1-af37-87b8cf702e4b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.237636 Oct 17 13:17:41.893178 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2688/5589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:41 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:41.904181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.904600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.905038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:41.905745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.906227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.906655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.083661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:42.098962 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18222277-eaae-4903-8301-cc41a8b1d95b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1460 microversion: 2.1 time: 0.219481 Oct 17 13:17:42.101559 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2902/5590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:41 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1460 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:42.199741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:42.200643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:42.227974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.228551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.229000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.242017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.242570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.243005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.255061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:42.258304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:42.275119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.278537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.279755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.281118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.283574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.284513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.370237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:42.380191 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b819f56-8ac9-421b-9194-b6527013303c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1187 microversion: 2.1 time: 0.186960 Oct 17 13:17:42.387017 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2689/5591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:42 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1187 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:42.516361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:42.526683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3105654-cf39-4a1c-bda1-d2345eaaded3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.275934 Oct 17 13:17:42.553531 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2903/5592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:42 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:42.690594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:42.691214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:42.699637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.700132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.700575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.701291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.701983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.702492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.920273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:42.920902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:42.929151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:42.938316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.938949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.939665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.941927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:42.943524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:42.945410 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2b8dcbfe-af2a-42f3-8e74-2f60cbe6375d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.258457 Oct 17 13:17:42.947144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.947766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.948215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.955580 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2690/5593] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:42 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:43.125351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:43.126327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:43.134627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.135700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.136350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.137322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.137973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.138609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.162525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:43.177269 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d115c0ad-00e2-48e2-960e-89e4a2e8d9fc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.260718 Oct 17 13:17:43.178907 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2904/5594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:42 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:43.321174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:43.335863 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da7ceb28-f8f6-4660-a924-59e7100cc495 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1460 microversion: 2.1 time: 0.214612 Oct 17 13:17:43.336624 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2691/5595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:43 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1460 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:43.419345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:43.419959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:43.429281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.430152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.431030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.431987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.432921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.433719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.473610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.473968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.474451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.475538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lazy-loading 'fault' on Instance uuid 16df401d-cb46-4487-afaa-946d42535d9e {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:43.525407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:43.533917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ccf8de1-d187-46ad-b245-9f0ae0981145 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 200 len: 1192 microversion: 2.1 time: 0.118556 Oct 17 13:17:43.534540 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2905/5596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:43 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 1192 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:43.564047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:43.564894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:43.572787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.573458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.574057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.574970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.575420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.576018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.581071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:43.753455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:43.765147 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0079d5f-a413-46e9-8b1e-2b4580310900 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1676 microversion: 2.1 time: 0.205735 Oct 17 13:17:43.774676 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2692/5597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:43 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:43.973302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:43.974059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:43.986268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.986872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.987386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.988175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.988723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.989240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.179085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:44.193173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:44.194823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:44.196214 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11302c6a-3006-4aab-a035-fcaa34b1a51d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.226985 Oct 17 13:17:44.196881 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2906/5598] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:43 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:44.215645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:44.216391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:44.222922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:44.223415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:44.223885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.224591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:44.225932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:44.226586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.364740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:44.365450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:44.373602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:44.374098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:44.374565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.375280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:44.375738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:44.376164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.379793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:44.388290 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-33c8c072-a77f-4e57-8558-b5bf69a79c22 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.180079 Oct 17 13:17:44.388843 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2693/5599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:44 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:44.544300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:44.552698 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6549bdae-435c-4aed-877b-264219da0296 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1462 microversion: 2.1 time: 0.195550 Oct 17 13:17:44.554501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2907/5600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:44 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1462 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:44.570496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:44.571387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 16df401d-cb46-4487-afaa-946d42535d9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:44.574422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:44.578246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:44.579207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:44.579953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.580959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:44.581505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:44.581998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.600671 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 16df401d-cb46-4487-afaa-946d42535d9e could not be found. Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e HTTP/1.1 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 16df401d-cb46-4487-afaa-946d42535d9e could not be found. Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '16df401d-cb46-4487-afaa-946d42535d9e'} Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16df401d-cb46-4487-afaa-946d42535d9e could not be found. Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16df401d-cb46-4487-afaa-946d42535d9e could not be found. Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:44.603437 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16df401d-cb46-4487-afaa-946d42535d9e could not be found. Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 16df401d-cb46-4487-afaa-946d42535d9e could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c99abe4e-c88e-4669-8ede-de00f3452cfe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e" status: 404 len: 111 microversion: 2.1 time: 0.039307 Oct 17 13:17:44.610508 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2694/5601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:44 2022] GET /compute/v2.1/servers/16df401d-cb46-4487-afaa-946d42535d9e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:17:44.790313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:44.790939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:44.797282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:44.797711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:44.798179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.798902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:44.799359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:44.799791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.980190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:44.993659 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-298f1d71-0a6b-4bdc-807e-0982a289685c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1653 microversion: 2.1 time: 0.208270 Oct 17 13:17:44.994428 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2908/5602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:44 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1653 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:45.019389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0eb204bd-9725-4765-8a42-73318b92063d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:45.028319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb204bd-9725-4765-8a42-73318b92063d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.028913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb204bd-9725-4765-8a42-73318b92063d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.029430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0eb204bd-9725-4765-8a42-73318b92063d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.059554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0eb204bd-9725-4765-8a42-73318b92063d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Going to try to start instance {{(pid=127539) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:17:45.108837 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0eb204bd-9725-4765-8a42-73318b92063d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.093199 Oct 17 13:17:45.109837 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2695/5603] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:45 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:45.118476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:45.119114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:45.122324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:45.126799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.127525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.127973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.128689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.129143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.129571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.224553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:45.225825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:45.234944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.236431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.237262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.238400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.239069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.239833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.305941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:45.315311 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8a614cd-f00a-4755-baae-ef70945962d4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1662 microversion: 2.1 time: 0.201495 Oct 17 13:17:45.327258 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2909/5604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:45 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1662 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:45.398424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:45.408218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:45.409677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:45.410943 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-227fcb1d-5ca1-4007-acaf-afd610870d3b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.191249 Oct 17 13:17:45.411537 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2696/5605] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:45 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:45.412318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:45.413344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:45.419669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.420289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.420759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.421476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.422125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.422637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.580891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:45.581544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:45.590534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.591309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.591923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.592855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.593502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.594130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.604143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:45.618369 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-575d1ce4-49de-4511-8b56-9a9bfb9baa39 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.210477 Oct 17 13:17:45.619728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2910/5606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:45 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:45.810012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:45.827477 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68dfbed9-ec17-4e0e-b364-5c04473e6ba9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1462 microversion: 2.1 time: 0.251633 Oct 17 13:17:45.829108 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2697/5607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:45 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1462 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:46.341364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:46.342036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:46.349071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:46.351150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:46.351474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:46.351947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:46.352404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:46.352832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:46.358846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:46.437361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:46.438244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:46.456536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:46.457192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:46.457822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:46.458722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:46.459351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:46.459904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:46.556087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:46.566384 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e47c8362-8659-44c4-9a7b-d3c31d36f769 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1662 microversion: 2.1 time: 0.228277 Oct 17 13:17:46.569498 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2911/5608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:46 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1662 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:46.644233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:46.644910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:46.652997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:46.653657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:46.654478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:46.655449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:46.655973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:46.656669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:46.839986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:46.854617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:46.867688 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9aa819bb-0f7a-4029-96a1-08218ec5b87c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.225665 Oct 17 13:17:46.869215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:46.873034 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2912/5609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:46 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:46.880140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:46.880678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:46.883690 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f8503b7-ab12-4556-9e73-0e13c29b0c01 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.450365 Oct 17 13:17:46.885884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2698/5610] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:46 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:46.888406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:46.909995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:46.911069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:46.911757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:46.913634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:46.914296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:46.915073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:47.137172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:47.169036 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c17f4dc-f261-497c-9d1e-4814137094ae tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.289907 Oct 17 13:17:47.170475 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2913/5611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:46 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:47.593251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:47.593855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:47.602216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:47.602725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:47.603174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:47.603904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:47.611945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:47.612822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:47.904045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:47.904988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:47.913008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:47.913511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:47.913951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:47.914724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:47.915492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:47.916083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:48.156961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:48.172196 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1f6bdc6-2499-48d0-9489-7ab9d9279704 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.272084 Oct 17 13:17:48.173561 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2914/5612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:47 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:48.181511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:48.182127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:48.190951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:48.192358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:48.193080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:48.196777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:48.198476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:48.199247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:48.374528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:48.395414 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-30fc4441-78e9-4e0d-a4ff-f5d4c5213bdd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1662 microversion: 2.1 time: 0.805643 Oct 17 13:17:48.410524 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2699/5613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:47 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1662 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:48.429190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:48.430412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:48.441837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:48.442667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:48.443206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:48.443745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:48.444839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:48.445138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:48.452185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:48.465597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:48.468778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:48.470623 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c60e2c5b-d566-4615-a8db-468a2c3e4118 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.295616 Oct 17 13:17:48.472755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2915/5614] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:48 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:48.780338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:48.791542 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9c22757e-d620-466d-a7af-7b638e766ad5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.372384 Oct 17 13:17:48.792845 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2700/5615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:48 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:48.961813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b82553f5-1902-4aba-a7e5-42b2347cf650 req-e3b2ecd0-b90c-48c0-a822-0c533867bd30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e8edfd5-201d-4c59-b87c-b9b987ac6996", "tag": "d5781fa1-d3fb-4668-acdd-398634e6693e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:48.972787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b82553f5-1902-4aba-a7e5-42b2347cf650 req-e3b2ecd0-b90c-48c0-a822-0c533867bd30 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:48.973675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b82553f5-1902-4aba-a7e5-42b2347cf650 req-e3b2ecd0-b90c-48c0-a822-0c533867bd30 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:48.974103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b82553f5-1902-4aba-a7e5-42b2347cf650 req-e3b2ecd0-b90c-48c0-a822-0c533867bd30 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:48.987685 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b82553f5-1902-4aba-a7e5-42b2347cf650 req-e3b2ecd0-b90c-48c0-a822-0c533867bd30 service nova] Creating event network-changed:d5781fa1-d3fb-4668-acdd-398634e6693e for instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 on n-h1-853316-12 Oct 17 13:17:48.994466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b82553f5-1902-4aba-a7e5-42b2347cf650 req-e3b2ecd0-b90c-48c0-a822-0c533867bd30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037294 Oct 17 13:17:48.995808 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2916/5616] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:49.196953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:49.197944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:49.205457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.210677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.211290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.212240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.213742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.215641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.441106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:49.441852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:49.450895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.451389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.451824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.452554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.460061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.475650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.575421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:49.592375 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1f13d071-c4e4-4b6a-9b72-cfd7be4b4efc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.400187 Oct 17 13:17:49.592976 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2701/5617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:49 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:49.613830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:49.614108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:49.626515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.627014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.627528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.628259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.629192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.629643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.908519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:49.919868 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-767eb11f-1221-4822-9c62-9726111df996 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.483122 Oct 17 13:17:49.920963 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2917/5618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:49 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:49.925900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:49.927547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:49.935534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.936310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.936911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.937816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.938474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.939120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.994927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.015657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.020272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.024329 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ef9dbb55-8a81-465f-8766-4bcfee7c58e7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.427674 Oct 17 13:17:50.049527 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2702/5619] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:49 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:50.058617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:50.063082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:50.084649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.085169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.085634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.086392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.086855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.087290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.129100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.156786 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b04af44-7d15-49db-b397-e6142002ddd2 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.234190 Oct 17 13:17:50.159908 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2918/5620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:49 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:50.565614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.579880 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d206f6ec-2eb0-41f5-b0f2-e02e55f04486 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.528256 Oct 17 13:17:50.590608 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2703/5621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:50 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:50.622735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:50.623924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:50.646437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:50.648765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:50.650330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.651685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.654115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.656289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.657967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.659197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.660768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.661532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.662269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.663260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.663955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.664619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.930863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.942992 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-38b1b9a4-7f90-4dd9-ad14-6d9a70a7ec98 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.302598 Oct 17 13:17:50.947725 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2704/5622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:50 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:50.975070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:50.977365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:50.990957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.994525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.996470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.997907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.998368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.998884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.999631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.013962 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-651efa78-d2b9-4880-b73a-16c4b06a8c75 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.397397 Oct 17 13:17:51.016825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2919/5623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:50 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:51.058317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:51.059214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:51.067706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.070559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.071292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.087001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.089446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.090151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.305215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:51.317142 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-247c511b-3ece-4903-8a16-097dd414e0e8 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.347231 Oct 17 13:17:51.318128 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2705/5624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:50 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:51.324689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:51.325709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:51.335068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.336094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.337288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.338613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.339353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.340088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.539418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:51.549235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:51.556997 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90b2ee7a-4f43-4939-a747-0f3e53f32e0d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.236948 Oct 17 13:17:51.557967 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2706/5625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:51 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:51.565936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:51.567534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:51.569386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:51.588197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:51.589850 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-47a93f5f-595b-4bcf-a71c-9e06708b6074 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.536508 Oct 17 13:17:51.593097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.593959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.594854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.595839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.597858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.602983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.605938 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2920/5626] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:51 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:51.617026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:51.618018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:51.628004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.628836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.629476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.630768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.631452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.632036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.859260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:51.868035 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e065f231-c39f-4c4a-bb6b-f81f45496e9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.260417 Oct 17 13:17:51.868994 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2921/5627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:51 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:51.889155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:51.892872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:51.893646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:51.897904 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-944dfbc7-f30d-45b1-9005-0170de256da2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1682 microversion: 2.1 time: 0.338386 Oct 17 13:17:51.898833 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2707/5628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:51 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1682 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:51.901768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.902359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.902742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.903411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:51.903892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:51.904286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:51.954262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lazy-loading 'flavor' on Instance uuid 66ea9158-6f53-4f79-8a42-69ca056124ac {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:52.035374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:52.040573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:52.048436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.049219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.049872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-74c3bbda-12bc-4c8a-bc7c-1f8d04dceeb4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.161311 Oct 17 13:17:52.050066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.050585 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2922/5629] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:51 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:52.055649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.055649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.055649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.056707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:52.057673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:52.065522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.065906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.066415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.067223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.067744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.068180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.085632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:52.124495 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62864453-eb94-47f3-92c6-2c64d79cf92f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb/action" status: 200 len: 32628 microversion: 2.1 time: 0.094085 Oct 17 13:17:52.125474 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2708/5630] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:52 2022] POST /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb/action => generated 32628 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:17:52.132372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:52.133636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:52.141749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.142327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.142849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.143970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.144635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.145288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.295433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:52.308971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9cc98212-fe41-48a0-88b9-9d712d7ba0b6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.256063 Oct 17 13:17:52.330337 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2923/5631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:52 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:52.336273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:52.337235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:52.344457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.345291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.346080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.347212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.348853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.349538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.407665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:52.423818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e99df923-035c-4475-8a28-4aa58d1bfeec tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1674 microversion: 2.1 time: 0.296139 Oct 17 13:17:52.432675 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2709/5632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:52 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1674 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:52.550739 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee7cab16-f3fd-4f6a-81b0-033e6c9fc9cf tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1835 microversion: 2.1 time: 0.218813 Oct 17 13:17:52.554344 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2924/5633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:52 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1835 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:52.600352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:52.606278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:52.621638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:52.621638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:52.638849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.639470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.641921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.642946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.643887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.645333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.647829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.648587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.650971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.653058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:52.655443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:52.656691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.731393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lazy-loading 'flavor' on Instance uuid 8a73c36f-0f0a-454b-8a98-de7cdca642cb {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:52.759808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Going to try to live migrate instance to another host {{(pid=127539) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:17:52.981086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:53.006567 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68d59e6f-7664-4762-93e0-abf61238aeca tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.393577 Oct 17 13:17:53.007955 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2925/5634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:52 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:53.023391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:53.024573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:53.042577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:53.045138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:53.047148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:53.049605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:53.050626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:53.052382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:53.529106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:53.556586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:53.590504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:53.600370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:53.603117 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e0a7526-33d2-49a6-b45a-87e11e767eff tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.593441 Oct 17 13:17:53.608991 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2926/5635] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:53 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:53.636782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-633342711", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "349982c5-252a-4920-856c-e30672ebab11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb1e7600-e122-4b5e-9526-e08a5b9bce6b"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:53.912828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] validate_networks() for [('eb1e7600-e122-4b5e-9526-e08a5b9bce6b', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:17:55.094299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:17:55.095106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:17:55.095465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:17:55.095894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:17:55.096312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:17:55.129273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:55.130270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:55.136492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:55.141564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:55.143932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:55.145074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:55.248226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:55.272322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:55.526453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:17:55.528971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='349982c5-252a-4920-856c-e30672ebab11',volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:17:55.894048 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32260893-fd55-4b4c-af28-550ebec63c56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278062 Oct 17 13:17:55.907256 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2927/5636] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:17:55.911602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:55.913579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:55.986396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:55.987425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:55.994619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:56.001818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:56.004349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:56.006629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:56.564285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:56.579299 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fdfa60ed-bf4f-4e57-8ef8-4b36775ec742 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.680445 Oct 17 13:17:56.580380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2928/5637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:55 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:56.627648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:56.628797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:56.660363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:56.661417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:56.662684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:56.664384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:56.665503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:56.666515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:57.081019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:57.098136 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43d5bf62-59f3-4ded-acf3-ab1a9be66115 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1657 microversion: 2.1 time: 0.514170 Oct 17 13:17:57.114194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2929/5638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:56 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1657 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:57.114194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:57.114194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:57.132683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:57.134787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:57.136032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:57.139158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:57.139803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:57.143260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:57.527954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:57.545291 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd81fcea-86f3-4e44-8040-b95de0666ae3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.443426 Oct 17 13:17:57.546218 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2930/5639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:57 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:57.586921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:57.588432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:57.608646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:57.614129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:57.621435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:57.623570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:57.624138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:57.626730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.189872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:58.220485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:58.230739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:58.237130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e50c2bc-9fca-4af4-a7a9-a987304ef11a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.670714 Oct 17 13:17:58.250871 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2931/5640] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:57 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:58.274543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:58.281372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:58.293340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.293955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.295069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.295965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.296524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.297091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.432977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:58.447538 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cb0dbe21-8404-4a53-a9af-d70f7bc5aa1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1154 microversion: 2.1 time: 0.189815 Oct 17 13:17:58.449605 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2932/5641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:58 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1154 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:58.461468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:58.482256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:58.512736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.517399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.519802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.523093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.524507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.530382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.788732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9c96aa1-df00-4577-b1d0-8ef2c2194543 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb/action" status: 202 len: 0 microversion: 2.1 time: 6.200589 Oct 17 13:17:58.790381 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2710/5642] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:52 2022] POST /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb/action => generated 0 bytes in 6204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:58.819522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:58.827046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:58.837178 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0f8494ed-3b8d-436e-8b37-72506198c3d3 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action" status: 202 len: 0 microversion: 2.1 time: 0.385387 Oct 17 13:17:58.838065 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2933/5643] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:58 2022] POST /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:58.860269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:58.861359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:58.884187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.888867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.891474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.894110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.894739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.895767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.896371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.900016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.901878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.902081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.906513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.908734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:59.598360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:59.633042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-00d2b5cb-2dc3-49fd-89a6-59b489065e88 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.783574 Oct 17 13:17:59.685808 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2934/5644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:58 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:59.713858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:59.718023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:59.749568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:59.770139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:59.771116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:59.773637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:59.790773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:59.793351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:59.930333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:59.951360 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cfb1b6e1-bdac-412c-b260-95011c7c5ee7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 1.154079 Oct 17 13:17:59.953263 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2711/5645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:58 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:59.976193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:59.977398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:00.006907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.013490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.014726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:00.016198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.022369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.025599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:00.561474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:00.579375 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3925d77-672c-4f79-aa12-661088f91058 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.891889 Oct 17 13:18:00.586277 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2935/5646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:59 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:00.597104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:00.606505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:00.631368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.632285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.632781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:00.637080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.638008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.642482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.181641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:01.182762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:01.196685 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e2f245a-3643-4a7d-8c4d-6ad051c2853d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1663 microversion: 2.1 time: 1.239332 Oct 17 13:18:01.197441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:01.200308 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2712/5647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:59 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1663 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:01.211118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:01.212502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:01.218563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1ccbee8-ed29-46e6-96fd-ba812778e0ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.626609 Oct 17 13:18:01.220081 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2936/5648] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:00 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:01.224072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:01.229564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-54ec8f59-18ef-4f2f-a53f-98251e331029 req-0649a3c0-eafe-480a-80c6-989ddebcce99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3001998-79dc-4411-aec7-cd86e6c72deb", "name": "network-vif-plugged", "status": "completed", "tag": "dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:01.241422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.242619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.252384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.254118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.255121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.256279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.266277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-54ec8f59-18ef-4f2f-a53f-98251e331029 req-0649a3c0-eafe-480a-80c6-989ddebcce99 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.267382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-54ec8f59-18ef-4f2f-a53f-98251e331029 req-0649a3c0-eafe-480a-80c6-989ddebcce99 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.268214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-54ec8f59-18ef-4f2f-a53f-98251e331029 req-0649a3c0-eafe-480a-80c6-989ddebcce99 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.340469 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-54ec8f59-18ef-4f2f-a53f-98251e331029 req-0649a3c0-eafe-480a-80c6-989ddebcce99 service nova] Creating event network-vif-plugged:dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e for instance f3001998-79dc-4411-aec7-cd86e6c72deb on n-h1-853316-12 Oct 17 13:18:01.366789 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-54ec8f59-18ef-4f2f-a53f-98251e331029 req-0649a3c0-eafe-480a-80c6-989ddebcce99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143064 Oct 17 13:18:01.376320 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2937/5649] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:01.402079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:01.403862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:01.416534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.417408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.418261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.419536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.420285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.421077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.534303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:01.553612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b213a8a8-c71c-4cd5-b728-564bcee64587 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1172 microversion: 2.1 time: 0.351377 Oct 17 13:18:01.555261 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2713/5650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:01 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1172 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:01.561759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:01.562880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:01.577550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.580334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.582003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.599069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.602696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.605110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.105662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:02.151039 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-689c55ed-0ecd-46ab-a259-8f6441720b58 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.768032 Oct 17 13:18:02.154984 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2938/5651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:01 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:02.197820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:02.210880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:02.241190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.241994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.254896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.257024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.257861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.258624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.783297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:02.791217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:02.804552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89c5e43e-3497-43b1-ab65-d62abc73373e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 1.247282 Oct 17 13:18:02.805101 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2714/5652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:01 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:02.829929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:02.833543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:02.837818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1fddfadd-12f4-4384-ae5c-d270f393e413 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.647472 Oct 17 13:18:02.838897 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2939/5653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:02 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:02.866891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.866891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.869047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.869909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.871612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.872129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.872711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:02.873389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:02.911217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.911956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.912870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.913835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.915525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.917321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.247986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:03.271003 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4e4979ed-40b6-4530-9d7c-adf4caf0d75b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1663 microversion: 2.1 time: 0.464405 Oct 17 13:18:03.308089 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2715/5654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:02 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1663 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:03.335268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:03.341735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:03.375696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:03.376361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.380143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.381471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.383108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.388450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.389663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.418985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:03.422346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:03.426884 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e2af6209-976b-4608-b147-39afea87fb95 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.586227 Oct 17 13:18:03.431520 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2940/5655] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:02 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:03.485935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:03.485935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:03.509880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.516614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.518035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.523568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.524871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.526294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.668061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:03.706901 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10f2a39a-8260-4124-a385-08e3929e769c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1172 microversion: 2.1 time: 0.384151 Oct 17 13:18:03.723982 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2716/5656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:03 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1172 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:03.852081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:03.853233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:03.875770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.876723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.877397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.878222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.882697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.883182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.936932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:03.947370 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6ad7aec-06c9-446d-b312-6a789a784801 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.501626 Oct 17 13:18:03.948521 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2941/5657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:03 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:03.955564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:03.966015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:03.979832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.980842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.982211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.983193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.983860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.984509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:04.288145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:04.324309 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9642c071-03be-4e02-a6bf-f3818bf138d4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.374061 Oct 17 13:18:04.325779 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2942/5658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:03 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:04.495383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:04.542783 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-290db6f5-0ce1-4984-a1fa-d047a9f500d5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.691592 Oct 17 13:18:04.558041 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2717/5659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:03 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:04.577347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:04.587814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:04.618092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:04.623526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:04.637386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:04.642499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:04.646136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:04.647989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.185029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:05.307660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:05.362007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:05.363998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:05.395860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.403468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.405012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.413788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.419727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.423080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.565363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:05.594317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:05.607630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:05.622884 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3259e5e4-4456-483c-9cd3-ccb9e82fe5a5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 1.047579 Oct 17 13:18:05.628898 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2718/5660] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:04 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:05.653264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:05.658292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:05.691583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.692208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.697439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.704659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.710565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.711856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.010428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:06.016376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:06.035428 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c7bb1ac-b0e4-4668-b352-7161e88ebb9f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1663 microversion: 2.1 time: 1.707424 Oct 17 13:18:06.040178 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2943/5661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:04 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1663 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:06.051146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:06.065008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:06.080124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.081567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.082808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.085406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.103601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.105180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.624663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:06.642255 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ea0475c-9262-410a-84f5-58915e9c2cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.599408 Oct 17 13:18:06.643964 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2944/5662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:06 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:06.690869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:06.700902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:06.758975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.760280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.761026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.763454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.765296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.766776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.080092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.112301 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90828e53-3817-407f-a652-2af0eb153341 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.460436 Oct 17 13:18:07.118729 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2945/5663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:06 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:07.125607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:07.130127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:07.156995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.158109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.160933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.162534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.163607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.168556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.349428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.371704 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-60b7869a-5e08-48c1-a670-89cdafcb1269 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1214 microversion: 2.1 time: 1.740726 Oct 17 13:18:07.372757 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2719/5664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:05 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1214 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:07.396290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:07.398958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:07.410044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.418281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.418866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.419949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.420713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.421738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.617000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.631674 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-74ed42e6-e21f-4934-bb27-848f468f4660 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.510177 Oct 17 13:18:07.632964 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2946/5665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:07 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:07.639758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:07.640858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:07.650073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.651090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.651841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.653449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.655400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.668421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.917745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.931143 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60e78554-05ee-457b-97f9-b2bc99dae437 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.296361 Oct 17 13:18:07.933395 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2947/5666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:07 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:07.946393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:07.946393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:07.951569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.952184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.954212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.955171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.955751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.956381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.960787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.978896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.980689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.982644 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d483482-ae3a-464a-9c2e-059be5f8e7e4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.605155 Oct 17 13:18:07.985146 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2720/5667] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:07 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:07.997530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:07.998445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:08.020472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.024126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.025320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.026983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.027745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.028867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.200768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:08.216305 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b1ca6224-f89f-4804-8e7a-6010cfebe87f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.281386 Oct 17 13:18:08.218108 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2948/5668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:07 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:08.225680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:08.226658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:08.235906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.237050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.237979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.239355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.240303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.240914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.475954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:08.495589 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc1db05e-5551-4096-8ff0-88c5bfa30946 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.273977 Oct 17 13:18:08.499590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2949/5669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:08 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:08.520274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b6b0c3da-187c-4285-9828-f0f77551c8ea req-b53b0724-dd4e-4377-9c8b-6503652c4b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a73c36f-0f0a-454b-8a98-de7cdca642cb", "name": "network-vif-unplugged", "status": "completed", "tag": "601c5043-9cee-42c7-8136-f10fb526fa82"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:08.556189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b6b0c3da-187c-4285-9828-f0f77551c8ea req-b53b0724-dd4e-4377-9c8b-6503652c4b8e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.556844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b6b0c3da-187c-4285-9828-f0f77551c8ea req-b53b0724-dd4e-4377-9c8b-6503652c4b8e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.557388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b6b0c3da-187c-4285-9828-f0f77551c8ea req-b53b0724-dd4e-4377-9c8b-6503652c4b8e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.583700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:08.585582 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b6b0c3da-187c-4285-9828-f0f77551c8ea req-b53b0724-dd4e-4377-9c8b-6503652c4b8e service nova] Creating event network-vif-unplugged:601c5043-9cee-42c7-8136-f10fb526fa82 for instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb on n-h2-853316-12 Oct 17 13:18:08.596778 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b6b0c3da-187c-4285-9828-f0f77551c8ea req-b53b0724-dd4e-4377-9c8b-6503652c4b8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081763 Oct 17 13:18:08.600897 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2950/5670] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:08.619367 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fbb7d5d9-fe5a-4584-a6c4-5d1221119bcf tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1666 microversion: 2.1 time: 0.632753 Oct 17 13:18:08.619697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:08.620278 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2721/5671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:07 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1666 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:08.638328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:08.638328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.638328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.638328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.638328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.638328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.638328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.675754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:08.677219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:08.689985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.691155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.691913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.692885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.694446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.695853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.763489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:08.777414 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Working on deleting snapshot f2cef783-cdd2-4926-9dcf-f65b1a0a529c from shelved instance... Oct 17 13:18:09.082157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:09.100082 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-61156292-fe8d-4500-a463-69290d76ddf9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1214 microversion: 2.1 time: 0.496420 Oct 17 13:18:09.105819 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2951/5672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:08 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1214 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:09.134924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:09.138144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:09.160005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:09.165766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:09.167022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:09.168342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:09.169701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:09.170597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:09.171365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:09.398813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:09.410680 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c26886aa-6955-4a34-be58-a0b7932dc7f7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1507 microversion: 2.1 time: 0.300982 Oct 17 13:18:09.411956 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2952/5673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:09 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:09.429307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:09.430858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:09.441327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:09.442131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:09.443364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:09.446960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:09.448826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:09.450652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:09.697515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:09.718116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:09.730982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:09.732680 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c432dadc-7c03-428a-a20f-4ace78b7a49d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1810 microversion: 2.20 time: 0.319083 Oct 17 13:18:09.734614 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2953/5674] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:09 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1810 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:09.744205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:09.745780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:09.754612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:09.755341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:09.756495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:09.757418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:09.758035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:09.758668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.179660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:10.182116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:10.194934 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f969361-f676-48e9-802d-f59b26d4865f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.458454 Oct 17 13:18:10.221598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Doing local delete in cell 77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) {{(pid=127539) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 17 13:18:10.223948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.226616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.227933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.228966 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 17 13:18:10.241060 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2954/5675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:09 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:10.258413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:10.261505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] deallocate_for_instance() {{(pid=127539) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 17 13:18:10.264573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:10.283175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.283975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.284711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.285970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.286808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.287634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.641789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:10.659599 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46a731ce-449f-4ccf-b4d1-ca4b2d2b520a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.414148 Oct 17 13:18:10.660882 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2955/5676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:10 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:10.676241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:10.678773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:10.692940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.694899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.696144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.697235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.698809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.702616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.951909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:10.965846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-48729c89-8657-405b-a3e8-0b30c6764f26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1214 microversion: 2.1 time: 0.302004 Oct 17 13:18:10.966500 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2956/5677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:10 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1214 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:10.990943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:10.990943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:10.990943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.990943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.990943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.990943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.990943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.990943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:11.299383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:11.319054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c215e2b-a79e-4310-bbca-98c955d9a8bc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1528 microversion: 2.1 time: 0.349378 Oct 17 13:18:11.321579 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2957/5678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:10 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1528 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:11.339119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1107b997-6c09-41fa-9261-0c601884e796 req-e6bfc313-631a-4340-866d-212fced0ae62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1680b297-14d4-403d-a0bb-df4182310f76", "tag": "98566b60-7da3-402f-9130-b85880173367"}, {"name": "network-changed", "server_uuid": "8a73c36f-0f0a-454b-8a98-de7cdca642cb", "tag": "601c5043-9cee-42c7-8136-f10fb526fa82"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:11.375178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1107b997-6c09-41fa-9261-0c601884e796 req-e6bfc313-631a-4340-866d-212fced0ae62 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:11.377232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1107b997-6c09-41fa-9261-0c601884e796 req-e6bfc313-631a-4340-866d-212fced0ae62 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:11.378610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1107b997-6c09-41fa-9261-0c601884e796 req-e6bfc313-631a-4340-866d-212fced0ae62 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:11.414389 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1107b997-6c09-41fa-9261-0c601884e796 req-e6bfc313-631a-4340-866d-212fced0ae62 service nova] Creating event network-changed:98566b60-7da3-402f-9130-b85880173367 for instance 1680b297-14d4-403d-a0bb-df4182310f76 on n-h2-853316-12 Oct 17 13:18:11.415795 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1107b997-6c09-41fa-9261-0c601884e796 req-e6bfc313-631a-4340-866d-212fced0ae62 service nova] Creating event network-changed:601c5043-9cee-42c7-8136-f10fb526fa82 for instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb on n-h2-853316-12 Oct 17 13:18:11.431678 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1107b997-6c09-41fa-9261-0c601884e796 req-e6bfc313-631a-4340-866d-212fced0ae62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105237 Oct 17 13:18:11.432735 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2958/5679] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:11.442079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:11.444212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:11.455475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:11.456232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:11.459359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:11.460875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:11.462427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:11.463028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:11.713588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Updating instance_info_cache with network_info: [] {{(pid=127539) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:18:11.797993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:11.827067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:11.827067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:11.829101 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae198a72-4e47-4284-9804-f35f46a4f599 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1797 microversion: 2.20 time: 0.394533 Oct 17 13:18:11.842315 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2959/5680] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:11 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1797 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:11.842315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:11.842315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:11.869976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:11.871075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:11.874642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:11.875515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:11.876001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:11.876599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.061206 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0d2004a1-dfa2-4012-a321-55ee39ed10e5 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 204 len: 0 microversion: 2.1 time: 3.397261 Oct 17 13:18:12.067040 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2722/5681] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:08 2022] DELETE /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 0 bytes in 3403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:12.081530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.082227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:12.098091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.099131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.100866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.101670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.102138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.104932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.208275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:12.219628 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e993b5f-f7b3-457b-93c7-e6d31bdb60ea tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.387885 Oct 17 13:18:12.221110 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2960/5682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:11 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:12.238565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.239183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:12.251703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.252270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.252748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.253506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.254035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.254501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.495664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:12.502439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:12.517966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:12.518672 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0217da7e-a088-48e3-9f9c-aef48b22dde6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.449856 Oct 17 13:18:12.520145 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2723/5683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:12 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:12.524308 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e2fc937-6049-483b-b6c6-bd0e3d64e838 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.301417 Oct 17 13:18:12.532487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.534343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 1ec4a533-498a-40e2-84e1-931941c16cc1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:12.534946 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2961/5684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:12 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:12.549605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.550666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.551629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.554147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.555757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.557132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.565123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.566141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:12.579669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.580499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.581248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.582486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.583288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.584552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.591629 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] HTTP exception thrown: Instance 1ec4a533-498a-40e2-84e1-931941c16cc1 could not be found. Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Request method failure captured: Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 HTTP/1.1 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVO0glWGLbeBqFYHnI47AkOOv9610GlPB_7XgGni0zy7AQddwFoAeqWQTUaxobD_wa1PiGslzsTtDShlB0fiZHCOQFavnW9yvVr9qLSJZ7jJjhqpvX_ASedHoa_DgK6owv82ZjkbTnFuMc4KqAmgS7gt2C8qTqQ9zmXe2bLIJ8wj_R8 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2ea124fdbff4df4b04a2e969871d8b4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: c71ac2b898f649cdaa99fbace633e738 Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 1ec4a533-498a-40e2-84e1-931941c16cc1 could not be found. Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1ec4a533-498a-40e2-84e1-931941c16cc1'} Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ec4a533-498a-40e2-84e1-931941c16cc1 could not be found. Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ec4a533-498a-40e2-84e1-931941c16cc1 could not be found. Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:12.594322 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:12.601953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:12.601953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:12.601953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:12.601953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:12.601953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:12.601953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ec4a533-498a-40e2-84e1-931941c16cc1 could not be found. Oct 17 13:18:12.601953 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:12.611477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Returning 404 to user: Instance 1ec4a533-498a-40e2-84e1-931941c16cc1 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:12.611632 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c35f234a-2586-48c5-b7a4-316a56c21d7d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1" status: 404 len: 111 microversion: 2.1 time: 0.087383 Oct 17 13:18:12.612704 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2724/5685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:12 2022] GET /compute/v2.1/servers/1ec4a533-498a-40e2-84e1-931941c16cc1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:12.627427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.629090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:12.640806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.641750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.642660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.643972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.644923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.645824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.702846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:12.801897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:12.818926 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0e662412-5ef3-4eac-a9a2-e197d1a4889d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1528 microversion: 2.1 time: 0.282288 Oct 17 13:18:12.819833 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2962/5686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:12 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1528 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:12.843819 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-645854e1-4daf-4b9f-b45b-36b7640d72ac tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 204 len: 0 microversion: 2.1 time: 0.222713 Oct 17 13:18:12.852036 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2725/5687] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:12 2022] DELETE /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:12.859542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.860546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:12.867369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.867860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.868303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.869020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.869475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.869899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.997686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:13.011030 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7586ae26-9b0e-4e49-8566-73a45fbc6d7a tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1465 microversion: 2.1 time: 0.157867 Oct 17 13:18:13.011649 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2963/5688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:12 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:13.262748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:13.264613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:13.279004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.280023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.281885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.283494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.284601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.285602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.307203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8eddfb0b-9384-48cb-ae90-36ab6ad967bf req-be4e3bb8-a4fd-4148-8856-f894e4afcdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c84769-498d-4e0b-9cdd-f9569b58f1f8", "name": "network-vif-plugged", "status": "completed", "tag": "e1736ccb-979b-4c83-b032-f7f4926f64b5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:13.332374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8eddfb0b-9384-48cb-ae90-36ab6ad967bf req-be4e3bb8-a4fd-4148-8856-f894e4afcdfa service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.333804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8eddfb0b-9384-48cb-ae90-36ab6ad967bf req-be4e3bb8-a4fd-4148-8856-f894e4afcdfa service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.335328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8eddfb0b-9384-48cb-ae90-36ab6ad967bf req-be4e3bb8-a4fd-4148-8856-f894e4afcdfa service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.357907 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8eddfb0b-9384-48cb-ae90-36ab6ad967bf req-be4e3bb8-a4fd-4148-8856-f894e4afcdfa service nova] Creating event network-vif-plugged:e1736ccb-979b-4c83-b032-f7f4926f64b5 for instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 on n-h1-853316-12 Oct 17 13:18:13.369503 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8eddfb0b-9384-48cb-ae90-36ab6ad967bf req-be4e3bb8-a4fd-4148-8856-f894e4afcdfa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071747 Oct 17 13:18:13.370885 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2964/5689] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:13.500472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1ae52dd1-1606-4097-ad54-b17c130408ac req-8cd1f565-de70-47c2-a322-6a14fceb1d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec4a533-498a-40e2-84e1-931941c16cc1", "name": "network-vif-deleted", "tag": "0ca362e1-43ba-45d3-b6eb-1eff56c67772"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:13.510446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:13.516684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1ae52dd1-1606-4097-ad54-b17c130408ac req-8cd1f565-de70-47c2-a322-6a14fceb1d4e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.517376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1ae52dd1-1606-4097-ad54-b17c130408ac req-8cd1f565-de70-47c2-a322-6a14fceb1d4e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.518078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1ae52dd1-1606-4097-ad54-b17c130408ac req-8cd1f565-de70-47c2-a322-6a14fceb1d4e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.523465 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8161257-6905-4082-8f02-05e0e6417c99 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.270097 Oct 17 13:18:13.524949 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2726/5690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:13 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:13.533362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.server_external_events [req-1ae52dd1-1606-4097-ad54-b17c130408ac req-8cd1f565-de70-47c2-a322-6a14fceb1d4e service nova] Unable to find a host for instance 1ec4a533-498a-40e2-84e1-931941c16cc1. Dropping event network-vif-deleted {{(pid=127540) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:18:13.534349 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1ae52dd1-1606-4097-ad54-b17c130408ac req-8cd1f565-de70-47c2-a322-6a14fceb1d4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.041325 Oct 17 13:18:13.535356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2965/5691] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 13:18:13.551493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:13.552691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:13.562356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.562998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.563479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.564215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.564741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.565135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.565773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:13.569049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:13.582052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.583222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.584358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.585953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.588406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.588406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.771695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:13.781678 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf4d47da-d505-4a75-9599-0318dfad6408 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.237558 Oct 17 13:18:13.789994 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2727/5692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:13 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:13.830801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:13.856563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-209a5989-8081-4994-98ed-c5d9eedf2893 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.291828 Oct 17 13:18:13.856563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2966/5693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:13 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:13.865884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:13.867649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:13.884425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.885277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.886083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.887488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.888265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.889009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.036737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:14.037531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:14.044594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.045799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.046617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.047565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.048160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.048682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.069042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:14.083741 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f85d0752-74d5-40ee-ae9f-9513478689a4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1528 microversion: 2.1 time: 0.223973 Oct 17 13:18:14.098187 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2728/5694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:13 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1528 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:14.153659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:14.165598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-78bea3eb-5117-4a96-a15c-70593fb86e61 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1465 microversion: 2.1 time: 0.133969 Oct 17 13:18:14.166078 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2967/5695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:14 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1465 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:14.557505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:14.558108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:14.565017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.565834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.566623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.567578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.569266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.569961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.812822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:14.813435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:14.823840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.832647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.833663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.835132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.836039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.836678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.878711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:14.889439 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5119c7f5-af68-4c12-927d-ef5704708f31 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.336200 Oct 17 13:18:14.891157 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2729/5696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:14 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:14.897856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:14.898767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:14.905776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:14.907615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.908651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.909625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.910937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.911591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.912318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.123842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:15.140464 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0b7b8463-4617-4b08-889b-8f94946ae260 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.247461 Oct 17 13:18:15.156838 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2730/5697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:14 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:15.174665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:15.177369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:15.190605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.191376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.192129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.194495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.195404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.196083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.495260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:15.504434 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f834941f-f027-4e00-8bd4-53b5710bdf68 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1528 microversion: 2.1 time: 0.346058 Oct 17 13:18:15.505252 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2731/5698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:15 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1528 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:15.519516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:15.520136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:15.542986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.543480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.543913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.544618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.545074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.545991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.655906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:15.665980 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e758f79b-7c6c-4aa6-bf70-b044e7bb6e3b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 200 len: 1300 microversion: 2.1 time: 0.154580 Oct 17 13:18:15.666612 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2732/5699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:15 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:15.688464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f82040d4-d2f9-4c9b-8d7f-fa68846ef301 req-8c96519c-64ec-4d99-bc23-885a7a57f579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03da82a7-7f5c-4389-9b38-04b10e6b8e33", "name": "network-vif-deleted", "tag": "42f43daa-57a0-4125-92c9-7123c9b479c8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:15.701204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f82040d4-d2f9-4c9b-8d7f-fa68846ef301 req-8c96519c-64ec-4d99-bc23-885a7a57f579 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.701693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f82040d4-d2f9-4c9b-8d7f-fa68846ef301 req-8c96519c-64ec-4d99-bc23-885a7a57f579 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.702133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f82040d4-d2f9-4c9b-8d7f-fa68846ef301 req-8c96519c-64ec-4d99-bc23-885a7a57f579 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.707452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:15.721328 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f82040d4-d2f9-4c9b-8d7f-fa68846ef301 req-8c96519c-64ec-4d99-bc23-885a7a57f579 service nova] Creating event network-vif-deleted:42f43daa-57a0-4125-92c9-7123c9b479c8 for instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 on n-h2-853316-12 Oct 17 13:18:15.731769 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f82040d4-d2f9-4c9b-8d7f-fa68846ef301 req-8c96519c-64ec-4d99-bc23-885a7a57f579 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046989 Oct 17 13:18:15.733780 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2733/5700] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:15.783235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:15.792827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b36c625-55ff-406d-9050-07d4eb8c0271 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.983788 Oct 17 13:18:15.793534 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2968/5701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:14 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:15.930986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:15.931762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:15.941237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.941237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.941237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.941237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.941237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.941905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.102671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:16.120710 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7b691d1f-f98c-4887-ae68-776b312e4316 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.196348 Oct 17 13:18:16.122038 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2734/5702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:15 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:16.174856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:16.176600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:16.191882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.192779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.193751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.195445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.196576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.197430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.356615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:16.366345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9932792f-7106-4004-9691-b45f8e394d2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.194721 Oct 17 13:18:16.376724 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2969/5703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:16 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:16.534677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:16.535536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:16.542491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.543092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.543603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.544387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.545143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.545775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.694056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:16.695333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 03da82a7-7f5c-4389-9b38-04b10e6b8e33] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:16.703380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:16.704567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.705297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.712468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.714096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.714917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.715101 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab71b40f-75dd-480b-a18e-acd3a440cde3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1528 microversion: 2.1 time: 0.184249 Oct 17 13:18:16.715369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.715931 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2735/5704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:16 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1528 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:16.742456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] HTTP exception thrown: Instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 could not be found. Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Request method failure captured: Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 HTTP/1.1 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVO0glWGLbeBqFYHnI47AkOOv9610GlPB_7XgGni0zy7AQddwFoAeqWQTUaxobD_wa1PiGslzsTtDShlB0fiZHCOQFavnW9yvVr9qLSJZ7jJjhqpvX_ASedHoa_DgK6owv82ZjkbTnFuMc4KqAmgS7gt2C8qTqQ9zmXe2bLIJ8wj_R8 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2ea124fdbff4df4b04a2e969871d8b4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: c71ac2b898f649cdaa99fbace633e738 Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 could not be found. Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '03da82a7-7f5c-4389-9b38-04b10e6b8e33'} Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 could not be found. Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 could not be found. Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:16.744375 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 could not be found. Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Returning 404 to user: Instance 03da82a7-7f5c-4389-9b38-04b10e6b8e33 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c5cb6110-efca-4a06-b4e4-1735d5025a56 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33" status: 404 len: 111 microversion: 2.1 time: 0.056844 Oct 17 13:18:16.751356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2970/5705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:16 2022] GET /compute/v2.1/servers/03da82a7-7f5c-4389-9b38-04b10e6b8e33 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:16.758974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:16.759581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:16.765955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.766491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.767245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.768048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.768503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.768929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.827577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:16.831101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:16.831721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:16.839002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.839536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.839976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.840671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.841121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.841545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.934801 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71bf92e2-422a-405e-9791-1adb3a867f55 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 204 len: 0 microversion: 2.1 time: 0.181023 Oct 17 13:18:16.937541 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2736/5706] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:16 2022] DELETE /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:16.953973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:16.954767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:16.963732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.964226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.964671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.965384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.965836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.966303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.048747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:17.061942 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4329ff30-ab85-4e7b-962e-af37db529308 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.244706 Oct 17 13:18:17.062900 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2971/5707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:16 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:17.145046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:17.151106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:17.153008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:17.156056 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1dcb2f44-7909-463f-a8e7-eb634fc3d44c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1507 microversion: 2.1 time: 0.211371 Oct 17 13:18:17.157235 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2737/5708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:16 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:17.166230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.167434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.168409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.171510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.172462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.173474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.375672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:17.393274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:17.394328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:17.394571 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3fd25da9-dbdb-4c14-a698-16648d954da9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.252766 Oct 17 13:18:17.395711 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2972/5709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:17 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:17.403922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.404502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.405177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.406329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.407097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.407786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.687111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:17.700074 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79e6958c-36dc-4f59-b80d-fbfb9b9fc6e1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.312920 Oct 17 13:18:17.701939 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2738/5710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:17 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:17.748349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:17.749366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:17.779883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.780658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.781386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.798278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.800170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.801520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.051636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-abc66191-dea3-437e-9274-295819a472ba req-75fe3acb-9581-4f47-97f4-3d0565e240dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8edfd5-201d-4c59-b87c-b9b987ac6996", "name": "network-vif-plugged", "status": "completed", "tag": "d5781fa1-d3fb-4668-acdd-398634e6693e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:18.079251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-abc66191-dea3-437e-9274-295819a472ba req-75fe3acb-9581-4f47-97f4-3d0565e240dc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.085157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-abc66191-dea3-437e-9274-295819a472ba req-75fe3acb-9581-4f47-97f4-3d0565e240dc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.086451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-abc66191-dea3-437e-9274-295819a472ba req-75fe3acb-9581-4f47-97f4-3d0565e240dc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.119300 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-abc66191-dea3-437e-9274-295819a472ba req-75fe3acb-9581-4f47-97f4-3d0565e240dc service nova] Creating event network-vif-plugged:d5781fa1-d3fb-4668-acdd-398634e6693e for instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 on n-h1-853316-12 Oct 17 13:18:18.134253 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-abc66191-dea3-437e-9274-295819a472ba req-75fe3acb-9581-4f47-97f4-3d0565e240dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090177 Oct 17 13:18:18.139262 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2739/5711] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:18.155309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:18.159801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:18.180977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.181769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.182355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.183347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.183958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.195498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.360547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:18.373411 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d320a985-c584-427c-909f-2b2ce44e27f9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.632130 Oct 17 13:18:18.378031 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2973/5712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:17 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:18.384082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:18.391980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:18.404260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.408601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.409388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.410354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.410972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.417925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.538150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:18.547691 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f017995-2395-46f3-b338-d71f9657ecaa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.406713 Oct 17 13:18:18.548294 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2740/5713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:18 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:18.571404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:18.572030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:18.578643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.579382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.579824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.580568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.580996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.581421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.812345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:18.831486 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d8b182d-a61a-4ef6-97c3-fb726ad096ea tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 200 len: 1507 microversion: 2.1 time: 0.451441 Oct 17 13:18:18.847183 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2974/5714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:18 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:18.857461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:18.859058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:18.866576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.867519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.868879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.869900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.870805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.871810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.973255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:18.993895 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b8e4c68-53fe-4b1d-a2d0-155aed4c7e4b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.429668 Oct 17 13:18:18.994872 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2741/5715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:18 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:18.999916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d21b7f46-a53c-45ba-9a01-5430ea42a650 req-7ff94d0f-286c-4567-9f7e-896c35af6058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6fbb90d-ee4d-419d-b839-c032d62fbb89", "name": "network-vif-deleted", "tag": "3cf027b7-9cb8-42d3-b227-094e4d67ed61"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:19.021236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d21b7f46-a53c-45ba-9a01-5430ea42a650 req-7ff94d0f-286c-4567-9f7e-896c35af6058 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.022088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d21b7f46-a53c-45ba-9a01-5430ea42a650 req-7ff94d0f-286c-4567-9f7e-896c35af6058 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.022705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d21b7f46-a53c-45ba-9a01-5430ea42a650 req-7ff94d0f-286c-4567-9f7e-896c35af6058 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.049507 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d21b7f46-a53c-45ba-9a01-5430ea42a650 req-7ff94d0f-286c-4567-9f7e-896c35af6058 service nova] Creating event network-vif-deleted:3cf027b7-9cb8-42d3-b227-094e4d67ed61 for instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 on n-h2-853316-12 Oct 17 13:18:19.059956 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d21b7f46-a53c-45ba-9a01-5430ea42a650 req-7ff94d0f-286c-4567-9f7e-896c35af6058 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063767 Oct 17 13:18:19.060575 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2742/5716] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:19.174347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:19.195822 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58d456dc-9db0-4cda-ae7c-5a1df5203a2d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.346220 Oct 17 13:18:19.199713 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2975/5717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:18 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:19.404893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:19.406598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:19.415912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.417086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.421993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.429023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.429750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.430391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.577979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:19.580700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:19.597556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.598737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.600183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.603945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.605022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.606487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.675417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:19.683853 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67ab6941-c484-4c96-ae43-afe66eb9c066 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.283169 Oct 17 13:18:19.699115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2743/5718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:19 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:19.866001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:19.866905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: e6fbb90d-ee4d-419d-b839-c032d62fbb89] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:19.867561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:19.876314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.877025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.877635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.878588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.879231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.879599 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3ece223-7e69-41c1-88aa-789240a16446 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.307861 Oct 17 13:18:19.879995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.895144 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] HTTP exception thrown: Instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 could not be found. Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Request method failure captured: Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 HTTP/1.1 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVO0glWGLbeBqFYHnI47AkOOv9610GlPB_7XgGni0zy7AQddwFoAeqWQTUaxobD_wa1PiGslzsTtDShlB0fiZHCOQFavnW9yvVr9qLSJZ7jJjhqpvX_ASedHoa_DgK6owv82ZjkbTnFuMc4KqAmgS7gt2C8qTqQ9zmXe2bLIJ8wj_R8 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2ea124fdbff4df4b04a2e969871d8b4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: c71ac2b898f649cdaa99fbace633e738 Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 could not be found. Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e6fbb90d-ee4d-419d-b839-c032d62fbb89'} Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 could not be found. Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 could not be found. Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:19.897671 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:19.901246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:19.901246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:19.901246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:19.901246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:19.901246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:19.901246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 could not be found. Oct 17 13:18:19.901246 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:19.902497 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2976/5719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:19 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:19.903361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Returning 404 to user: Instance e6fbb90d-ee4d-419d-b839-c032d62fbb89 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:19.904459 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e1debc9f-8bda-43f2-af46-4f52dd6138b7 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89" status: 404 len: 111 microversion: 2.1 time: 0.042757 Oct 17 13:18:19.905536 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2744/5720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:19 2022] GET /compute/v2.1/servers/e6fbb90d-ee4d-419d-b839-c032d62fbb89 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:18:19.915895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:19.917288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:19.929338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.930612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.931797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.933399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.935170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.936228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.993735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:20.021211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:20.022147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:20.035828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.037580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.038723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.040176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.041114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.041908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.163883 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-61c84212-6977-4e49-8659-ea8975a5877e tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 204 len: 0 microversion: 2.1 time: 0.250850 Oct 17 13:18:20.166453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2977/5721] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:19 2022] DELETE /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:18:20.177221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:20.179306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:20.187024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.187234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.187868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.188627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.189230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.189667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.278558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:20.288204 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6085a855-82ff-483a-aae0-0b3429e48579 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.271483 Oct 17 13:18:20.289132 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2745/5722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:20.299618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:20.300249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:20.314931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.315432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.315874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.316777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.319359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.319860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.496632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:20.501043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:20.524360 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8bfa5e53-4fd4-4af9-bb2f-be2921b1fc8c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1494 microversion: 2.1 time: 0.353349 Oct 17 13:18:20.524962 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2978/5723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1494 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:20.666455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:20.688010 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d725a59-8bd9-4ff3-8fb1-b0b7641c0fa6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.397656 Oct 17 13:18:20.691071 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2746/5724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:20.728579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:20.729625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:20.750978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.754766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.756724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.758657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.759238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.761032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.907524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:20.908504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:20.920683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.923573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.924235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.926830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.927562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.930107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.295186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.307727 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3b2538df-262e-4bca-b578-812d045e704f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.404142 Oct 17 13:18:21.319516 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2747/5725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:21.341052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:21.345408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:21.373806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.380965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.382238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.383720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.392036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.393291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.478943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.499070 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-274ed2a8-25c9-45f1-b013-f1cd64c8a39b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.785509 Oct 17 13:18:21.502789 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2979/5726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:21.553276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:21.554472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:21.579961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.582660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.583359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.585244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.592021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.592887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.824015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.836092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.839957 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-643f5db1-62f4-447b-a19e-db2743a6b230 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 200 len: 1452 microversion: 2.1 time: 0.291062 Oct 17 13:18:21.840873 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2980/5727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:21 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 1452 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:21.853966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:21.854611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:21.868114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.868713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.869199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.874422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.875842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.876691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.877673 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d3aefe4-1aa2-47a9-abb8-bbec8fc7f114 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1518 microversion: 2.1 time: 0.553570 Oct 17 13:18:21.881798 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2748/5728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:21 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1518 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:22.044842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c734e7b2-829d-4a09-952a-672315903639 req-9a6a4bac-1fa4-46ac-b1bd-9d2ee67a2b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac7c688b-c922-471a-8a08-c1ba365c4dc6", "name": "network-vif-deleted", "tag": "91f1ce14-9d8b-47c9-a806-d9abb7e75671"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:22.092378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c734e7b2-829d-4a09-952a-672315903639 req-9a6a4bac-1fa4-46ac-b1bd-9d2ee67a2b48 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.093042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c734e7b2-829d-4a09-952a-672315903639 req-9a6a4bac-1fa4-46ac-b1bd-9d2ee67a2b48 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.094600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c734e7b2-829d-4a09-952a-672315903639 req-9a6a4bac-1fa4-46ac-b1bd-9d2ee67a2b48 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.113806 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c734e7b2-829d-4a09-952a-672315903639 req-9a6a4bac-1fa4-46ac-b1bd-9d2ee67a2b48 service nova] Creating event network-vif-deleted:91f1ce14-9d8b-47c9-a806-d9abb7e75671 for instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 on n-h2-853316-12 Oct 17 13:18:22.135250 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c734e7b2-829d-4a09-952a-672315903639 req-9a6a4bac-1fa4-46ac-b1bd-9d2ee67a2b48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091898 Oct 17 13:18:22.137895 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2749/5729] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:22.231292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:22.244966 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8bce13d9-3b9d-4cf1-9f86-9fec027795ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.402560 Oct 17 13:18:22.246155 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2981/5730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:21 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:22.367055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.368557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.378888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.379578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.380213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.381346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.381973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.382590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.525633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.526526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.536729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.538602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.540104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.544114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.544825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.545426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.650580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:22.668416 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5480ecb6-07b6-44fe-89ea-18dfb2ae8b87 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.306453 Oct 17 13:18:22.688263 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2750/5731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:22 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:22.812425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:22.814779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-75851ef3-cf7e-4c1e-afab-432cb1e47f39 req-265be96c-e646-449f-9b28-2ecf348475f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1680b297-14d4-403d-a0bb-df4182310f76", "name": "network-vif-plugged", "status": "completed", "tag": "98566b60-7da3-402f-9130-b85880173367"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:22.824847 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f947b3e1-bfe5-4535-8896-59de718c5ece tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.303252 Oct 17 13:18:22.840803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-75851ef3-cf7e-4c1e-afab-432cb1e47f39 req-265be96c-e646-449f-9b28-2ecf348475f6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.841784 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2982/5732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:22 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:22.842698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-75851ef3-cf7e-4c1e-afab-432cb1e47f39 req-265be96c-e646-449f-9b28-2ecf348475f6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.844392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-75851ef3-cf7e-4c1e-afab-432cb1e47f39 req-265be96c-e646-449f-9b28-2ecf348475f6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.870747 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-75851ef3-cf7e-4c1e-afab-432cb1e47f39 req-265be96c-e646-449f-9b28-2ecf348475f6 service nova] Creating event network-vif-plugged:98566b60-7da3-402f-9130-b85880173367 for instance 1680b297-14d4-403d-a0bb-df4182310f76 on n-h2-853316-12 Oct 17 13:18:22.872199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.872816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: ac7c688b-c922-471a-8a08-c1ba365c4dc6] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.884226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.884723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.885338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.887453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.888268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.888951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.901532 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-75851ef3-cf7e-4c1e-afab-432cb1e47f39 req-265be96c-e646-449f-9b28-2ecf348475f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088783 Oct 17 13:18:22.904801 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2751/5733] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:18:22.919803 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] HTTP exception thrown: Instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 could not be found. Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Request method failure captured: Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 HTTP/1.1 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVO0glWGLbeBqFYHnI47AkOOv9610GlPB_7XgGni0zy7AQddwFoAeqWQTUaxobD_wa1PiGslzsTtDShlB0fiZHCOQFavnW9yvVr9qLSJZ7jJjhqpvX_ASedHoa_DgK6owv82ZjkbTnFuMc4KqAmgS7gt2C8qTqQ9zmXe2bLIJ8wj_R8 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2ea124fdbff4df4b04a2e969871d8b4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: c71ac2b898f649cdaa99fbace633e738 Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 could not be found. Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'ac7c688b-c922-471a-8a08-c1ba365c4dc6'} Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 could not be found. Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 could not be found. Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:22.922181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 could not be found. Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Returning 404 to user: Instance ac7c688b-c922-471a-8a08-c1ba365c4dc6 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bbaf328f-63b8-4224-80cb-0bc4f1c59abd tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6" status: 404 len: 111 microversion: 2.1 time: 0.057922 Oct 17 13:18:22.926950 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2983/5734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:22 2022] GET /compute/v2.1/servers/ac7c688b-c922-471a-8a08-c1ba365c4dc6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:22.933685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.934197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.936582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.938433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.943858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.944617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.945205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.946115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.947145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.947716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.963410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.965314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.966240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.967436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.968236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.968851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.983328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:22.987907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:23.105199 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5fb1515e-bc61-49bc-9a0f-8990d7b99921 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 204 len: 0 microversion: 2.1 time: 0.174585 Oct 17 13:18:23.110303 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2984/5735] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:22 2022] DELETE /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:23.118671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:23.119795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:23.127767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.128580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.129200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.130154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.130957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.131739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.301171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.316041 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0d9c04fd-3094-4110-b656-be498e9802ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.405106 Oct 17 13:18:23.317751 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2752/5736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:22 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:23.322817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:23.323691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:23.350929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.352288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.354332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.357392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.358094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.359099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.370741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.379822 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3a19047f-c1ea-47e7-9e93-141311b0cf0f tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1672 microversion: 2.1 time: 0.266250 Oct 17 13:18:23.394264 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2985/5737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:23 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1672 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:23.396085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:23.396944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:23.404927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.405429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.405876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.406621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.407079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.407507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.589505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.602317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.611715 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4623bb0-6e03-4778-be10-b729b7ef212f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1202 microversion: 2.1 time: 0.292634 Oct 17 13:18:23.612505 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2753/5738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:23 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1202 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:23.618793 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a8be9b73-93ba-404e-9511-e78c78543e96 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.223642 Oct 17 13:18:23.619867 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2986/5739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:23 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:23.658683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:23.659477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:23.678224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.679637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.681035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.682421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.682983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.683515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.705401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:23.706759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:23.718921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.720440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.722722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.724192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.726013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.727478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.972529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.973477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.984445 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af3656bc-187b-4c2c-b9de-c1ca9acac3d5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.285014 Oct 17 13:18:23.991692 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2987/5740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:23 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:23.999830 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-649bf4a4-57d7-4794-9888-a520fad6f606 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.345466 Oct 17 13:18:24.001216 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2754/5741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:23 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:24.014910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.015516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.025434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4be87a9-869f-4b30-a4e8-b22384881950 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:24.025725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.026154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.026804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.027934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.028748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.029357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.035260 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c4be87a9-869f-4b30-a4e8-b22384881950 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 8289ab9d-90ce-4db8-8623-74411ce9b5a4 has no mapping to a cell. Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4be87a9-869f-4b30-a4e8-b22384881950 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/8289ab9d-90ce-4db8-8623-74411ce9b5a4/action HTTP/1.1 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 15 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: {"os-stop": {}} Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 8289ab9d-90ce-4db8-8623-74411ce9b5a4 has no mapping to a cell. Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8289ab9d-90ce-4db8-8623-74411ce9b5a4', 'body': {'os-stop': {}}} Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 8289ab9d-90ce-4db8-8623-74411ce9b5a4 has no mapping to a cell. Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:24.067079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8289ab9d-90ce-4db8-8623-74411ce9b5a4 has no mapping to a cell. Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8289ab9d-90ce-4db8-8623-74411ce9b5a4 has no mapping to a cell. Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4be87a9-869f-4b30-a4e8-b22384881950 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 8289ab9d-90ce-4db8-8623-74411ce9b5a4 has no mapping to a cell. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:24.071777 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4be87a9-869f-4b30-a4e8-b22384881950 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/8289ab9d-90ce-4db8-8623-74411ce9b5a4/action" status: 404 len: 117 microversion: 2.1 time: 0.048488 Oct 17 13:18:24.079463 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2755/5742] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:24 2022] POST /compute/v2.1/servers/8289ab9d-90ce-4db8-8623-74411ce9b5a4/action => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:18:24.090913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.091577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.099305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.099839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.100288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.101016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.101481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.101930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.331499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.343323 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74528f92-f384-4719-b38b-0ca17742abac tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.262728 Oct 17 13:18:24.344789 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2756/5743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:24 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:24.365860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.370988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.371981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.377385 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2dbbdb2f-a0b4-44b4-a085-f92909404b95 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.383605 Oct 17 13:18:24.378645 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2988/5744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:23 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:24.380134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.380678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.381355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.382193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.382732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.383167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.415737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.416271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.424454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.425035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.425485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.426207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.426660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.428229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.599065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.637819 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-718a6893-d144-4d05-960f-c1251cc2dfcf tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.270933 Oct 17 13:18:24.638993 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2757/5745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:24 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:24.644201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.644822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.652435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.652939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.653383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.654272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.654736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.655166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.773742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.785159 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c69c100c-88d6-4f1b-9857-42028d0cc185 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1672 microversion: 2.1 time: 0.375843 Oct 17 13:18:24.805964 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2989/5746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:24 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1672 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:24.826674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-869fa62a-9748-46ba-8c3e-1151e62f69a8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:24.832465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-869fa62a-9748-46ba-8c3e-1151e62f69a8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 95891b3f-432f-4e46-abe3-bdefa72f950d] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.855247 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-869fa62a-9748-46ba-8c3e-1151e62f69a8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 95891b3f-432f-4e46-abe3-bdefa72f950d could not be found. Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-869fa62a-9748-46ba-8c3e-1151e62f69a8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/95891b3f-432f-4e46-abe3-bdefa72f950d/action HTTP/1.1 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 15 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: {"suspend": {}} Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 95891b3f-432f-4e46-abe3-bdefa72f950d could not be found. Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '95891b3f-432f-4e46-abe3-bdefa72f950d', 'body': {'suspend': {}}} Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95891b3f-432f-4e46-abe3-bdefa72f950d could not be found. Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95891b3f-432f-4e46-abe3-bdefa72f950d could not be found. Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:24.863716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:24.868858 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:24.868858 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:24.868858 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95891b3f-432f-4e46-abe3-bdefa72f950d could not be found. Oct 17 13:18:24.868858 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:24.869811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-869fa62a-9748-46ba-8c3e-1151e62f69a8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 95891b3f-432f-4e46-abe3-bdefa72f950d could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:24.871498 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-869fa62a-9748-46ba-8c3e-1151e62f69a8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/95891b3f-432f-4e46-abe3-bdefa72f950d/action" status: 404 len: 111 microversion: 2.1 time: 0.063623 Oct 17 13:18:24.892187 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2990/5747] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:24 2022] POST /compute/v2.1/servers/95891b3f-432f-4e46-abe3-bdefa72f950d/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:24.901466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.902669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.914133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.915087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.915756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.916849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.917546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.918223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.967564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.977280 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b232759-19ed-4b61-9827-b9767ac57833 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1388 microversion: 2.1 time: 0.337092 Oct 17 13:18:24.977880 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2758/5748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:24 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1388 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:25.013238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:25.014285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:25.023103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.023858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.024467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.025493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.026767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.027386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.242215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.279919 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8220972f-20da-4a82-a662-ead70589a02f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.270607 Oct 17 13:18:25.286718 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2759/5749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:25 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:25.308495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:25.309105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:25.324471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.325028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.325598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.326508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.326975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.327451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.372294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.398882 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d564577f-0689-4e24-be5d-0a20be620ba7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.496574 Oct 17 13:18:25.402582 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2991/5750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:24 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:25.417244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:25.420213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:25.445399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.449564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.450242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.451378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.452016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.452645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.533471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.549756 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8776c7b2-7130-465f-b83b-0945be6817ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1388 microversion: 2.1 time: 0.260771 Oct 17 13:18:25.559215 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2760/5751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:25 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1388 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:25.566425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:25.567636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:25.575816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.576644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.577351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.578492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.579946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.580608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.756549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.765949 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac3ad370-9566-48c7-9019-82592ec7f683 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.358284 Oct 17 13:18:25.772246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.781824 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41fadd3b-2930-4062-b04a-ed01e923d269 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.220760 Oct 17 13:18:25.783069 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2992/5753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:25 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:25.783233 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2761/5753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:25 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:25.799224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:25.801100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:25.812617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:25.813319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:25.819923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.820796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.822677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.824220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.826583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.826770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.827412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.827694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.828401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.830578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.831691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.833052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.883110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lazy-loading 'flavor' on Instance uuid 5e8edfd5-201d-4c59-b87c-b9b987ac6996 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:26.009528 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4c662631-fe2f-45b6-b960-6691fa41a11a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 202 len: 0 microversion: 2.1 time: 0.204182 Oct 17 13:18:26.015306 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2762/5754] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:25 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:26.028750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.029582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.042406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.045983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.047441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.048271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.055434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.055972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.252410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.263047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7ea89e86-9abf-4639-b4ba-180e5d02e12b tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1672 microversion: 2.1 time: 0.246783 Oct 17 13:18:26.264066 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2763/5755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1672 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:26.268970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.269690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.277534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.278109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.278701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.279502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.280193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.280722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.405932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.422347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e51aa37a-1518-4ab3-a8cd-1fcdd49ea41e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1388 microversion: 2.1 time: 0.633718 Oct 17 13:18:26.434203 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2993/5756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:25 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1388 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:26.434203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.434203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.445247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.445921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.446786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.450019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.450702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.451357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.469307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.479759 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e64b7f1b-2e88-48e2-aa9f-7f609fcbcdfa tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1513 microversion: 2.1 time: 0.214674 Oct 17 13:18:26.480976 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2764/5757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:26.485982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.486641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.493193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.493882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.494523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.495336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.495900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.496503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.530032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:26.750988 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c6d3bd4-25f1-4273-aba5-bdd0fe47e676 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 204 len: 0 microversion: 2.1 time: 0.268310 Oct 17 13:18:26.757927 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2765/5758] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:26 2022] DELETE /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:26.774482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.775355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.790359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.794430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.794879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.795322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.796052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.797202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.797647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.800398 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b8557801-b454-4056-89b8-d9ee8ad4c1f1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.375044 Oct 17 13:18:26.801325 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2994/5759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:26.808335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.809331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.823318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.824488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.825460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.827356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.828549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.830056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.866915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:26.890893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:27.080166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:27.092132 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bf0ded96-1193-4830-89e0-c0fbf485f3c0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.289512 Oct 17 13:18:27.094363 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2995/5760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:27.303652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:27.304542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:27.311204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:27.316932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.317916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.318640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.319629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.320764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.321572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.407942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:27.422984 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cf4d4681-e87c-431a-878b-1451fc477369 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1394 microversion: 2.1 time: 0.663447 Oct 17 13:18:27.423613 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2766/5761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1394 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:27.506017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:27.507384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:27.516291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.516791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.517239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.517961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.518449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.518878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.523836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:27.532993 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1caa6b6b-a2d8-42fe-a284-bc377eeb822d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1672 microversion: 2.1 time: 0.234146 Oct 17 13:18:27.534253 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2996/5762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:27 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:27.757311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:27.770915 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a0f9ed6-b2c7-46fd-a575-a70b64ce8513 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1496 microversion: 2.1 time: 0.268878 Oct 17 13:18:27.787360 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2767/5763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:27 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1496 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:27.796203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:27.797004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:27.804459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.805282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.805884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.814964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.815707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.816333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.833422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:27.834407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:27.849094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.850621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.851257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.852198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.852811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.853425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.868527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lazy-loading 'flavor' on Instance uuid 5e8edfd5-201d-4c59-b87c-b9b987ac6996 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:27.882526 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Cannot 'suspend' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state suspended Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action HTTP/1.1 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 15 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: {"suspend": {}} Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: exception: Cannot 'suspend' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state suspended Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'suspend': {}}} Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 17 13:18:27.884494 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state suspended Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state suspended Oct 17 13:18:27.889046 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:27.891838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 409 to user: Cannot 'suspend' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state suspended {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:27.892918 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2c4f2d2-2558-43e6-bba3-8e08066405b0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 409 len: 148 microversion: 2.1 time: 0.101032 Oct 17 13:18:27.899873 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2997/5764] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:27 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 148 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:18:27.905200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:27.906067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:27.913213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.914208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.914897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.915809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.916473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.917094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.033024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9fa621cd-2fe2-4a70-b908-b8ed9f680fff tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 202 len: 0 microversion: 2.1 time: 0.128911 Oct 17 13:18:28.035957 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2998/5765] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:27 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:28.053248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:28.054646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:28.063619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.064497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.065244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.066240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.066949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.067604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.170744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:28.189998 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c47cb08e-3097-4250-b0d9-a0bc814d0f61 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.360814 Oct 17 13:18:28.191225 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2768/5766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:27 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:28.202426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:28.203355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:28.223007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.223765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.224436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.226389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.228779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.230057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.526408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:28.548128 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-abc83784-1259-4644-90f6-795e27bc7ddc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1502 microversion: 2.1 time: 0.502622 Oct 17 13:18:28.550929 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 2999/5767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:28 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1502 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:28.562436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:28.562657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:28.574196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.574724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.575878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.576762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.577918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.578430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.883389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:28.897695 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7cc0689a-6b9a-4808-8a81-2e964361aae7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1394 microversion: 2.1 time: 0.344702 Oct 17 13:18:28.901100 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3000/5768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:28 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1394 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:28.914926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:28.915790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:28.934235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.935355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.935963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.936871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.937537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.938228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.091597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:29.107355 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-39737d42-7861-4dfa-8398-28653723d117 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1604 microversion: 2.1 time: 0.203167 Oct 17 13:18:29.108016 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3001/5769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:28 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:29.222473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:29.232702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:29.249492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.250535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.251251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.252285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.255144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.256315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.551387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:29.575770 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dfc1542d-1bf5-4549-a40e-adeeffc219ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 1.382707 Oct 17 13:18:29.576501 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2769/5770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:28 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:29.588041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:29.597252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:29.610997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.611826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.612338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.613146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.613670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.614236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.889795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:29.907582 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b52a2f54-4f6f-474d-b7c4-e94c3497bba2 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.692035 Oct 17 13:18:29.908717 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3002/5771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:29 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:29.920376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2909b56a-5cdb-4a1f-b53e-0c8753dd49ff req-3126874f-a52a-444e-b087-c14a003a8d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1680b297-14d4-403d-a0bb-df4182310f76", "name": "network-vif-deleted", "tag": "98566b60-7da3-402f-9130-b85880173367"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:29.957914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2909b56a-5cdb-4a1f-b53e-0c8753dd49ff req-3126874f-a52a-444e-b087-c14a003a8d89 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.959208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2909b56a-5cdb-4a1f-b53e-0c8753dd49ff req-3126874f-a52a-444e-b087-c14a003a8d89 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.959890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2909b56a-5cdb-4a1f-b53e-0c8753dd49ff req-3126874f-a52a-444e-b087-c14a003a8d89 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.992499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2909b56a-5cdb-4a1f-b53e-0c8753dd49ff req-3126874f-a52a-444e-b087-c14a003a8d89 service nova] Creating event network-vif-deleted:98566b60-7da3-402f-9130-b85880173367 for instance 1680b297-14d4-403d-a0bb-df4182310f76 on n-h2-853316-12 Oct 17 13:18:30.001127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2909b56a-5cdb-4a1f-b53e-0c8753dd49ff req-3126874f-a52a-444e-b087-c14a003a8d89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090538 Oct 17 13:18:30.002590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3003/5772] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:30.018561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:30.019872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:30.042228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.043443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.043945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.044697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.045161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.045589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.214499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.231117 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eeaebe90-d468-4cf4-9465-96840c16c013 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1187 microversion: 2.1 time: 0.225081 Oct 17 13:18:30.246876 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3004/5773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:30 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1187 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:30.263753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:30.265213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:30.275952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.276974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.277888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.279313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.280278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.281302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.398481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.422299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.425356 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1eec353d-d4b1-47e5-baa0-dfcc2d275948 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1502 microversion: 2.1 time: 0.843675 Oct 17 13:18:30.426670 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2770/5774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:29 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1502 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:30.433672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a0a11cfd-de90-4fad-9fb6-bfb2aa76132d tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1604 microversion: 2.1 time: 0.184788 Oct 17 13:18:30.465650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3005/5775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:30 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:30.618474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:30.619220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:30.638282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.645373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.646567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.648212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.649287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.651756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.954434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:30.955413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:30.976279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.976850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.977508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.987124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.987948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.988618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.317279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:31.333589 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e9c1eca2-a5b3-4f35-8e55-ac04283fd782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.385762 Oct 17 13:18:31.346913 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3006/5776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:30 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:31.366812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:31.367443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:31.387131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.387619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.388564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.389307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.389780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.390232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.653097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:31.704549 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e9504d9f-99e6-4b26-8a02-744d7789def2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1187 microversion: 2.1 time: 0.350861 Oct 17 13:18:31.707324 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3007/5777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:31 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1187 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:31.725154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:31.728669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:31.764294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.766345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.769726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.770993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.772552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.774856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.926134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:31.943940 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b69581da-1fb2-4973-b394-a148824994d8 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 1.329348 Oct 17 13:18:31.948106 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2771/5778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:30 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:31.963233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:31.966539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:31.992092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.992945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.993690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.997165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.001479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.004109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.401581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:32.438126 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aa7cd978-9b22-47b4-8782-8fc6b2f16edc tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1502 microversion: 2.1 time: 0.727095 Oct 17 13:18:32.455755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3008/5779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:31 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1502 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:32.469615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d220735e-c137-4fd6-927e-243035445e6c req-e444e309-8f8d-41ca-99d9-03d9224900fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ea9158-6f53-4f79-8a42-69ca056124ac", "name": "network-vif-deleted", "tag": "3f447a1b-a6f0-4c0d-967b-1866173aaba8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:32.496551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d220735e-c137-4fd6-927e-243035445e6c req-e444e309-8f8d-41ca-99d9-03d9224900fd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.497819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d220735e-c137-4fd6-927e-243035445e6c req-e444e309-8f8d-41ca-99d9-03d9224900fd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.498088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c71ac2b898f649cdaa99fbace633e738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea124fdbff4df4b04a2e969871d8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:32.499151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d220735e-c137-4fd6-927e-243035445e6c req-e444e309-8f8d-41ca-99d9-03d9224900fd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.528038 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d220735e-c137-4fd6-927e-243035445e6c req-e444e309-8f8d-41ca-99d9-03d9224900fd service nova] Creating event network-vif-deleted:3f447a1b-a6f0-4c0d-967b-1866173aaba8 for instance 66ea9158-6f53-4f79-8a42-69ca056124ac on n-h1-853316-12 Oct 17 13:18:32.534790 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e7e0f9b-5787-49b5-82b0-e7179cdcf34c tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 200 len: 1321 microversion: 2.1 time: 0.584726 Oct 17 13:18:32.538880 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2772/5780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:31 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:32.542493 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d220735e-c137-4fd6-927e-243035445e6c req-e444e309-8f8d-41ca-99d9-03d9224900fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080343 Oct 17 13:18:32.543955 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3009/5781] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:32.589449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:32.591810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:32.627761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.638436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.640896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.646505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.649291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.653737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.749738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:32.758949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:32.844948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.845832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.846650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.862209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.880199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.884121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.148566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:33.165614 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c705728-9819-458b-a18b-5a2e8a189f33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1692 microversion: 2.1 time: 0.621027 Oct 17 13:18:33.167172 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2773/5782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:32 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1692 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:33.175671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:33.177437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:33.194367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:33.197097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.197900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.205202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.214202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.215710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.216957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.270545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:33.297323 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-849f66a5-507d-4858-be84-6889bf95f1da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1187 microversion: 2.1 time: 0.559658 Oct 17 13:18:33.314255 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3010/5783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:32 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1187 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:33.522015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:33.528457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:33.556903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.558367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.563101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.566094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.569001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.573091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.746091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:33.803672 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe29cd29-99d7-4ea1-bf4b-95592c60724f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.632710 Oct 17 13:18:33.849163 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2774/5784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:33 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:33.875160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:33.877154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] [instance: 66ea9158-6f53-4f79-8a42-69ca056124ac] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:33.925202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.933500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.934612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.937597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.941306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.943972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.009478 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] HTTP exception thrown: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac could not be found. Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Request method failure captured: Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac HTTP/1.1 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVO0glWGLbeBqFYHnI47AkOOv9610GlPB_7XgGni0zy7AQddwFoAeqWQTUaxobD_wa1PiGslzsTtDShlB0fiZHCOQFavnW9yvVr9qLSJZ7jJjhqpvX_ASedHoa_DgK6owv82ZjkbTnFuMc4KqAmgS7gt2C8qTqQ9zmXe2bLIJ8wj_R8 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2ea124fdbff4df4b04a2e969871d8b4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2ea124fdbff4df4b04a2e969871d8b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c2ea124fdbff4df4b04a2e969871d8b4 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776921852 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: c71ac2b898f649cdaa99fbace633e738 Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1776921852-project Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac could not be found. Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '66ea9158-6f53-4f79-8a42-69ca056124ac'} Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac could not be found. Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac could not be found. Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:34.013616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:34.018351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:34.018351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:34.018351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:34.018351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:34.018351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:34.018351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac could not be found. Oct 17 13:18:34.018351 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:34.018351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Returning 404 to user: Instance 66ea9158-6f53-4f79-8a42-69ca056124ac could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:34.021750 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-39bc8f42-e2ee-47e0-bb79-d5a9eba12fe4 tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac" status: 404 len: 111 microversion: 2.1 time: 0.169571 Oct 17 13:18:34.026623 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2775/5785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:33 2022] GET /compute/v2.1/servers/66ea9158-6f53-4f79-8a42-69ca056124ac => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:34.055612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1dfd9d3-6c11-4e63-825e-629325ba40ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] Calling method '.version_select at 0x7fa820f26ca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:34.117667 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c1dfd9d3-6c11-4e63-825e-629325ba40ee tempest-ServerActionsTestJSON-1776921852 tempest-ServerActionsTestJSON-1776921852-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2609902" status: 202 len: 0 microversion: 2.1 time: 0.086109 Oct 17 13:18:34.121565 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2776/5786] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 17 13:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2609902 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:34.124193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:34.155596 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fed999b8-f124-43af-82aa-5608d3fa9ef3 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.651739 Oct 17 13:18:34.157910 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3011/5787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:33 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:34.198575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:34.199936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:34.218106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:34.219203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:34.225632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.226719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.227405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.230473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.231665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.232716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.237700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.239973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.240608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.244745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.245258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.245716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.358909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:34.758499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:34.833119 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cbf1c691-054f-4ea4-a9d3-7b820ae757a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1682 microversion: 2.1 time: 0.618697 Oct 17 13:18:34.838255 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3012/5788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:34 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1682 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:34.854150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:34.855451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:34.870976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.871794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.872458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.873204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.874011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.874144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.883721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:34.907866 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e8e77fa3-0a80-4f0f-b275-1f35b75054ba tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.713235 Oct 17 13:18:34.913110 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2777/5789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:34 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:34.920081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:34.920935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:34.928375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.929104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.929734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.930669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.931286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.931879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.977284 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:18:34.977656 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:18:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 (ip 10.222.0.27) !!! Oct 17 13:18:35.128656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:35.151101 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c3028c1a-64ee-4e5a-82a5-277d28f36c4f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1187 microversion: 2.1 time: 0.311615 Oct 17 13:18:35.160491 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3013/5790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:34 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1187 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:35.183458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:35.185866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:35.201150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.205860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.206637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.207733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.208563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.211366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.312615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:35.358736 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-964c11f6-2dde-4fd6-8f38-16d21aeb4922 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.440817 Oct 17 13:18:35.370276 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2778/5791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:34 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:35.386129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-768fea45-a6f8-4c87-97c5-0d20910ce639 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:35.388418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-768fea45-a6f8-4c87-97c5-0d20910ce639 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 195e4329-2b6a-463a-8f35-0d1a072b514c] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:35.409878 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-768fea45-a6f8-4c87-97c5-0d20910ce639 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 195e4329-2b6a-463a-8f35-0d1a072b514c could not be found. Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-768fea45-a6f8-4c87-97c5-0d20910ce639 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/195e4329-2b6a-463a-8f35-0d1a072b514c/action HTTP/1.1 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 15 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: {"unpause": {}} Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 195e4329-2b6a-463a-8f35-0d1a072b514c could not be found. Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '195e4329-2b6a-463a-8f35-0d1a072b514c', 'body': {'unpause': {}}} Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195e4329-2b6a-463a-8f35-0d1a072b514c could not be found. Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195e4329-2b6a-463a-8f35-0d1a072b514c could not be found. Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:35.420428 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:35.432635 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:35.432635 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:35.432635 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195e4329-2b6a-463a-8f35-0d1a072b514c could not be found. Oct 17 13:18:35.432635 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:35.432635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-768fea45-a6f8-4c87-97c5-0d20910ce639 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 195e4329-2b6a-463a-8f35-0d1a072b514c could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:35.432635 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-768fea45-a6f8-4c87-97c5-0d20910ce639 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/195e4329-2b6a-463a-8f35-0d1a072b514c/action" status: 404 len: 111 microversion: 2.1 time: 0.061027 Oct 17 13:18:35.438254 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2779/5792] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:35 2022] POST /compute/v2.1/servers/195e4329-2b6a-463a-8f35-0d1a072b514c/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:35.460429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:35.460975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:35.473773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.475191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.475577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.476605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.477173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.477622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.708252 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-789550d5-1b80-48ad-9d76-840a4303cfc0 tempest-TestNetworkAdvancedServerOps-2025312015 tempest-TestNetworkAdvancedServerOps-2025312015-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1835 microversion: 2.1 time: 0.544890 Oct 17 13:18:35.709720 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3014/5793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:35 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1835 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:35.763207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:35.765421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:35.784980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.789291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.790344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.792014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.796013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.797217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.859217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:35.876928 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35d6d03a-106a-4fe7-99d0-27b3bfbb2c2b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.434769 Oct 17 13:18:35.893464 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2780/5794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:35 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:35.936730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:35.950823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:35.970624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.972005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.972005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.975503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.985889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.987269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.327555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:36.335919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:36.337157 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca2633ed-922a-41e9-8938-4898f4a9bd33 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1682 microversion: 2.1 time: 0.589959 Oct 17 13:18:36.350577 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3015/5795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:35 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1682 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:36.350577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:36.350577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:36.369492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.370016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.370656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.371389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.371851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.372286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.373119 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-31c55caf-dd5f-4300-9103-a70060f612a4 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.446674 Oct 17 13:18:36.374618 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2781/5796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:35 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:36.400592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:36.402669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:36.409237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.409831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.410409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.411608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.413168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.413821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.576829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:36.585785 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20bb213a-f466-48ec-87f5-4d6d9a138add tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1187 microversion: 2.1 time: 0.244539 Oct 17 13:18:36.606721 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3016/5797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:36 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1187 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:36.623474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:36.624272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:36.641568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.642679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.647317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.648559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.649204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.650341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.697111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Cannot 'unpause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action HTTP/1.1 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 15 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: {"unpause": {}} Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: exception: Cannot 'unpause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'unpause': {}}} Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 in vm_state active. Cannot unpause while the instance is in this state. Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:36.705449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:36.710215 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:36.710215 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:36.710215 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:36.710215 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:18:36.710215 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.714643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 409 to user: Cannot 'unpause' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:36.714872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:36.718467 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65721ed0-cdfb-43a1-b7f5-61abb3c89cf7 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 409 len: 145 microversion: 2.1 time: 0.110257 Oct 17 13:18:36.719736 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3017/5798] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:36 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 145 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:18:36.731772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:36.739975 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-87f86b97-7640-40bc-8b57-4010a0667ec5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.353555 Oct 17 13:18:36.740866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:36.749580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.750484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.751140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.752052 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2782/5799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:36 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:36.752362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.758367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.759216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.767028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:36.769634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:36.778836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.779326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.779768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.781439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.781439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.781439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.908915 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a35710b3-7520-476c-bf5d-d6823fd27d7a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb/action" status: 200 len: 38649 microversion: 2.1 time: 0.186576 Oct 17 13:18:36.912216 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3018/5800] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:36 2022] POST /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb/action => generated 38649 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:18:37.235696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:37.268026 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-987c4b11-f933-4b32-a734-55e3593e24c8 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.514513 Oct 17 13:18:37.268900 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2783/5801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:36 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:37.297041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.298005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.307246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.308533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.309627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.310951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.311943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.312611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.624176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.624850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.634377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.634883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.635331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.641409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.642107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.642902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.870612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:37.884159 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a3c7109-eb86-4aa5-b46b-fe2cf776b44e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1187 microversion: 2.1 time: 0.264322 Oct 17 13:18:37.900851 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2784/5802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:37 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1187 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:37.910002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.921408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.928802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.929301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.930203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.930754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.931232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.931664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:38.410409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:38.420657 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce10b550-6535-4f0a-99b9-b0aba9128753 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 1.128040 Oct 17 13:18:38.424389 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3019/5803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:37 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:38.445191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:38.452085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54f05401-b781-4d7c-bced-876fc5106739 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:38.452681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-54f05401-b781-4d7c-bced-876fc5106739 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 19386953-c40d-4ab3-886f-32e29be68199] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:38.466193 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-54f05401-b781-4d7c-bced-876fc5106739 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 19386953-c40d-4ab3-886f-32e29be68199 could not be found. Oct 17 13:18:38.481849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54f05401-b781-4d7c-bced-876fc5106739 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/19386953-c40d-4ab3-886f-32e29be68199/action HTTP/1.1 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 18 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: {"unshelve": null} Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 19386953-c40d-4ab3-886f-32e29be68199 could not be found. Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '19386953-c40d-4ab3-886f-32e29be68199', 'body': {'unshelve': None}} Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19386953-c40d-4ab3-886f-32e29be68199 could not be found. Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19386953-c40d-4ab3-886f-32e29be68199 could not be found. Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:38.490950 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19386953-c40d-4ab3-886f-32e29be68199 could not be found. Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-54f05401-b781-4d7c-bced-876fc5106739 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 19386953-c40d-4ab3-886f-32e29be68199 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-54f05401-b781-4d7c-bced-876fc5106739 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/19386953-c40d-4ab3-886f-32e29be68199/action" status: 404 len: 111 microversion: 2.1 time: 0.045056 Oct 17 13:18:38.501772 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3020/5804] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:38 2022] POST /compute/v2.1/servers/19386953-c40d-4ab3-886f-32e29be68199/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:38.507863 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-642f2f77-bc75-48b3-8188-1f36f936afee tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.605812 Oct 17 13:18:38.510335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:38.511113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:38.529686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:38.535686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:38.539892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:38.542124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:38.542863 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2785/5805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:37 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:38.546078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:38.548870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:38.908470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:38.910753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:38.937959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:38.938643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:38.939392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:38.940711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:38.941455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:38.942109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.126200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:39.144306 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4d22c20-e2d9-4c22-ab81-85ea5f44a3a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1187 microversion: 2.1 time: 0.237209 Oct 17 13:18:39.148540 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2786/5806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:38 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1187 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:39.464788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:39.481140 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c18bc92-0084-4cbf-8e8d-b1af0d4cdc1d tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.980012 Oct 17 13:18:39.484090 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3021/5807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:38 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:39.515245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:39.522588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:39.555254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:39.558678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:39.563189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.565532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.573711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.576769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.583821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.589269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.596350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.600426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.604201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.608444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.609789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.612216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.975737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:39.986050 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc127536-4209-4bdb-9372-f2c882cb0b9d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1523 microversion: 2.1 time: 0.438484 Oct 17 13:18:39.987285 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3022/5808] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:39 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:40.173736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:40.177813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:40.199845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.200384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.206473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.207405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.208789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.212837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.345396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:40.355161 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69faf5d2-75d7-433b-9341-9b79b6c4dba6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1187 microversion: 2.1 time: 0.185467 Oct 17 13:18:40.368688 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3023/5809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:40 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1187 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:40.408192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:40.409014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:40.417263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.418616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.419273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.420288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.421258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.421910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.493076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:40.675164 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60674240-714f-464e-aedc-47862e3d45e8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 204 len: 0 microversion: 2.1 time: 0.298534 Oct 17 13:18:40.677947 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3024/5810] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:40 2022] DELETE /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:40.699450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5c4eb39d-2571-4384-a3ad-06b0f5a3a774 req-58477439-1146-442d-b021-df3c929d909b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a73c36f-0f0a-454b-8a98-de7cdca642cb", "tag": "601c5043-9cee-42c7-8136-f10fb526fa82"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:40.716309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c4eb39d-2571-4384-a3ad-06b0f5a3a774 req-58477439-1146-442d-b021-df3c929d909b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.717196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c4eb39d-2571-4384-a3ad-06b0f5a3a774 req-58477439-1146-442d-b021-df3c929d909b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.717879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5c4eb39d-2571-4384-a3ad-06b0f5a3a774 req-58477439-1146-442d-b021-df3c929d909b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.743569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5c4eb39d-2571-4384-a3ad-06b0f5a3a774 req-58477439-1146-442d-b021-df3c929d909b service nova] Creating event network-changed:601c5043-9cee-42c7-8136-f10fb526fa82 for instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb on n-h1-853316-12 Oct 17 13:18:40.765363 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5c4eb39d-2571-4384-a3ad-06b0f5a3a774 req-58477439-1146-442d-b021-df3c929d909b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082161 Oct 17 13:18:40.770245 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3025/5811] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:40.791383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:40.795274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:40.798608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:40.815940 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9fa3183e-7aa5-4aee-894d-4e18ba72f595 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 1.307953 Oct 17 13:18:40.819653 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2787/5812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:39 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:40.822830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.832770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.833619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.835230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.836060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.838873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.847012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:40.853866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:40.875815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.876619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.877253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.878291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.879509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.880154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.961347 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Cannot 'unshelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action HTTP/1.1 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 18 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: {"unshelve": null} Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: exception: Cannot 'unshelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'unshelve': None}} Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 in vm_state active. Cannot unshelve while the instance is in this state. Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:18:40.964789 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active Oct 17 13:18:40.969876 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:40.973866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 409 to user: Cannot 'unshelve' instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 while it is in vm_state active {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:40.975385 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b6b2492-7e53-4052-98be-7f3b77072748 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action" status: 409 len: 146 microversion: 2.1 time: 0.135632 Oct 17 13:18:40.976914 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2788/5813] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:40 2022] POST /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996/action => generated 146 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:18:40.989317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:40.994141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:41.010627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.011845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.012590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.013505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.014136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.017266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.094031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:41.105800 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9acf16fc-5b56-4d6d-8fc8-25fd1d805d6d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1688 microversion: 2.1 time: 0.333520 Oct 17 13:18:41.110092 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3026/5814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:40 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1688 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:41.118656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:41.119347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:41.145941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.147266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.147826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.149244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.149724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.154363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.392681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:41.405117 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e0d4226f-0025-41d9-8c79-687efcba4142 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.423857 Oct 17 13:18:41.406608 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2789/5815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:40 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:41.420251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:41.422348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:41.436739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.441382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.442210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.443823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.444551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.445235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.526070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.526972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.527631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.528348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lazy-loading 'fault' on Instance uuid 1680b297-14d4-403d-a0bb-df4182310f76 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:41.616262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:41.639732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51cb4ad6-30b5-4daf-820e-58716427d2ad tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1505 microversion: 2.1 time: 0.521842 Oct 17 13:18:41.654229 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3027/5816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:41 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:41.654229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:41.654229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:41.674358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.675436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.676089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.679587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.680748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.681688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.687514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:41.696810 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ccb9c88e-cf1c-4de2-a0fb-74e8846a0895 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 200 len: 1146 microversion: 2.1 time: 0.288858 Oct 17 13:18:41.710629 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2790/5817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:41 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 1146 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:41.984741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:41.999744 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18557fba-a166-4a25-8a88-cded67a76b00 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.357266 Oct 17 13:18:42.010518 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3028/5818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:41 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:42.037305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-47c5dec2-4c9d-4fb7-8ee9-5a99dbf49641 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-156545831_updated"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:42.043558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-47c5dec2-4c9d-4fb7-8ee9-5a99dbf49641 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 756a4034-38ca-484a-969b-6a644589255a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:42.057135 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-47c5dec2-4c9d-4fb7-8ee9-5a99dbf49641 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 756a4034-38ca-484a-969b-6a644589255a could not be found. Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-47c5dec2-4c9d-4fb7-8ee9-5a99dbf49641 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: request: PUT /compute/v2.1/servers/756a4034-38ca-484a-969b-6a644589255a HTTP/1.1 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 80 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-156545831_updated"}} Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 756a4034-38ca-484a-969b-6a644589255a could not be found. Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '756a4034-38ca-484a-969b-6a644589255a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-156545831_updated'}}} Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756a4034-38ca-484a-969b-6a644589255a could not be found. Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 17 13:18:42.060448 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756a4034-38ca-484a-969b-6a644589255a could not be found. Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756a4034-38ca-484a-969b-6a644589255a could not be found. Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-47c5dec2-4c9d-4fb7-8ee9-5a99dbf49641 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 756a4034-38ca-484a-969b-6a644589255a could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-47c5dec2-4c9d-4fb7-8ee9-5a99dbf49641 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "PUT /compute/v2.1/servers/756a4034-38ca-484a-969b-6a644589255a" status: 404 len: 111 microversion: 2.1 time: 0.035216 Oct 17 13:18:42.074715 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2791/5819] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:18:42 2022] PUT /compute/v2.1/servers/756a4034-38ca-484a-969b-6a644589255a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:42.080518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:42.080518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:42.089987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.092427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.092427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.092780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.093066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.093505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.138934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:42.139559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:42.159124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.159124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.159599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.160284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.160751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.161279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.350853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:42.376209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:42.395324 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e077fd0c-f69b-48a0-8de6-9f356c122ce6 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.321948 Oct 17 13:18:42.396777 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3029/5820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:42 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:42.423953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:42.424720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:42.433141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.433806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.434401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.435281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.435853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.436394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.762106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:42.780408 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-14608b34-44c2-4310-bbe3-105877d7083a tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.356553 Oct 17 13:18:42.783151 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3030/5821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:42 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:42.793122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:42.795476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:42.818742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.839490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.841114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.843173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.844347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.845388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.217646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:43.276432 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c98d40c-04cd-4833-8e46-87d283bec1a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1505 microversion: 2.1 time: 0.491416 Oct 17 13:18:43.277527 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3031/5822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:42 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:43.343126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:43.358110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1680b297-14d4-403d-a0bb-df4182310f76] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:43.403458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.404361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.405161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.411535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.412809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.416996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.506753 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 1680b297-14d4-403d-a0bb-df4182310f76 could not be found. Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 HTTP/1.1 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1680b297-14d4-403d-a0bb-df4182310f76 could not be found. Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1680b297-14d4-403d-a0bb-df4182310f76'} Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1680b297-14d4-403d-a0bb-df4182310f76 could not be found. Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1680b297-14d4-403d-a0bb-df4182310f76 could not be found. Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:43.509951 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.513797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.513797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:43.513797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:43.513797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:43.513797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:43.513797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1680b297-14d4-403d-a0bb-df4182310f76 could not be found. Oct 17 13:18:43.513797 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.513797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 1680b297-14d4-403d-a0bb-df4182310f76 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:43.527038 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff8b33a2-eb2e-4745-8c22-5e9da6acb965 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76" status: 404 len: 111 microversion: 2.1 time: 0.205897 Oct 17 13:18:43.528158 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3032/5823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:43 2022] GET /compute/v2.1/servers/1680b297-14d4-403d-a0bb-df4182310f76 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:43.581465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16cd3f5f-ba93-4a2d-a984-95d604499b3e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16cd3f5f-ba93-4a2d-a984-95d604499b3e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: request: PUT /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 HTTP/1.1 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 280 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.672636 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:18:43.675869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.685234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16cd3f5f-ba93-4a2d-a984-95d604499b3e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:43.708797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16cd3f5f-ba93-4a2d-a984-95d604499b3e tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "PUT /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 400 len: 619 microversion: 2.1 time: 0.163315 Oct 17 13:18:43.722648 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3033/5824] 10.222.0.27 () {60 vars in 1257 bytes} [Mon Oct 17 13:18:43 2022] PUT /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 619 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:18:43.743070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:43.744956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:43.774731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.776936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.778246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.784162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.785256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.786680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.050607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:44.112799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d2ef84a-704f-4deb-b6f0-ddbc0d7cdedb tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1688 microversion: 2.1 time: 1.976713 Oct 17 13:18:44.115441 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2792/5825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:42 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1688 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:44.192335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-0df4ddb2-cf98-45f1-bebe-493becb7f401 req-b68ea08e-2c1e-489d-a165-395037694f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c84769-498d-4e0b-9cdd-f9569b58f1f8", "name": "network-vif-unplugged", "status": "completed", "tag": "e1736ccb-979b-4c83-b032-f7f4926f64b5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:44.257976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0df4ddb2-cf98-45f1-bebe-493becb7f401 req-b68ea08e-2c1e-489d-a165-395037694f68 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.259509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0df4ddb2-cf98-45f1-bebe-493becb7f401 req-b68ea08e-2c1e-489d-a165-395037694f68 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.263991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0df4ddb2-cf98-45f1-bebe-493becb7f401 req-b68ea08e-2c1e-489d-a165-395037694f68 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.351425 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-0df4ddb2-cf98-45f1-bebe-493becb7f401 req-b68ea08e-2c1e-489d-a165-395037694f68 service nova] Creating event network-vif-unplugged:e1736ccb-979b-4c83-b032-f7f4926f64b5 for instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 on n-h1-853316-12 Oct 17 13:18:44.365765 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-0df4ddb2-cf98-45f1-bebe-493becb7f401 req-b68ea08e-2c1e-489d-a165-395037694f68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181239 Oct 17 13:18:44.371629 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2793/5826] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:44.390017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:44.413047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:44.422097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:44.458365 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6d763fb-80f6-478b-9f35-6bd826808902 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.728820 Oct 17 13:18:44.463981 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3034/5827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:43 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:44.468544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.473458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.476049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.482291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.483499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.484196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.500045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:44.500923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:44.517169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.520875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.521603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.522708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.523448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.524911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.165134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:45.183515 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0214f9df-5821-462f-86c8-0dd597020e18 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.687515 Oct 17 13:18:45.190320 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3035/5828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:44 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:45.205783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a29ae431-f87a-4c30-bf5d-e1db26bad331 req-bed7dd3f-293a-4180-9389-8937007413d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a73c36f-0f0a-454b-8a98-de7cdca642cb", "name": "network-vif-deleted", "tag": "601c5043-9cee-42c7-8136-f10fb526fa82"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:45.231648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a29ae431-f87a-4c30-bf5d-e1db26bad331 req-bed7dd3f-293a-4180-9389-8937007413d5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.232960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a29ae431-f87a-4c30-bf5d-e1db26bad331 req-bed7dd3f-293a-4180-9389-8937007413d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.233783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a29ae431-f87a-4c30-bf5d-e1db26bad331 req-bed7dd3f-293a-4180-9389-8937007413d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.267607 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a29ae431-f87a-4c30-bf5d-e1db26bad331 req-bed7dd3f-293a-4180-9389-8937007413d5 service nova] Creating event network-vif-deleted:601c5043-9cee-42c7-8136-f10fb526fa82 for instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb on n-h1-853316-12 Oct 17 13:18:45.307319 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a29ae431-f87a-4c30-bf5d-e1db26bad331 req-bed7dd3f-293a-4180-9389-8937007413d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110854 Oct 17 13:18:45.309015 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3036/5829] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:45.320779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:45.334418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:45.360306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.362107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.367097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.368215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.368992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.369744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.442073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:45.452359 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2bb1f226-9b5e-45f6-9959-cf44f8abe87a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1505 microversion: 2.1 time: 1.079068 Oct 17 13:18:45.453238 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2794/5830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:44 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1505 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:45.460055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7a1092fd-efaa-4918-bb61-eeb93511425b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7a1092fd-efaa-4918-bb61-eeb93511425b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: request: PUT /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 HTTP/1.1 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 24 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": ""}} Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996', 'body': {'server': {'name': ''}}} Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi '' Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:18:45.464918 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:18:45.469884 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.471551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7a1092fd-efaa-4918-bb61-eeb93511425b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:45.472423 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7a1092fd-efaa-4918-bb61-eeb93511425b tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "PUT /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 400 len: 108 microversion: 2.1 time: 0.017955 Oct 17 13:18:45.473010 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2795/5831] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:18:45 2022] PUT /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:18:45.475648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.482366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.483107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.483937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lazy-loading 'fault' on Instance uuid 8a73c36f-0f0a-454b-8a98-de7cdca642cb {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:45.493164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:45.494065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:45.512928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.513419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.513867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.531143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.532459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.533122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.604108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:45.613853 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5ef6e75a-5b31-457a-81dc-7aa15e1437ff tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1507 microversion: 2.1 time: 0.302869 Oct 17 13:18:45.615714 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3037/5832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:45 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:45.762280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:45.773562 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c2b0ca86-5db2-4013-9516-5162c71d4112 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1505 microversion: 2.1 time: 0.289468 Oct 17 13:18:45.775215 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2796/5833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:45 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:46.489660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:46.491134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:46.504248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:46.504745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:46.505198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:46.505999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:46.509733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:46.510409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:46.641553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:46.643308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:46.652574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:46.653426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:46.661257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:46.663119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:46.663794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:46.664411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:46.755197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:46.756546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:46.757313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:46.758610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lazy-loading 'fault' on Instance uuid 8a73c36f-0f0a-454b-8a98-de7cdca642cb {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:46.881557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:46.919980 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e03bac30-aa1b-48e9-b575-7c8254dd1473 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1505 microversion: 2.1 time: 0.434289 Oct 17 13:18:46.925689 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3038/5834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:46 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:47.109018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:47.121094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9889a61-e8d3-41b1-ab59-a86019f8e0ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 200 len: 1507 microversion: 2.1 time: 0.481410 Oct 17 13:18:47.134494 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2797/5835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:46 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:47.984300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:47.985951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:48.002395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:48.003542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:48.004473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:48.006138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:48.007032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:48.007874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:48.157901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:48.159447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 8a73c36f-0f0a-454b-8a98-de7cdca642cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:48.174321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:48.175001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:48.175572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:48.176561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:48.177159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:48.177980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:48.206065 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] HTTP exception thrown: Instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb could not be found. Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Request method failure captured: Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb HTTP/1.1 Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVO8wsZSqmfW49vI1THHOfwL_5j3vM2FktN7RpHbtgow7aDmUW4Pv3BVI8Oy7tO9oSfFgC6rTSlxAHfrY-eM07pY0Umu71X2M6X4Ue9KgT0Ml48iFOxFgBMPMdHbsgVJGlEaT3gitl9BY6UXQ9cLmroOJW8AWk3NApwUBQgRlOKon1A Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: e5d16284093341d980341f1dce38f68b Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5d16284093341d980341f1dce38f68b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5d16284093341d980341f1dce38f68b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5d16284093341d980341f1dce38f68b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5d16284093341d980341f1dce38f68b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: e5d16284093341d980341f1dce38f68b Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkAdvancedServerOps-497241743-project Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 0cee3a8479444aa3a00b2c29407931d9 Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-497241743-project Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb could not be found. Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8a73c36f-0f0a-454b-8a98-de7cdca642cb'} Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb could not be found. Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb could not be found. Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:48.209081 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:48.213253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:48.213253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:48.213253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:48.213253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:48.213253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:48.213253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:48.213253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb could not be found. Oct 17 13:18:48.213253 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:18:48.218098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Returning 404 to user: Instance 8a73c36f-0f0a-454b-8a98-de7cdca642cb could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:48.219622 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6f510a9f-59d3-49f8-83c4-7fc9e4714cd5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb" status: 404 len: 111 microversion: 2.1 time: 0.066537 Oct 17 13:18:48.220771 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2798/5836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:48 2022] GET /compute/v2.1/servers/8a73c36f-0f0a-454b-8a98-de7cdca642cb => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:18:48.511137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:48.522722 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d90e15c-399a-4001-832f-7f209e126a23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 200 len: 1448 microversion: 2.1 time: 0.545384 Oct 17 13:18:48.523319 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3039/5837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:47 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 1448 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:48.548673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:48.549757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:48.564061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:48.564569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:48.565026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:48.565743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:48.566223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:48.575259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:48.711479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:48.737164 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Working on deleting snapshot 834b528d-f60a-4fce-bc79-f515cec16f61 from shelved instance... Oct 17 13:18:50.169316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Doing local delete in cell 77ecd0a0-9d66-4c67-8ba1-a094c627ce98(cell1) {{(pid=127539) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 17 13:18:50.171124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:50.171983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:50.172648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:50.173448 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 17 13:18:50.179666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] deallocate_for_instance() {{(pid=127539) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 17 13:18:53.561058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Updating instance_info_cache with network_info: [] {{(pid=127539) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:18:53.670521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-63a4a3ef-5df3-4070-a8ba-6d8ff255bd8c req-dced8641-25da-4ce3-bf7f-5c0f709c63e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c84769-498d-4e0b-9cdd-f9569b58f1f8", "name": "network-vif-deleted", "tag": "e1736ccb-979b-4c83-b032-f7f4926f64b5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:53.733190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-63a4a3ef-5df3-4070-a8ba-6d8ff255bd8c req-dced8641-25da-4ce3-bf7f-5c0f709c63e2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:53.737139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-63a4a3ef-5df3-4070-a8ba-6d8ff255bd8c req-dced8641-25da-4ce3-bf7f-5c0f709c63e2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:53.738004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-63a4a3ef-5df3-4070-a8ba-6d8ff255bd8c req-dced8641-25da-4ce3-bf7f-5c0f709c63e2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:53.805467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.server_external_events [req-63a4a3ef-5df3-4070-a8ba-6d8ff255bd8c req-dced8641-25da-4ce3-bf7f-5c0f709c63e2 service nova] Unable to find a host for instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8. Dropping event network-vif-deleted {{(pid=127540) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:18:53.806603 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-63a4a3ef-5df3-4070-a8ba-6d8ff255bd8c req-dced8641-25da-4ce3-bf7f-5c0f709c63e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.175039 Oct 17 13:18:53.813852 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3040/5838] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 184 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 13:18:53.967060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=14,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:53.982429 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55af230e-9c47-4072-84bb-9adb8eb75fa6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 204 len: 0 microversion: 2.1 time: 5.436852 Oct 17 13:18:53.983050 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2799/5839] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:48 2022] DELETE /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 0 bytes in 5439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:53.998079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:53.999422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:54.015851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:54.019757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:54.029313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:54.031202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:54.032778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:54.034054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:54.085773 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 HTTP/1.1 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '71c84769-498d-4e0b-9cdd-f9569b58f1f8'} Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:54.092188 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:54.097423 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:54.097423 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:54.097423 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:54.097423 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:54.097423 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:54.097423 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:18:54.097423 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:54.103311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:54.109809 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9064ccf-e26a-42f5-a9ce-812c0a569425 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 404 len: 111 microversion: 2.1 time: 0.114545 Oct 17 13:18:54.114590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3041/5840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:53 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:54.385892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-262255275", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e6961d90-c691-4862-9018-60bca57213f2"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:54.555575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] validate_networks() for [('e6961d90-c691-4862-9018-60bca57213f2', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:18:56.624914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:56.626660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:56.692139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.693111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.694083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.704364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.705569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.706323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.776230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:18:56.776769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:18:56.777423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:18:56.778096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:18:56.778942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:18:56.797737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af HTTP/1.1 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1e1f8fb2-8451-4008-8dd8-80246250c2af'} Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:56.804066 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.808120 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.814102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:56.816472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.817019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.817478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.818430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.819279 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dea9f357-e0fc-42cd-a29f-a4f47819f16f tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 404 len: 111 microversion: 2.1 time: 0.205791 Oct 17 13:18:56.822108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.822733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.822997 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3042/5841] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:56 2022] DELETE /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:56.844558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:56.845537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 1e1f8fb2-8451-4008-8dd8-80246250c2af] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:56.858654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:56.861344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.865262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.866958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.869794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.874662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.875773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:18:56.877001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.894661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for user 24c6068b196d4cc398176b22196bd5b1 and project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:18:56.928894 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af HTTP/1.1 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1e1f8fb2-8451-4008-8dd8-80246250c2af'} Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:56.930583 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.937434 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:56.937434 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:56.937434 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:56.937434 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:56.937434 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:56.937434 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. Oct 17 13:18:56.937434 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.937434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 1e1f8fb2-8451-4008-8dd8-80246250c2af could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:56.939699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:18:56.939864 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-961c55d4-bede-4918-90e3-25117b1a9990 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af" status: 404 len: 111 microversion: 2.1 time: 0.099088 Oct 17 13:18:56.940105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:18:56.940259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3043/5842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:56 2022] GET /compute/v2.1/servers/1e1f8fb2-8451-4008-8dd8-80246250c2af => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:56.957968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:56.963361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:56.984609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.989502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.993828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.998291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.999889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:57.002821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:57.070571 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5afd702d-0887-4533-af8e-456f8b36f97e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.688452 Oct 17 13:18:57.106657 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2800/5843] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:18:57.115822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a0763d2b-05c0-4a61-a89a-9a332cbf6756 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:57.116550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a0763d2b-05c0-4a61-a89a-9a332cbf6756 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:57.154705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:57.614523 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2dc645c1-85ec-4e5a-8eed-0161d4e9e8d1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 204 len: 0 microversion: 2.1 time: 0.669250 Oct 17 13:18:57.625409 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3044/5844] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:56 2022] DELETE /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:57.664513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:57.665733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:57.695693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:57.696570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:57.697365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:57.698699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:57.714710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:57.715547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:58.183984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:58.202673 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a492dd6d-5e89-4ed4-bb1f-164eb730fae5 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 0.573612 Oct 17 13:18:58.205983 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3045/5845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:57 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:58.287751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0763d2b-05c0-4a61-a89a-9a332cbf6756 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:58.316184 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a0763d2b-05c0-4a61-a89a-9a332cbf6756 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1214 microversion: 2.1 time: 1.207968 Oct 17 13:18:58.326776 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2801/5846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:57 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1214 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:59.260996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:59.261625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:59.287933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.295189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.295845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.296965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.297538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.298047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.346044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:59.352428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:59.392018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.395685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.402766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.407105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.409258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.410074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:00.038792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:00.077677 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c26d189-1db2-49c5-a7b0-03f934ab3769 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1266 microversion: 2.1 time: 0.736494 Oct 17 13:19:00.078944 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2802/5847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:59 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1266 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:00.484807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:00.498013 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51c5300d-ad8f-4385-bcb0-036e505bb5c9 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1511 microversion: 2.1 time: 1.257505 Oct 17 13:19:00.504584 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3046/5848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:59 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1511 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:01.128045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:01.128823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:01.143938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:01.144911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:01.145767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.147354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:01.147964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:01.148506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.342373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:01.360052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-132e311f-3dfa-40fe-a4dd-a43d61a91c78 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1272 microversion: 2.1 time: 0.236440 Oct 17 13:19:01.385992 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2803/5849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:01 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:01.540128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:01.540972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:01.549932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:01.550774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:01.551409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.552307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:01.552957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:01.553394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.701236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:01.729487 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a675d9b4-5b71-472a-97c8-d339b0955989 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1469 microversion: 2.1 time: 0.195301 Oct 17 13:19:01.733890 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3047/5850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:01 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:01.848565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-07cc98df-a67f-4670-8c01-83a026ec2c1e req-30b265d1-0031-4423-aa40-5efbf96e8c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8edfd5-201d-4c59-b87c-b9b987ac6996", "name": "network-vif-deleted", "tag": "d5781fa1-d3fb-4668-acdd-398634e6693e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:01.874963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-07cc98df-a67f-4670-8c01-83a026ec2c1e req-30b265d1-0031-4423-aa40-5efbf96e8c4a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:01.876337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-07cc98df-a67f-4670-8c01-83a026ec2c1e req-30b265d1-0031-4423-aa40-5efbf96e8c4a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:01.876961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-07cc98df-a67f-4670-8c01-83a026ec2c1e req-30b265d1-0031-4423-aa40-5efbf96e8c4a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.906436 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-07cc98df-a67f-4670-8c01-83a026ec2c1e req-30b265d1-0031-4423-aa40-5efbf96e8c4a service nova] Creating event network-vif-deleted:d5781fa1-d3fb-4668-acdd-398634e6693e for instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 on n-h1-853316-12 Oct 17 13:19:01.919563 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-07cc98df-a67f-4670-8c01-83a026ec2c1e req-30b265d1-0031-4423-aa40-5efbf96e8c4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077641 Oct 17 13:19:01.921321 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2804/5851] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:02.397151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:02.405507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:02.430450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.431366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.432178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.433476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.441438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.442087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.757272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:02.759247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:02.780087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.785051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.785051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.796749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.797378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.804825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.932820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.933545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.936023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.937183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lazy-loading 'fault' on Instance uuid 5e8edfd5-201d-4c59-b87c-b9b987ac6996 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:19:03.127468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc9096896f74f5da7b8cc3649dfce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafd87325a094e1ca41e18cc1bde5593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:03.145567 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84c18c2a-4437-4edc-b3fc-29aae6cdb7b1 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 200 len: 1307 microversion: 2.1 time: 0.393309 Oct 17 13:19:03.149062 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2805/5852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:02 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:03.532931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:03.547510 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b93dfa24-f754-4330-b3d8-26e104415dd4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1314 microversion: 2.1 time: 1.157295 Oct 17 13:19:03.550410 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3048/5853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:02 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1314 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:03.591490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e345e15-90a0-4300-9824-c164d9289f8f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '.version_select at 0x7fa820418d30>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:03.612384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:03.633546 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e345e15-90a0-4300-9824-c164d9289f8f tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1300379660" status: 202 len: 0 microversion: 2.1 time: 0.044011 Oct 17 13:19:03.639339 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2806/5854] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 17 13:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1300379660 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:19:03.677944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1a9fd3d-9110-4de6-89d4-8d66f73c1e72 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'create', calling method: .version_select at 0x7fa81bbd5670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-254862252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5SdeiXPW9L/aSVRe+SxgKnK3VGWKtWe+59UfwffW7Y8zqJexuKNTiHqlzbYPsHnr/QQF2+fAZaCwoavRAQgmBXq3bigD9yrrIcAYKFcggK38Ul+yXS1UI7i29NFJKJuw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:03.719176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b1a9fd3d-9110-4de6-89d4-8d66f73c1e72 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for project e5d16284093341d980341f1dce38f68b. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:03.732827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b1a9fd3d-9110-4de6-89d4-8d66f73c1e72 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for user 0cee3a8479444aa3a00b2c29407931d9 and project e5d16284093341d980341f1dce38f68b. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:03.813885 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b1a9fd3d-9110-4de6-89d4-8d66f73c1e72 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.131713 Oct 17 13:19:03.825263 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3049/5855] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:19:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:19:04.179280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:04.180683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] [instance: 5e8edfd5-201d-4c59-b87c-b9b987ac6996] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:04.198903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.199398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.199840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.200559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.201008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.201430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.277731 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] HTTP exception thrown: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 could not be found. Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Request method failure captured: Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 HTTP/1.1 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVYwzTJv6Xvz2EPuVG9SbVx_ySl4KdnTTaMUrL8exgAnBaLVrdNGjHMtBp0WEr4fTX0P5Z8yVWzv9u_g1Lg-Ddes4EnAXd65uWnpPtxHIf20WHxeWjy23MbgzL7G98-EDrHvKs9Nck_WJ5w8lqkJ4PJBHNvzYM4w5Oxx_g3tTSqAds Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dafd87325a094e1ca41e18cc1bde5593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dafd87325a094e1ca41e18cc1bde5593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: dafd87325a094e1ca41e18cc1bde5593 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228099610 Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 1cc9096896f74f5da7b8cc3649dfce8b Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-228099610-project Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 could not be found. Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5e8edfd5-201d-4c59-b87c-b9b987ac6996'} Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 could not be found. Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 could not be found. Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:04.293190 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:19:04.300928 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:04.300928 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:04.300928 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:04.300928 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:19:04.300928 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:19:04.300928 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 could not be found. Oct 17 13:19:04.300928 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:19:04.311210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] Returning 404 to user: Instance 5e8edfd5-201d-4c59-b87c-b9b987ac6996 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:04.312629 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1192d1af-5892-46c4-9243-0f3007f7acc0 tempest-ServersNegativeTestJSON-228099610 tempest-ServersNegativeTestJSON-228099610-project] 10.222.0.27 "GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996" status: 404 len: 111 microversion: 2.1 time: 0.137965 Oct 17 13:19:04.318408 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2807/5856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:04 2022] GET /compute/v2.1/servers/5e8edfd5-201d-4c59-b87c-b9b987ac6996 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:19:04.574584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:04.575368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:04.592375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.593196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.603278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.604306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.604786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.606810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.694515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:05.538462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:05.556107 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d4c32366-18f0-4cb8-90a9-1ac079dcffe1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1314 microversion: 2.1 time: 0.983327 Oct 17 13:19:05.558476 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3050/5857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:04 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:06.605214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:06.605910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:06.650290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:06.652417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:06.653333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:06.654777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:06.656349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:06.657298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:06.851256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:07.145424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b704da6d-bbd2-4717-8287-215155b74516 req-537174cb-0fc1-4643-861f-953ea75cdd0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee937c73-5e03-4d4c-8780-b8c2d1016f3f", "tag": "4c801a1f-6714-4000-856f-e83a7329d839"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:07.208906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b704da6d-bbd2-4717-8287-215155b74516 req-537174cb-0fc1-4643-861f-953ea75cdd0f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:07.209839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b704da6d-bbd2-4717-8287-215155b74516 req-537174cb-0fc1-4643-861f-953ea75cdd0f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:07.210684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b704da6d-bbd2-4717-8287-215155b74516 req-537174cb-0fc1-4643-861f-953ea75cdd0f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:07.259725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b704da6d-bbd2-4717-8287-215155b74516 req-537174cb-0fc1-4643-861f-953ea75cdd0f service nova] Creating event network-changed:4c801a1f-6714-4000-856f-e83a7329d839 for instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f on n-h2-853316-12 Oct 17 13:19:07.268576 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b704da6d-bbd2-4717-8287-215155b74516 req-537174cb-0fc1-4643-861f-953ea75cdd0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128739 Oct 17 13:19:07.271736 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3051/5858] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:07.449117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:07.466565 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e45ce77c-3e25-4efe-bff5-2d69b6f86e65 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1314 microversion: 2.1 time: 0.879218 Oct 17 13:19:07.467176 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2808/5859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:06 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:08.501715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:08.503739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:08.541282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:08.544784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:08.548411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:08.550311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:08.553916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:08.554992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:10.284880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:10.303221 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31e5b161-ca14-4d38-a6ec-5661faadda9c tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1314 microversion: 2.1 time: 1.804720 Oct 17 13:19:10.304270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3052/5860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:08 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1314 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:11.345671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:11.347530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:11.372039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:11.385129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:11.386075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:11.387993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:11.389006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:11.392924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:11.394448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:12.060686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:12.076073 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba5c6183-0810-48e5-8762-3170f5f66348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1314 microversion: 2.1 time: 0.733706 Oct 17 13:19:12.077656 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2809/5861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:11 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:13.000054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1286227805", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:13.111691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:13.112918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:13.137414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:13.138265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:13.139004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:13.140233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:13.140348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] validate_networks() for [('38b24f77-5b11-4106-b2f1-2c97b1e93962', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:13.141008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:13.142565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:13.466855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:13.488917 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc6acc15-791e-491a-8f84-f7881a1b3e23 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1314 microversion: 2.1 time: 0.378600 Oct 17 13:19:13.511526 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2810/5862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:13 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:13.577448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b0d727ae-5ce0-4a6f-ae70-2f53d82fa06a req-a94a1ecc-3c00-40f3-b4b8-64f505339c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee937c73-5e03-4d4c-8780-b8c2d1016f3f", "name": "network-vif-plugged", "status": "completed", "tag": "4c801a1f-6714-4000-856f-e83a7329d839"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:13.606776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0d727ae-5ce0-4a6f-ae70-2f53d82fa06a req-a94a1ecc-3c00-40f3-b4b8-64f505339c2e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:13.608597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0d727ae-5ce0-4a6f-ae70-2f53d82fa06a req-a94a1ecc-3c00-40f3-b4b8-64f505339c2e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:13.610752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0d727ae-5ce0-4a6f-ae70-2f53d82fa06a req-a94a1ecc-3c00-40f3-b4b8-64f505339c2e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:13.640964 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b0d727ae-5ce0-4a6f-ae70-2f53d82fa06a req-a94a1ecc-3c00-40f3-b4b8-64f505339c2e service nova] Creating event network-vif-plugged:4c801a1f-6714-4000-856f-e83a7329d839 for instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f on n-h2-853316-12 Oct 17 13:19:13.665077 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b0d727ae-5ce0-4a6f-ae70-2f53d82fa06a req-a94a1ecc-3c00-40f3-b4b8-64f505339c2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091727 Oct 17 13:19:13.676720 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2811/5863] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:13.748019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:14.532539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:14.540011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:14.571604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.572881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.573488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.576663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.577367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.578060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.887133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:14.915450 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-13c15d68-412a-403f-841c-a3bb984858ef tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1314 microversion: 2.1 time: 0.396589 Oct 17 13:19:14.917037 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2812/5864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:14 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:15.141268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:15.142415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:15.143327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:15.144206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:15.144927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:15.176608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:15.177944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:15.178662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:15.180589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:15.185143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:15.185944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:15.214748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Getting quotas for project 8a70674ba07848b3aef59e8fc4893feb. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:15.222928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Getting quotas for user 5456d0b366d64cb481dd95e17d2ccb4c and project 8a70674ba07848b3aef59e8fc4893feb. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:15.239183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:15.242473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:15.309624 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3285580f-f5b8-4369-9ab5-e70757411246 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.718328 Oct 17 13:19:15.323841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8fb2eec4-4175-4b42-b1fe-a4714d536277 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:15.324465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8fb2eec4-4175-4b42-b1fe-a4714d536277 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:15.328062 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3053/5865] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:19:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:19:15.422421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8fb2eec4-4175-4b42-b1fe-a4714d536277 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:15.464944 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8fb2eec4-4175-4b42-b1fe-a4714d536277 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1214 microversion: 2.1 time: 0.140870 Oct 17 13:19:15.465689 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2813/5866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:15 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:15.954887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:15.958189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:15.977465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:15.977979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:15.979005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:15.979758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:15.980220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:15.985298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.429993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:16.446234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8987dbff-6dce-4d08-9986-a282a0151caf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1501 microversion: 2.1 time: 0.503437 Oct 17 13:19:16.450949 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3054/5867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:15 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:16.483273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fbfa3f58-8aad-4e57-ac78-a7a4f5313a00 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:16.501752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:16.503926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbfa3f58-8aad-4e57-ac78-a7a4f5313a00 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:16.504724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbfa3f58-8aad-4e57-ac78-a7a4f5313a00 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:16.508510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fbfa3f58-8aad-4e57-ac78-a7a4f5313a00 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.509201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:16.530488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:16.533099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:16.549140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.554578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:16.555106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:16.555563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.616564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fbfa3f58-8aad-4e57-ac78-a7a4f5313a00 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:19:16.802562 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fbfa3f58-8aad-4e57-ac78-a7a4f5313a00 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f/action" status: 202 len: 0 microversion: 2.1 time: 0.311929 Oct 17 13:19:16.809044 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2814/5868] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:19:16 2022] POST /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:19:16.859770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:16.860883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:16.891490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:16.896194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:16.898249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.901384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:16.902086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:16.904836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.919814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:16.936393 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c23567a7-7e0a-4a1a-8a2d-0827c6218c41 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1218 microversion: 2.1 time: 0.443944 Oct 17 13:19:16.959508 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3055/5869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:16 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1218 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:17.413737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:17.430853 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1df20162-d8cb-4ddf-a5c8-7974565cf3ac tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.604695 Oct 17 13:19:17.447467 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2815/5870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:16 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:17.965868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:17.966518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:18.003133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:18.003650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:18.004097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:18.004830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:18.011062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:18.015381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:18.399590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:18.417376 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01dddcca-0ca6-413d-828e-ae3cdf0f5721 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1284 microversion: 2.1 time: 0.454143 Oct 17 13:19:18.432292 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3056/5871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:17 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1284 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:18.457165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:18.457805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:18.480072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:18.480790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:18.481464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:18.485671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:18.486975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:18.488789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:18.977955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:18.991635 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9325d0e1-d949-4efd-a25a-5752c3e4d32b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.538589 Oct 17 13:19:19.002085 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2816/5872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:18 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:19.336189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77820c7a-6358-4788-9d62-fc8c7b769a17 tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] Calling method '.version_select at 0x7fa81bccbc10>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:19.464244 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77820c7a-6358-4788-9d62-fc8c7b769a17 tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311/defaults" status: 200 len: 371 microversion: 2.1 time: 0.455826 Oct 17 13:19:19.469631 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2817/5873] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 13:19:19 2022] GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311/defaults => generated 371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:19.493822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:19.499886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:19.500723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:19.513112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:19.521417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:19.521417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:19.521792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:19.522309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:19.527353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:19.527812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:19.530914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:19.532212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:19.533442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:19.534927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:19.535791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:19.537130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:19.614402 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e9d57157-5f49-4ad1-947e-6470ee7d7bc2 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments/762c005a-acd6-4ff1-8dd4-1e298f196304" status: 200 len: 194 microversion: 2.20 time: 0.619716 Oct 17 13:19:19.622607 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3057/5874] 10.222.0.27 () {60 vars in 1454 bytes} [Mon Oct 17 13:19:18 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments/762c005a-acd6-4ff1-8dd4-1e298f196304 => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:19.653795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4755573c-5b86-4776-986c-039a375c57e2 tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] Calling method '.version_select at 0x7fa81ba5d700>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:19.909436 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4755573c-5b86-4776-986c-039a375c57e2 tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311" status: 200 len: 371 microversion: 2.1 time: 0.286893 Oct 17 13:19:19.910573 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3058/5875] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 13:19:19 2022] GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311 => generated 371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:19.929712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:19.933762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:19.946979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:19.952650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:19.955490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:19.956688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:19.959526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:19.962813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.155542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lazy-loading 'services' on Instance uuid f3001998-79dc-4411-aec7-cd86e6c72deb {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:19:20.229996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:20.259005 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b738ffc-6524-448f-a0bd-820000d0e026 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments/762c005a-acd6-4ff1-8dd4-1e298f196304" status: 202 len: 0 microversion: 2.20 time: 0.344603 Oct 17 13:19:20.262506 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a0ebb8c8-e21c-4b30-bf5a-a7db2a62138b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1314 microversion: 2.1 time: 0.789708 Oct 17 13:19:20.263452 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3059/5876] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 17 13:19:19 2022] DELETE /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments/762c005a-acd6-4ff1-8dd4-1e298f196304 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:19:20.287655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2818/5877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:19 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:20.300267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-719335ac-3b7e-45a4-9b08-9b00059f0024 tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] Calling method '.version_select at 0x7fa81ba5d700>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:20.304316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:20.310650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:20.332941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:20.335321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:20.352856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.355396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:20.357077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:20.372282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.467273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-719335ac-3b7e-45a4-9b08-9b00059f0024 tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311/defaults" status: 200 len: 371 microversion: 2.1 time: 0.202247 Oct 17 13:19:20.467930 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3060/5878] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 13:19:20 2022] GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311/defaults => generated 371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:20.498878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:20.513543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:20.534589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:20.535804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:20.540806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.541790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:20.542297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:20.544203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.651677 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c76ae5d-0d7c-4cfc-afad-ddd0748e773e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180551 Oct 17 13:19:20.658913 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3061/5879] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:20 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:20.681413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69463080-de97-45e9-95f9-abf2e9a273a1 tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] Calling method '.version_select at 0x7fa81bdfa790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:20.807260 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69463080-de97-45e9-95f9-abf2e9a273a1 tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311" status: 200 len: 371 microversion: 2.1 time: 0.144727 Oct 17 13:19:20.807910 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3062/5880] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 13:19:20 2022] GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311 => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:20.820882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd1e548c-9890-4b02-a7c2-f6ddb205411b tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] Calling method '.version_select at 0x7fa81ba5d040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:20.973069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:20.982540 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba9d511c-1b8e-4cde-a25d-a24ecef651ed tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.693388 Oct 17 13:19:20.983463 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2819/5881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:20 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:20.992366 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd1e548c-9890-4b02-a7c2-f6ddb205411b tempest-QuotasTestJSON-848912918 tempest-QuotasTestJSON-848912918-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311?user_id=90d9f47852ff40ae939427eb1b3a58ea" status: 200 len: 371 microversion: 2.1 time: 0.175720 Oct 17 13:19:21.002857 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3063/5882] 10.222.0.27 () {58 vars in 1323 bytes} [Mon Oct 17 13:19:20 2022] GET /compute/v2.1/os-quota-sets/78cd7f069e2f4a50bf7d7c778c859311?user_id=90d9f47852ff40ae939427eb1b3a58ea => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:19:21.295738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:21.296430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:21.309904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.311155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.314234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.316589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.318718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.322340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.673372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:21.682541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:21.729083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.731685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.733713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.735100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.736933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.737690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.899784 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-210950ae-957b-4341-9213-e7edd55e3332 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.230589 Oct 17 13:19:21.900641 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3064/5883] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:21 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:19:22.012240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:22.013220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:22.023866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.030419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.031460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.032450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.033144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.033814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.227519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:22.243708 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2631a2af-0854-400f-a2ca-9aab55b2ef16 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1314 microversion: 2.1 time: 0.953722 Oct 17 13:19:22.249281 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2820/5884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:21 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:22.736379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e7576a09-442a-4b50-b850-e6002dd87f4e req-c3caded8-73cb-4504-adef-8c1bbb1f1e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37", "tag": "c02b3326-e774-4542-b3cb-67db6b018469"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:22.770990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7576a09-442a-4b50-b850-e6002dd87f4e req-c3caded8-73cb-4504-adef-8c1bbb1f1e67 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.771625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7576a09-442a-4b50-b850-e6002dd87f4e req-c3caded8-73cb-4504-adef-8c1bbb1f1e67 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.772177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e7576a09-442a-4b50-b850-e6002dd87f4e req-c3caded8-73cb-4504-adef-8c1bbb1f1e67 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.800899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:DELETE=2,nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:22.827732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e7576a09-442a-4b50-b850-e6002dd87f4e req-c3caded8-73cb-4504-adef-8c1bbb1f1e67 service nova] Creating event network-changed:c02b3326-e774-4542-b3cb-67db6b018469 for instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 on n-h1-853316-12 Oct 17 13:19:22.853762 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e7576a09-442a-4b50-b850-e6002dd87f4e req-c3caded8-73cb-4504-adef-8c1bbb1f1e67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121099 Oct 17 13:19:22.858581 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2821/5885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:22.914591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:22.922690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:22.941140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.944320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.944923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.945748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.946309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.949697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.069899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d708db4-88a7-4156-bd23-8181ea22b247 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160557 Oct 17 13:19:23.076028 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2822/5886] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:22 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:23.277385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:23.278740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:23.289287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.297988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.299634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.300674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.306013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.306812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.569094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:23.578076 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aec56c15-8049-4e84-a678-9b83234644db tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 1.570327 Oct 17 13:19:23.582505 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3065/5887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:22 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:23.897357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:23.909689 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0b4706bf-cda3-474a-ae6b-8e99c6fdf866 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1314 microversion: 2.1 time: 0.636691 Oct 17 13:19:23.913604 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2823/5888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:23 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:24.090483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:24.094090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:24.107577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:24.108091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:24.112252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:24.113023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:24.113500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:24.116140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:24.166379 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ade30a89-cffd-4b09-b0af-6dbddf8db30c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083056 Oct 17 13:19:24.167767 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3066/5889] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:24 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:24.611460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:24.612864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:24.629536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:24.630335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:24.631517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:24.632598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:24.633294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:24.634341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:24.938081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:24.938929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:24.949177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:24.953142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:24.953844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:24.954986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:24.958836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:24.959636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.063093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:25.077315 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d16d5a15-40ca-411c-834e-665122048c45 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.470990 Oct 17 13:19:25.078276 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2824/5890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:24 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:25.189445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:25.192502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:25.200640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:25.211302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:25.212574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:25.215362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.216394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:25.218681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:25.219654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.298966 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-46e21a2f-a2b6-46a1-80f4-f5a8154e7257 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117404 Oct 17 13:19:25.312825 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2825/5891] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:25 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:25.687721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:25.704247 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-09874a49-01cb-400f-8e15-4f11fa4a8a72 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1314 microversion: 2.1 time: 0.770104 Oct 17 13:19:25.726483 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3067/5892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:24 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:26.106478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:26.109690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:26.116879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:26.137864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.140426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.141347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:26.146741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.147693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.148374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:26.250552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-127436031", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "7dbe46e9-1555-4966-8066-e1ab1b02f404"}], "key_name": "tempest-TestNetworkAdvancedServerOps-254862252", "security_groups": [{"name": "tempest-secgroup-smoke-1045679214"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:26.533044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] validate_networks() for [('7dbe46e9-1555-4966-8066-e1ab1b02f404', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:26.768766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:26.784853 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1f2a1205-7aa3-42f9-8131-7b445194528a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.687741 Oct 17 13:19:26.803415 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2826/5893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:26 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:26.812875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:26.816612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:26.831690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.835071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.835713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:26.836607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.837877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.840752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:26.934799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1986d421-5b28-4289-9d10-b8426ec23bf4 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129823 Oct 17 13:19:26.938884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2827/5894] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:26 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:26.952345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:26.953498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:26.970491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.974479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.975293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:26.979083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.980048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.980726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.090617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:27.407651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:27.408899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:27.409662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:27.410494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:27.411333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:27.430475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:27.431497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:27.432381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.433815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:27.434828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:27.435688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.475596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for project e5d16284093341d980341f1dce38f68b. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:27.491967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Getting quotas for user 0cee3a8479444aa3a00b2c29407931d9 and project e5d16284093341d980341f1dce38f68b. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:27.515803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:27.519588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:27.607803 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-292107c4-6d70-4917-9ec0-471a5061c4ec tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.363650 Oct 17 13:19:27.609322 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3068/5895] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:19:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:19:27.622521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d037fb62-5292-42d4-91f0-409f8105826d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:27.628852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d037fb62-5292-42d4-91f0-409f8105826d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:27.762058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d037fb62-5292-42d4-91f0-409f8105826d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:27.780917 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d037fb62-5292-42d4-91f0-409f8105826d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1265 microversion: 2.1 time: 0.163175 Oct 17 13:19:27.785099 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3069/5896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:27 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:27.836866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:27.838084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:27.847261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:27.848225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:27.849378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.850934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:27.851834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:27.853598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:28.131455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:28.145183 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7d1f539-5224-4700-8141-21508666e6eb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1314 microversion: 2.1 time: 1.204764 Oct 17 13:19:28.146486 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2828/5897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:26 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:28.160672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:28.169322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:28.194032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:28.194594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:28.195055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:28.200087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:28.200589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:28.201031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:28.272074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:28.281761 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7d4defbc-5373-4d4b-ab6b-3690031c7f8e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133654 Oct 17 13:19:28.283435 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2829/5898] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:28 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:28.300673 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-448852f5-4465-4fbe-a6f1-a25bb41b2693 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.488439 Oct 17 13:19:28.302817 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3070/5899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:27 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:28.817316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:28.819197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:28.833385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:28.834068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:28.834639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:28.835402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:28.835881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:28.836320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:28.955134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:28.980182 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d10fe0c6-676d-4bb5-babc-7fcfbdcb76bd tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1261 microversion: 2.1 time: 0.168110 Oct 17 13:19:28.988267 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2830/5900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:28 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:29.169796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:29.170607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:29.189172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:29.189736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:29.190296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:29.191034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:29.191519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:29.191995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:29.299402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:29.302441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:29.321619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:29.322131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:29.322600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:29.323571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:29.324172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:29.324676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:29.401283 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-102d7c99-053f-409a-814a-fed022e8b5f3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106737 Oct 17 13:19:29.411235 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2831/5901] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:29 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:29.424094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:29.424715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:29.456683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:29.457282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:29.457766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:29.458680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:29.462753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:29.464252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:29.571406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:29.584250 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-57a4775f-94cd-4329-a769-1bf54c36a441 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1314 microversion: 2.1 time: 0.417910 Oct 17 13:19:29.586191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3071/5902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:29 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:29.861065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:29.875493 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9d2420a-0f00-45f9-9e4a-a79a6160c731 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.462697 Oct 17 13:19:29.876942 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2832/5903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:29 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:30.007738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:30.008549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:30.031163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.032288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.041992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.044302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.045981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.049205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.210482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:30.237463 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a619c722-f8cb-4973-8030-2fe7b5f6077d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1335 microversion: 2.1 time: 0.234396 Oct 17 13:19:30.241263 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3072/5904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:30 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1335 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:30.415886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:30.421998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:30.442241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.445335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.446005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.447203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.448649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.450945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.547613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1e90759f-3193-4648-8558-7abba03206c8 req-d909bcd8-5077-49aa-a42c-d7e2a4d0a0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37", "name": "network-vif-plugged", "status": "completed", "tag": "c02b3326-e774-4542-b3cb-67db6b018469"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:30.575208 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2523cc5-f7e1-4ff2-ae86-357f852c6f11 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157645 Oct 17 13:19:30.579915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1e90759f-3193-4648-8558-7abba03206c8 req-d909bcd8-5077-49aa-a42c-d7e2a4d0a0dd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.580683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1e90759f-3193-4648-8558-7abba03206c8 req-d909bcd8-5077-49aa-a42c-d7e2a4d0a0dd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.581126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1e90759f-3193-4648-8558-7abba03206c8 req-d909bcd8-5077-49aa-a42c-d7e2a4d0a0dd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.584383 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2833/5905] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:30 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:30.616153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:30.616950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:30.636738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.636738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.638880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.640922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.642224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.643448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.643977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1e90759f-3193-4648-8558-7abba03206c8 req-d909bcd8-5077-49aa-a42c-d7e2a4d0a0dd service nova] Creating event network-vif-plugged:c02b3326-e774-4542-b3cb-67db6b018469 for instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 on n-h1-853316-12 Oct 17 13:19:30.661016 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1e90759f-3193-4648-8558-7abba03206c8 req-d909bcd8-5077-49aa-a42c-d7e2a4d0a0dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117355 Oct 17 13:19:30.662140 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3073/5906] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:30.912930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:30.914285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:30.926254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.927617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.928355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.929710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.930434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.931333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.937013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:31.417193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:31.438452 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8bab9ce-865c-4785-9655-8150ef693cc2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1314 microversion: 2.1 time: 0.830962 Oct 17 13:19:31.439012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:31.449871 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2834/5907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:30 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:31.475044 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a955948b-a627-402d-bbf8-5b6db33ce077 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.571767 Oct 17 13:19:31.477422 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3074/5908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:30 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:31.508337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:31.513365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:31.539688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.540481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.548077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.549563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.550353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.551061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.600999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:31.603666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:31.640605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.641835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.643379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.646965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.662084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.669413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.764609 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8d68d0da-f43b-4019-b5f1-2c6e11227272 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.168793 Oct 17 13:19:31.777120 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3075/5909] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:31 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb/os-volume_attachments => generated 25 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:31.942686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:31.982969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:31.985856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:31.986820 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a80c577e-9aa9-43ae-9c41-c86ac9d1cfa5 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1323 microversion: 2.1 time: 0.531729 Oct 17 13:19:31.988115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2835/5910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:31 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:32.067191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.068862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.078792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.090899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.093594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.101349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.217030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:19:32.500000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:32.502699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:32.528745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c25e8dd4-4253-41d4-864b-3862058b3136 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 204 len: 0 microversion: 2.20 time: 0.562969 Oct 17 13:19:32.530834 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3076/5911] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:19:31 2022] DELETE /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:19:32.538490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.540938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.541689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.546449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.547005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:32.548737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.549657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:32.551000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.571349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.572411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.573247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.574354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.575174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.575943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.889462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:32.900743 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c73023f0-a273-4024-83f8-c9b27b8c1b47 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1314 microversion: 2.1 time: 0.410202 Oct 17 13:19:32.902061 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2836/5912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:32 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:32.907136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:32.907985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:32.918993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.920178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.921524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.923182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.924471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.925097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:33.254824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:33.274205 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49ae3df7-554b-41ae-8ec9-56210558e1b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.741470 Oct 17 13:19:33.283574 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3077/5913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:32 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:33.298553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:33.305613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:33.333538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:33.334619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:33.337331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:33.338413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:33.342582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:33.343648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:33.396637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:33.417246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:33.422482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:33.430201 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3fb81375-20e3-43c1-8ac7-caa89d1b1918 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.526482 Oct 17 13:19:33.431565 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2837/5914] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:32 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:33.890868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:33.910988 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9f8e646c-b9e5-46ae-b61b-3c5c46a0e0b8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1391 microversion: 2.1 time: 0.625802 Oct 17 13:19:33.912895 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3078/5915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:33 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1391 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:33.937397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:33.938787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:33.964671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:33.966686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:33.968408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:33.970644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:33.971418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:33.973331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.026143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:34.312239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:34.313189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:34.317725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:34.329731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.331762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.333047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.334872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.336316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.337264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.338842 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51ac66af-bb2e-4f3a-83bf-b7142abc4ad1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1500 microversion: 2.1 time: 0.407372 Oct 17 13:19:34.353876 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2838/5916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:33 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1500 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:34.385113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:34.387940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:34.398353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.400288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.401292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.402247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.402891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.403755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.454924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lazy-loading 'flavor' on Instance uuid f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:19:34.603398 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f5565672-bbb7-4134-9975-e615817e0844 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "POST /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37/action" status: 200 len: 32 microversion: 2.1 time: 0.223009 Oct 17 13:19:34.610911 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2839/5917] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:19:34 2022] POST /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:19:34.653174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-661af963-3a96-4b7e-8cef-bad1246b7214 req-dbfad1b7-6da2-49da-bcef-88feef2e4453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a5fcb1-ccb9-4247-8395-fc8506f2ca9e", "tag": "d2c65543-51d8-4a69-ac3d-092733af5213"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:34.703491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-661af963-3a96-4b7e-8cef-bad1246b7214 req-dbfad1b7-6da2-49da-bcef-88feef2e4453 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.705177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-661af963-3a96-4b7e-8cef-bad1246b7214 req-dbfad1b7-6da2-49da-bcef-88feef2e4453 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.706541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-661af963-3a96-4b7e-8cef-bad1246b7214 req-dbfad1b7-6da2-49da-bcef-88feef2e4453 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.746811 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-661af963-3a96-4b7e-8cef-bad1246b7214 req-dbfad1b7-6da2-49da-bcef-88feef2e4453 service nova] Creating event network-changed:d2c65543-51d8-4a69-ac3d-092733af5213 for instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e on n-h2-853316-12 Oct 17 13:19:34.758534 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-661af963-3a96-4b7e-8cef-bad1246b7214 req-dbfad1b7-6da2-49da-bcef-88feef2e4453 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140236 Oct 17 13:19:34.760191 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2840/5918] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:34.771600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:34.773492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:34.801197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.801744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.802438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.803775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.837667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.839083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.974517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:34.989129 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a1f2586-d310-46cc-bb3c-7ecb130c54fd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.681830 Oct 17 13:19:34.991320 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3079/5919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:34 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:35.009738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:35.013053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:35.037144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.043374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.046351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.050110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.055270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.056126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.546023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.577474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.585105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.592059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8f2272ff-aeda-4cab-89ad-6619f9c1a491 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.829603 Oct 17 13:19:35.598613 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2841/5920] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:34 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:35.610199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:35.611382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:35.625095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.626805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.632252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.632757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.633237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.633671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.885500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.912960 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-348e1999-c628-4aa9-8295-57d9cc5e9942 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.920047 Oct 17 13:19:35.918993 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3080/5921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:34 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:36.043891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:36.046422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:36.066036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.073721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.074977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:36.076453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.081600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.083088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:36.142308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:36.158402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb99683b-886e-4f11-87b8-eadedfd63f84 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1391 microversion: 2.1 time: 0.557126 Oct 17 13:19:36.159639 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2842/5922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:35 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1391 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:36.558913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:36.575087 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d478881-1341-4ac5-9a5a-d590c3c8f701 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.537645 Oct 17 13:19:36.576970 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3081/5923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:36 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:36.624897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:36.625525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:36.639738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.640546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.641184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:36.642350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.642985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.643583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:36.951065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:36.952288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:36.981141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.983296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.984128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:36.987786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.988636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.994307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.435598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.455151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:37.487784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.498117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.503597 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cec18ee3-e3d1-41d6-bbc7-34845972dfba tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1725 microversion: 2.20 time: 0.879397 Oct 17 13:19:37.505408 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2843/5924] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:36 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1725 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:19:37.520275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:37.525130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:37.541281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:37.548100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.549327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.553409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.555564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.556872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.558080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.664626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.695214 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-61bf5e2b-95a5-4f2f-90d1-5a4f04a8c32e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.753039 Oct 17 13:19:37.702150 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3082/5925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:36 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:37.731309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:37.732372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:37.760824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.761823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.779930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.781662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.785331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.788067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.790400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=22 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:38.525834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:38.549206 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6583ebd0-8fcd-4010-8ee0-6e4b6772fefd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.843882 Oct 17 13:19:38.551463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3083/5926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:37 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:38.583371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:38.593016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:38.651328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:38.668628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.672742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.675090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:38.682950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.689964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.691871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:38.700031 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7cc56f67-a8ca-4bd8-9316-b7eac316ef86 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1391 microversion: 2.1 time: 1.179778 Oct 17 13:19:38.701883 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2844/5927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:37 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1391 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:38.735888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b21c5067-3728-4633-b0dd-017428c961b7 req-a22e3939-8a63-4edb-9e95-04da56ba6ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3001998-79dc-4411-aec7-cd86e6c72deb", "name": "network-vif-deleted", "tag": "dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:38.794815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b21c5067-3728-4633-b0dd-017428c961b7 req-a22e3939-8a63-4edb-9e95-04da56ba6ea4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.807825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b21c5067-3728-4633-b0dd-017428c961b7 req-a22e3939-8a63-4edb-9e95-04da56ba6ea4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.809260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b21c5067-3728-4633-b0dd-017428c961b7 req-a22e3939-8a63-4edb-9e95-04da56ba6ea4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:38.870503 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b21c5067-3728-4633-b0dd-017428c961b7 req-a22e3939-8a63-4edb-9e95-04da56ba6ea4 service nova] Creating event network-vif-deleted:dec4d0e3-38a0-43c6-ad79-ce6a7c266f9e for instance f3001998-79dc-4411-aec7-cd86e6c72deb on n-h1-853316-12 Oct 17 13:19:38.886537 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b21c5067-3728-4633-b0dd-017428c961b7 req-a22e3939-8a63-4edb-9e95-04da56ba6ea4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174160 Oct 17 13:19:38.889014 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2845/5928] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:38.911129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:38.938129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:38.951169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:38.960059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:38.969697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:38.977380 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc5666bb-a793-4f4b-bc87-241c427e29ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 200 len: 1366 microversion: 2.20 time: 0.417545 Oct 17 13:19:38.978856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.979637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.980503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:38.981928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.987272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.988038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.004218 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3084/5929] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:38 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:39.425983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:39.456832 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e81029c5-1fc5-458e-b57b-01fe56eb4b9c tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.564180 Oct 17 13:19:39.461344 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2846/5930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:38 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:39.620025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:39.625475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:39.644092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.645057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.646911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.652169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.654971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.656889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.760413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:39.761563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:39.788382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.791623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.792327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.795868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.799275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.801609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.249005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:40.261352 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9af209bc-1068-4b18-9f3a-2071b0f1be7d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.649444 Oct 17 13:19:40.264321 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3085/5931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:39 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:40.301493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:40.303635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:40.314846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.315918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.317415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.319052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.320083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.321028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.399863 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] HTTP exception thrown: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Request method failure captured: Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb HTTP/1.1 Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVUaSGB2bnWIQ4NApeb5zGIshTtHUM3JnaRwMpTQ47_bm3D0YV-MA8BR9wdXHf0OUXdfkBO-WfMMBbXFqbs9nlQAxcmMEcu3pl6EZ8-JnX2jZ-VwboxNzAEW2iwJc2tr5QP9fmmySlVZTlnqQCU8h6RdMCoIt5qm-jwRNFns4l2ByUQ Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26f98949744c40cca4df9d331462cd0d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 28c5de5f487848a8a91ab2669a81149a Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'f3001998-79dc-4411-aec7-cd86e6c72deb'} Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:40.415837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Returning 404 to user: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7bf5dd3b-93e5-42aa-99d6-9e9d83737b6a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 404 len: 111 microversion: 2.20 time: 0.153195 Oct 17 13:19:40.421041 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3086/5932] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:40 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:19:40.440374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11714f19-7c20-4a3f-bb33-0921c5a844ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '.version_select at 0x7fa81ba79af0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:40.469243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:40.492629 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fb555535-d5ab-43c1-acc9-e65ad45c55ee tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1391 microversion: 2.1 time: 0.741560 Oct 17 13:19:40.509499 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2847/5933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:39 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1391 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:40.533970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:40.535180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:40.549429 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11714f19-7c20-4a3f-bb33-0921c5a844ed tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593243049" status: 204 len: 0 microversion: 2.20 time: 0.121760 Oct 17 13:19:40.550924 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3087/5934] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 13:19:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593243049 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 13:19:40.559276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.560393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.561432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.562939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.564712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.565699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.855746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:40.874223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e420890d-8855-4316-af04-0ce330d32305 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.361750 Oct 17 13:19:40.875232 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2848/5935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:40 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:41.299573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:41.304899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:41.325986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:41.328256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:41.329373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:41.331234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:41.332566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:41.336174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:41.539856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:41.540962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:41.576214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:41.576858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:41.577514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:41.578546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:41.585326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:41.587232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.129267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:42.139216 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-013d567f-584a-4c8f-a379-66fb33f549bb tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1511 microversion: 2.1 time: 0.849944 Oct 17 13:19:42.140677 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3088/5936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:41 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1511 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:42.160559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:42.163330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:42.169662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:42.181238 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5a7c9279-4769-418b-ac4d-9d493db24ded tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1391 microversion: 2.1 time: 0.650632 Oct 17 13:19:42.182735 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2849/5937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:41 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1391 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:42.186274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:42.186917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:42.187379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.188300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:42.189389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1537944440", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "03c1fa23-eba7-4e57-9b13-42f785635b28", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "eb1e7600-e122-4b5e-9526-e08a5b9bce6b"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:42.195602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:42.196230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.439156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] validate_networks() for [('eb1e7600-e122-4b5e-9526-e08a5b9bce6b', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:42.482819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:42.493817 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eee84486-0aed-4780-a9d0-4d399d51c476 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.351898 Oct 17 13:19:42.494740 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3089/5938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:42 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:42.510952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b714426-3c5e-46c7-be66-8d75e3024f16 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'create', calling method: .version_select at 0x7fa820207ee0>, body: {"keypair": {"name": "tempest-keypair-1602245950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6RA8flaL3DFgvRgHYVPEtTh+TRLAe60oNg5vnQvsl6y1QFi0xysopnxWkYgJsaR8iy5/D3ErUHBeu0COg+eJpqK3KmOtSnRXBtM29f8GF8EZ9zpUhrY3cMUk4+LZwQTw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:42.547358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-0b714426-3c5e-46c7-be66-8d75e3024f16 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Getting quotas for project 26f98949744c40cca4df9d331462cd0d. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:42.559979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-0b714426-3c5e-46c7-be66-8d75e3024f16 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Getting quotas for user 28c5de5f487848a8a91ab2669a81149a and project 26f98949744c40cca4df9d331462cd0d. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:42.639714 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b714426-3c5e-46c7-be66-8d75e3024f16 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.143591 Oct 17 13:19:42.640977 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3090/5939] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 13:19:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:19:43.164663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:43.166978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:43.193436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.194384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.196007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.199681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.201235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.203999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.285205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:43.286080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:43.286080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:43.286952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:43.287411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:43.315166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.316289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.317742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.320936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.322306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.323238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.367349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:43.376536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:43.397580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:43.405836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='03c1fa23-eba7-4e57-9b13-42f785635b28',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:43.542135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:43.554589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:43.569598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68ba6ed1-0d76-45b6-9dc3-4847ced27a4a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1488 microversion: 2.1 time: 0.409261 Oct 17 13:19:43.570679 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3091/5940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:43 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1488 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:43.582730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:43.584525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:43.596911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.598443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.600005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.601122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.601961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.602576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.655302 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e7edef5-22b1-4664-a8f8-c92cec1132a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470313 Oct 17 13:19:43.656935 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2850/5941] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:19:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:19:43.685312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2b4a4d3b-df35-470a-82f0-573ce9e96c42 req-d827ea43-2905-43ed-8be0-8c6f135e9d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a5fcb1-ccb9-4247-8395-fc8506f2ca9e", "name": "network-vif-plugged", "status": "completed", "tag": "d2c65543-51d8-4a69-ac3d-092733af5213"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:43.727390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2b4a4d3b-df35-470a-82f0-573ce9e96c42 req-d827ea43-2905-43ed-8be0-8c6f135e9d61 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.729049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2b4a4d3b-df35-470a-82f0-573ce9e96c42 req-d827ea43-2905-43ed-8be0-8c6f135e9d61 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.731460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2b4a4d3b-df35-470a-82f0-573ce9e96c42 req-d827ea43-2905-43ed-8be0-8c6f135e9d61 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.791485 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2b4a4d3b-df35-470a-82f0-573ce9e96c42 req-d827ea43-2905-43ed-8be0-8c6f135e9d61 service nova] Creating event network-vif-plugged:d2c65543-51d8-4a69-ac3d-092733af5213 for instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e on n-h2-853316-12 Oct 17 13:19:43.818623 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2b4a4d3b-df35-470a-82f0-573ce9e96c42 req-d827ea43-2905-43ed-8be0-8c6f135e9d61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154876 Oct 17 13:19:43.819655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2851/5942] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:43.831062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:43.845035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:43.859832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.860342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.860793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.861522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.861984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.863633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.949475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:43.961467 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d9996c2-ca38-41f4-8aae-d660464ead3c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1391 microversion: 2.1 time: 0.389054 Oct 17 13:19:43.964364 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3092/5943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:43 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1391 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:43.969211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:43.997107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:44.020121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:44.021508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:44.024606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:44.025354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:44.025834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:44.036210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:44.155040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:19:44.367742 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc0b5619-f21e-4787-9661-538852bb0b7f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 204 len: 0 microversion: 2.1 time: 0.401885 Oct 17 13:19:44.372063 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3093/5944] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:19:43 2022] DELETE /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:19:44.377874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6725ac76-188f-41f8-96f5-1f4d9ea04f5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:44.383519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6725ac76-188f-41f8-96f5-1f4d9ea04f5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:44.466319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:44.478535 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2fe23787-fbef-438d-8353-ab86388688b5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.657293 Oct 17 13:19:44.482085 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2852/5945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:43 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:44.498916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:44.499943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:44.507671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6725ac76-188f-41f8-96f5-1f4d9ea04f5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:44.515305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:44.516204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:44.516883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:44.518150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:44.518891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:44.519701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:44.524758 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6725ac76-188f-41f8-96f5-1f4d9ea04f5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1057 microversion: 2.1 time: 0.151093 Oct 17 13:19:44.531067 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3094/5946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:44 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1057 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:44.851582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:44.872309 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ed1b3b41-46ba-4047-9533-0b631ad8af6a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1494 microversion: 2.1 time: 0.387918 Oct 17 13:19:44.873572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2853/5947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:44 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1494 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:44.996327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:44.997163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:45.007242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.008007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.008925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.010465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.011985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.013476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.318348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:45.327975 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d338a6e-cce7-41fa-a865-6e7823509b39 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1391 microversion: 2.1 time: 0.334856 Oct 17 13:19:45.341426 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3095/5948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:44 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1391 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:45.522834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:45.524878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:45.538891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.539524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.539976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.540708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.541327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.544595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.569818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:45.570756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:45.581184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.590442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.591090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.592359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.592826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.593250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.725398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:45.742676 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-766d08b6-e4e9-4917-a1e3-41a2268769b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1109 microversion: 2.1 time: 0.177116 Oct 17 13:19:45.745526 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3096/5949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:45 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1109 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:45.858697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:45.868143 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-644ba081-08a1-48ee-9091-8b5db1cdac43 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.350324 Oct 17 13:19:45.868735 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2854/5950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:45 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:45.898398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:45.899225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:45.901979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:45.923717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.924224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.924669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.927642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.929945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.930670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.141415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-33875218", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "379d38e3-eed4-4313-9734-01a14db67615"}], "security_groups": [{"name": "tempest-securitygroup--2017621552"}], "key_name": "tempest-keypair-1602245950", "user_data": "}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:46.471968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:46.501204 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c7548dd1-c8c8-4fa7-a00b-a9b78f6dfa4d tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 200 len: 1494 microversion: 2.1 time: 0.605628 Oct 17 13:19:46.516727 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3097/5951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:45 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 1494 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:46.557756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:46.568135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:46.581859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:46.582381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:46.582815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.583741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:46.584439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:46.584869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.714501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] validate_networks() for [('379d38e3-eed4-4313-9734-01a14db67615', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:46.978640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:47.000718 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6be6b0c3-c7ca-4933-9abd-1e45f199bac6 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1563 microversion: 2.1 time: 0.482304 Oct 17 13:19:47.010848 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3098/5952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:46 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1563 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:47.041593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:47.042578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:47.067492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.073937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.077381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.080242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.086677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.088036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.310880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:47.336056 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-934abb0e-b057-4d7a-afcb-c77538121a04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1127 microversion: 2.1 time: 0.323185 Oct 17 13:19:47.336784 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3099/5953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:47 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1127 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:47.373762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:47.374822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:47.384406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.384917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.385366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.386278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.387321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.387767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.633672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:47.649023 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86f73a53-d6ef-4018-9eff-a972b21305a6 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.288563 Oct 17 13:19:47.651433 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3100/5954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:47 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:47.673720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:47.674968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:47.684028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.684844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.685525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.686769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.687546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.688142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.752558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:47.753116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:47.753517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:47.753935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:47.754415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:47.767760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.768254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.768792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.769536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.769995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.770453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.824529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Getting quotas for project 26f98949744c40cca4df9d331462cd0d. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:47.835159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Getting quotas for user 28c5de5f487848a8a91ab2669a81149a and project 26f98949744c40cca4df9d331462cd0d. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:47.876196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:47.879288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:47.982152 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51bc6de1-5fc4-4166-94c6-06f11787d49c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.845338 Oct 17 13:19:47.987074 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2855/5955] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 13:19:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 13:19:47.999117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-311b15cd-8fd0-45b3-b1e6-93185727720b req-f1df060f-6bf9-4b47-bf66-75453e738624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee937c73-5e03-4d4c-8780-b8c2d1016f3f", "name": "network-vif-deleted", "tag": "4c801a1f-6714-4000-856f-e83a7329d839"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:48.018471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-311b15cd-8fd0-45b3-b1e6-93185727720b req-f1df060f-6bf9-4b47-bf66-75453e738624 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.022484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-311b15cd-8fd0-45b3-b1e6-93185727720b req-f1df060f-6bf9-4b47-bf66-75453e738624 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.024380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-311b15cd-8fd0-45b3-b1e6-93185727720b req-f1df060f-6bf9-4b47-bf66-75453e738624 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.038372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:48.055161 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8eea2baa-eb8e-4cc5-a7dd-aa14ba1fa88c tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1563 microversion: 2.1 time: 0.402271 Oct 17 13:19:48.057662 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-311b15cd-8fd0-45b3-b1e6-93185727720b req-f1df060f-6bf9-4b47-bf66-75453e738624 service nova] Creating event network-vif-deleted:4c801a1f-6714-4000-856f-e83a7329d839 for instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f on n-h2-853316-12 Oct 17 13:19:48.070731 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-311b15cd-8fd0-45b3-b1e6-93185727720b req-f1df060f-6bf9-4b47-bf66-75453e738624 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078951 Oct 17 13:19:48.070944 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3101/5956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:47 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1563 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:48.076472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:48.077029 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2856/5957] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:48.085661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:48.091447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f0ccaf8-0fb3-4f10-8946-aaa8434a55e6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:48.095044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f0ccaf8-0fb3-4f10-8946-aaa8434a55e6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:48.122293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.124477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.125332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.127323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.132083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.132724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.211751 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f HTTP/1.1 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'ee937c73-5e03-4d4c-8780-b8c2d1016f3f'} Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:48.214395 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:48.218122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db9be8a5-844a-4f2f-b90e-1f86c9be1ff9 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 404 len: 111 microversion: 2.1 time: 0.144981 Oct 17 13:19:48.220131 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3102/5958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:48 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:19:48.329385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f0ccaf8-0fb3-4f10-8946-aaa8434a55e6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:48.341542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f0ccaf8-0fb3-4f10-8946-aaa8434a55e6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:48.348407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0f0ccaf8-0fb3-4f10-8946-aaa8434a55e6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:48.353630 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f0ccaf8-0fb3-4f10-8946-aaa8434a55e6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1280 microversion: 2.20 time: 0.274707 Oct 17 13:19:48.358465 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2857/5959] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:48 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1280 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:48.369771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:48.370536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:48.382297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.384876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.386388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.389521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.390708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.391952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.472198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1412078341", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e6961d90-c691-4862-9018-60bca57213f2"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:48.521945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:48.538348 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-59f601b8-dfad-40e0-8dda-eebc6e374285 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1127 microversion: 2.1 time: 0.173386 Oct 17 13:19:48.542419 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3103/5960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:48 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1127 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:48.581680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] validate_networks() for [('e6961d90-c691-4862-9018-60bca57213f2', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:48.693277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:48.700352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:48.725077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.734759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.738411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.744465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.744465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.756353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:49.181002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:49.201810 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44ccf2d2-59c0-46c3-a9c8-7398e3ffecb7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.519867 Oct 17 13:19:49.202601 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3104/5961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:48 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:49.401199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:49.401737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:49.413954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:49.419227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:49.420194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:49.421318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:49.422019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:49.422754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:49.601870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:49.612889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:49.620118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:49.621530 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01c44ad3-955d-4e64-830b-c0b6f77d4818 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1332 microversion: 2.20 time: 0.227688 Oct 17 13:19:49.622755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3105/5962] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:49 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1332 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:19:49.629225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:49.635318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:49.656914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:49.657838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:49.658534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:49.666075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:49.667349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:49.668172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.055019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:50.070873 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-526788e3-9054-40d2-a5d5-6256b2353008 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.446912 Oct 17 13:19:50.071843 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3106/5963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:49 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:50.101203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:50.101987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:50.102889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:50.103636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:50.104419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:50.135913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:50.136458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:50.136936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.137736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:50.138242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:50.138728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.173644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:50.197704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:50.216914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Getting quotas for user 24c6068b196d4cc398176b22196bd5b1 and project 0306c43449c3449797cabdbca458e182. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:50.236868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:50.240360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:50.259004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:50.262892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:50.263401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:50.264067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:50.265485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.266461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:50.269432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:50.270432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.366468 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7114e43-104c-4601-85c1-b7ebec2d9eb6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.902740 Oct 17 13:19:50.382932 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2858/5964] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:19:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:19:50.392924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c965cd18-fa4d-428c-b2ba-6e78684faadf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:50.396298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c965cd18-fa4d-428c-b2ba-6e78684faadf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:50.636065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c965cd18-fa4d-428c-b2ba-6e78684faadf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:50.662603 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c965cd18-fa4d-428c-b2ba-6e78684faadf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1215 microversion: 2.1 time: 0.277794 Oct 17 13:19:50.691262 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2859/5965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:50 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:50.701444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:50.710552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:50.727806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:50.728856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:50.730205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.732136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:50.733921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:50.735032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.901516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:50.914154 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2d676367-48a7-41a6-bd76-5012fdfb4176 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.684643 Oct 17 13:19:50.915408 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3107/5966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:50 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:51.111682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:51.113143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:51.128166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.128902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.129728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.133271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.134563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.135725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.197859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:51.406363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:51.442831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:51.457829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:51.469111 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ec8f450f-b649-4556-89b1-3c60614224bf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1338 microversion: 2.20 time: 0.776357 Oct 17 13:19:51.472596 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2860/5967] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:50 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1338 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:51.669132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:51.689087 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f64ec728-1ae8-4c02-889f-f5a8a267ae78 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.579833 Oct 17 13:19:51.689464 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3108/5968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:51 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:51.717377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:51.725396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:51.758621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.759219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.759666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.760391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.760847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.769039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.944265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:51.944882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:51.959899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.960401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.960841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.961555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.962012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.963600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.104501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:52.118645 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f851f0b4-73e4-469f-815a-e6f782564519 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1219 microversion: 2.1 time: 0.408836 Oct 17 13:19:52.119918 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2861/5969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:51 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1219 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:52.498524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:52.499519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:52.511295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.511838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.513640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.515233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.515769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.521098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.553837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:52.563797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-28a7f414-b8bb-46b0-86f3-b0c0b1ba979d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.624854 Oct 17 13:19:52.564410 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3109/5970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:51 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:52.712430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:52.713049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:52.726737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.727241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.732334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.735402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.735809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.738129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:53.136898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:53.149939 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca95a350-5a32-4295-b8c0-5087e91be560 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.441469 Oct 17 13:19:53.163575 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3110/5971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:52 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:53.180778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:53.185233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:53.200162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:53.200925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:53.201676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:53.202622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:53.203290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:53.203943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:53.334415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:53.343501 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f47da00-d37d-486b-b799-48a3f4db50e6 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1273 microversion: 2.1 time: 0.178226 Oct 17 13:19:53.348186 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3111/5972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:53 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:53.593133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:53.594574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:53.610018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:53.613930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:53.616052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:53.618922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:53.622360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:53.623598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:53.889317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:53.912762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:53.916545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:53.917964 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de10c794-fcc9-4d28-ab53-7d163c3bd283 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1406 microversion: 2.20 time: 1.424674 Oct 17 13:19:53.921158 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2862/5973] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:52 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1406 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:54.179132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:54.179764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:54.191919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.192976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.193550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.204452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.205183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.206809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.242830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:54.281624 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7bac6d5b-2354-44e4-b737-cd54d1a31d61 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.692859 Oct 17 13:19:54.285884 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3112/5974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:53 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:54.371485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:54.372733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:54.384716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.385453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.386102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.387068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.387703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.390345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.512738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:54.565003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:54.585907 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2d0614e9-094e-4733-920c-a8af89a98daf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1273 microversion: 2.1 time: 0.212451 Oct 17 13:19:54.599202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3113/5975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:54 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:54.941561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-baa3428f-985f-4c92-af9f-0e69df947cef req-24e60aca-7c2a-4916-8e56-ca0e3f67c741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62aae524-015b-4a15-aafa-9000a2183d87", "tag": "da7a58b2-ab1e-4bb4-8804-af0f51d82900"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:54.990708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-baa3428f-985f-4c92-af9f-0e69df947cef req-24e60aca-7c2a-4916-8e56-ca0e3f67c741 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.992796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-baa3428f-985f-4c92-af9f-0e69df947cef req-24e60aca-7c2a-4916-8e56-ca0e3f67c741 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.993256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-baa3428f-985f-4c92-af9f-0e69df947cef req-24e60aca-7c2a-4916-8e56-ca0e3f67c741 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.044361 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-baa3428f-985f-4c92-af9f-0e69df947cef req-24e60aca-7c2a-4916-8e56-ca0e3f67c741 service nova] Creating event network-changed:da7a58b2-ab1e-4bb4-8804-af0f51d82900 for instance 62aae524-015b-4a15-aafa-9000a2183d87 on n-h2-853316-12 Oct 17 13:19:55.061518 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-baa3428f-985f-4c92-af9f-0e69df947cef req-24e60aca-7c2a-4916-8e56-ca0e3f67c741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125562 Oct 17 13:19:55.065690 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3114/5976] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:55.107086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:55.109227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:55.119991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.122867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.123686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.125287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.127700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.128579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.414773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:55.469337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:55.476176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:55.482751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:55.484318 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88904daa-06d0-4bf3-adb1-5f5688954b45 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1406 microversion: 2.20 time: 0.400605 Oct 17 13:19:55.488499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe9a8a00-967f-46b5-9cf6-92422887b2be tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 1.313791 Oct 17 13:19:55.494535 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2863/5977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:54 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:55.496568 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3115/5978] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:55 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:55.509773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:55.519065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:55.539913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.540780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.541722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.543205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.547209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.547948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.616065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:55.618727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:55.653887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.662273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.665468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.668865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.671006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.671673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.939826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:55.980658 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c91ca128-1eaa-4d48-a997-b87862de2b30 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1273 microversion: 2.1 time: 0.369354 Oct 17 13:19:55.981865 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3116/5979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:55 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1273 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:56.093315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:56.118037 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d0cdec9-0f79-429f-8710-2c23a3be8158 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.612972 Oct 17 13:19:56.125285 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2864/5980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:55 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:56.263110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c1685372-a679-4e6c-9b88-261bbeef923a req-c523154c-6955-455a-a16e-b1b9b64288ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1276f410-3ce3-4048-9d62-1222b0af1bf7", "tag": "395fbeef-4885-4f0a-beb0-e11b3f979c9c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:56.302814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1685372-a679-4e6c-9b88-261bbeef923a req-c523154c-6955-455a-a16e-b1b9b64288ba service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.305618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1685372-a679-4e6c-9b88-261bbeef923a req-c523154c-6955-455a-a16e-b1b9b64288ba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.307019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1685372-a679-4e6c-9b88-261bbeef923a req-c523154c-6955-455a-a16e-b1b9b64288ba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.374671 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c1685372-a679-4e6c-9b88-261bbeef923a req-c523154c-6955-455a-a16e-b1b9b64288ba service nova] Creating event network-changed:395fbeef-4885-4f0a-beb0-e11b3f979c9c for instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 on n-h1-853316-12 Oct 17 13:19:56.389634 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c1685372-a679-4e6c-9b88-261bbeef923a req-c523154c-6955-455a-a16e-b1b9b64288ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132832 Oct 17 13:19:56.398013 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3117/5981] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:19:56.527243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:56.528182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:56.538895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:56.540268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:56.549149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.549644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.550084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.550839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.551473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.553145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.555312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.555812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.556467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.557552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.558405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.559008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.987518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.003492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.006748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.008599 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b77548a3-8b40-4d33-9089-7d7a7e751b55 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1406 microversion: 2.20 time: 0.480081 Oct 17 13:19:57.009935 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3118/5982] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:56 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:19:57.699044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.724790 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2eb4573b-760e-4a11-92f8-20104be48b51 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 1.204389 Oct 17 13:19:57.733872 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2865/5983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:56 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:57.752770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:57.753554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:57.768605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.775730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.776717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.777684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.778187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.778633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.920052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:57.920913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:57.930214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.930662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.931279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.940364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.941090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.941760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.109320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.131101 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-302980e9-9ace-4876-a253-ed8c9b7c61a1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1273 microversion: 2.1 time: 1.102244 Oct 17 13:19:58.132308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3119/5984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:57 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1273 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:58.143148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:58.145088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:58.168503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.169356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.169960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.170848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.171492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.172294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.516150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.527699 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-83f4e1e0-8468-4a32-93c7-be996cb877b8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.792041 Oct 17 13:19:58.537523 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2866/5985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:57 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:58.593975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.623694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.627765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.629266 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7164faef-c23c-4225-befb-7ffc64e60353 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1406 microversion: 2.20 time: 0.495628 Oct 17 13:19:58.633365 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3120/5986] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:58 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:58.766905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:58.769634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:58.804343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.805351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.806385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.807356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.808043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.810315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.173266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:59.185396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:59.218228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.219465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.226951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.236396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.237301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.238141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.502080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:59.547731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a132bf9-f2fb-4f61-a540-482986b3c39e tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1315 microversion: 2.1 time: 0.375751 Oct 17 13:19:59.552734 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3121/5987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:59 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:59.568332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:59.570716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:59.588231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.588738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.590276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.591229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.591991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.593819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.997376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:00.013652 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-53252a52-2fc9-415b-a32c-9c3f520ff3ef tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.452807 Oct 17 13:20:00.015028 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3122/5988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:59 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:00.027689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:00.028769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:00.040977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.042617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.043520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.044972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.045769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.046514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.177484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:00.299994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:00.312747 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5d4a9b30-c38c-467b-b943-907848f2b942 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1563 microversion: 2.1 time: 0.295990 Oct 17 13:20:00.313627 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3123/5989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:00 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1563 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:00.340591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:00.341213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:00.359602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.362087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.362087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.362087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.362087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.363576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.414467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:00.434318 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-708a8603-bb51-4557-9d77-8c82be58bd06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 1.683183 Oct 17 13:20:00.435283 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2867/5990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:58 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:00.440224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6f1c8602-228d-408a-8f93-e1923e95de2b req-0c9802d8-a523-4bdd-a29e-7fa151644ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a5fcb1-ccb9-4247-8395-fc8506f2ca9e", "tag": "d2c65543-51d8-4a69-ac3d-092733af5213"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:00.463980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f1c8602-228d-408a-8f93-e1923e95de2b req-0c9802d8-a523-4bdd-a29e-7fa151644ada service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.465024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f1c8602-228d-408a-8f93-e1923e95de2b req-0c9802d8-a523-4bdd-a29e-7fa151644ada service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.466585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6f1c8602-228d-408a-8f93-e1923e95de2b req-0c9802d8-a523-4bdd-a29e-7fa151644ada service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.493344 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6f1c8602-228d-408a-8f93-e1923e95de2b req-0c9802d8-a523-4bdd-a29e-7fa151644ada service nova] Creating event network-changed:d2c65543-51d8-4a69-ac3d-092733af5213 for instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e on n-h2-853316-12 Oct 17 13:20:00.506533 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6f1c8602-228d-408a-8f93-e1923e95de2b req-0c9802d8-a523-4bdd-a29e-7fa151644ada service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069598 Oct 17 13:20:00.518865 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2868/5991] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:00.574776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:00.575927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:00.600444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.601618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.603957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.606438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.607571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.608239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.663475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=22 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:01.120678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.132398 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9760ba7c-b336-4837-bd51-765c16b240e1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1315 microversion: 2.1 time: 0.563003 Oct 17 13:20:01.139567 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2869/5992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:00 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:01.144961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:01.145963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:01.191893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:01.198403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.202547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.207174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.211415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.215154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.216154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.495161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.503727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.516087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.525064 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8cff11ff-14c2-4523-8928-3c012621c013 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1406 microversion: 2.20 time: 1.191154 Oct 17 13:20:01.534127 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3124/5993] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:00 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1406 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:01.539986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-26f2673c-68ff-418b-8b5d-1f5c0a1133ab req-43be2638-ba53-483d-8fa6-835e269c8cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62aae524-015b-4a15-aafa-9000a2183d87", "name": "network-vif-plugged", "status": "completed", "tag": "da7a58b2-ab1e-4bb4-8804-af0f51d82900"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:01.605823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-26f2673c-68ff-418b-8b5d-1f5c0a1133ab req-43be2638-ba53-483d-8fa6-835e269c8cea service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.617562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-26f2673c-68ff-418b-8b5d-1f5c0a1133ab req-43be2638-ba53-483d-8fa6-835e269c8cea service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.624212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-26f2673c-68ff-418b-8b5d-1f5c0a1133ab req-43be2638-ba53-483d-8fa6-835e269c8cea service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.665848 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-26f2673c-68ff-418b-8b5d-1f5c0a1133ab req-43be2638-ba53-483d-8fa6-835e269c8cea service nova] Creating event network-vif-plugged:da7a58b2-ab1e-4bb4-8804-af0f51d82900 for instance 62aae524-015b-4a15-aafa-9000a2183d87 on n-h2-853316-12 Oct 17 13:20:01.680348 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-26f2673c-68ff-418b-8b5d-1f5c0a1133ab req-43be2638-ba53-483d-8fa6-835e269c8cea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144489 Oct 17 13:20:01.684617 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3125/5994] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:01.693090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:01.697116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:01.716833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.720561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.723048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.725694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.726849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.730585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.924407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.966072 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7e2db4f2-0992-46d2-b72d-be9a169524aa tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.825077 Oct 17 13:20:01.971240 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2870/5995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:01 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:02.295948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:02.295948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:02.295948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:02.295948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:02.295948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:02.295948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:02.295948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:02.295948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:02.401992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:02.401992 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21ab220c-fc71-481b-a19f-469d060b4ed9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.588924 Oct 17 13:20:02.401992 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3126/5996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:01 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:02.561051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:02.562536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:02.580551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:02.582554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:02.583979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:02.585436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:02.586281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:02.586984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:02.592887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:02.984082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:02.999699 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cfd97f74-d9ce-4f0b-88b7-fc73aec98348 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1315 microversion: 2.1 time: 0.836450 Oct 17 13:20:03.027342 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2871/5997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:02 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:03.056209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:03.058117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:03.078735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.081821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.083020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.085312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.087390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.089907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.333232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.358558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.362201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.376861 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ccd7a1c8-6142-4c22-8392-7a2dff99f0d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1406 microversion: 2.20 time: 0.808733 Oct 17 13:20:03.397057 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3127/5998] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:02 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1406 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:03.441055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-59d30f6b-20b7-48ff-9173-69f376438c06 req-f953a378-f074-4b23-8e05-d8e1a2654e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71895fd8-afd2-4903-9eb9-8425a3cb46f5", "tag": "9e5a0f44-1eaa-4603-a3d1-e874e034c6f9"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:03.478571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-59d30f6b-20b7-48ff-9173-69f376438c06 req-f953a378-f074-4b23-8e05-d8e1a2654e9e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.482022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-59d30f6b-20b7-48ff-9173-69f376438c06 req-f953a378-f074-4b23-8e05-d8e1a2654e9e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.483033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-59d30f6b-20b7-48ff-9173-69f376438c06 req-f953a378-f074-4b23-8e05-d8e1a2654e9e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.533651 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-59d30f6b-20b7-48ff-9173-69f376438c06 req-f953a378-f074-4b23-8e05-d8e1a2654e9e service nova] Creating event network-changed:9e5a0f44-1eaa-4603-a3d1-e874e034c6f9 for instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 on n-h2-853316-12 Oct 17 13:20:03.558015 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-59d30f6b-20b7-48ff-9173-69f376438c06 req-f953a378-f074-4b23-8e05-d8e1a2654e9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158752 Oct 17 13:20:03.559672 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3128/5999] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:03.578455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:03.579942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:03.598805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.600891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.601542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.602779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.603800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.604451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.811472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.827352 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-61e0779d-d04f-42a5-87b2-394a9a58feac tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.792662 Oct 17 13:20:03.842653 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2872/6000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:03 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:03.922899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.944333 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50905580-06e9-4b09-acc4-4df231d87ef3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.382113 Oct 17 13:20:03.944945 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3129/6001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:03 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:04.031764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:04.033114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:04.047990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.049269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.050393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.052358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.053349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.054309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.418668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.433198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-73fc75d2-28c7-4e11-9788-f6392adc6bb1 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1315 microversion: 2.1 time: 0.407256 Oct 17 13:20:04.433485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:04.434127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:04.434512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2873/6002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:04 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:04.441344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.442234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.443391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.444542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.445662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.446224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.656776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.668678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.671198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.673145 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df68b922-80cc-42a4-91c4-fc9e2b6db45d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1599 microversion: 2.20 time: 0.244694 Oct 17 13:20:04.674301 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3130/6003] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:04 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1599 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:04.699466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:04.699972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:04.707910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.708516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.709048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.709953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.710508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.711011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.825694 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9587cdb-a5a3-4839-8099-b0c7f414ca97 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130166 Oct 17 13:20:04.834817 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2874/6004] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 13:20:04 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:20:04.859753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:04.859753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:04.866834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.867408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.867854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.868573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.869215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.869840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.969509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:04.970458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:04.982205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.983004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.985960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.986768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.987249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.987689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.179537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:05.191124 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac6be9c7-83f6-4daf-b87a-3d2bbccc7e78 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1506 microversion: 2.1 time: 0.337095 Oct 17 13:20:05.206896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3131/6005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:04 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:05.303932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:05.313951 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68323f34-932d-418d-b303-32ec9b504104 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.349170 Oct 17 13:20:05.315228 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2875/6006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:04 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:05.462849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:05.467831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:05.506483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.507480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.508170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.511358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.512703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.514426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.997498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:06.011537 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31bc5641-c629-42cc-a5cb-60de4f53e001 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1315 microversion: 2.1 time: 0.555230 Oct 17 13:20:06.014977 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3132/6007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:05 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:06.226658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:06.228580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:06.259403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.261648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.264259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.266352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.266830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.267451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.359863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:06.360663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:06.367842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.368336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.368777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.369923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.370435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.371046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.468338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:06.478753 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e965ad72-1070-40c2-b2de-3abb184cf7d4 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1486 microversion: 2.1 time: 0.258427 Oct 17 13:20:06.480369 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2876/6008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:06 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1486 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:06.603530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:06.605440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-64dc1c2d-04cb-4dbf-baef-9b48db306e0a req-39dec7d9-e15c-4064-b060-32aa1e2f70a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62aae524-015b-4a15-aafa-9000a2183d87", "tag": "da7a58b2-ab1e-4bb4-8804-af0f51d82900"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:06.618901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-64dc1c2d-04cb-4dbf-baef-9b48db306e0a req-39dec7d9-e15c-4064-b060-32aa1e2f70a0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.623610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-64dc1c2d-04cb-4dbf-baef-9b48db306e0a req-39dec7d9-e15c-4064-b060-32aa1e2f70a0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.624142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-64dc1c2d-04cb-4dbf-baef-9b48db306e0a req-39dec7d9-e15c-4064-b060-32aa1e2f70a0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.629953 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8960b86e-feb6-40bb-9b23-b35b361b1ba5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.284809 Oct 17 13:20:06.643400 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3133/6009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:06 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:06.643899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-64dc1c2d-04cb-4dbf-baef-9b48db306e0a req-39dec7d9-e15c-4064-b060-32aa1e2f70a0 service nova] Creating event network-changed:da7a58b2-ab1e-4bb4-8804-af0f51d82900 for instance 62aae524-015b-4a15-aafa-9000a2183d87 on n-h2-853316-12 Oct 17 13:20:06.655671 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-64dc1c2d-04cb-4dbf-baef-9b48db306e0a req-39dec7d9-e15c-4064-b060-32aa1e2f70a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053935 Oct 17 13:20:06.660561 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2877/6010] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:06.698540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-115413967", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:06.802554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] validate_networks() for [('38b24f77-5b11-4106-b2f1-2c97b1e93962', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:20:07.053552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:07.054375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:07.068577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.069674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.071103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:07.072955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.074869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.076370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:07.089868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:07.895568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:07.919745 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b912cba-c201-4071-a132-110157322cdc tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1315 microversion: 2.1 time: 0.869912 Oct 17 13:20:07.920698 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2878/6011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:07 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:07.933753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:07.944937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:07.968691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.973309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.975906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:07.977266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.978599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.980064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:08.283231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:20:08.283762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:20:08.284120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:20:08.284907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:20:08.284907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:20:08.291893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:08.309237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:08.309975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:08.311181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:08.312147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:08.312802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:08.313586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:08.320906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b353b536-c4da-455b-b4c1-67c6aa568776 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.389804 Oct 17 13:20:08.321772 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2879/6012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:07 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:08.377723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Getting quotas for project 8a70674ba07848b3aef59e8fc4893feb. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:20:08.387507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Getting quotas for user 5456d0b366d64cb481dd95e17d2ccb4c and project 8a70674ba07848b3aef59e8fc4893feb. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:20:08.405295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:20:08.411666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:20:08.490599 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be593aeb-ee93-4362-b57b-4a4ef1d3e837 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.796085 Oct 17 13:20:08.491743 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3134/6013] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:20:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:20:08.506691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f3b0a935-8cf6-4151-98d9-41dfd2138a6e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:08.508463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f3b0a935-8cf6-4151-98d9-41dfd2138a6e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:08.609198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f3b0a935-8cf6-4151-98d9-41dfd2138a6e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:08.623684 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f3b0a935-8cf6-4151-98d9-41dfd2138a6e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1213 microversion: 2.1 time: 0.124342 Oct 17 13:20:08.625189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2880/6014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:08 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:08.949644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:08.950670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:08.969656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:08.970184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:08.970652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:08.971381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:08.971843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:08.973407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.290702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:09.305770 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bdb9f258-5737-46a5-afc5-2bee0a3819bf tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1315 microversion: 2.1 time: 0.361070 Oct 17 13:20:09.307036 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3135/6015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:08 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:09.312114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-dce7a696-c01c-4312-8379-037efa4cdef6 req-cdeb9cc9-e025-4372-9fd3-d41275fee5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71895fd8-afd2-4903-9eb9-8425a3cb46f5", "name": "network-vif-plugged", "status": "completed", "tag": "9e5a0f44-1eaa-4603-a3d1-e874e034c6f9"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:09.341917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dce7a696-c01c-4312-8379-037efa4cdef6 req-cdeb9cc9-e025-4372-9fd3-d41275fee5b1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.343100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dce7a696-c01c-4312-8379-037efa4cdef6 req-cdeb9cc9-e025-4372-9fd3-d41275fee5b1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.344443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dce7a696-c01c-4312-8379-037efa4cdef6 req-cdeb9cc9-e025-4372-9fd3-d41275fee5b1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.362889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:09.367950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:09.381174 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-dce7a696-c01c-4312-8379-037efa4cdef6 req-cdeb9cc9-e025-4372-9fd3-d41275fee5b1 service nova] Creating event network-vif-plugged:9e5a0f44-1eaa-4603-a3d1-e874e034c6f9 for instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 on n-h2-853316-12 Oct 17 13:20:09.421329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.424354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.425412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.428328 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-dce7a696-c01c-4312-8379-037efa4cdef6 req-cdeb9cc9-e025-4372-9fd3-d41275fee5b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118145 Oct 17 13:20:09.433209 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2881/6016] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:09.443623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.444391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.445041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.653295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3204092d-e555-4086-bc06-5abd4b0adfc8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:09.654363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3204092d-e555-4086-bc06-5abd4b0adfc8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:09.766848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3204092d-e555-4086-bc06-5abd4b0adfc8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:09.779494 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3204092d-e555-4086-bc06-5abd4b0adfc8 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1213 microversion: 2.1 time: 0.131012 Oct 17 13:20:09.781269 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2882/6017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:09 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:09.783840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:09.796916 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fea8a1fe-af18-463d-9d6e-a72316e158f8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.450882 Oct 17 13:20:09.811223 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3136/6018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:09 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:10.341538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:10.342183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:10.350723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.351109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.351552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.352254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.352702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.353127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.541430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:10.550719 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6bb8ea2-2f2a-4dd9-a8f3-6b264cc73332 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1315 microversion: 2.1 time: 0.213134 Oct 17 13:20:10.564501 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2883/6019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:10 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:10.814964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:10.815595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:10.836376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:10.836997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:10.842593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.843507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.845443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.847594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.849892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.856194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.856706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.857156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.857427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.857889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.858381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.862829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.001039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:11.012212 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fee426a0-284f-4deb-b38e-a4cf48941d3d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1273 microversion: 2.1 time: 0.209504 Oct 17 13:20:11.027389 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3137/6020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:10 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:11.353139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:11.361195 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71c959d5-850a-4404-868a-67674b356cc6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.528931 Oct 17 13:20:11.365420 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2884/6021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:10 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:11.586991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:11.588131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:11.597601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.599187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.599966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.601503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.602729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.603407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.851830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:11.864540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-59c09b14-4876-41a7-990a-f1915d5d41a7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1502 microversion: 2.1 time: 0.289530 Oct 17 13:20:11.883872 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3138/6022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:11 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:11.893893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:11.896659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:11.907691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.908752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.909353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.910277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.912191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.913003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.950429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'flavor' on Instance uuid 71895fd8-afd2-4903-9eb9-8425a3cb46f5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:12.037509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:12.038121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:12.046693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:12.051248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:12.051779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:12.052543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:12.053015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:12.053448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:12.073402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9aacc209-f769-4649-a652-d7f24d3b97c3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "POST /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5/action" status: 202 len: 0 microversion: 2.1 time: 0.184976 Oct 17 13:20:12.075754 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2885/6023] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:11 2022] POST /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:20:12.104970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:12.106892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:12.117446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:12.118387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:12.119193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:12.121535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:12.122606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:12.122933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:12.215113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:12.234052 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60a5a579-6ba2-41c7-910d-b75f916132be tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1271 microversion: 2.1 time: 0.200318 Oct 17 13:20:12.243839 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3139/6024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:12 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:12.394900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:12.395983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:12.399083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:12.420343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:12.420853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:12.421289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:12.426403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:12.427729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:12.428530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:12.754655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:12.759313 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e07f8151-61a1-45ea-ad8d-d1637f466ecd tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1510 microversion: 2.1 time: 0.661718 Oct 17 13:20:12.775405 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2886/6025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:12 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1510 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:12.775775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:12.788742 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-03506652-d132-4b14-aa88-36b0cb1b0869 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.397462 Oct 17 13:20:12.803171 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3140/6026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:12 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:13.026217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:13.028782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:13.040203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.040746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.042813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.043563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.044028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.049067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.113820 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa7f769c-8be2-4976-ab6c-8230b8e8ce9e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e/action" status: 200 len: 24565 microversion: 2.1 time: 0.091194 Oct 17 13:20:13.116042 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2887/6027] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:13 2022] POST /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e/action => generated 24565 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:20:13.268711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:13.269457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:13.283440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.283858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.284332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.285077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.285543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.286042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.528769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:13.540159 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-28f6bf22-c8b3-4207-9bfc-29cbcbab003a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.275553 Oct 17 13:20:13.544914 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3141/6028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:13 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:13.788534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:13.791081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:13.832472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.834777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.835483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.837214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.838825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.839474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.084490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d8f85abb-cffb-4a14-912a-304b68a20d3b req-4e1b6db4-25b4-43b3-b132-1902c084a1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d179739-9247-42b2-8368-fa97b931aa78", "tag": "5a9276b3-12d1-462b-9954-aef16ae4855b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:14.107182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d8f85abb-cffb-4a14-912a-304b68a20d3b req-4e1b6db4-25b4-43b3-b132-1902c084a1ea service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.107982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d8f85abb-cffb-4a14-912a-304b68a20d3b req-4e1b6db4-25b4-43b3-b132-1902c084a1ea service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.108690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d8f85abb-cffb-4a14-912a-304b68a20d3b req-4e1b6db4-25b4-43b3-b132-1902c084a1ea service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.129273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d8f85abb-cffb-4a14-912a-304b68a20d3b req-4e1b6db4-25b4-43b3-b132-1902c084a1ea service nova] Creating event network-changed:5a9276b3-12d1-462b-9954-aef16ae4855b for instance 0d179739-9247-42b2-8368-fa97b931aa78 on n-h1-853316-12 Oct 17 13:20:14.135157 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d8f85abb-cffb-4a14-912a-304b68a20d3b req-4e1b6db4-25b4-43b3-b132-1902c084a1ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346073 Oct 17 13:20:14.136520 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3142/6029] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:14.144477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.146222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:14.156367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.157212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.159440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.160485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.163260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.163712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.238003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:14.264750 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9004f49-5a12-434f-bda0-5a57f77119f4 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1493 microversion: 2.1 time: 0.482074 Oct 17 13:20:14.271794 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2888/6030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:13 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1493 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:14.311279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.311962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:14.334923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.338055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.339883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.342878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.344000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.345045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.399630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:20:14.514889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:14.524869 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-360075b2-0ef8-40d0-ba6d-89c67d6f7453 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.386933 Oct 17 13:20:14.525457 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3143/6031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:14 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:14.573896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.575028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:14.587995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.590907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.591729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.593751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.595201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.597429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.648707 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e3cfc562-be7f-4f15-879e-dae91f8846d2 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 204 len: 0 microversion: 2.1 time: 0.347360 Oct 17 13:20:14.649731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2889/6032] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:14 2022] DELETE /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:14.660217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.661230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:14.673672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.674282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.675146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.676164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.677438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.678216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.906544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:14.923693 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-89385317-5743-4b0e-bec4-32ce278774c9 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.356197 Oct 17 13:20:14.938205 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3144/6033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:14 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:14.985889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:15.014206 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-00a64230-2c84-4b3e-b652-ea2fc1478027 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1499 microversion: 2.1 time: 0.359322 Oct 17 13:20:15.014896 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2890/6034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:14 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1499 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:15.555583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:15.557234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:15.565521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.566012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.566472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.568963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.569430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.569925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.832201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:15.844026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:15.851382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ae49de2-100b-4d83-8ad5-0430d68684b0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1169 microversion: 2.1 time: 0.300769 Oct 17 13:20:15.852372 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3145/6035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:15 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1169 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:15.983277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:15.985292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:15.997132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.998243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.999185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.000920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.001592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.002211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.042921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:16.043741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:16.050994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.051665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.052048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.053059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.053846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.055489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.286478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:16.312806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d4501192-e5f9-4237-9667-edc2eff79585 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1499 microversion: 2.1 time: 0.274459 Oct 17 13:20:16.314791 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3146/6036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:16 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1499 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:16.412164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:16.421224 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c523e51-565f-45d1-81a9-5ca7a2e66bcb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.447380 Oct 17 13:20:16.422192 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2891/6037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:15 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:16.889268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:16.889964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:16.928133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.928991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.931380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.932159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.932649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.933080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.022741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4362ac7e-8211-4d63-8101-54b6ca7129c9 req-c7118c81-9fbf-4de7-b725-3217407bbca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71895fd8-afd2-4903-9eb9-8425a3cb46f5", "name": "network-vif-deleted", "tag": "9e5a0f44-1eaa-4603-a3d1-e874e034c6f9"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:17.065522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4362ac7e-8211-4d63-8101-54b6ca7129c9 req-c7118c81-9fbf-4de7-b725-3217407bbca5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.068045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4362ac7e-8211-4d63-8101-54b6ca7129c9 req-c7118c81-9fbf-4de7-b725-3217407bbca5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.071643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4362ac7e-8211-4d63-8101-54b6ca7129c9 req-c7118c81-9fbf-4de7-b725-3217407bbca5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.111467 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4362ac7e-8211-4d63-8101-54b6ca7129c9 req-c7118c81-9fbf-4de7-b725-3217407bbca5 service nova] Creating event network-vif-deleted:9e5a0f44-1eaa-4603-a3d1-e874e034c6f9 for instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 on n-h2-853316-12 Oct 17 13:20:17.132674 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4362ac7e-8211-4d63-8101-54b6ca7129c9 req-c7118c81-9fbf-4de7-b725-3217407bbca5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130104 Oct 17 13:20:17.135615 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2892/6038] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:17.352714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:17.355209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:17.373491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:17.390769 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-588cea0d-8bfd-4c02-8684-7eee0345dd3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1215 microversion: 2.1 time: 0.505672 Oct 17 13:20:17.392331 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3147/6039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:16 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1215 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:17.407364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.407888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.408340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.409070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.409532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.410099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.461439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.462286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.462899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:17.463116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.463567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lazy-loading 'fault' on Instance uuid 71895fd8-afd2-4903-9eb9-8425a3cb46f5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:17.468198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:17.493957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.499968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.507355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.508268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.508832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.509381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.584207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c6068b196d4cc398176b22196bd5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0306c43449c3449797cabdbca458e182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:17.597093 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d703b733-2214-4853-90ba-16e503538821 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 200 len: 1305 microversion: 2.1 time: 0.259274 Oct 17 13:20:17.599213 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2893/6040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:17 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 1305 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:17.713859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:17.726023 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b150c0e6-05c1-415b-80be-86d41fa71731 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.283356 Oct 17 13:20:17.736725 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3148/6041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:17 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:18.423746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.425029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.435520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.436117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.437091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.438672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.439612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.440221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.643057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.644165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.654822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:18.655592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:18.658211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.661792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.662517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.663992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.664839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.665482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.700669 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 HTTP/1.1 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '71895fd8-afd2-4903-9eb9-8425a3cb46f5'} Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.704058 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:18.712415 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df5ad01a-594c-4e31-a0ec-d2d836dd8808 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 404 len: 111 microversion: 2.1 time: 0.077225 Oct 17 13:20:18.713887 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3149/6042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:18 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:18.730341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.730870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.738078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.738763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.739819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.740619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.741178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.741637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.744167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:18.757577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:18.765466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 HTTP/1.1 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '71895fd8-afd2-4903-9eb9-8425a3cb46f5'} Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:18.767092 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.772119 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.774718 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79e42b00-acb6-429e-b1f7-360b53271632 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.358493 Oct 17 13:20:18.775043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:18.776246 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ba710ec-cb25-4171-ade1-de9d9ca305be tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 404 len: 111 microversion: 2.1 time: 0.051328 Oct 17 13:20:18.776819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2894/6043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:18 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:18.785522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.787533 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3150/6044] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:18 2022] DELETE /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:20:18.789404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.813340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.814274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71895fd8-afd2-4903-9eb9-8425a3cb46f5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.816578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.817626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.819836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.824689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.825574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.830963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.832712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.833757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.834439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.835398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.836013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.836595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.855269 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 HTTP/1.1 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '71895fd8-afd2-4903-9eb9-8425a3cb46f5'} Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.857154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.861630 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.861630 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.861630 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.861630 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:18.861630 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:18.861630 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. Oct 17 13:20:18.861630 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.863553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 71895fd8-afd2-4903-9eb9-8425a3cb46f5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:18.865076 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1958607b-4895-449c-ba3e-a221858659ab tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5" status: 404 len: 111 microversion: 2.1 time: 0.068810 Oct 17 13:20:18.869535 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3151/6045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:18 2022] GET /compute/v2.1/servers/71895fd8-afd2-4903-9eb9-8425a3cb46f5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:20:18.875483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.876220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.885012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.885895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.886744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.887784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.888404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.888993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.906789 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f HTTP/1.1 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'ee937c73-5e03-4d4c-8780-b8c2d1016f3f'} Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:18.909286 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.914440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.916475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:18.918746 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-da0468b2-f447-4a64-9644-a5d3c0354e18 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 404 len: 111 microversion: 2.1 time: 0.047952 Oct 17 13:20:18.920151 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3152/6046] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:18 2022] DELETE /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:18.929202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.930085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: ee937c73-5e03-4d4c-8780-b8c2d1016f3f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.937739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.938812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.939807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.941141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.941773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.943917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.965768 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f HTTP/1.1 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'ee937c73-5e03-4d4c-8780-b8c2d1016f3f'} Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.967567 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance ee937c73-5e03-4d4c-8780-b8c2d1016f3f could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9a04cb7-9d80-4a00-a0d2-3bd0ed6a5247 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f" status: 404 len: 111 microversion: 2.1 time: 0.048688 Oct 17 13:20:18.975880 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3153/6047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:18 2022] GET /compute/v2.1/servers/ee937c73-5e03-4d4c-8780-b8c2d1016f3f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:20:18.983914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.984596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.993227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.993842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.994434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.995229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.995842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.996303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.016935 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 HTTP/1.1 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '71c84769-498d-4e0b-9cdd-f9569b58f1f8'} Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:19.018716 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50f932ca-860d-4bbe-a67a-807a8bb63635 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 404 len: 111 microversion: 2.1 time: 0.042025 Oct 17 13:20:19.023705 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3154/6048] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:18 2022] DELETE /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:20:19.030142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:19.030796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 71c84769-498d-4e0b-9cdd-f9569b58f1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:19.039051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.039556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.040293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.041010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.041767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.042443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.065440 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 HTTP/1.1 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '71c84769-498d-4e0b-9cdd-f9569b58f1f8'} Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.069204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.073482 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.073482 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.073482 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.073482 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:19.073482 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:19.073482 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. Oct 17 13:20:19.073482 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.075835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 71c84769-498d-4e0b-9cdd-f9569b58f1f8 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:19.077990 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f30f7820-86a5-46d3-8fb1-d3b0dc7700f0 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8" status: 404 len: 111 microversion: 2.1 time: 0.052098 Oct 17 13:20:19.079230 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3155/6049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:19 2022] GET /compute/v2.1/servers/71c84769-498d-4e0b-9cdd-f9569b58f1f8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:19.090628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:19.091715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:19.100386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.102341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.103512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.105054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.106598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.107996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.136179 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb HTTP/1.1 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '77b3ca2f-65c3-4763-a0b4-fb09db45c4bb'} Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:19.138341 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:19.144028 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f798ee37-ac60-4e6d-ba92-76d5e4c23f1b tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 404 len: 111 microversion: 2.1 time: 0.057126 Oct 17 13:20:19.146320 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3156/6050] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:19 2022] DELETE /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:20:19.152359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:19.153197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:19.160502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.161512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.162734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.164717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.165241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.165851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.203809 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb HTTP/1.1 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '77b3ca2f-65c3-4763-a0b4-fb09db45c4bb'} Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.205985 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.210887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.210887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.210887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.210887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:19.210887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:19.210887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. Oct 17 13:20:19.210887 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.212605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 77b3ca2f-65c3-4763-a0b4-fb09db45c4bb could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:19.213483 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-559415ff-4dae-43a5-ac60-8e1f5b9047b3 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb" status: 404 len: 111 microversion: 2.1 time: 0.065950 Oct 17 13:20:19.214276 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3157/6051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:19 2022] GET /compute/v2.1/servers/77b3ca2f-65c3-4763-a0b4-fb09db45c4bb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:19.221550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:19.228080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:19.229426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 08ee6e4d-4327-49bb-ab01-61ab4539b474] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:19.233883 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e948ffc1-2201-417c-bfea-134f3ad585bf tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.454322 Oct 17 13:20:19.234748 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2895/6052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:18 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:19.240959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.242041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.242715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.243627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.244264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.244911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.269088 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474 HTTP/1.1 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '08ee6e4d-4327-49bb-ab01-61ab4539b474'} Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:19.273568 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4bfefd93-7421-4d4f-8c76-bd543c0aa6a5 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474" status: 404 len: 111 microversion: 2.1 time: 0.052325 Oct 17 13:20:19.279921 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3158/6053] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:19 2022] DELETE /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:19.289088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:19.289789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 08ee6e4d-4327-49bb-ab01-61ab4539b474] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:19.297170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.297679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.299777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.299777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.299777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.300901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.327793 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474 HTTP/1.1 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '08ee6e4d-4327-49bb-ab01-61ab4539b474'} Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:19.330850 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 08ee6e4d-4327-49bb-ab01-61ab4539b474 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0879ec5-716a-46ca-abb8-e4b670838137 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474" status: 404 len: 111 microversion: 2.1 time: 0.050957 Oct 17 13:20:19.343457 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2896/6054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:19 2022] GET /compute/v2.1/servers/08ee6e4d-4327-49bb-ab01-61ab4539b474 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:19.808459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:19.809357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:19.822094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.822930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.823755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.824826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.825507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.826237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:20.007075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:20.019751 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-993ba8cd-2a0b-4740-b3f4-7a054d25e5e8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.216352 Oct 17 13:20:20.019751 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3159/6055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:19 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:20.265894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:20.267237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:20.274877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:20.276942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:20.277439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:20.277877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:20.278852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:20.279317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:20.279762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:20.491116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:20.500329 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1eb4668-f402-4fd0-a274-94d8230fd128 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.241135 Oct 17 13:20:20.500919 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2897/6056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:20 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:21.043304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:21.043936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:21.051372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:21.052465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:21.053147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:21.054116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:21.054610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:21.055101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:21.251146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:21.264977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-82e7ca4b-2d18-4112-9db1-0efbfafdae25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.225497 Oct 17 13:20:21.279650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3160/6057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:21 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:21.525971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:21.530959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:21.541075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:21.541819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:21.542470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:21.543638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:21.544251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:21.544830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:21.754520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:21.763363 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-57fda34f-05b7-4718-baa5-2c3f732a9d25 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.241121 Oct 17 13:20:21.764265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2898/6058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:21 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:22.292153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:22.293536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:22.300737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.301223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.302761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.304260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.304969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.305229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.557396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:22.568765 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c6bc17c-2d53-4aa2-9793-e333423949e2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.281167 Oct 17 13:20:22.569907 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3161/6059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:22 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:22.733188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:22.733188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:22.744160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.744882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.746681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.747558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.749015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.760625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.790200 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca HTTP/1.1 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '6c51dfd5-737b-4962-a56f-a0190dbca4ca'} Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:22.792070 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bb78d903-5685-482f-b83e-9c0e94290fbe tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 404 len: 111 microversion: 2.1 time: 0.066845 Oct 17 13:20:22.795793 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3162/6060] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:22 2022] DELETE /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:22.801046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:22.801747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:22.808046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.808542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.808990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.809698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.810426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.811047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.819813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f4ecb2cd-97b6-41e3-9154-4aa51b437f38 req-2a57328e-0754-4e4c-b247-aa0803970807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d179739-9247-42b2-8368-fa97b931aa78", "name": "network-vif-plugged", "status": "completed", "tag": "5a9276b3-12d1-462b-9954-aef16ae4855b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:22.851832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4ecb2cd-97b6-41e3-9154-4aa51b437f38 req-2a57328e-0754-4e4c-b247-aa0803970807 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.852318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4ecb2cd-97b6-41e3-9154-4aa51b437f38 req-2a57328e-0754-4e4c-b247-aa0803970807 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.852755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4ecb2cd-97b6-41e3-9154-4aa51b437f38 req-2a57328e-0754-4e4c-b247-aa0803970807 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.878810 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f4ecb2cd-97b6-41e3-9154-4aa51b437f38 req-2a57328e-0754-4e4c-b247-aa0803970807 service nova] Creating event network-vif-plugged:5a9276b3-12d1-462b-9954-aef16ae4855b for instance 0d179739-9247-42b2-8368-fa97b931aa78 on n-h1-853316-12 Oct 17 13:20:22.888340 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f4ecb2cd-97b6-41e3-9154-4aa51b437f38 req-2a57328e-0754-4e4c-b247-aa0803970807 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.471580 Oct 17 13:20:22.891193 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2899/6061] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:20:22.897577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:22.898815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 6c51dfd5-737b-4962-a56f-a0190dbca4ca] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:22.906231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.906847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.907336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.908050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.908502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.908929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.933637 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca HTTP/1.1 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '6c51dfd5-737b-4962-a56f-a0190dbca4ca'} Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:22.938717 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.943657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:22.943657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:22.943657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:22.943657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:22.943657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:22.943657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. Oct 17 13:20:22.943657 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:22.945606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 6c51dfd5-737b-4962-a56f-a0190dbca4ca could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:22.947106 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c282a498-cf69-4665-88d7-d34f227c882f tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca" status: 404 len: 111 microversion: 2.1 time: 0.054350 Oct 17 13:20:22.952444 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2900/6062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:22 2022] GET /compute/v2.1/servers/6c51dfd5-737b-4962-a56f-a0190dbca4ca => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:22.962885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:22.964207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:22.982424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.983205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.983799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.984693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.985901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.986698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.003005 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 HTTP/1.1 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '006e7d34-4751-4b4c-9e9b-8be014839e20'} Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:23.005116 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.009836 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.012750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:23.013630 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89673b9f-e2df-4c96-840b-2d79096dca8a tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "DELETE /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 404 len: 111 microversion: 2.1 time: 0.055602 Oct 17 13:20:23.014219 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2901/6063] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:22 2022] DELETE /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:23.024693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:23.025466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] [instance: 006e7d34-4751-4b4c-9e9b-8be014839e20] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:23.033238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.034535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.035376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.036826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.037850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.038909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.059922 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] HTTP exception thrown: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Request method failure captured: Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 HTTP/1.1 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVVQp6YvYDHxc0yiGvf-ijRAGPV7MFNaostbqGmZSC-AMUFEimGmHza5OUiwGbOYigiioTBH3c1SR28EmZWL0tS2BL4RKrW2aC996KRF-CmEetMxCANtzBEeixvC2EhbocZEtDLu3r3IQdVMJkEOiPELvO_2inOiTpe7uAdABtVSh14 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0306c43449c3449797cabdbca458e182", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0306c43449c3449797cabdbca458e182"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0306c43449c3449797cabdbca458e182"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 0306c43449c3449797cabdbca458e182 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1713416349 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 24c6068b196d4cc398176b22196bd5b1 Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersTestJSON-1713416349-project Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '006e7d34-4751-4b4c-9e9b-8be014839e20'} Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:23.061882 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.065667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:23.065667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:23.065667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:23.065667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:23.065667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:23.065667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. Oct 17 13:20:23.065667 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:23.069104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] Returning 404 to user: Instance 006e7d34-4751-4b4c-9e9b-8be014839e20 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:23.070853 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8503e77b-e315-41ba-ac38-f8c1d12d66c7 tempest-DeleteServersTestJSON-1713416349 tempest-DeleteServersTestJSON-1713416349-project] 10.222.0.27 "GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20" status: 404 len: 111 microversion: 2.1 time: 0.051903 Oct 17 13:20:23.072417 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2902/6064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:23 2022] GET /compute/v2.1/servers/006e7d34-4751-4b4c-9e9b-8be014839e20 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:23.113773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:23.122974 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8cfb6804-a9b7-47c2-91a2-934384e00542 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.327141 Oct 17 13:20:23.124031 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3163/6065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:22 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:23.603519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:23.604391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:23.611746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.612498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.613104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.614468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.615416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.616073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.780531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:23.793001 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b6c92c0-57b3-4dcd-9239-3f5128aec926 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.193771 Oct 17 13:20:23.793583 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2903/6066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:23 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:24.032001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:24.037524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:24.059709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.060203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.060636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.061342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.061791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.064873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.149944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:24.151228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:24.161394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.174874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.175324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.176071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.186446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.188624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.270022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:20:24.270752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:20:24.271279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:20:24.271811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:20:24.272429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:20:24.365498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:24.378298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.379557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.381141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.382591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.383496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.384472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.419185 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e25392b3-5ee3-467a-9ca5-0e118820ce69 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e/action" status: 202 len: 1137 microversion: 2.1 time: 0.391253 Oct 17 13:20:24.420297 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3164/6067] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:24 2022] POST /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e/action => generated 1137 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:20:24.444743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:24.445625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:24.453268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.454220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.468679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.470560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.475819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.476645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.480792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:24.497249 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-137d054a-37eb-42dc-bfca-b8465b0f2805 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1313 microversion: 2.1 time: 0.351895 Oct 17 13:20:24.500380 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2904/6068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:24 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:24.790763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:24.804136 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-681fe5e4-319d-49ef-9be0-2d05d8809dda tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.363753 Oct 17 13:20:24.805367 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3165/6069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:24 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:24.820493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:24.828197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:24.836926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.837689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.838596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.839382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.839920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.840415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.052485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:25.064922 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-95a6592c-3e96-4d94-bc7e-29dae6fd7395 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.249646 Oct 17 13:20:25.065885 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2905/6070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:24 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:25.532290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:25.533391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:25.547428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:25.548433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:25.549047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.550311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:25.551642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:25.553415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.793635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:25.802831 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c784c629-688d-420a-949d-b67524fa42cb tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1499 microversion: 2.1 time: 0.275476 Oct 17 13:20:25.804380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3166/6071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:25 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1499 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:25.826994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:25.835181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:25.837680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:25.842685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:25.852527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:25.853025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:25.853467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.854202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:25.854662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:25.859382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:25.859829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:25.860257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.861167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:25.861616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:25.862514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.866079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.920649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lazy-loading 'flavor' on Instance uuid 0d179739-9247-42b2-8368-fa97b931aa78 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:26.017099 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ceb03736-b4aa-4515-b091-4a59c59b1b37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "POST /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78/action" status: 200 len: 32 microversion: 2.1 time: 0.194050 Oct 17 13:20:26.023291 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2906/6072] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:25 2022] POST /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:20:26.034629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:26.035626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:26.046493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:26.047014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:26.047461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:26.049029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:26.049559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:26.049869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:26.421749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:26.426824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:26.430754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:26.440690 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ec76f04-a10f-4e07-83a8-e8f2fca25fde tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.611909 Oct 17 13:20:26.441598 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3167/6073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:25 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:26.450351 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d375875-8ac2-4708-8438-29cba65dc13e tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.423709 Oct 17 13:20:26.450351 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2907/6074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:26 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:26.462031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:26.463819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:26.471931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:26.472830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:26.474544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:26.475984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:26.476622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:26.477456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:26.756558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:26.773955 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a927795b-a5f3-4110-94b7-f39de111044c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.325085 Oct 17 13:20:26.773955 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3168/6075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:26 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:27.466490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:27.467834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:27.477898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:27.478558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:27.487358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.487989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.488153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.488718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.490000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.490575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.491064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.494707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.495152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.495486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.496133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.496685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.767256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:27.777123 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0bd89575-06b4-4f63-8529-f6f3c000dab7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.302581 Oct 17 13:20:27.790209 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3169/6076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:27 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:27.805938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:27.807163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:27.815002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.815701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.816299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.817970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.818656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.819412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.978590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:27.994024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-418c9ef9-99f9-4b79-9437-93e95e75fba2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.193001 Oct 17 13:20:28.012848 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3170/6077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:27 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:28.033302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:28.048652 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17dd1beb-2087-44db-8628-3c3f83eed7f3 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.585715 Oct 17 13:20:28.049559 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2908/6078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:27 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:28.814322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:28.815751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:28.847971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:28.849632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:28.855513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:28.856286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:28.856780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:28.860537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:29.020549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:29.022016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:29.032983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:29.034203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:29.035198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:29.036592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:29.037860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:29.038491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:29.198420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:29.235894 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c255683-126b-49ad-b994-dbedf7c26f37 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.434271 Oct 17 13:20:29.236443 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3171/6079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:28 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:29.265663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:29.266331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:29.300914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:29.301687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:29.303786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:29.304802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:29.308549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:29.309589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:29.399332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:29.409499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4a593a77-4f22-47a8-9e04-04ad5186314c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.393194 Oct 17 13:20:29.419105 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2909/6080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:29 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:29.699316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:29.711680 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b3f5982-8a60-40f6-b93b-90894ee9ed62 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.474049 Oct 17 13:20:29.712500 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3172/6081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:29 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:30.267061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:30.268041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:30.329854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.344118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.344984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.350108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.362629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.370456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.454949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:30.455743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:30.474115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.475000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.475597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.476872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.477742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.495850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.817996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:30.831829 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7ba0f243-4261-4c5f-8cb5-63509f67d175 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.570514 Oct 17 13:20:30.842556 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2910/6082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:30 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:30.844185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:30.850403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:30.851029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:30.863333 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c60a7611-1a7e-48a6-97a5-ebf23876c98e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.415325 Oct 17 13:20:30.864033 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3173/6083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:30 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:30.869336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.869839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.870314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.871027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.875007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.877585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.952044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-530e429c-cc13-4f8f-9027-4203031197b0 req-99672af0-f114-4ddb-9cdc-c0b6ef6a983b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1276f410-3ce3-4048-9d62-1222b0af1bf7", "name": "network-vif-plugged", "status": "completed", "tag": "395fbeef-4885-4f0a-beb0-e11b3f979c9c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:31.029965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-530e429c-cc13-4f8f-9027-4203031197b0 req-99672af0-f114-4ddb-9cdc-c0b6ef6a983b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:31.030806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-530e429c-cc13-4f8f-9027-4203031197b0 req-99672af0-f114-4ddb-9cdc-c0b6ef6a983b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:31.031334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-530e429c-cc13-4f8f-9027-4203031197b0 req-99672af0-f114-4ddb-9cdc-c0b6ef6a983b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:31.058928 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-530e429c-cc13-4f8f-9027-4203031197b0 req-99672af0-f114-4ddb-9cdc-c0b6ef6a983b service nova] Creating event network-vif-plugged:395fbeef-4885-4f0a-beb0-e11b3f979c9c for instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 on n-h1-853316-12 Oct 17 13:20:31.074907 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-530e429c-cc13-4f8f-9027-4203031197b0 req-99672af0-f114-4ddb-9cdc-c0b6ef6a983b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127219 Oct 17 13:20:31.075817 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3174/6084] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:31.524590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:31.551905 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d6651195-a2f0-4ef0-86e2-37462d5176c4 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.707994 Oct 17 13:20:31.562441 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2911/6085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:30 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:31.871937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:31.874631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:31.886991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:31.887503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:31.887936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:31.888849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:31.889317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:31.890115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:31.906014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:31.906873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:31.931949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:31.937504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:31.939170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:31.939626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:31.946898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:31.946898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:31.946898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:32.169049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:32.181534 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20963210-32f0-4207-a921-b783d4a73e53 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.325616 Oct 17 13:20:32.183976 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3175/6086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:31 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:32.389343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:32.395120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:32.422241 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3a4638b5-5e43-47cf-8994-db52e39ac1c9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1203 microversion: 2.1 time: 0.536646 Oct 17 13:20:32.424073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2912/6087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:31 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1203 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:32.586901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:32.587605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:32.602025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:32.602550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:32.602992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:32.603722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:32.604173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:32.604604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:32.858322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:32.875895 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f41a1dfa-5372-4a43-81c7-72e8c8cd1d00 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.300839 Oct 17 13:20:32.876418 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3176/6088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:32 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:33.213347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:33.215209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:33.225101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.225889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.226428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.227657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.228361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.228868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.390630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:33.401798 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e008b9ca-cf46-4687-aeca-6b7c6c715bb1 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.195846 Oct 17 13:20:33.402395 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2913/6089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:33 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:33.455200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:33.455825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:33.463769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.465436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.467229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.469180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.469875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.471685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.737252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:33.751658 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-381f7b39-d919-43bc-8b0c-65b77eba0518 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1389 microversion: 2.1 time: 0.300195 Oct 17 13:20:33.752388 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3177/6090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:33 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1389 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:33.779194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:33.780563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:33.789269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.789982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.790507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.791729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.792372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.792974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.901576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:33.902248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:33.916568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.916912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.917338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.918119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.918621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.919066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.072133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:34.085944 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52a64967-6e67-4b5e-9423-abbfed117efd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1389 microversion: 2.1 time: 0.312060 Oct 17 13:20:34.089865 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2914/6091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:33 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1389 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:34.113317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:34.115149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:34.122247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.122960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.123591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.124486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.124941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.125534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.162373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:34.177084 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-581f67a0-df78-4ccd-b8d9-c27eac7ef86a tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.278785 Oct 17 13:20:34.194390 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3178/6092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:33 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:34.401651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:34.422899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-24a1aac9-ddc1-48e3-b7ff-c9a7d5bbc3cc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1389 microversion: 2.1 time: 0.314394 Oct 17 13:20:34.427680 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2915/6093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:34 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1389 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:34.429858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:34.430710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:34.440479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.441141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.441745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.444123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.444390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.445000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.538641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:34.539367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:34.546286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.547033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.547646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.548815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.549447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.550068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.581118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:20:34.701161 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d846629-273d-4d3f-a18a-745dba54e0fb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 204 len: 0 microversion: 2.1 time: 0.166831 Oct 17 13:20:34.702774 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2916/6094] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:34 2022] DELETE /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:34.718856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:34.722007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:34.730291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.731059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.731712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.732601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.733265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.733985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.910274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:34.925387 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6800a1bb-19da-4fd1-b501-9bdfcd183d7d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.501965 Oct 17 13:20:34.926003 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3179/6095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:34 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:35.015091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:35.026233 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4449fa1d-9ade-4c11-b6c3-4a66a4414f86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1395 microversion: 2.1 time: 0.318300 Oct 17 13:20:35.027562 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2917/6096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:34 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1395 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:35.210073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:35.210847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:35.217536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:35.218248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:35.218857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:35.219731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:35.221865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:35.222547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:35.384672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:35.394730 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-427ca9ac-31b1-467f-8c6f-4f9c49c2c725 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.189603 Oct 17 13:20:35.395410 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3180/6097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:35 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:35.950115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:35.951087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:35.962509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:35.963406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:35.964157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:35.965264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:35.966386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:35.967085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:36.060426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:36.062631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:36.075446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:36.076569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:36.077154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:36.078779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:36.079674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:36.080532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:36.207109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:36.221168 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2bf77612-4dc2-4a98-a4a4-4bfb70f3e701 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.274922 Oct 17 13:20:36.237146 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2918/6098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:35 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:36.371764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:36.390181 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b1f87de-e29c-471e-affe-32261c677e75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1395 microversion: 2.1 time: 0.332532 Oct 17 13:20:36.406757 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3181/6099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:36 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1395 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:36.420377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:36.421053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:36.433328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:36.433823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:36.436627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:36.438208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:36.438855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:36.439517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:36.958879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:36.972384 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80f30905-045c-4adc-8874-e5011d470994 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.558423 Oct 17 13:20:36.972964 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2919/6100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:36 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:37.249157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:37.249753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:37.258147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:37.258664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:37.259103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:37.259813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:37.260338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:37.260756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:37.423040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:37.423659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:37.433735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:37.434197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:37.434648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:37.439337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:37.440120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:37.440736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:37.477565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:37.511560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9edf6196-63d9-4200-bad0-b6d9abd397c7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.266380 Oct 17 13:20:37.515181 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3182/6101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:37 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:37.956607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:37.966624 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f80dcb92-eaf7-4bd8-9e28-5d426c31e202 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1395 microversion: 2.1 time: 0.547230 Oct 17 13:20:37.967895 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2920/6102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:37 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1395 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:38.000242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:38.000851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:38.009082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.009850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.010529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.011470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.012229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.012960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.214072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.226284 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a10be06b-ffd3-4b14-8a6b-e126e0ed5782 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.229570 Oct 17 13:20:38.231631 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3183/6103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:37 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:38.428003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e0190a9f-be64-4fa4-b497-6fde851bd88f req-d55e4148-43a6-4a3f-b3c4-fad040c14cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1276f410-3ce3-4048-9d62-1222b0af1bf7", "name": "network-vif-deleted", "tag": "395fbeef-4885-4f0a-beb0-e11b3f979c9c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:38.441264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e0190a9f-be64-4fa4-b497-6fde851bd88f req-d55e4148-43a6-4a3f-b3c4-fad040c14cae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.441741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e0190a9f-be64-4fa4-b497-6fde851bd88f req-d55e4148-43a6-4a3f-b3c4-fad040c14cae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.445491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e0190a9f-be64-4fa4-b497-6fde851bd88f req-d55e4148-43a6-4a3f-b3c4-fad040c14cae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.465283 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e0190a9f-be64-4fa4-b497-6fde851bd88f req-d55e4148-43a6-4a3f-b3c4-fad040c14cae service nova] Creating event network-vif-deleted:395fbeef-4885-4f0a-beb0-e11b3f979c9c for instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 on n-h1-853316-12 Oct 17 13:20:38.481998 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e0190a9f-be64-4fa4-b497-6fde851bd88f req-d55e4148-43a6-4a3f-b3c4-fad040c14cae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057889 Oct 17 13:20:38.484105 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2921/6104] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:38.550034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:38.551372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:38.572276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.572783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.573231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.574812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.578614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.579354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.893664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.898761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:38.899858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:38.916149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.916973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.917419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.918436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.919128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.919726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.920550 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-82ec93a4-f34d-42bb-b802-01437d2b5b27 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.377596 Oct 17 13:20:38.921836 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3184/6105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:38 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:38.977501 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab0331e7-b39e-4115-bc8c-6f96e69f95d9 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/ips" status: 200 len: 153 microversion: 2.20 time: 0.076611 Oct 17 13:20:38.984755 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2922/6106] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Oct 17 13:20:38 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/ips => generated 153 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:20:38.996993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:38.998610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:39.012872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.014409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.015912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.018703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.019364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.020021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.026585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:39.130540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:39.143600 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bb8db324-9b2b-4487-a4e9-33d3c0ba7075 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.146981 Oct 17 13:20:39.144945 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3185/6107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:38 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:39.251027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:39.253539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:39.266111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.268125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.269921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.272815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.275060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.277144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.837693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:39.846952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82431ddf-6978-4e09-91c2-fae2e85d7007 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.599992 Oct 17 13:20:39.848926 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2923/6108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:39 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:39.960738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:39.962038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:39.976424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.980488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.982765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.983730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.985664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.986714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.171457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:40.172257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:40.186079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.187399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.190007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.190819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.192852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.194362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.310296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.318197 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c51b2de8-b6fa-46b1-b156-812a53e9b1f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.363913 Oct 17 13:20:40.323033 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3186/6109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:39 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:40.368019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.378178 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-20f4e7c2-b5ff-4f49-9ae6-da5e3a4b6b61 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.211230 Oct 17 13:20:40.378767 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2924/6110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:40 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:40.873183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:40.873803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:40.882189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.883586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.885520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.888770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.890153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.893838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.157839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:41.178315 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-777881d3-11e5-4c90-8502-1eb364d24dfa tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1691 microversion: 2.1 time: 0.309186 Oct 17 13:20:41.179077 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3187/6111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:40 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1691 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:41.351940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:41.353138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:41.372339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.373163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.374450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.375371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.378226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.378861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.401266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:41.402040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:41.409905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:41.412093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.412763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.413838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.427439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.428215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.428852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.591902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:41.605095 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1b42405-0034-4c95-aec1-eda3ae5b11a6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.207466 Oct 17 13:20:41.607840 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3188/6112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:41 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:41.791621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:41.800406 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4643a81-9e76-4af2-abcb-bfaffa78eaf5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.455280 Oct 17 13:20:41.805359 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2925/6113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:41 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:42.205012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:42.205716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:42.216253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:42.217239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:42.234511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.235262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.236064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.237718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.238373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.239956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.257916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.258494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.258957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.259720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.265546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.266133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.284937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lazy-loading 'flavor' on Instance uuid 62aae524-015b-4a15-aafa-9000a2183d87 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:42.541624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:42.556524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:42.569706 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-162d6493-7a84-4fd6-9739-59aa7ae7e33d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1697 microversion: 2.1 time: 0.369183 Oct 17 13:20:42.570339 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3189/6114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:42 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1697 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:42.635015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:42.638336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:42.654672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.657113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.659578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.660579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.661831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.665638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.852248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:42.880850 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51046989-09bd-45c6-b83d-aa9740e6d8fa tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.250252 Oct 17 13:20:42.884655 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3190/6115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:42 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:42.921788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:42.922468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:42.934358 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-58f56e03-c4ce-4b74-8167-7134f07e72f6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/action" status: 202 len: 0 microversion: 2.20 time: 0.722315 Oct 17 13:20:42.940645 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2926/6116] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 13:20:42 2022] POST /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:20:42.951757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.952259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.952703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.953422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.953890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.954302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:42.959411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:42.966865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.969272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.984888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.985488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.987617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.990284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.990972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:43.249617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:43.264725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:43.267813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:43.273336 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-562224f6-6022-4901-bf45-c5c0412da916 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.331150 Oct 17 13:20:43.274215 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2927/6117] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:42 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:43.372067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:43.388616 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21fad936-cbbf-4c7d-b577-2461ec7657ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.502518 Oct 17 13:20:43.390153 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3191/6118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:42 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:43.601446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:43.602074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:43.619000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:43.619599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:43.621835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:43.622892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:43.624021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:43.624450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:43.788062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-173737225", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "7a2bca28-0614-40fd-98d9-4183eae06764"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:43.881650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:43.896122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4edbd9a1-a7e0-4125-8f04-362974883260 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1697 microversion: 2.1 time: 0.301534 Oct 17 13:20:43.901588 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3192/6119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:43 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1697 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:43.910609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:43.925611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:43.937533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:43.937957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] validate_networks() for [('7a2bca28-0614-40fd-98d9-4183eae06764', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:20:43.938095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:43.938482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:43.939190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:43.939650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:43.940095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:44.055890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:44.064936 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5219054d-c9bb-4f6f-bd1c-cbc015084cc8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.160238 Oct 17 13:20:44.065529 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3193/6120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:43 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:44.307454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:44.308112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:44.316627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:44.317371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:44.318047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:44.318956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:44.319437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:44.319875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:44.579091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:44.584206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:20:44.584668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:20:44.585511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:20:44.585640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:20:44.586576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:20:44.597284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:44.604269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:44.604761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:44.606045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:44.606649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:44.607916 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d68956e1-f912-4cb7-bd09-b86b2c247458 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.312295 Oct 17 13:20:44.608448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:44.609417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:44.610058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:44.618504 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3194/6121] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:44 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:44.631516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Getting quotas for project db5b4f46ea5e44669a0afdad6d80011d. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:20:44.638260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Getting quotas for user 496e1f8f17c641978ad203e23e93877e and project db5b4f46ea5e44669a0afdad6d80011d. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:20:44.638440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:44.639078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:44.654718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:20:44.657309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:44.657808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:44.658411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:20:44.660432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:44.661371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:44.661904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:44.662566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:44.760512 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ea2419bb-4662-4472-953d-2024007ec5c0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.246910 Oct 17 13:20:44.770953 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2928/6122] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 13:20:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:20:44.780202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d869a018-a12d-49c6-9a53-143578496512 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:44.781441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d869a018-a12d-49c6-9a53-143578496512 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:44.857401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d869a018-a12d-49c6-9a53-143578496512 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:44.868431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d869a018-a12d-49c6-9a53-143578496512 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:44.872026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d869a018-a12d-49c6-9a53-143578496512 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:44.874281 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d869a018-a12d-49c6-9a53-143578496512 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1258 microversion: 2.21 time: 0.101055 Oct 17 13:20:44.892726 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2929/6123] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:44 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1258 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:44.952055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:44.952329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:44.956461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:44.997529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:45.000200 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2b45095b-a974-4b6e-bcba-00cdcfe72a7f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.376111 Oct 17 13:20:45.002078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:45.006443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:45.010145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:45.010769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:45.013185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:45.021170 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3195/6124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:44 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:45.092496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:45.093115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:45.106533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:45.107220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:45.113854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:45.115051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:45.115712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:45.116544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:45.262893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:45.283247 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c4749317-a68a-46b9-85fb-848d29f34000 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.194573 Oct 17 13:20:45.287230 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3196/6125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:45 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:45.349912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:45.359139 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3434ffb6-216a-4d22-a419-f49d3ba9b540 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1682 microversion: 2.1 time: 0.422290 Oct 17 13:20:45.360146 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2930/6126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:44 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1682 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:45.642764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:45.643418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:45.656821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:45.657358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:45.657835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:45.663136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:45.673408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:45.674154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:45.902742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:45.904038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:45.926962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:45.928344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:45.929518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:45.931301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:45.932368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:45.935472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:45.998554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.011904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.017142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.018827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a726391d-dd24-4b59-9d1b-486672816880 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.381038 Oct 17 13:20:46.022116 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3197/6127] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:45 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:46.033465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:46.038863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:46.052898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.054100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.054959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.056220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.057230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.059410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.172549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.204850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.213007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.222608 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e020e464-62b5-465b-b7ab-239d1c27cfdb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1262 microversion: 2.21 time: 0.320107 Oct 17 13:20:46.230499 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2931/6128] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:45 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1262 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:46.306860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.318870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:46.319757 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc2d1ce7-e5d8-47cc-9022-de8011d0440a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.295538 Oct 17 13:20:46.320364 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3198/6129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:46 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:46.335272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:46.368990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.369833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.370644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.373377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.373377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.376705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.490942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.501981 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3777cffe-69e9-4d16-a557-017d9f7849a7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.193212 Oct 17 13:20:46.505806 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2932/6130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:46 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:47.058683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:47.063305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:47.098477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.100012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.101938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.107145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.108296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.109313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.262179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:47.265614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:47.301600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.304777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.306508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.311658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.312557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.317595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.532062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.544148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.545924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.548257 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ffb78784-3b78-4b69-8ac8-90b50630ee3d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.494664 Oct 17 13:20:47.549344 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3199/6131] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:47 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:47.554787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:47.556045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:47.564427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.565531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.566424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.568770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.569648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.570420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.595903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.616072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.620479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.623146 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-45691444-f17a-42fa-9192-adae137c2b34 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1316 microversion: 2.21 time: 0.369110 Oct 17 13:20:47.643174 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2933/6132] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:47 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:47.655012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-006e9991-c722-43c3-a49f-43f478388c35 req-59dff96d-ef4b-402c-9519-9f8945578686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a5fcb1-ccb9-4247-8395-fc8506f2ca9e", "name": "network-vif-plugged", "status": "completed", "tag": "d2c65543-51d8-4a69-ac3d-092733af5213"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:47.668836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-006e9991-c722-43c3-a49f-43f478388c35 req-59dff96d-ef4b-402c-9519-9f8945578686 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.669986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-006e9991-c722-43c3-a49f-43f478388c35 req-59dff96d-ef4b-402c-9519-9f8945578686 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.670796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-006e9991-c722-43c3-a49f-43f478388c35 req-59dff96d-ef4b-402c-9519-9f8945578686 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.688767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-006e9991-c722-43c3-a49f-43f478388c35 req-59dff96d-ef4b-402c-9519-9f8945578686 service nova] Creating event network-vif-plugged:d2c65543-51d8-4a69-ac3d-092733af5213 for instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e on n-h2-853316-12 Oct 17 13:20:47.695651 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-006e9991-c722-43c3-a49f-43f478388c35 req-59dff96d-ef4b-402c-9519-9f8945578686 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053000 Oct 17 13:20:47.696574 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2934/6133] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:47.704037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:47.705742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:47.731762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.735475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.737161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.738228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.743041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.743470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.902007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.916414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.918573 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97f8710e-2b19-4bde-818e-27fb6be9d28f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.367870 Oct 17 13:20:47.921214 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3200/6134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:47 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:47.939967 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-552707d4-5b75-4f77-8e83-f19bc50fbf5b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.241665 Oct 17 13:20:47.943513 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2935/6135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:47 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:48.591655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.601796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.629993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.630657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.631293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.632401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.633305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.634056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.656418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.657944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.681562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.685091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.685867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.687045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.689056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.689764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.042522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.046499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:49.053485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.056626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.058530 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-52a10966-e023-4c78-8319-82c96796b114 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.477549 Oct 17 13:20:49.059726 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3201/6136] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:49.064815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.065746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.073823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.074673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.075382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.076382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.077131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.077793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.228696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.256252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.282692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.284827 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c194629c-85e7-419b-af3f-37227612f39f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1358 microversion: 2.21 time: 0.632890 Oct 17 13:20:49.285887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2936/6137] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1358 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:49.318812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.320034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.338485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.343570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.344703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.346233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.352806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.353914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.377075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.389135 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b2acc3d-e8c0-4c75-970e-8b5aa4064289 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.327672 Oct 17 13:20:49.389927 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3202/6138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:49.768970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.780472 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b808b30-2fc2-437e-b303-cd92052a9983 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 200 len: 1188 microversion: 2.1 time: 0.485455 Oct 17 13:20:49.781621 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2937/6139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 1188 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:50.121578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.123441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.135485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.136436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.137226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.138378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.138996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.139577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.320851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.321937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.339316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.340120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.343157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.348044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.349930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.352510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.404866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.418559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.420572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.421953 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16753d37-2e35-46ae-b22b-bc97c8785959 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.311378 Oct 17 13:20:50.422624 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3203/6140] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:50.443796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e0140b2d-623b-43c7-8783-19e23901a150 req-e2c26a87-131a-460b-bf1c-9a4c5c51658e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c53d19fd-4a13-499b-b067-33220cd6ebed", "tag": "fa45f744-5f83-423d-8840-9e4cc26c3f3e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:50.455083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e0140b2d-623b-43c7-8783-19e23901a150 req-e2c26a87-131a-460b-bf1c-9a4c5c51658e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.456029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e0140b2d-623b-43c7-8783-19e23901a150 req-e2c26a87-131a-460b-bf1c-9a4c5c51658e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.456730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e0140b2d-623b-43c7-8783-19e23901a150 req-e2c26a87-131a-460b-bf1c-9a4c5c51658e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.470467 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e0140b2d-623b-43c7-8783-19e23901a150 req-e2c26a87-131a-460b-bf1c-9a4c5c51658e service nova] Creating event network-changed:fa45f744-5f83-423d-8840-9e4cc26c3f3e for instance c53d19fd-4a13-499b-b067-33220cd6ebed on n-h2-853316-12 Oct 17 13:20:50.476574 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e0140b2d-623b-43c7-8783-19e23901a150 req-e2c26a87-131a-460b-bf1c-9a4c5c51658e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052382 Oct 17 13:20:50.477460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3204/6141] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:50.482915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.483622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.492177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.492548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.493258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.494147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.494795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.495380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.827711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.861818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f95c3cce-f383-4393-9861-9cce882e03ab tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.383115 Oct 17 13:20:50.865356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3205/6142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:50.883892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.886633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.904245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.907035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.907792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.908832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.910880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.912887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.933229 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 HTTP/1.1 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '1276f410-3ce3-4048-9d62-1222b0af1bf7'} Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:50.936481 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:50.940756 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:50.940756 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:50.940756 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:50.940756 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:50.940756 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:50.940756 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:50.940756 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:20:50.945391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:50.947572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e17e12b3-aa44-4b16-81b3-33429e8d907b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 404 len: 111 microversion: 2.1 time: 0.077188 Oct 17 13:20:50.948721 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3206/6143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:51.195380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.231551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.233052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.236624 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dd47cb77-787e-4d9f-83d0-4d7a521fe36e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1358 microversion: 2.21 time: 0.924962 Oct 17 13:20:51.237881 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2938/6144] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1358 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:51.458871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.461742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.477024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.478033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.479005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.480392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.481332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.482278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.773233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.783614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.791613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.791613 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f424aac0-b3cf-4ff6-b746-5b0fc862a920 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.339541 Oct 17 13:20:51.791613 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3207/6145] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:51 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:51.894038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.895276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.923397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.923903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.924759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.925333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.925798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.926281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.163136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.182194 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-320b1adb-6884-4454-9f07-693c047be16d tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.294635 Oct 17 13:20:52.209438 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2939/6146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:51 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:52.277264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:52.281516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:52.303640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.304546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.305149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.306401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.307061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.307654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.664859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.685287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.691272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.694314 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-93981d42-fa4b-48ac-bb6a-c27f42dc05b6 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1358 microversion: 2.21 time: 0.426880 Oct 17 13:20:52.696404 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3208/6147] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:52 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1358 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:52.819050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:52.831558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:52.840422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.841646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.842704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.844334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.845437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.846742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.221350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:53.221977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:53.234609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.235402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.236000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.236883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.237516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.238107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.397889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.417179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.422292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.428055 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0387c4dd-5791-4468-9d21-24fff23dc426 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.612959 Oct 17 13:20:53.430547 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2940/6148] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:52 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:53.486576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.511572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0d0227b-12b3-46d8-9768-f366873a8dc7 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.294980 Oct 17 13:20:53.514514 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3209/6149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:53 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:53.754448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:53.767066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:53.779718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.780872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.781901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.783810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.785080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.785906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.196211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.214335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.216295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.217758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-49c94e20-754d-40a0-a36a-513a9c6cd743 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1358 microversion: 2.21 time: 0.481023 Oct 17 13:20:54.219388 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2941/6150] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:53 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1358 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:54.466235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:54.468581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:54.539429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:54.540739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:54.548167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.555236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.555644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.556469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.556828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.557773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.558943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.559415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.559860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.564494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.565462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.570231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.643218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:54.867133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:54.909039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.920702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.922296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.923675 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-874b5efd-4426-4952-96e9-4aa43cbe3a21 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.467404 Oct 17 13:20:54.925077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.927900 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3210/6151] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:54 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:54.943675 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c3849e12-3aeb-40ea-b627-340fdc644871 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.410368 Oct 17 13:20:54.944524 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2942/6152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:54 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:55.249338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:55.250449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:55.257885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.258675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.259322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:55.260430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.261238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.262236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:55.505640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:55.524975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:55.527852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:55.543638 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f666d866-1f9e-4ab7-91a3-f01e42421d8f tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1358 microversion: 2.21 time: 0.301451 Oct 17 13:20:55.544627 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3211/6153] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:55 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:55.590924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8cd44118-7516-4200-b1a9-ae40b57f5bcb req-6e8f93d1-62ee-44c2-aedd-8e9e88c33a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53d19fd-4a13-499b-b067-33220cd6ebed", "name": "network-vif-plugged", "status": "completed", "tag": "fa45f744-5f83-423d-8840-9e4cc26c3f3e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:55.603026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8cd44118-7516-4200-b1a9-ae40b57f5bcb req-6e8f93d1-62ee-44c2-aedd-8e9e88c33a8b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.603791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8cd44118-7516-4200-b1a9-ae40b57f5bcb req-6e8f93d1-62ee-44c2-aedd-8e9e88c33a8b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.604485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8cd44118-7516-4200-b1a9-ae40b57f5bcb req-6e8f93d1-62ee-44c2-aedd-8e9e88c33a8b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:55.622989 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8cd44118-7516-4200-b1a9-ae40b57f5bcb req-6e8f93d1-62ee-44c2-aedd-8e9e88c33a8b service nova] Creating event network-vif-plugged:fa45f744-5f83-423d-8840-9e4cc26c3f3e for instance c53d19fd-4a13-499b-b067-33220cd6ebed on n-h2-853316-12 Oct 17 13:20:55.630468 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8cd44118-7516-4200-b1a9-ae40b57f5bcb req-6e8f93d1-62ee-44c2-aedd-8e9e88c33a8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043027 Oct 17 13:20:55.631745 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2943/6154] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:55.951487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:55.955880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:55.978827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:55.979535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:55.983176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.984344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.985368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:55.986900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.988665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.989944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.990110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.990804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:55.990925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:55.991870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.992460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.992989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.215780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:56.229355 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-42e8845d-4234-4544-a03c-65266b6fcef5 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.263209 Oct 17 13:20:56.230428 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2944/6155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:55 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:56.328081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:56.342740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:56.350791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:56.352979 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0f2a2fc-3f19-4f43-bd60-3596b528d400 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.407502 Oct 17 13:20:56.356486 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3212/6156] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:55 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:56.503864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:56.505541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:56.538919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:56.539787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:56.541382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.542619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:56.543451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:56.544231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.570970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:56.571640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:56.578960 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.583038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:56.583541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:56.583975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 HTTP/1.1 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1276f410-3ce3-4048-9d62-1222b0af1bf7'} Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:56.585047 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.589679 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.591607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:56.593093 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6258a061-5bc9-4830-9f30-b933efbd26d1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 404 len: 111 microversion: 2.1 time: 0.112404 Oct 17 13:20:56.594194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:56.595267 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2945/6157] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:56 2022] DELETE /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:56.596029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:56.596643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.605077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:56.608329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 1276f410-3ce3-4048-9d62-1222b0af1bf7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:56.622976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:56.623669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:56.624614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.625539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:56.626226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:56.626867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.642848 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 HTTP/1.1 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '1276f410-3ce3-4048-9d62-1222b0af1bf7'} Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:56.644669 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.649533 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:56.649533 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:56.649533 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:56.649533 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:56.649533 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:56.649533 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. Oct 17 13:20:56.649533 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:20:56.651096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 1276f410-3ce3-4048-9d62-1222b0af1bf7 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:56.652692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-95b58335-709c-49fe-8780-64699db7f8fd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7" status: 404 len: 111 microversion: 2.1 time: 0.051614 Oct 17 13:20:56.653465 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2946/6158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:56 2022] GET /compute/v2.1/servers/1276f410-3ce3-4048-9d62-1222b0af1bf7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:20:57.262958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:57.263761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:57.294496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.295064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.295443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.305942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.307190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.307814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.529227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.555124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.560624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.563982 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40fffd48-3c53-4d5e-876e-785f886ad4f4 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1358 microversion: 2.21 time: 0.996369 Oct 17 13:20:57.565059 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3213/6159] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:56 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1358 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:57.580645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:57.587401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:57.599380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.600111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.600887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.601787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.602523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.603211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.710601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.720612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:57.732538 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3ebad512-8a1f-4a1d-82b2-9558ad9f383f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.481833 Oct 17 13:20:57.747960 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2947/6160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:57 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:58.117226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.133960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.136017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.136920 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fbb6e7b4-20b9-4ee0-bf95-a3b417efd96b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.570292 Oct 17 13:20:58.144001 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3214/6161] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:57 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:58.593490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:58.594802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:58.609845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.610771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.611582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.613813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.616828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.617742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.766873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:58.768389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:58.801120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.802854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.803320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.806710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.807189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.810327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.921966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.966240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.985093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.992193 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c91c5037-aabc-4f27-b358-6a050a4f823a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1550 microversion: 2.21 time: 0.397538 Oct 17 13:20:58.993581 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2948/6162] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:58 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1550 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:59.049041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.049678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.069693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.070296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.070938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.073077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.076008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.076503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.120995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:20:59.188274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.210090 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-64c6402c-9cef-4206-b99b-d7a26f5d881f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1485 microversion: 2.1 time: 0.455664 Oct 17 13:20:59.210724 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3215/6163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:58 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1485 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:59.219260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.219877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.241591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.244075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.246785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.247748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.248385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.249988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.271846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:59.282894 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0277ee45-00bd-4cfb-ac89-a05eacb0ec3e tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 204 len: 0 microversion: 2.21 time: 0.244934 Oct 17 13:20:59.284165 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2949/6164] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:20:59 2022] DELETE /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:20:59.294338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:59.294706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.304285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.304869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.305397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.306102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.306588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.307018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.418954 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac261bd1-4e2e-4f4c-a105-452078b7bcd3 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "POST /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78/action" status: 202 len: 0 microversion: 2.1 time: 0.132930 Oct 17 13:20:59.420288 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2950/6165] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:59 2022] POST /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:20:59.426457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.430791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.462431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.465301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.466907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.468510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.470964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.479951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.831968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.851914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.855633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.857885 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c5e1ac3-5377-4a6a-a13a-2d6c5ccb33ad tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1745 microversion: 2.20 time: 0.642267 Oct 17 13:20:59.873541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.885222 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3216/6166] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:59 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1745 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:59.890918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.899978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.902026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.902764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.905599 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-37ce0e33-985b-4063-852a-493cb6cab7e0 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1556 microversion: 2.21 time: 0.483749 Oct 17 13:20:59.906683 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2951/6167] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:59 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1556 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:59.933750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.934560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.943335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.944132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.944629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.945068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.527439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:00.548488 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-66a4f168-1a5b-4720-9aa7-8dd404f3180b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1493 microversion: 2.1 time: 0.661353 Oct 17 13:21:00.558744 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3217/6168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:59 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1493 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:00.893085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:00.913441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:00.931267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.934065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.934746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.939131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.939614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.940054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.940854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:00.941483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:00.963448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.968686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.974429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.976252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.980698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.981568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.251187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.278834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.280719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.287293 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-863aeecc-3034-45ec-9110-c7fbe8bdc648 tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1556 microversion: 2.21 time: 0.349615 Oct 17 13:21:01.288233 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3218/6169] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:00 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1556 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:21:01.511090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.533480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.538225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.543095 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bda9aacc-bb2b-4a2b-85f8-f69f6cb331aa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1745 microversion: 2.20 time: 0.656868 Oct 17 13:21:01.545048 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2952/6170] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:00 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1745 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:01.564395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-04525d06-11f4-4e66-afeb-f6798a39b5a6 req-b613fce2-560f-4b06-8107-7ad040fb1f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62aae524-015b-4a15-aafa-9000a2183d87", "name": "network-vif-plugged", "status": "completed", "tag": "da7a58b2-ab1e-4bb4-8804-af0f51d82900"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:01.601543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:01.602886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-04525d06-11f4-4e66-afeb-f6798a39b5a6 req-b613fce2-560f-4b06-8107-7ad040fb1f59 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.611853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:01.615105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-04525d06-11f4-4e66-afeb-f6798a39b5a6 req-b613fce2-560f-4b06-8107-7ad040fb1f59 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.615560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-04525d06-11f4-4e66-afeb-f6798a39b5a6 req-b613fce2-560f-4b06-8107-7ad040fb1f59 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.619476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.619986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.621145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.621145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.621601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.622038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.665188 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-04525d06-11f4-4e66-afeb-f6798a39b5a6 req-b613fce2-560f-4b06-8107-7ad040fb1f59 service nova] Creating event network-vif-plugged:da7a58b2-ab1e-4bb4-8804-af0f51d82900 for instance 62aae524-015b-4a15-aafa-9000a2183d87 on n-h2-853316-12 Oct 17 13:21:01.671287 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-04525d06-11f4-4e66-afeb-f6798a39b5a6 req-b613fce2-560f-4b06-8107-7ad040fb1f59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110656 Oct 17 13:21:01.672230 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3219/6171] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:02.105831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.109744 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7ab51854-1776-423c-b38f-cd81e5d69c4b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1493 microversion: 2.1 time: 0.526111 Oct 17 13:21:02.123798 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2953/6172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:01 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1493 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:02.318558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:02.319809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:02.331371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.337609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.338259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.339118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.339695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.345420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.393305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:02.589367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:02.590055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:02.609295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.609910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.610399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.611177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.611643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.612514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.723866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.750094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.758426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.760466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a5c64d27-7c60-4e0e-ba93-96480a14beee tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1556 microversion: 2.21 time: 0.449387 Oct 17 13:21:02.770826 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3220/6173] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:02 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1556 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:03.139978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:03.141011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:03.155479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.156028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.156476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.157216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.157670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.158097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.539379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:03.549248 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e81c9fc9-ab57-442d-be3a-243aabd502ea tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1499 microversion: 2.1 time: 0.413146 Oct 17 13:21:03.568664 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3221/6174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:03 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1499 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:03.585599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:03.585926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:03.616354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.621929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.622795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.631954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.632559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.633090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.775816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:21:04.175288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.195592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.197088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.209447 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04ddf171-94f2-4b64-a487-9906e29d859a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.613883 Oct 17 13:21:04.213169 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2954/6175] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:02 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:04.230791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:04.232286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:04.267749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.273997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.273997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.274787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.279597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.280645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.376782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.377281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.379457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.381446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lazy-loading 'fault' on Instance uuid c53d19fd-4a13-499b-b067-33220cd6ebed {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:21:04.485515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.499049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.503805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496e1f8f17c641978ad203e23e93877e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5b4f46ea5e44669a0afdad6d80011d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.507811 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9fdc3e74-578b-4066-9ba9-1cdd9e9fdafb tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 200 len: 1348 microversion: 2.21 time: 0.293359 Oct 17 13:21:04.531594 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2955/6176] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:04 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 1348 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:04.547345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-dd1f5d6a-7f86-425d-b197-bae57ad6d34f req-a036b49b-9251-4fef-8e1c-91c138695034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53d19fd-4a13-499b-b067-33220cd6ebed", "name": "network-vif-deleted", "tag": "fa45f744-5f83-423d-8840-9e4cc26c3f3e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:04.565176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd1f5d6a-7f86-425d-b197-bae57ad6d34f req-a036b49b-9251-4fef-8e1c-91c138695034 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.565974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd1f5d6a-7f86-425d-b197-bae57ad6d34f req-a036b49b-9251-4fef-8e1c-91c138695034 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.566542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd1f5d6a-7f86-425d-b197-bae57ad6d34f req-a036b49b-9251-4fef-8e1c-91c138695034 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.584047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-dd1f5d6a-7f86-425d-b197-bae57ad6d34f req-a036b49b-9251-4fef-8e1c-91c138695034 service nova] Creating event network-vif-deleted:fa45f744-5f83-423d-8840-9e4cc26c3f3e for instance c53d19fd-4a13-499b-b067-33220cd6ebed on n-h2-853316-12 Oct 17 13:21:04.589606 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-dd1f5d6a-7f86-425d-b197-bae57ad6d34f req-a036b49b-9251-4fef-8e1c-91c138695034 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051203 Oct 17 13:21:04.590365 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2956/6177] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:04.734198 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7cc67302-a688-4c16-b37e-f08473bd9344 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 204 len: 0 microversion: 2.1 time: 1.152443 Oct 17 13:21:04.744084 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3222/6178] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:21:03 2022] DELETE /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 0 bytes in 1159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:21:04.750455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:04.751209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:04.768592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.769767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.770013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.771159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.771707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.772146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.278479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.279791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.302045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.302800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.303256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.306202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.306691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.311129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.402991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.431255 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0fb280a7-176c-4db9-9dbc-1cdf68f57766 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.685441 Oct 17 13:21:05.431906 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2957/6179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:04 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:05.549550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.553827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.584775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.588761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.589480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.590528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.591208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.591843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.670419 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] HTTP exception thrown: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:05.671482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Request method failure captured: Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed HTTP/1.1 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVar_BpC8s-QH8M9tFre2hikmdvGmwzxP9VPti1_G0n7Y17DY_8poGWS-eRr4Cqhg-bsl3KRUj_Z5Kq1FxXeZ46TGsw6GGeawNzk1CFVnhhz_ZqgcNQAenpCQYcyAaGdI-3390DliiKnqtcS6E3vKj9RnVWnIfGiTz2lPD-a1wIXIQ4 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: db5b4f46ea5e44669a0afdad6d80011d Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_db5b4f46ea5e44669a0afdad6d80011d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: db5b4f46ea5e44669a0afdad6d80011d Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-InstanceActionsV221TestJSON-1076480533-project Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 496e1f8f17c641978ad203e23e93877e Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-InstanceActionsV221TestJSON-1076480533-project Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c53d19fd-4a13-499b-b067-33220cd6ebed'} Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:05.681200 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:05.686146 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:05.686146 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:05.686146 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:05.686146 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:05.686146 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:05.686146 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:05.686146 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:05.686146 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:05.692164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Returning 404 to user: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:05.693783 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b499c578-80a8-4ce9-b5d8-99c61f53b42c tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 404 len: 111 microversion: 2.21 time: 0.156452 Oct 17 13:21:05.706333 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2958/6180] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:21:05.709518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.713000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.713969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '.version_select at 0x7fa81bb974c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.716605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.716785 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e786bf26-b9d2-49ea-8105-92978ac4e166 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 0.465040 Oct 17 13:21:05.726443 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3223/6181] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:21:05.732101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.737951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.739380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.741171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.741863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.742552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.990388 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a651d26c-5135-4d80-b3ba-dfcdb6f3926a tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.277129 Oct 17 13:21:06.008487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.009174 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2959/6182] 10.222.0.27 () {60 vars in 1337 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed/os-instance-actions => generated 611 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:21:06.010960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.044636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.045407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.046019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.052541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.055380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.056012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.115024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] HTTP exception thrown: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Request method failure captured: Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed HTTP/1.1 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVar_BpC8s-QH8M9tFre2hikmdvGmwzxP9VPti1_G0n7Y17DY_8poGWS-eRr4Cqhg-bsl3KRUj_Z5Kq1FxXeZ46TGsw6GGeawNzk1CFVnhhz_ZqgcNQAenpCQYcyAaGdI-3390DliiKnqtcS6E3vKj9RnVWnIfGiTz2lPD-a1wIXIQ4 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: db5b4f46ea5e44669a0afdad6d80011d Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_db5b4f46ea5e44669a0afdad6d80011d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: db5b4f46ea5e44669a0afdad6d80011d Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-InstanceActionsV221TestJSON-1076480533-project Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 496e1f8f17c641978ad203e23e93877e Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-InstanceActionsV221TestJSON-1076480533-project Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'c53d19fd-4a13-499b-b067-33220cd6ebed'} Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:06.121133 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.125154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Returning 404 to user: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:06.126090 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6805207a-a75f-4655-b521-50ce7d81389d tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 404 len: 111 microversion: 2.21 time: 0.127889 Oct 17 13:21:06.136921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.137547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] [instance: c53d19fd-4a13-499b-b067-33220cd6ebed] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.146026 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3224/6183] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:21:05 2022] DELETE /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:21:06.153639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.154738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.155197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.155937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.156392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.158609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.200017 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] HTTP exception thrown: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Request method failure captured: Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed HTTP/1.1 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVar_BpC8s-QH8M9tFre2hikmdvGmwzxP9VPti1_G0n7Y17DY_8poGWS-eRr4Cqhg-bsl3KRUj_Z5Kq1FxXeZ46TGsw6GGeawNzk1CFVnhhz_ZqgcNQAenpCQYcyAaGdI-3390DliiKnqtcS6E3vKj9RnVWnIfGiTz2lPD-a1wIXIQ4 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: db5b4f46ea5e44669a0afdad6d80011d Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_db5b4f46ea5e44669a0afdad6d80011d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db5b4f46ea5e44669a0afdad6d80011d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: db5b4f46ea5e44669a0afdad6d80011d Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1076480533 Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-InstanceActionsV221TestJSON-1076480533-project Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 496e1f8f17c641978ad203e23e93877e Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-InstanceActionsV221TestJSON-1076480533-project Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c53d19fd-4a13-499b-b067-33220cd6ebed'} Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.208909 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:06.215278 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.215278 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:06.215278 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:06.215278 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:06.215278 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:06.215278 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:06.215278 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. Oct 17 13:21:06.215278 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:06.219463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] Returning 404 to user: Instance c53d19fd-4a13-499b-b067-33220cd6ebed could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:06.221169 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b90d99b-1e75-47c6-8aee-f15c8c440bdd tempest-InstanceActionsV221TestJSON-1076480533 tempest-InstanceActionsV221TestJSON-1076480533-project] 10.222.0.27 "GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed" status: 404 len: 111 microversion: 2.21 time: 0.089578 Oct 17 13:21:06.226225 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2960/6184] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/c53d19fd-4a13-499b-b067-33220cd6ebed => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:21:06.462206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.463314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.472042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.476738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.477467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.479709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.484170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.485220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.758649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.759548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.783694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.784527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.785243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.803239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.804446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.809227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.461422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.483640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21ae0f5d-728a-452f-91ad-a86e82b7c152 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 1.023114 Oct 17 13:21:07.492953 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3225/6185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:07.561067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.586981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.599245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.600611 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7e98403d-a601-46f5-b806-7a517e303f69 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 0.846368 Oct 17 13:21:07.604671 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2961/6186] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:08.509889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:08.511203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:08.532142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.532532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.533167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.535244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.536517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.537299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.657048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:08.657544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:08.680444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.682628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.684717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.685689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.686905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.690584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.267955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:09.297108 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e0ac81f0-a327-415a-80a1-3a59114b08f2 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1505 microversion: 2.1 time: 0.791611 Oct 17 13:21:09.315349 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3226/6187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:08 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1505 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:09.410099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:09.425459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:09.428728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:09.432942 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a7726859-d89d-47ad-bb02-1191723a890f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 0.784718 Oct 17 13:21:09.444790 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2962/6188] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:08 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:21:10.336951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:10.337733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:10.367193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.370014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.384965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.388769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.390612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.392138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.403621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2fb07217-5f6b-4f05-8915-a5e9678ae5e8 req-9f7cf444-19ad-40eb-af80-d547939a1d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d179739-9247-42b2-8368-fa97b931aa78", "name": "network-vif-deleted", "tag": "5a9276b3-12d1-462b-9954-aef16ae4855b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:10.450319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2fb07217-5f6b-4f05-8915-a5e9678ae5e8 req-9f7cf444-19ad-40eb-af80-d547939a1d09 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.463292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2fb07217-5f6b-4f05-8915-a5e9678ae5e8 req-9f7cf444-19ad-40eb-af80-d547939a1d09 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.464032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2fb07217-5f6b-4f05-8915-a5e9678ae5e8 req-9f7cf444-19ad-40eb-af80-d547939a1d09 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.524270 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2fb07217-5f6b-4f05-8915-a5e9678ae5e8 req-9f7cf444-19ad-40eb-af80-d547939a1d09 service nova] Creating event network-vif-deleted:5a9276b3-12d1-462b-9954-aef16ae4855b for instance 0d179739-9247-42b2-8368-fa97b931aa78 on n-h1-853316-12 Oct 17 13:21:10.539575 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2fb07217-5f6b-4f05-8915-a5e9678ae5e8 req-9f7cf444-19ad-40eb-af80-d547939a1d09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139643 Oct 17 13:21:10.550982 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2963/6189] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:10.588017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:10.589176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:10.598786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.603693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.604416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.605996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.606690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.609627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:10.618689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.623051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16284605-7443-441d-a958-2a91ef26381b tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 200 len: 1298 microversion: 2.1 time: 0.291611 Oct 17 13:21:10.641882 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3227/6190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:10 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 1298 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:10.682675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:11.318565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.343949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.355756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.372141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a3c5f0c2-2286-45d0-86f9-96792266fc52 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 0.815140 Oct 17 13:21:11.374414 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2964/6191] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:10 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:11.654882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:11.655500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: 0d179739-9247-42b2-8368-fa97b931aa78] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:11.680624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:11.681563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:11.685140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:11.685586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.689190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.690030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.691045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.691778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.693988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.735635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.745441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.745982 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] HTTP exception thrown: Instance 0d179739-9247-42b2-8368-fa97b931aa78 could not be found. Oct 17 13:21:11.747757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.748528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.749004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Request method failure captured: Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 HTTP/1.1 Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVZQfPNDBfh7TJCBgX5wohZjsCV3X6CeyJxpIxfFH5poF1_pa7GNFi68_2B5ZD-I6lIcvOz6EoH-_kojhkhpmDb-MxWm0IwQM9Ajs41Wrr0XCZrycZNjwuSd6-v0EqFcFUZ3pk8B6Pa_-b1wNjaYkeK0nuLAtA4hZete_EXsuluFDik Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 8a70674ba07848b3aef59e8fc4893feb Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerRescueTestJSON-1294522101 Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a70674ba07848b3aef59e8fc4893feb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a70674ba07848b3aef59e8fc4893feb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a70674ba07848b3aef59e8fc4893feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a70674ba07848b3aef59e8fc4893feb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerRescueTestJSON-1294522101 Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 8a70674ba07848b3aef59e8fc4893feb Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerRescueTestJSON-1294522101 Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerRescueTestJSON-1294522101-project Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 5456d0b366d64cb481dd95e17d2ccb4c Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerRescueTestJSON-1294522101-project Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 0d179739-9247-42b2-8368-fa97b931aa78 could not be found. Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '0d179739-9247-42b2-8368-fa97b931aa78'} Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d179739-9247-42b2-8368-fa97b931aa78 could not be found. Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d179739-9247-42b2-8368-fa97b931aa78 could not be found. Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:11.753923 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.762939 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:11.762939 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:11.762939 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:11.762939 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:11.762939 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:11.762939 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d179739-9247-42b2-8368-fa97b931aa78 could not be found. Oct 17 13:21:11.762939 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.764386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.769915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Returning 404 to user: Instance 0d179739-9247-42b2-8368-fa97b931aa78 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:11.774254 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6cfcd732-a9db-4796-8704-af49d51c030a tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78" status: 404 len: 111 microversion: 2.1 time: 0.123924 Oct 17 13:21:11.784580 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3228/6192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:11 2022] GET /compute/v2.1/servers/0d179739-9247-42b2-8368-fa97b931aa78 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:21:11.809718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:11.810842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:11.835326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.839688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.842777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.846068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.859639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.860151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.895159 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f6a62f73-907e-4d5e-b049-008b2bac3d31 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "POST /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e/action" status: 200 len: 24571 microversion: 2.1 time: 0.219645 Oct 17 13:21:11.898368 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2965/6193] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:21:11 2022] POST /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e/action => generated 24571 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:21:12.003388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:21:12.177749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a2205bb-86ba-4142-9edc-98fe50db0654 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 204 len: 0 microversion: 2.1 time: 0.386651 Oct 17 13:21:12.181224 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3229/6194] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:21:11 2022] DELETE /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:21:12.191409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:12.193165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:12.219567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.220062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.220687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.221494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.221953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.242111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.433202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:12.434231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:12.447677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.448442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.449039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.449974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.453975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.454671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.793683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:12.817025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f42e9b72-8c3f-4a3c-989c-3cc4c2eaa751 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1492 microversion: 2.1 time: 0.629716 Oct 17 13:21:12.821709 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2966/6195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:12 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1492 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:13.531714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:13.572394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:13.579494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:13.586061 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ccf63ebb-9355-4316-bf12-dde48e58564b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.153558 Oct 17 13:21:13.587825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3230/6196] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:12 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:13.867438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:13.868286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:13.896288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.896788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.897229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:13.897963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.898446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.898913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:14.280946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:14.296200 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa8039b5-b7d4-4118-8899-660614a8cf92 tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1492 microversion: 2.1 time: 0.432852 Oct 17 13:21:14.303374 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2967/6197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:13 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1492 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:14.617459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:14.618809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:14.633471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:14.640923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:14.641506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:14.642380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:14.642898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:14.643327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:15.185173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:15.197235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:15.200018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:15.201660 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9441a40c-f961-47d2-9945-92028dddaf79 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 0.588957 Oct 17 13:21:15.215254 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3231/6198] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:14 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:15.338769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:15.339401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:15.363512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:15.364581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:15.365026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:15.377073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:15.378399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:15.380684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.231548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:16.232271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:16.246892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:16.250269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:16.251004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.251940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:16.255445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:16.256146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.357673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.386912 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a26fdd04-a49e-452c-a3c8-b74dfba36ecd tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1492 microversion: 2.1 time: 1.054276 Oct 17 13:21:16.390989 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2968/6199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:15 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1492 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:16.709249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.740879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.753516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.755439 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5c8499ff-a0f9-4e46-9157-0e8f07dc70f5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 0.527719 Oct 17 13:21:16.773039 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3232/6200] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:16 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:21:17.199377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e535bdfa-2440-48b4-bcb9-47257a3a60c3 req-9249407e-250a-4e78-95b0-eb55e1ed862d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37", "name": "network-vif-deleted", "tag": "c02b3326-e774-4542-b3cb-67db6b018469"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:17.243761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e535bdfa-2440-48b4-bcb9-47257a3a60c3 req-9249407e-250a-4e78-95b0-eb55e1ed862d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.251612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e535bdfa-2440-48b4-bcb9-47257a3a60c3 req-9249407e-250a-4e78-95b0-eb55e1ed862d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.253253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e535bdfa-2440-48b4-bcb9-47257a3a60c3 req-9249407e-250a-4e78-95b0-eb55e1ed862d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.414190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:17.415734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:17.432518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.433010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.433456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.434296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.447840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.448327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.690489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.690994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.695522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.700614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lazy-loading 'fault' on Instance uuid f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:21:17.961707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5456d0b366d64cb481dd95e17d2ccb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a70674ba07848b3aef59e8fc4893feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:17.991657 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18767140-c8a9-44d5-9e07-86471077a5ee tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 200 len: 1304 microversion: 2.1 time: 0.581409 Oct 17 13:21:17.992267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3233/6201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:17 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 1304 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:18.018637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:18.033116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:18.060064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.063204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.063945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.068694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.069476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.070121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.181052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e535bdfa-2440-48b4-bcb9-47257a3a60c3 req-9249407e-250a-4e78-95b0-eb55e1ed862d service nova] Creating event network-vif-deleted:c02b3326-e774-4542-b3cb-67db6b018469 for instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 on n-h1-853316-12 Oct 17 13:21:18.203906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e535bdfa-2440-48b4-bcb9-47257a3a60c3 req-9249407e-250a-4e78-95b0-eb55e1ed862d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.004709 Oct 17 13:21:18.208692 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2969/6202] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:21:18.616828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.621070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:18.634279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.636433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.638753 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df09201f-8942-44e0-83ae-3a6995514cc1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 0.636383 Oct 17 13:21:18.651368 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3234/6203] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:18 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:19.035779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:19.044398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] [instance: f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:19.073412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:19.073972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:19.074520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:19.075285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:19.086824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:19.087409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:19.167341 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] HTTP exception thrown: Instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 could not be found. Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Request method failure captured: Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 HTTP/1.1 Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVZQfPNDBfh7TJCBgX5wohZjsCV3X6CeyJxpIxfFH5poF1_pa7GNFi68_2B5ZD-I6lIcvOz6EoH-_kojhkhpmDb-MxWm0IwQM9Ajs41Wrr0XCZrycZNjwuSd6-v0EqFcFUZ3pk8B6Pa_-b1wNjaYkeK0nuLAtA4hZete_EXsuluFDik Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 8a70674ba07848b3aef59e8fc4893feb Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerRescueTestJSON-1294522101 Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a70674ba07848b3aef59e8fc4893feb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a70674ba07848b3aef59e8fc4893feb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a70674ba07848b3aef59e8fc4893feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a70674ba07848b3aef59e8fc4893feb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerRescueTestJSON-1294522101 Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 8a70674ba07848b3aef59e8fc4893feb Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerRescueTestJSON-1294522101 Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerRescueTestJSON-1294522101-project Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 5456d0b366d64cb481dd95e17d2ccb4c Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerRescueTestJSON-1294522101-project Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 could not be found. Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37'} Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 could not be found. Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 could not be found. Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:19.169122 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 could not be found. Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] Returning 404 to user: Instance f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:19.174377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0a22a2e2-1270-4301-8910-8e7f37e3933f tempest-ServerRescueTestJSON-1294522101 tempest-ServerRescueTestJSON-1294522101-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37" status: 404 len: 111 microversion: 2.1 time: 0.148741 Oct 17 13:21:19.184143 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2970/6204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:19 2022] GET /compute/v2.1/servers/f3f7dd4a-929d-42ad-b4e3-b69ac1b9fa37 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:21:19.669722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:19.671084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:19.690668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:19.700375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:19.701562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:19.703432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:19.704531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:19.705215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:20.737605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:20.753572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:20.756096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:20.758141 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3be08781-b854-41f8-91c9-2c7cc0336917 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.092322 Oct 17 13:21:20.774200 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3235/6205] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:19 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:21.792720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:21.793570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:21.819470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:21.823118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:21.832155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:21.838523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:21.839746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:21.842334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.456941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.493351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.498426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.499209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:22.500467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:22.509409 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-06752010-79aa-4836-9449-278b6e125449 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 0.723596 Oct 17 13:21:22.512219 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2971/6206] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:21 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:22.521746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.523040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.523754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.524705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.526026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.544116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.587094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-143eb684-79e8-431e-8ae3-71a4526a8579 req-fbdbe0b1-b615-48b1-8576-bd6d541f83f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a5fcb1-ccb9-4247-8395-fc8506f2ca9e", "tag": "d2c65543-51d8-4a69-ac3d-092733af5213"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:22.624277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-143eb684-79e8-431e-8ae3-71a4526a8579 req-fbdbe0b1-b615-48b1-8576-bd6d541f83f8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.625955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-143eb684-79e8-431e-8ae3-71a4526a8579 req-fbdbe0b1-b615-48b1-8576-bd6d541f83f8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.630929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-143eb684-79e8-431e-8ae3-71a4526a8579 req-fbdbe0b1-b615-48b1-8576-bd6d541f83f8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.644110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:21:22.688957 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-143eb684-79e8-431e-8ae3-71a4526a8579 req-fbdbe0b1-b615-48b1-8576-bd6d541f83f8 service nova] Creating event network-changed:d2c65543-51d8-4a69-ac3d-092733af5213 for instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e on n-h2-853316-12 Oct 17 13:21:22.706339 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-143eb684-79e8-431e-8ae3-71a4526a8579 req-fbdbe0b1-b615-48b1-8576-bd6d541f83f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125516 Oct 17 13:21:22.713126 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2972/6207] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:23.020544 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-598c66fd-aa3e-4d44-a12e-36bdd37bfef1 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 204 len: 0 microversion: 2.1 time: 0.522936 Oct 17 13:21:23.025493 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3236/6208] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:21:22 2022] DELETE /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:21:23.037569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:23.038324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:23.058044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:23.058504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:23.058959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:23.059699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:23.060162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:23.062473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:23.544630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:23.545293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:23.560996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:23.561778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:23.562514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:23.568640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:23.569502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:23.570706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:23.591611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:23.603543 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b32840a1-ff6f-40ad-a301-6325edc06bad tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1688 microversion: 2.1 time: 0.572841 Oct 17 13:21:23.619172 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2973/6209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:23 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1688 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:24.647902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:24.649285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:24.668562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:24.673251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:24.674740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:24.678121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:24.681650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:24.685772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.218293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.231222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.237942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.241644 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eab7d31b-ec62-4b77-80df-2950a66d61a6 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.700599 Oct 17 13:21:25.243463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3237/6210] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:23 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:25.419672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.429983 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-469ec50a-ced0-47bd-aaca-3411a0c80e0e tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1688 microversion: 2.1 time: 0.787438 Oct 17 13:21:25.461852 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2974/6211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:24 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1688 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:26.274555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:26.275390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:26.298767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:26.299647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:26.300355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.301738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:26.302761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:26.303429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.474691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:26.476338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:26.517984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:26.519307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:26.520903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.523796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:26.527654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:26.529262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.725135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:26.751172 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-383d0a28-2110-48ed-8682-3363373b28db tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1501 microversion: 2.1 time: 0.282202 Oct 17 13:21:26.755635 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2975/6212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:26 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:27.717409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e474b1da-9f10-4364-8c69-c47b7bb91ab1 req-d3881836-9fd0-41ee-bfea-b1a28b938204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a5fcb1-ccb9-4247-8395-fc8506f2ca9e", "name": "network-vif-deleted", "tag": "d2c65543-51d8-4a69-ac3d-092733af5213"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:27.757159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e474b1da-9f10-4364-8c69-c47b7bb91ab1 req-d3881836-9fd0-41ee-bfea-b1a28b938204 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.771209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e474b1da-9f10-4364-8c69-c47b7bb91ab1 req-d3881836-9fd0-41ee-bfea-b1a28b938204 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.771857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e474b1da-9f10-4364-8c69-c47b7bb91ab1 req-d3881836-9fd0-41ee-bfea-b1a28b938204 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:27.823492 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e474b1da-9f10-4364-8c69-c47b7bb91ab1 req-d3881836-9fd0-41ee-bfea-b1a28b938204 service nova] Creating event network-vif-deleted:d2c65543-51d8-4a69-ac3d-092733af5213 for instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e on n-h2-853316-12 Oct 17 13:21:27.841679 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e474b1da-9f10-4364-8c69-c47b7bb91ab1 req-d3881836-9fd0-41ee-bfea-b1a28b938204 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128493 Oct 17 13:21:27.848621 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2976/6213] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:21:27.858248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:27.876715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:27.880512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:27.884886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:27.897090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:27.904825 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-325e1774-281b-46e2-b68a-fa7bf49cd05a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.631393 Oct 17 13:21:27.908653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.909829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.911400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:27.915162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.915847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.916503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:27.920786 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3238/6214] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:26 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:28.002274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.003294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.004400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.005548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lazy-loading 'fault' on Instance uuid 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:21:28.179158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cee3a8479444aa3a00b2c29407931d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d16284093341d980341f1dce38f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:28.197552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d4cb5067-8ca7-4171-8302-3bbe93e5b9a8 tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 200 len: 1355 microversion: 2.1 time: 0.346550 Oct 17 13:21:28.205159 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2977/6215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:27 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 1355 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:28.938680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:28.939284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:28.967555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.968394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.971236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.972337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.973521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.978212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.235766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:29.236818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] [instance: 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:29.306986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:29.307841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:29.308734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.309913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:29.319113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:29.325718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.391358 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] HTTP exception thrown: Instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e could not be found. Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Request method failure captured: Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e HTTP/1.1 Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVO8wsZSqmfW49vI1THHOfwL_5j3vM2FktN7RpHbtgow7aDmUW4Pv3BVI8Oy7tO9oSfFgC6rTSlxAHfrY-eM07pY0Umu71X2M6X4Ue9KgT0Ml48iFOxFgBMPMdHbsgVJGlEaT3gitl9BY6UXQ9cLmroOJW8AWk3NApwUBQgRlOKon1A Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: e5d16284093341d980341f1dce38f68b Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5d16284093341d980341f1dce38f68b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5d16284093341d980341f1dce38f68b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5d16284093341d980341f1dce38f68b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5d16284093341d980341f1dce38f68b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: e5d16284093341d980341f1dce38f68b Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-497241743 Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkAdvancedServerOps-497241743-project Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 0cee3a8479444aa3a00b2c29407931d9 Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-497241743-project Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e could not be found. Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '46a5fcb1-ccb9-4247-8395-fc8506f2ca9e'} Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e could not be found. Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e could not be found. Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:29.395664 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:29.403387 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:29.403387 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:29.403387 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:29.403387 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:29.403387 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:29.403387 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:29.403387 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e could not be found. Oct 17 13:21:29.403387 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:21:29.410113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Returning 404 to user: Instance 46a5fcb1-ccb9-4247-8395-fc8506f2ca9e could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:29.412192 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f48008a6-60c9-4b92-8cf9-ac8e1f3d82ab tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e" status: 404 len: 111 microversion: 2.1 time: 0.184101 Oct 17 13:21:29.421110 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2978/6216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:29 2022] GET /compute/v2.1/servers/46a5fcb1-ccb9-4247-8395-fc8506f2ca9e => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:21:30.744268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.782028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.847449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.854080 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46b3e1c5-c0e1-4b21-9d58-a04bcf8d1625 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.918714 Oct 17 13:21:30.861438 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3239/6217] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:28 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:21:31.899548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:31.900373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:31.904037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:31.940630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:31.942675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:31.943845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:31.947601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:31.950081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:31.951221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:33.657448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:33.681564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:33.683030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:33.684269 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-850fe5fc-b52e-4ca8-b70a-6ac10e843b58 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.791502 Oct 17 13:21:33.685176 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2979/6218] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:31 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:21:34.732270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:34.733597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:34.750957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.751743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.758964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.760581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.761200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.761647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.062499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.077982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.079846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.092054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3cc987a8-1e75-4b73-be5d-22d257ad971f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.384403 Oct 17 13:21:36.093705 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3240/6219] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:34 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:37.127020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:37.128238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:37.140542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.141354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.141963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.143096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.143744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.144348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.903713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:38.938088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:38.948849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:38.963251 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e788f20-f37c-46a2-a2da-c79c31e34303 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1740 microversion: 2.20 time: 1.840015 Oct 17 13:21:38.964796 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2980/6220] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:37 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1740 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:39.995227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:39.996393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:40.008994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:40.015893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:40.022923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:40.024775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:40.026457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:40.027088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:40.895014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:40.916495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:40.919346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:40.933844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f01441ad-17ff-44a9-bc9a-3c748d4904bb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1722 microversion: 2.20 time: 0.942542 Oct 17 13:21:40.934750 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3241/6221] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:39 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1722 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:41.969683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:41.970826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:42.003975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:42.007954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:42.008761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:42.013859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:42.015395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:42.022790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:42.117836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=81 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:42.931915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:42.940932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:42.945440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:42.946744 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-efc40700-bdfd-4169-9fba-1a3cda6db884 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1722 microversion: 2.20 time: 0.984603 Oct 17 13:21:42.947307 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2981/6222] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:41 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1722 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:44.001232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:44.002373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:44.039440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:44.048024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:44.055460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:44.056255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:44.085516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:44.093092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:44.096818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:45.686515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-13628106-3ebd-471b-b7f1-2c8332a7c06e req-26223bf2-eb00-4ed3-8d6d-dc8b19f64257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62aae524-015b-4a15-aafa-9000a2183d87", "name": "network-vif-unplugged", "status": "completed", "tag": "da7a58b2-ab1e-4bb4-8804-af0f51d82900"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:45.706585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-13628106-3ebd-471b-b7f1-2c8332a7c06e req-26223bf2-eb00-4ed3-8d6d-dc8b19f64257 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:45.708603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-13628106-3ebd-471b-b7f1-2c8332a7c06e req-26223bf2-eb00-4ed3-8d6d-dc8b19f64257 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:45.709306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-13628106-3ebd-471b-b7f1-2c8332a7c06e req-26223bf2-eb00-4ed3-8d6d-dc8b19f64257 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:45.748391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.compute.server_external_events [req-13628106-3ebd-471b-b7f1-2c8332a7c06e req-26223bf2-eb00-4ed3-8d6d-dc8b19f64257 service nova] Unable to find a host for instance 62aae524-015b-4a15-aafa-9000a2183d87. Dropping event network-vif-unplugged {{(pid=127539) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:21:45.750271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-13628106-3ebd-471b-b7f1-2c8332a7c06e req-26223bf2-eb00-4ed3-8d6d-dc8b19f64257 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.068645 Oct 17 13:21:45.751564 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2982/6223] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 13:21:46.745645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:46.766501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:46.774561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:46.781187 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-379ef779-ddc8-4bbf-afd4-92b6374d46d7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1722 microversion: 2.20 time: 2.782931 Oct 17 13:21:46.781907 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3242/6224] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:43 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1722 bytes in 2789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:47.835271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:47.835955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:47.859647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:47.860162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:47.860717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:47.861469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:47.862626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:47.863096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.784022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:48.816083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:48.818038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:48.824054 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-57988745-4470-41a2-89f7-1da9dcd79da8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1665 microversion: 2.20 time: 1.005954 Oct 17 13:21:48.827537 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2983/6225] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:47 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1665 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:48.862841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01af5e31-dd43-497a-85be-92eda4205e81"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:48.873050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:48.910923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:48.911955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:48.912822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.913792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:48.914806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:48.915817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:49.532436 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ef4204f-21bd-4d4a-9850-9e787e366355 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.676998 Oct 17 13:21:49.540233 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3243/6226] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 17 13:21:48 2022] POST /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/os-volume_attachments => generated 188 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:21:49.796409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:49.798272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:49.816679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:49.822834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:49.823937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:49.829499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:49.830320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:49.831106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:50.388682 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9eae973-b9ab-4348-8cb0-7c1a031c7207 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/os-volume_attachments/01af5e31-dd43-497a-85be-92eda4205e81" status: 202 len: 0 microversion: 2.20 time: 0.598509 Oct 17 13:21:50.396330 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2984/6227] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 17 13:21:49 2022] DELETE /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/os-volume_attachments/01af5e31-dd43-497a-85be-92eda4205e81 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:21:50.512054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:50.512802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:50.532148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:50.535451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:50.536178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:50.539284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:50.540422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:50.542859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:50.555424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:50.628700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127540) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:21:50.764715 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9f350d07-4237-4203-bc4e-a40fa8c23ce5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "POST /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/action" status: 202 len: 0 microversion: 2.20 time: 0.271754 Oct 17 13:21:50.765813 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3244/6228] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 13:21:50 2022] POST /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:21:50.774341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:50.774977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:50.782336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:50.788734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:50.789327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:50.790485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:50.802588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:50.810996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:51.163839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e97d576b-b3ea-4c73-b0a4-f6cbd6d5ad2d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] Calling method '.version_select at 0x7fa81b9ec1f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:51.212706 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e97d576b-b3ea-4c73-b0a4-f6cbd6d5ad2d tempest-TestNetworkAdvancedServerOps-497241743 tempest-TestNetworkAdvancedServerOps-497241743-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-254862252" status: 202 len: 0 microversion: 2.1 time: 0.054323 Oct 17 13:21:51.213464 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3245/6229] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 17 13:21:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-254862252 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:21:51.275415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:51.289620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:51.291703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:51.299791 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-277d3d91-222f-405b-a15f-b89b17186f9b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1673 microversion: 2.20 time: 0.529552 Oct 17 13:21:51.301047 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2985/6230] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:50 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1673 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:52.344801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:52.346248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:52.360959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:52.361651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:52.362334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:52.370565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:52.371177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:52.372023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:52.691248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-91665623", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "211ea8c6-ed7b-4e16-8fd3-10a69bfce547"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:52.740859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:52.749814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:52.751335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:52.752527 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0c4e327-bc06-4b1e-948a-13e7dd06e6ac tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1673 microversion: 2.20 time: 0.411836 Oct 17 13:21:52.794606 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2986/6231] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:52 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1673 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:52.830882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1828050716", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "76f14718-0c7b-4a4b-b168-978ea8e885ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "eb1e7600-e122-4b5e-9526-e08a5b9bce6b"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:52.854483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] validate_networks() for [('211ea8c6-ed7b-4e16-8fd3-10a69bfce547', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:21:53.003024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] validate_networks() for [('eb1e7600-e122-4b5e-9526-e08a5b9bce6b', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:21:54.265600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:21:54.266226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:21:54.266717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:21:54.267128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:21:54.267751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:21:54.278960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:54.279705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:54.280522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:54.281753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:54.282467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:54.283178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:54.327023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:21:54.343957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:21:54.439907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:21:54.442336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:21:54.445021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:21:54.446675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76f14718-0c7b-4a4b-b168-978ea8e885ea',volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:21:54.447362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:21:54.448198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:21:54.448787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:21:54.476666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:54.487098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:54.487792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:54.490799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:54.494504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:54.495171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:54.561614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Getting quotas for project 63881a21a0e94a43886fa10c180b6b03. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:21:54.588365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Getting quotas for user e8b99c3ed2164c32ab657e5eddea445a and project 63881a21a0e94a43886fa10c180b6b03. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:21:54.626013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:21:54.634036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:21:54.747959 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:21:54.748365 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 13:21:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 17 13:21:54.787838 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-59e4f373-7944-4efc-af64-b06a55cbfce9 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611545 Oct 17 13:21:54.788516 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3246/6232] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:21:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:21:54.864568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:54.865375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:54.877469 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8eb71352-77f5-4bd1-9c76-41c35c9971c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.081641 Oct 17 13:21:54.896259 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2987/6233] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:21:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:21:54.901279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:54.901804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:54.902314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:54.906350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bdbf8097-3753-4fbb-a628-a7465a2d9ae0 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:54.906990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bdbf8097-3753-4fbb-a628-a7465a2d9ae0 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:54.913717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:54.914268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:54.914922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:55.203232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bdbf8097-3753-4fbb-a628-a7465a2d9ae0 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:55.237552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bdbf8097-3753-4fbb-a628-a7465a2d9ae0 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1223 microversion: 2.1 time: 0.338171 Oct 17 13:21:55.258378 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2988/6234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:54 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1223 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:55.276023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95e22ae0-9b99-4b10-a671-5f1a45387d10 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:55.279390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-95e22ae0-9b99-4b10-a671-5f1a45387d10 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:55.692822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:55.716111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:55.723626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:55.727520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aba04aeb-b4af-4d21-83d3-4e223bbb322f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.926219 Oct 17 13:21:55.737340 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3247/6235] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:54 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:55.885324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-95e22ae0-9b99-4b10-a671-5f1a45387d10 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:55.902351 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-95e22ae0-9b99-4b10-a671-5f1a45387d10 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1071 microversion: 2.1 time: 0.641465 Oct 17 13:21:55.905312 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2989/6236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:55 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1071 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:56.272915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-28469619-65de-4ce2-bed1-21cbd522b3e1 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:56.273664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-28469619-65de-4ce2-bed1-21cbd522b3e1 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:56.485081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28469619-65de-4ce2-bed1-21cbd522b3e1 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:56.514882 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-28469619-65de-4ce2-bed1-21cbd522b3e1 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1223 microversion: 2.1 time: 0.247865 Oct 17 13:21:56.515573 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3248/6237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:56 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1223 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:56.767759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:56.768811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:56.782405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:56.782930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:56.783382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:56.786761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:56.788849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:56.789788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:56.948815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:56.950350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:56.979982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:56.980415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:56.980855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:56.982974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:56.985079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:56.988119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:57.198790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:57.217497 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-074fbf10-c537-4e3a-979e-f598ed9625cf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1113 microversion: 2.1 time: 0.277111 Oct 17 13:21:57.218429 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3249/6238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:56 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1113 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:57.545410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:57.547481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:57.576232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:57.578878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:57.579690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:57.581561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:57.585073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:57.596898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:57.778076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:57.810924 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4568831-4222-4011-8a56-7f817bc51ace tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1219 microversion: 2.1 time: 0.269439 Oct 17 13:21:57.816311 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3250/6239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:57 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1219 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:58.077487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:58.104600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:58.115226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:58.126796 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77bbcef2-0c0a-4530-8270-0b96044b2f04 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 1.358310 Oct 17 13:21:58.127778 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2990/6240] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:56 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:58.243833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:58.244565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:58.278730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:58.285037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:58.286815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:58.288708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:58.290676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:58.303047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:58.505928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:58.523314 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1b3e88a-e71a-45bf-8049-fd90ec619a9e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1187 microversion: 2.1 time: 0.286477 Oct 17 13:21:58.526071 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3251/6241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:58 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1187 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:58.847385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:58.849472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:58.872357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:58.874770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:58.875575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:58.877706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:58.881958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:58.885886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:59.153752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:59.154590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:59.165743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:59.179635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:59.180361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:59.185917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:59.188055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:59.190599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:00.100879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:00.131085 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d99008ea-03f7-462c-94ea-f7c3f829af61 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1281 microversion: 2.1 time: 1.288819 Oct 17 13:22:00.138084 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2991/6242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:58 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1281 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:00.153723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:00.154434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:00.189856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:00.220134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:00.235282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:00.235961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:00.237327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:00.239549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:00.240228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:00.242589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:00.243381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:00.250089 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21ebfb1c-2252-468d-aa9c-0c490339783f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 1.100563 Oct 17 13:22:00.272063 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3252/6243] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:59 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:01.157075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:01.157692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:01.165275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:01.165771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:01.166264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:01.166944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:01.167401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:01.179176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:01.318355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:01.328456 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc163de1-11f0-447d-ae4b-d794814856ca tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1229 microversion: 2.1 time: 1.188860 Oct 17 13:22:01.331321 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2992/6244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:00 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1229 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:01.343476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:01.344181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:01.353322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:01.362188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:01.362773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:01.363740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:01.364743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:01.365399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:01.365843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:01.366082 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-85e7c52c-115d-4448-bb57-a8c676d32334 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1281 microversion: 2.1 time: 0.210526 Oct 17 13:22:01.383710 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3253/6245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:01 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1281 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:01.839486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d8cd5707-f3e7-4d58-a83b-c5a671b1be8f req-84696a4e-ee79-4849-a798-fdcb9b28e3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33b1c54-ee87-45e8-9f4f-d43caf4f12c7", "tag": "0bcf46e2-ba54-473e-9ad8-aceac756e571"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:01.860538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d8cd5707-f3e7-4d58-a83b-c5a671b1be8f req-84696a4e-ee79-4849-a798-fdcb9b28e3b4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:01.861021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d8cd5707-f3e7-4d58-a83b-c5a671b1be8f req-84696a4e-ee79-4849-a798-fdcb9b28e3b4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:01.861821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d8cd5707-f3e7-4d58-a83b-c5a671b1be8f req-84696a4e-ee79-4849-a798-fdcb9b28e3b4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:01.889259 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d8cd5707-f3e7-4d58-a83b-c5a671b1be8f req-84696a4e-ee79-4849-a798-fdcb9b28e3b4 service nova] Creating event network-changed:0bcf46e2-ba54-473e-9ad8-aceac756e571 for instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 on n-h2-853316-12 Oct 17 13:22:01.903418 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d8cd5707-f3e7-4d58-a83b-c5a671b1be8f req-84696a4e-ee79-4849-a798-fdcb9b28e3b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067998 Oct 17 13:22:01.906113 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3254/6246] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:22:02.033336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:02.055416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:02.058244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:02.060770 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3548a0b5-7f36-41c3-8aa0-5802ab99d3fa tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.725277 Oct 17 13:22:02.061747 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2993/6247] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:01 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:02.086958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0f0cf48b-8eff-402f-a591-f9f9fc996a75 req-c696ae16-eb90-480d-a377-536ba7bd8eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62aae524-015b-4a15-aafa-9000a2183d87", "tag": "da7a58b2-ab1e-4bb4-8804-af0f51d82900"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:02.099050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0f0cf48b-8eff-402f-a591-f9f9fc996a75 req-c696ae16-eb90-480d-a377-536ba7bd8eb1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:02.100235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0f0cf48b-8eff-402f-a591-f9f9fc996a75 req-c696ae16-eb90-480d-a377-536ba7bd8eb1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:02.100892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0f0cf48b-8eff-402f-a591-f9f9fc996a75 req-c696ae16-eb90-480d-a377-536ba7bd8eb1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:02.113070 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0f0cf48b-8eff-402f-a591-f9f9fc996a75 req-c696ae16-eb90-480d-a377-536ba7bd8eb1 service nova] Creating event network-changed:da7a58b2-ab1e-4bb4-8804-af0f51d82900 for instance 62aae524-015b-4a15-aafa-9000a2183d87 on n-h1-853316-12 Oct 17 13:22:02.120845 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0f0cf48b-8eff-402f-a591-f9f9fc996a75 req-c696ae16-eb90-480d-a377-536ba7bd8eb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039036 Oct 17 13:22:02.122072 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3255/6248] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:02.357245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:02.357855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:02.360404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:02.375610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:02.380750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:02.382104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:02.384284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:02.392955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:02.395482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:02.402922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:02.409043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:02.425801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:02.431749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:02.432693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:02.433669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:02.436721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:02.437206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:02.561144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:02.575913 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-187c6d3b-16f9-4669-aa81-4cebb817cd51 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1281 microversion: 2.1 time: 0.186710 Oct 17 13:22:02.575913 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3256/6249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:02 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:02.983726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:02.994391 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4acc859c-e667-43c3-928d-75a9fa77a381 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1229 microversion: 2.1 time: 0.641055 Oct 17 13:22:03.006650 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2994/6250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:02 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1229 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:03.093583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:03.094670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:03.123291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:03.124167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:03.124946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:03.126269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:03.127130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:03.127899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:03.602498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:03.603413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:03.627595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:03.632330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:03.639904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:03.642262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:03.645448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:03.652531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:03.757457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:03.782524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:03.784739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:03.786662 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-642d434d-186f-43a0-b17e-39d0c9552784 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.700994 Oct 17 13:22:03.798446 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3257/6251] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:03 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:04.017074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:04.017703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:04.030563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.031312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.031751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.032468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.032994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.033360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.279313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:04.297855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:04.298958 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be50fe77-42ea-4200-9833-f9285a032030 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1229 microversion: 2.1 time: 0.284238 Oct 17 13:22:04.300062 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3258/6252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:04 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1229 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:04.431472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:04.449189 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7413c9d8-066b-4c1f-bd75-11b820b509ef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 0.851754 Oct 17 13:22:04.449895 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2995/6253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:03 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:04.824991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:04.828210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:04.839315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:04.843921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.844700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.845152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.847134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.848337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.848951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.108539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.133239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.144954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.152075 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d80ba9d-8805-40c2-b726-aa5574653406 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.332161 Oct 17 13:22:05.154841 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3259/6254] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:04 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:05.327910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:05.329206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:05.350484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.350993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.351449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.352401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.352618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.353056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.477315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:05.477943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:05.490105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.491040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.491500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.492229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.492695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.493136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.900495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:06.290801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:06.303138 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0df86be-cd3d-4bae-bd73-b0bfd54df45d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1229 microversion: 2.1 time: 0.979598 Oct 17 13:22:06.303743 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2996/6255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:05 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1229 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:06.308427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:06.309045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:06.324069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:06.324848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:06.325477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:06.326426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:06.327112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:06.327817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:06.360395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:06.374678 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-38b8293c-dff6-4345-a4be-f49fbe2842e3 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 0.901655 Oct 17 13:22:06.375878 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3260/6256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:05 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:07.075053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.100486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.102557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.104043 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d23b5b87-e4fe-4e7d-a2d2-fbea7f2bcbf0 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.799294 Oct 17 13:22:07.104841 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2997/6257] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:06 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:07.329575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:07.330311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:07.343305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:07.346818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.347339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.355367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.356398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.357115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.357774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.406195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:07.407019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:07.420971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.421809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.422486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.423444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.424272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.425384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.482429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:07.955882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.981706 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c438a0f9-4846-45d7-b68c-b06a24bc55af tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1229 microversion: 2.1 time: 0.655631 Oct 17 13:22:07.987381 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3261/6258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:07 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1229 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:08.009505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7f3837a2-f7ca-4b2b-9f69-1aceabb5f6cb req-97d21615-f6e9-442f-9e8e-e9ad05c52f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c89fec-4026-466c-99d3-59cfdfcaefc5", "tag": "3a8a1124-e2ba-4d19-8da9-c555b8afabc6"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:08.065113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7f3837a2-f7ca-4b2b-9f69-1aceabb5f6cb req-97d21615-f6e9-442f-9e8e-e9ad05c52f6a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.070684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7f3837a2-f7ca-4b2b-9f69-1aceabb5f6cb req-97d21615-f6e9-442f-9e8e-e9ad05c52f6a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.078574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7f3837a2-f7ca-4b2b-9f69-1aceabb5f6cb req-97d21615-f6e9-442f-9e8e-e9ad05c52f6a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:08.112621 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7f3837a2-f7ca-4b2b-9f69-1aceabb5f6cb req-97d21615-f6e9-442f-9e8e-e9ad05c52f6a service nova] Creating event network-changed:3a8a1124-e2ba-4d19-8da9-c555b8afabc6 for instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 on n-h2-853316-12 Oct 17 13:22:08.131312 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7f3837a2-f7ca-4b2b-9f69-1aceabb5f6cb req-97d21615-f6e9-442f-9e8e-e9ad05c52f6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134956 Oct 17 13:22:08.133845 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3262/6259] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:08.145215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:08.150056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:08.168164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.169167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.173095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:08.175507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.179294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.180799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:08.237834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:08.263327 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-262b6947-5c52-43bb-95bc-ed35b5438340 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 0.863211 Oct 17 13:22:08.267379 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2998/6260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:07 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:08.970483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:09.012587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:09.013701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:09.028572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:09.031821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:09.039080 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ae35d4f-9c10-4d11-aa57-04ea1c885e7c tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.900679 Oct 17 13:22:09.043051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:09.058208 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3263/6261] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:08 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:09.058523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:09.058523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:09.058523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:09.058523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:09.058523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:09.302081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:09.308523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:09.350501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:09.359119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:09.359871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:09.364367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:09.365302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:09.365952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:09.432686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:09.583072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:09.604169 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8c50e28-41d2-46a0-bf94-e0774dd54c73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1229 microversion: 2.1 time: 0.592692 Oct 17 13:22:09.607094 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 2999/6262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:09 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1229 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:10.081647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:10.087106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:10.103259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:10.105532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:10.107005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:10.108725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:10.111043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:10.112927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:10.609527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:10.624029 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-068405c0-2247-4520-a92a-47328d50f0aa tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 1.330918 Oct 17 13:22:10.624794 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3264/6263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:09 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:10.648224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:10.649051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:10.662956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:10.665582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:10.668081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:10.672135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:10.672674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:10.673969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.131128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:11.139241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:11.142774 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7fe604e6-d139-4df3-a192-ed5b1de5bf25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1229 microversion: 2.1 time: 0.501086 Oct 17 13:22:11.146448 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3265/6264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:10 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1229 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:11.189206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:11.191622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:11.193533 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b2908da-7beb-4088-8451-04b271d6b298 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 1.116288 Oct 17 13:22:11.195496 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3000/6265] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:10 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:11.656716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:11.659418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:11.690187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.691071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.697055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.702733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.703847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.707180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.186733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:12.200108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:12.248783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.265200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.266006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.267445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.268428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.278439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.371522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:12.385119 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea162065-8ca1-42e2-9391-1bdef6b3d644 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 0.736560 Oct 17 13:22:12.390917 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3266/6266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:11 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:12.402997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:12.406377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:12.438497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.439431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.440265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.441398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.445811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.446629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.077549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:13.089188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:13.096281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:13.098868 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ced3990f-3e4e-43c8-bfa5-b4ab87d444d1 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.706308 Oct 17 13:22:13.103693 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3267/6267] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:12 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:13.419633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:13.420393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:13.429089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.435013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.435835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.436891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.437631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.438351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.495587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:13.504612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5994ee00-e976-4142-adb2-f3e302b73a27 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 1.326990 Oct 17 13:22:13.509086 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3001/6268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:12 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:14.140439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:14.141259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:14.161503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.162001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.165965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.166795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.167286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.167774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.285038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:14.310293 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-76f59243-d84e-4508-8576-729ac86b51d8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 0.894528 Oct 17 13:22:14.317768 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3268/6269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:13 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:14.539564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:14.540377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:14.547120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:14.568661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.571589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.575390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.576178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.578954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.580911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.123003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.139067 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-23861678-ca13-478d-8112-dda68ec76d37 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 0.603471 Oct 17 13:22:15.144846 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3269/6270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:14 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:15.361888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:15.362733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:15.384915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.385506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.390917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.392975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.402695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.404753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.672183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.681945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.695670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.704512 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ceee92e-fee2-4baf-ae26-bd877179e0f7 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 1.564767 Oct 17 13:22:15.705580 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3002/6271] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:14 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:15.967993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.996032 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e810f37c-7759-4781-a8a3-230df1a8776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 0.640002 Oct 17 13:22:15.996631 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3270/6272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:15 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:16.177690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:16.178876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:16.201332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.206112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.208498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.211744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.213868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.217351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.754890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:16.755727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:16.783659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.784173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.784624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.785426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.785897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.799941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.039360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:17.048514 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8102f409-96b4-4544-8152-631b1152a702 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 0.875118 Oct 17 13:22:17.048514 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3003/6273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:16 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:17.085273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:17.085905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:17.147331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:17.147888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:17.148353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.157797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:17.160601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:17.163453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.856630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:17.871672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:17.876678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:17.878434 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97220e7c-ca97-4141-b063-30d3b70b218d tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 1.128779 Oct 17 13:22:17.899838 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3271/6274] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:16 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:18.079151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:18.079972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:18.096507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.099992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.100795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.103301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.104394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.110224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.123026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:18.144633 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6bfe695b-07d2-4b70-b6ff-eab1d3cfda7d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 1.092427 Oct 17 13:22:18.146060 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3004/6275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:17 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:18.799263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:18.810195 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d4db4f2d-cbb9-4a4f-88c2-fc61d728cc93 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 0.735938 Oct 17 13:22:18.813955 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3272/6276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:18 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:18.917692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:18.933607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:18.955390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.956182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.957714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.977484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.977991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.983118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:19.194777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:19.197248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:19.214273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:19.222569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:19.224775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:19.225737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:19.228639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:19.229326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:19.580810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:19.590322 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46b07668-297d-4ea4-a938-45ef9041e835 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 0.405052 Oct 17 13:22:19.622382 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3273/6277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:19 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:19.704171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:19.719901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:19.722080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:19.723945 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-18073a98-8107-4e17-9feb-fc8a5e5cf51f tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.815340 Oct 17 13:22:19.725013 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3005/6278] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:18 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:19.839042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:19.839982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:19.868865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:19.870785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:19.872835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:19.873851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:19.883519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:19.884370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:20.214825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:20.224355 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-35484703-4e29-4db1-9d00-def6f9dc45bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 0.389156 Oct 17 13:22:20.226453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3274/6279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:19 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:20.630093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:20.630820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:20.649135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:20.650212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:20.650932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:20.652528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:20.653377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:20.653983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:20.656324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0b4765f3-d2de-4484-aa19-40c54760becf req-ffbdb77f-c61f-42ef-b4cf-a4226a66b728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c89fec-4026-466c-99d3-59cfdfcaefc5", "name": "network-vif-plugged", "status": "completed", "tag": "3a8a1124-e2ba-4d19-8da9-c555b8afabc6"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:20.716812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0b4765f3-d2de-4484-aa19-40c54760becf req-ffbdb77f-c61f-42ef-b4cf-a4226a66b728 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:20.717712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0b4765f3-d2de-4484-aa19-40c54760becf req-ffbdb77f-c61f-42ef-b4cf-a4226a66b728 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:20.718464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0b4765f3-d2de-4484-aa19-40c54760becf req-ffbdb77f-c61f-42ef-b4cf-a4226a66b728 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:20.748854 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0b4765f3-d2de-4484-aa19-40c54760becf req-ffbdb77f-c61f-42ef-b4cf-a4226a66b728 service nova] Creating event network-vif-plugged:3a8a1124-e2ba-4d19-8da9-c555b8afabc6 for instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 on n-h2-853316-12 Oct 17 13:22:20.763447 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0b4765f3-d2de-4484-aa19-40c54760becf req-ffbdb77f-c61f-42ef-b4cf-a4226a66b728 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106889 Oct 17 13:22:20.764957 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3275/6280] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:20.781363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:20.784470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:20.802285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:20.802903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:20.803623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:20.804248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:20.806155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:20.807365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.084475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.101894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.115930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.117758 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-06c03745-3e4e-4c3a-8a58-421194f5bd4e tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.351182 Oct 17 13:22:21.135114 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3276/6281] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:20 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:21.263402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:21.266260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:21.283494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.286052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.287991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.290509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.291276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.292061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.518544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.540726 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-32235b95-c82e-44ae-b1bb-5d49931c7763 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1323 microversion: 2.1 time: 0.915336 Oct 17 13:22:21.550324 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3006/6282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:20 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1323 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:21.606861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.624863 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-964d5e00-0d76-49b2-ac37-188d67967988 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 0.365140 Oct 17 13:22:21.627038 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3277/6283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:21 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:22.153770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:22.154460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:22.167245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.167773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.168225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.168978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.169450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.169887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.575803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:22.576513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:22.592871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.593372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.593889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.594856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.598896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.600022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.813540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:22.833919 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e93e0560-db27-4bd0-ab2b-199fd99f776f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1521 microversion: 2.1 time: 0.263720 Oct 17 13:22:22.846210 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3278/6284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:22 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:22.846210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:22.846210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:22.847036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.847611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.848252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.849158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.850296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.850902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.048803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:23.059973 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0036d535-ac49-41e7-a69b-688cb2795774 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 0.223602 Oct 17 13:22:23.061100 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3279/6285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:22 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:23.068218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:23.069002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:23.082223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:23.082834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:23.083355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.090084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:23.090865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:23.091566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.143109 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] HTTP exception thrown: Action 999 not found Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Request method failure captured: Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5/os-instance-actions/999 HTTP/1.1 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVbvv0EWYSQmNBD4lKqgWfr30HMeUjpUAmm1RGtZPkGWJFLw0OLNYEFhMf-XIUPg_MwtIdv4poJf9dl_RKE5knkYDkcur2HK24dvqgy8QjpDgCrawEQgOZrXwO5ezczIv5IyBDKy57t6t8aVBOYYZGj27rw7H8zV4Ho3ku-BzwvKEKM Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63881a21a0e94a43886fa10c180b6b03 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63881a21a0e94a43886fa10c180b6b03", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63881a21a0e94a43886fa10c180b6b03 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-InstanceActionsNegativeTestJSON-846094274-project Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e8b99c3ed2164c32ab657e5eddea445a Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-846094274-project Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: exception: Action 999 not found Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'server_id': '10c89fec-4026-466c-99d3-59cfdfcaefc5', 'id': '999'} Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 17 13:22:23.154418 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:23.160884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Returning 404 to user: Action 999 not found {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:23.162000 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a5a8f03-7826-4e48-b63c-3e6b21d5f8b8 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.099750 Oct 17 13:22:23.163207 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3280/6286] 10.222.0.27 () {58 vars in 1308 bytes} [Mon Oct 17 13:22:23 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5/os-instance-actions/999 => generated 66 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:22:23.176751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9272fe23-6878-47a2-90fc-800941bfd48a req-cbbd019d-3c54-478c-8e85-7e6c0758baa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33b1c54-ee87-45e8-9f4f-d43caf4f12c7", "name": "network-vif-plugged", "status": "completed", "tag": "0bcf46e2-ba54-473e-9ad8-aceac756e571"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:23.196958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9272fe23-6878-47a2-90fc-800941bfd48a req-cbbd019d-3c54-478c-8e85-7e6c0758baa6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:23.197557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9272fe23-6878-47a2-90fc-800941bfd48a req-cbbd019d-3c54-478c-8e85-7e6c0758baa6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:23.199015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9272fe23-6878-47a2-90fc-800941bfd48a req-cbbd019d-3c54-478c-8e85-7e6c0758baa6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.218029 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9272fe23-6878-47a2-90fc-800941bfd48a req-cbbd019d-3c54-478c-8e85-7e6c0758baa6 service nova] Creating event network-vif-plugged:0bcf46e2-ba54-473e-9ad8-aceac756e571 for instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 on n-h2-853316-12 Oct 17 13:22:23.229788 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9272fe23-6878-47a2-90fc-800941bfd48a req-cbbd019d-3c54-478c-8e85-7e6c0758baa6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062117 Oct 17 13:22:23.230919 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3281/6287] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:23.246867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f8695313-7cd3-4ec7-adf5-ab4ad8631aef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '.version_select at 0x7fa820d46040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:23.249332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f8695313-7cd3-4ec7-adf5-ab4ad8631aef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 69e002eb-7c15-422b-ac33-146095efef85] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:23.272012 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f8695313-7cd3-4ec7-adf5-ab4ad8631aef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] HTTP exception thrown: Instance 69e002eb-7c15-422b-ac33-146095efef85 could not be found. Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f8695313-7cd3-4ec7-adf5-ab4ad8631aef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Request method failure captured: Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/69e002eb-7c15-422b-ac33-146095efef85/os-instance-actions HTTP/1.1 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVbvv0EWYSQmNBD4lKqgWfr30HMeUjpUAmm1RGtZPkGWJFLw0OLNYEFhMf-XIUPg_MwtIdv4poJf9dl_RKE5knkYDkcur2HK24dvqgy8QjpDgCrawEQgOZrXwO5ezczIv5IyBDKy57t6t8aVBOYYZGj27rw7H8zV4Ho3ku-BzwvKEKM Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63881a21a0e94a43886fa10c180b6b03 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63881a21a0e94a43886fa10c180b6b03", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63881a21a0e94a43886fa10c180b6b03 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-InstanceActionsNegativeTestJSON-846094274-project Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e8b99c3ed2164c32ab657e5eddea445a Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-846094274-project Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 69e002eb-7c15-422b-ac33-146095efef85 could not be found. Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'server_id': '69e002eb-7c15-422b-ac33-146095efef85'} Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e002eb-7c15-422b-ac33-146095efef85 could not be found. Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:23.274706 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e002eb-7c15-422b-ac33-146095efef85 could not be found. Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e002eb-7c15-422b-ac33-146095efef85 could not be found. Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:23.279840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f8695313-7cd3-4ec7-adf5-ab4ad8631aef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Returning 404 to user: Instance 69e002eb-7c15-422b-ac33-146095efef85 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:23.282508 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f8695313-7cd3-4ec7-adf5-ab4ad8631aef tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/69e002eb-7c15-422b-ac33-146095efef85/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.049801 Oct 17 13:22:23.288333 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3282/6288] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 17 13:22:23 2022] GET /compute/v2.1/servers/69e002eb-7c15-422b-ac33-146095efef85/os-instance-actions => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:22:23.294535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:23.295106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:23.309189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:23.310621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:23.311404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.312925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:23.322415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:23.324001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.362017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:23.372629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:22:23.504024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4bac7409-38b5-4e13-a48a-da58b8d8dda4 tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 204 len: 0 microversion: 2.1 time: 0.213604 Oct 17 13:22:23.505755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3283/6289] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:22:23 2022] DELETE /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:22:23.530628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:23.534437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:23.543417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:23.544383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:23.546024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.546024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:23.546024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:23.546024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.724612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:23.743377 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-09cef525-f9f6-4952-849e-90993e73d0ec tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1527 microversion: 2.1 time: 0.232084 Oct 17 13:22:23.744108 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3284/6290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:23 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1527 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:23.754112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:23.770306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:23.773169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:23.774661 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41c88f4a-f602-4e52-a7cd-c332b550041a tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 1.629231 Oct 17 13:22:23.785033 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3007/6291] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:22 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:24.096509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:24.097232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:24.108747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.110703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.119259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.120328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.120828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.121359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.356760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:24.373541 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d70a12a-86fb-419e-88c2-c8dfd71bcbbf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 0.280867 Oct 17 13:22:24.375177 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3285/6292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:24 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:24.768957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:24.770576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:24.777317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.777818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.778678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.779411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.780801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.780801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.805087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:24.806347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:24.825805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.826400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.826879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.827570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.833152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.833851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:25.073102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:25.083651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:25.086006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:25.088454 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b5aac1af-5347-4c3d-827f-0d5551cc1018 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.286711 Oct 17 13:22:25.089799 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3286/6293] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:24 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:25.236616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:25.246084 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-39599d5e-68ab-4a60-a47d-9a371a8c36cc tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1527 microversion: 2.1 time: 0.480657 Oct 17 13:22:25.247465 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3008/6294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:24 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1527 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:25.399835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:25.401898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:25.411208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:25.411939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:25.412474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:25.413284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:25.413845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:25.414416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:25.579983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:25.589349 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3e2c06d-6627-4964-9147-990603c7fa73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1217 microversion: 2.1 time: 0.195744 Oct 17 13:22:25.590860 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3287/6295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:25 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1217 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:26.122090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:26.123224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:26.156484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.159097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.161234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.163744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.165006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.166529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.218700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1582225027", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "ac88ccf7-6e02-43f0-867e-d5bce8d1d9b3"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:26.348783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] validate_networks() for [('ac88ccf7-6e02-43f0-867e-d5bce8d1d9b3', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:22:26.582285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.598701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.601189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.603159 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cd033bc2-4fe9-4a1a-b3e9-30f96e407dc8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.490176 Oct 17 13:22:26.604356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3288/6296] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:26 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:26.622074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3d0ebc6f-1047-4f61-9d13-c8a72fea715a req-5c9a22ca-86d7-45e0-88c2-e9366eada6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c89fec-4026-466c-99d3-59cfdfcaefc5", "name": "network-vif-deleted", "tag": "3a8a1124-e2ba-4d19-8da9-c555b8afabc6"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:26.648996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3d0ebc6f-1047-4f61-9d13-c8a72fea715a req-5c9a22ca-86d7-45e0-88c2-e9366eada6ee service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.652229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3d0ebc6f-1047-4f61-9d13-c8a72fea715a req-5c9a22ca-86d7-45e0-88c2-e9366eada6ee service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.653797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3d0ebc6f-1047-4f61-9d13-c8a72fea715a req-5c9a22ca-86d7-45e0-88c2-e9366eada6ee service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.691838 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3d0ebc6f-1047-4f61-9d13-c8a72fea715a req-5c9a22ca-86d7-45e0-88c2-e9366eada6ee service nova] Creating event network-vif-deleted:3a8a1124-e2ba-4d19-8da9-c555b8afabc6 for instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 on n-h2-853316-12 Oct 17 13:22:26.704932 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3d0ebc6f-1047-4f61-9d13-c8a72fea715a req-5c9a22ca-86d7-45e0-88c2-e9366eada6ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089201 Oct 17 13:22:26.706127 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3289/6297] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:26.713165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:26.714194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:26.722098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.724070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.724844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.725819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.726552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.727208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.833928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.836966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.840643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.842074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lazy-loading 'fault' on Instance uuid 10c89fec-4026-466c-99d3-59cfdfcaefc5 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:22:26.938153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b99c3ed2164c32ab657e5eddea445a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63881a21a0e94a43886fa10c180b6b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.951579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ccc82868-ae1a-4c77-98dc-ca3a47ffc53f tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 200 len: 1313 microversion: 2.1 time: 0.243305 Oct 17 13:22:26.973200 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3290/6298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:26 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:26.981529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:26.983368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:26.994915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.995810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.996493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.999051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.000098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.001135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.098985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:22:27.099773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:22:27.100476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:22:27.101583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:22:27.102259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:22:27.114268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.116086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.116796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.118769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.119610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.120305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.145926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Getting quotas for project cbd038095e25420d84384f7f7c97ff58. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:27.152871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Getting quotas for user c4607f2ad6bb4daca1d86d4a7befee92 and project cbd038095e25420d84384f7f7c97ff58. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:27.170006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:22:27.172856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:22:27.201120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.213520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b38c861-bd84-4ccc-93d0-b2020081cff8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1403 microversion: 2.1 time: 0.238483 Oct 17 13:22:27.214463 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3291/6299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:26 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1403 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:27.242084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:27.242964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:27.249207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.249963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.250958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.252481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.253491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.254564 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-16566004-c968-4f35-8505-4ca3b0a25ca0 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326046 Oct 17 13:22:27.255559 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3009/6300] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:22:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:22:27.255857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.271363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71bdf24b-021a-41c5-b9c6-825823661240 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:27.272992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71bdf24b-021a-41c5-b9c6-825823661240 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:27.381343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71bdf24b-021a-41c5-b9c6-825823661240 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.390859 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71bdf24b-021a-41c5-b9c6-825823661240 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1228 microversion: 2.1 time: 0.127801 Oct 17 13:22:27.402199 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3010/6301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:27 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1228 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:27.566856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.580257 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bce82709-713e-49da-999b-1a08d895f657 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1403 microversion: 2.1 time: 0.343341 Oct 17 13:22:27.581120 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3292/6302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:27 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1403 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:27.606503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-479751257"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:27.610129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:27.625498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.626103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.627880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.627880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.634474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:27.635265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:27.639226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.641508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.646807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.650500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.651065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.655049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.655733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.666631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.868922 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Attempting to quiesce instance before volume snapshot. Oct 17 13:22:27.927034 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 17 13:22:27.970418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.986586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.991461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.995015 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65a32957-4692-451e-b6ba-4d3f4ca953e8 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.365391 Oct 17 13:22:28.002440 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3293/6303] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:27 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:28.014502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:28.015137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] [instance: 10c89fec-4026-466c-99d3-59cfdfcaefc5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:28.033499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.033852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.036651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.037610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.037986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.039611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.070847 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] HTTP exception thrown: Instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 could not be found. Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Request method failure captured: Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 HTTP/1.1 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVbvv0EWYSQmNBD4lKqgWfr30HMeUjpUAmm1RGtZPkGWJFLw0OLNYEFhMf-XIUPg_MwtIdv4poJf9dl_RKE5knkYDkcur2HK24dvqgy8QjpDgCrawEQgOZrXwO5ezczIv5IyBDKy57t6t8aVBOYYZGj27rw7H8zV4Ho3ku-BzwvKEKM Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63881a21a0e94a43886fa10c180b6b03 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63881a21a0e94a43886fa10c180b6b03", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63881a21a0e94a43886fa10c180b6b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63881a21a0e94a43886fa10c180b6b03 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-846094274 Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-InstanceActionsNegativeTestJSON-846094274-project Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e8b99c3ed2164c32ab657e5eddea445a Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-846094274-project Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 could not be found. Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '10c89fec-4026-466c-99d3-59cfdfcaefc5'} Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 could not be found. Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 could not be found. Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:28.074825 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 could not be found. Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] Returning 404 to user: Instance 10c89fec-4026-466c-99d3-59cfdfcaefc5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:28.080114 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ca4d05c-0303-4914-83eb-0c9ebeab064d tempest-InstanceActionsNegativeTestJSON-846094274 tempest-InstanceActionsNegativeTestJSON-846094274-project] 10.222.0.27 "GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5" status: 404 len: 111 microversion: 2.1 time: 0.080928 Oct 17 13:22:28.081419 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3294/6304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:27 2022] GET /compute/v2.1/servers/10c89fec-4026-466c-99d3-59cfdfcaefc5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:22:28.089232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Creating snapshot from volume 76f14718-0c7b-4a4b-b168-978ea8e885ea. {{(pid=127539) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 17 13:22:28.418949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:28.419521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:28.435702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.437841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.439285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.439755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.440228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.444244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.709847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:28.725529 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16adf7ac-3098-4bd6-90ee-10ab63d98911 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1224 microversion: 2.1 time: 0.308401 Oct 17 13:22:28.738528 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3295/6305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:28 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1224 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:29.025632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:29.026763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:29.037429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.037939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.038412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:29.039141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.042476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.044623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.155376 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1e8a383-98d1-4f63-b913-28b65e3f521f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7/action" status: 202 len: 0 microversion: 2.1 time: 2.552572 Oct 17 13:22:30.178052 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3011/6306] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:22:27 2022] POST /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7/action => generated 0 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:22:30.190355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.215670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:30.216757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:30.224189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.226881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.228274 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a61c4779-de40-4919-b7dd-f1c243b54747 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 1.207187 Oct 17 13:22:30.231981 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3296/6307] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:29 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:30.254670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:30.262149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:30.262149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.262694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:30.263388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:30.264536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.445425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.460942 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-146ad043-b795-49e3-aeb2-c2066c27bf07 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1286 microversion: 2.1 time: 0.281395 Oct 17 13:22:30.461543 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3012/6308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:30 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1286 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:31.258759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:31.259496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:31.283406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.284735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.288841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.292178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.293285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.296797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.493826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:31.494726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:31.517737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.524384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.525312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.530923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.532893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.537783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.146379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:32.163527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:32.177519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:32.193945 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8bb67d00-c6c5-4d72-ae2b-47bd6aa68b53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.932365 Oct 17 13:22:32.195987 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3297/6309] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:31 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:33.081512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.093754 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be70aa52-4e04-4d2a-a84f-1aaea0dee3a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1286 microversion: 2.1 time: 1.603913 Oct 17 13:22:33.094396 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3013/6310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:31 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1286 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:33.226201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:33.227477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:33.245415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.248624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.249430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.250550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.253267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.253946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.510807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f209019b-db4f-4100-af43-ffa2607f478a req-17ddce0d-d9a1-4d4c-90e5-d68884b6a119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62aae524-015b-4a15-aafa-9000a2183d87", "name": "network-vif-plugged", "status": "completed", "tag": "da7a58b2-ab1e-4bb4-8804-af0f51d82900"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:33.532988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:33.538899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f209019b-db4f-4100-af43-ffa2607f478a req-17ddce0d-d9a1-4d4c-90e5-d68884b6a119 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.539410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f209019b-db4f-4100-af43-ffa2607f478a req-17ddce0d-d9a1-4d4c-90e5-d68884b6a119 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.542255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f209019b-db4f-4100-af43-ffa2607f478a req-17ddce0d-d9a1-4d4c-90e5-d68884b6a119 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.580751 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f209019b-db4f-4100-af43-ffa2607f478a req-17ddce0d-d9a1-4d4c-90e5-d68884b6a119 service nova] Creating event network-vif-plugged:da7a58b2-ab1e-4bb4-8804-af0f51d82900 for instance 62aae524-015b-4a15-aafa-9000a2183d87 on n-h1-853316-12 Oct 17 13:22:33.587946 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f209019b-db4f-4100-af43-ffa2607f478a req-17ddce0d-d9a1-4d4c-90e5-d68884b6a119 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080698 Oct 17 13:22:33.589173 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3014/6311] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:22:33.874240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1305154476", "imageRef": "393553b7-6e30-4c72-9273-4ca9c9276943", "flavorRef": "452", "networks": [{"uuid": "eb1e7600-e122-4b5e-9526-e08a5b9bce6b"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:33.889134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.902644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.905385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.908533 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49a12567-c149-4627-b27f-0375c5449895 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.687625 Oct 17 13:22:33.917123 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3298/6312] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:33 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:34.027008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] validate_networks() for [('eb1e7600-e122-4b5e-9526-e08a5b9bce6b', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:22:34.120551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:34.121655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:34.138723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.139688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.140478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.141604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.142333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.142976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.182662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:34.694823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:34.723558 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3003c43d-7612-4f03-b978-3f3c8c313aa3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.593920 Oct 17 13:22:34.723558 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3299/6313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:34 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:34.947846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:34.948860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:34.994385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.996176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.997288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.002468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:35.015035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:35.015903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.579592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:35.598354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:35.602723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:35.603978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d453953c-bf09-4200-9f81-bef949ca02fb tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.661899 Oct 17 13:22:35.610909 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3300/6314] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:34 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:35.629666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:22:35.630849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:22:35.631645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:22:35.632258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:22:35.633030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:22:35.659312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:35.660468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:35.660468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.661696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:35.671657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:35.672277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.737417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:35.738826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:35.748626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:35.749128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:35.749612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.765245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:35.766548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:35.767995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.791975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:35.831626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:35.871893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:22:35.875076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d32900fb-bdf4-47be-8700-2bab28b515ea',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:22:36.079920 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe335c7f-d32e-4174-80fd-657d76ec5e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.215018 Oct 17 13:22:36.090060 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3015/6315] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:22:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:22:36.102452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff55caf0-f776-4673-8fdd-fb859f63f66e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:36.102988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff55caf0-f776-4673-8fdd-fb859f63f66e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:36.290767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff55caf0-f776-4673-8fdd-fb859f63f66e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:36.308263 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff55caf0-f776-4673-8fdd-fb859f63f66e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1230 microversion: 2.1 time: 0.213012 Oct 17 13:22:36.328600 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3016/6316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:36 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1230 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:36.624085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:36.644140 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3054271-6065-4596-bd9b-bbd2b8e54b28 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.910952 Oct 17 13:22:36.651440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:36.652168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:36.661384 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3301/6317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:35 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:36.671804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:36.672713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:36.673647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:36.674846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:36.676263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:36.677099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:36.680842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:37.329462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:37.347236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:37.349121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:37.349602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:37.351992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:37.357199 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf9811ac-ad23-486c-9bc0-9e9e98ab0a62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1731 microversion: 2.20 time: 0.718012 Oct 17 13:22:37.360679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.363410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.364127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.365172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.366589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.367293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.368145 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3017/6318] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:36 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1731 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:37.674572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:37.676216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:37.699960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.701749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.703929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.704714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.705157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.705636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.789992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:37.806348 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cbdc0102-df05-4b0d-bb66-0f60bbc6d5a0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1226 microversion: 2.1 time: 0.462901 Oct 17 13:22:37.822191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3302/6319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:37 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1226 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:38.225569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:38.277229 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-175eb518-67ce-428d-8d73-232215321fe3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.607129 Oct 17 13:22:38.282276 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3018/6320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:37 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:38.401989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:38.407236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:38.433976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.443828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.448905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:38.452872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.454376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.458964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:38.835018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:38.835568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:38.857121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.858181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.859007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:38.863425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.864314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.865380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:38.947667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:38.967052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:38.971240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:38.977872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af7bd222-e042-441c-b130-3f731b69cfe5 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1718 microversion: 2.20 time: 0.581555 Oct 17 13:22:38.980777 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3303/6321] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:38 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1718 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:39.184239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:39.202042 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f0357274-c136-4b7c-bc9d-ee44785b5a7d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1300 microversion: 2.1 time: 0.371358 Oct 17 13:22:39.205459 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3019/6322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:38 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1300 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:39.332927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:39.338885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:39.369780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.370584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.371150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.371987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.372487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.373519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.732859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:39.744659 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ff31f21-9353-4f8c-9649-3102f5c2220b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.426038 Oct 17 13:22:39.758188 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3304/6323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:39 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:39.961749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7c0259c0-1a65-4deb-b276-00ca9ce98def req-5a0ffedf-11ea-4f8d-ad14-a6f6316fff09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3", "tag": "8219affe-a396-4088-8c5a-419f52c703b9"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:39.981150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7c0259c0-1a65-4deb-b276-00ca9ce98def req-5a0ffedf-11ea-4f8d-ad14-a6f6316fff09 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.981872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7c0259c0-1a65-4deb-b276-00ca9ce98def req-5a0ffedf-11ea-4f8d-ad14-a6f6316fff09 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.982350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7c0259c0-1a65-4deb-b276-00ca9ce98def req-5a0ffedf-11ea-4f8d-ad14-a6f6316fff09 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.005363 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7c0259c0-1a65-4deb-b276-00ca9ce98def req-5a0ffedf-11ea-4f8d-ad14-a6f6316fff09 service nova] Creating event network-changed:8219affe-a396-4088-8c5a-419f52c703b9 for instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 on n-h1-853316-12 Oct 17 13:22:40.033131 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7c0259c0-1a65-4deb-b276-00ca9ce98def req-5a0ffedf-11ea-4f8d-ad14-a6f6316fff09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075022 Oct 17 13:22:40.035971 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3020/6324] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:40.248424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:40.252253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:40.262061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.263491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.264615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.265610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.274745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.275469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.446817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:40.482923 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-008ed086-1592-47c9-aac0-2d9d1979531f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1300 microversion: 2.1 time: 0.242312 Oct 17 13:22:40.487633 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3305/6325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:40 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:40.774042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:40.775455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:40.786271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.787127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.788177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.789185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.789861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.790706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:41.520444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:41.522109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:41.554325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:41.555166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:41.557593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:41.559193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:41.562698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:41.580102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:41.711143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:41.723949 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-924ebd28-2585-4b45-8f21-9801aeeaa7df tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.954945 Oct 17 13:22:41.731514 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3021/6326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:40 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:41.757381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:41.769856 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fb6539ac-e0b1-44a6-bc55-ce4973479b58 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1300 microversion: 2.1 time: 0.255650 Oct 17 13:22:41.776383 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3306/6327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:41 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1300 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:42.763609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:42.764555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:42.784325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.787372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.788080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.789601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.830005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:42.837418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.838434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:42.842729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.905787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.914022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.929077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.931902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.934873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.946521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:43.523438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:43.557292 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1243012c-1c96-4b59-856c-f0968234d239 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.797915 Oct 17 13:22:43.576403 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3022/6328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:42 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:44.012268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:44.026051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-89d89b82-8ab2-4eed-b97c-6cab7c162a80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 1.229297 Oct 17 13:22:44.029270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3307/6329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:42 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:44.585841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:44.586985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:44.605462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.605792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.606282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.618981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.619737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.620372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:45.056379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:45.057475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:45.061138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:45.084005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:45.084459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:45.085242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:45.086066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:45.086761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:45.087421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:45.506329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:45.520284 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4455ee5-1986-41d0-8491-9348b86893a2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.468298 Oct 17 13:22:45.541186 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3308/6330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:45 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:45.723774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:46.301936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=16 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:46.495159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.523054 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51e312e5-473f-4c21-b527-bc98436d01c3 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 1.943579 Oct 17 13:22:46.534333 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3023/6331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:44 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:46.548906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:46.549649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:46.580429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.616258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.617231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.630661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.635974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.640047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.245756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:47.281901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9aba296c-1a16-403e-845c-eb7033dcd524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.735249 Oct 17 13:22:47.283414 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3309/6332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:46 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:47.425005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-287fec63-f69d-499c-b600-4fb89ab2d568 req-6e88af1c-f5ce-4c18-a62d-0e457a82590f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d639a073-e2d1-442c-bb29-a462e2f91566", "tag": "7655af64-e6f5-4c7b-bcdc-451127b727e4"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:47.488668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-287fec63-f69d-499c-b600-4fb89ab2d568 req-6e88af1c-f5ce-4c18-a62d-0e457a82590f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.493468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-287fec63-f69d-499c-b600-4fb89ab2d568 req-6e88af1c-f5ce-4c18-a62d-0e457a82590f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.496003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-287fec63-f69d-499c-b600-4fb89ab2d568 req-6e88af1c-f5ce-4c18-a62d-0e457a82590f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.546082 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-287fec63-f69d-499c-b600-4fb89ab2d568 req-6e88af1c-f5ce-4c18-a62d-0e457a82590f service nova] Creating event network-changed:7655af64-e6f5-4c7b-bcdc-451127b727e4 for instance d639a073-e2d1-442c-bb29-a462e2f91566 on n-h2-853316-12 Oct 17 13:22:47.564678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:47.567527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:47.592019 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-287fec63-f69d-499c-b600-4fb89ab2d568 req-6e88af1c-f5ce-4c18-a62d-0e457a82590f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192882 Oct 17 13:22:47.607320 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3024/6333] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:47.616763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.617680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.618546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.619849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.620684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.621415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.096788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:48.168146 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-02244683-ddbc-4a68-b7ae-8f591a41afbb tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.607791 Oct 17 13:22:48.211936 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3310/6334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:47 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:48.318101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:48.319569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:48.338800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.339469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.342783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.349924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.353979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.355608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.887462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:48.923332 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-825548d9-1a4c-4709-aeaa-ff2cd9f43341 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.609996 Oct 17 13:22:48.936089 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3025/6335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:48 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:49.225506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:49.226135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:49.237755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.239146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.239969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.240915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.241543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.242439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.989269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:50.000818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:50.005094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:50.040363 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-391369d4-abdc-4969-a783-376b1032e6a4 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.819202 Oct 17 13:22:50.044892 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3311/6336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:49 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:50.084082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.088256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.089283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.090949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.095858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.098108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.759909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:50.807451 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e90191e-8d8d-4ae5-86c3-4d792ce1a0b7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.831900 Oct 17 13:22:50.809179 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3026/6337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:49 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:51.100675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:51.103858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:51.139847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.140717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.163386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.165099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.165815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.168046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.841110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:51.843365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:51.862202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.864828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.865629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.868480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.872676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.873409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.943821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:51.971313 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-61031c1d-6881-432a-a1f1-7a0d1ab90645 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 0.884632 Oct 17 13:22:51.975267 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3312/6338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:51 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:52.182122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-225903c5-c51a-45e5-9861-6d55af414baa req-a3e33d1a-8f40-4579-8b18-1998ec242e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3", "name": "network-vif-plugged", "status": "completed", "tag": "8219affe-a396-4088-8c5a-419f52c703b9"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:52.209171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-225903c5-c51a-45e5-9861-6d55af414baa req-a3e33d1a-8f40-4579-8b18-1998ec242e57 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:52.212512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-225903c5-c51a-45e5-9861-6d55af414baa req-a3e33d1a-8f40-4579-8b18-1998ec242e57 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:52.213312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-225903c5-c51a-45e5-9861-6d55af414baa req-a3e33d1a-8f40-4579-8b18-1998ec242e57 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:52.249720 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-225903c5-c51a-45e5-9861-6d55af414baa req-a3e33d1a-8f40-4579-8b18-1998ec242e57 service nova] Creating event network-vif-plugged:8219affe-a396-4088-8c5a-419f52c703b9 for instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 on n-h1-853316-12 Oct 17 13:22:52.266036 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-225903c5-c51a-45e5-9861-6d55af414baa req-a3e33d1a-8f40-4579-8b18-1998ec242e57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088901 Oct 17 13:22:52.272140 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3313/6339] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:22:52.327250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:52.341076 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b2ec66bc-ab14-45e4-b20a-b3bfb8606c1f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.505864 Oct 17 13:22:52.342289 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3027/6340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:51 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:53.001775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:53.002701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:53.017063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.021582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.022452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.023552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.029663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.032049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.412548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:53.416428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:53.461600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.467340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.468575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.469643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.473758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.475015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:54.194363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:54.244120 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f00151b-4a53-4c00-b675-477ae5bc78c3 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.831922 Oct 17 13:22:54.244415 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3028/6341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:53 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:55.320919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:55.340213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:55.364430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:55.365492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:55.366649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:55.368602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:55.369731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:55.370827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:55.496332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:55.531852 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a0ea9d6f-da6a-4164-afbc-2fc56e77e1c9 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1328 microversion: 2.1 time: 2.534461 Oct 17 13:22:55.555540 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3314/6342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:52 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1328 bytes in 2559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:56.058541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:56.105222 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80bd4d6d-d3c4-4781-b196-e30c914cabfd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.799971 Oct 17 13:22:56.128419 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3029/6343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:55 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:56.572466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:56.573075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:56.585431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:56.587387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:56.589055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:56.590554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:56.591589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:56.592272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.159055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:57.159055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:57.178565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.180358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.182096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.184777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.186260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.187603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.388416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:57.439181 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a9574a64-e832-4f61-b808-c9366fb9f1f7 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1528 microversion: 2.1 time: 0.865805 Oct 17 13:22:57.443815 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3315/6344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:56 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1528 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:57.501461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:57.511404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:57.537468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.539209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.540328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.559261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.560805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.562451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.721661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:57.749571 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8700c520-549a-4d62-8db6-74167c92423d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.598502 Oct 17 13:22:57.776349 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3030/6345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:57 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:58.415707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:58.426414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:58.473950 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-057425b8-b89c-467e-a3bb-0c51b6fdac0b tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1528 microversion: 2.1 time: 0.994205 Oct 17 13:22:58.479834 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3316/6346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:57 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1528 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:58.791466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.792431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:58.847892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.851824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.852606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.856771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.859489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.868376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.101877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:59.102652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:59.130800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.135047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.135996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.139971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.140808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.141565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.188003 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] HTTP exception thrown: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Request method failure captured: Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 HTTP/1.1 Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcRCZ4QOaxV1BJ4XEcYh2kaRZ29wDu4zL9WqbKrzFWdrhLZAzvbxxhEHmy0f_n8ICN4sYxSO4k-QgjdKLoUOy5lPGDx2UzgO9uOA3xQFrDA1ngKuJGC75aDuN2cdTfhz3dvjkfLgu-6rohCvyhbCuc9WLIssibSa2AIeMeHCGGqApQ Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 5441bb817a624eaa966b2746ae45f98e Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-79526981 Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5441bb817a624eaa966b2746ae45f98e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5441bb817a624eaa966b2746ae45f98e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5441bb817a624eaa966b2746ae45f98e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5441bb817a624eaa966b2746ae45f98e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-79526981 Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 5441bb817a624eaa966b2746ae45f98e Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-79526981 Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestMultiTenantJSON-79526981-project Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 231bcdffa2a24df1a6ba1f1128e209e1 Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-79526981-project Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3'} Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:59.190491 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:22:59.197015 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:22:59.202026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Returning 404 to user: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:59.209914 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6c105297-8e5e-497c-9635-7862043ec37b tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 404 len: 111 microversion: 2.1 time: 0.700976 Oct 17 13:22:59.211499 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3031/6347] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:22:58 2022] DELETE /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 111 bytes in 705 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:22:59.223931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:59.224901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:59.239483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.251003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.251757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.252961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.253580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.254078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.353418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:59.372741 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-093446e8-163e-402c-b248-5d383f98f367 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.592695 Oct 17 13:22:59.385304 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3317/6348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:59.551595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-656101323", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "d655af17-e1cc-4020-9487-2d7bb4d8b86d"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:59.721473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] validate_networks() for [('d655af17-e1cc-4020-9487-2d7bb4d8b86d', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:22:59.873852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:59.889417 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-881ed78d-0ff7-41b6-b8bf-08563a6edd74 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1528 microversion: 2.1 time: 0.670906 Oct 17 13:22:59.896430 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3032/6349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:59 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1528 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:59.924681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Action: 'update', calling method: >, body: {"server": {"name": "c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3_new"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:59.940308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:59.967284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.970061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.972734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.976751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.979525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.980253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:00.056494 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] HTTP exception thrown: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Request method failure captured: Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: request: PUT /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 HTTP/1.1 Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 64 Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcRCZ4QOaxV1BJ4XEcYh2kaRZ29wDu4zL9WqbKrzFWdrhLZAzvbxxhEHmy0f_n8ICN4sYxSO4k-QgjdKLoUOy5lPGDx2UzgO9uOA3xQFrDA1ngKuJGC75aDuN2cdTfhz3dvjkfLgu-6rohCvyhbCuc9WLIssibSa2AIeMeHCGGqApQ Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 5441bb817a624eaa966b2746ae45f98e Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-79526981 Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5441bb817a624eaa966b2746ae45f98e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5441bb817a624eaa966b2746ae45f98e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5441bb817a624eaa966b2746ae45f98e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5441bb817a624eaa966b2746ae45f98e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-79526981 Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 5441bb817a624eaa966b2746ae45f98e Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-79526981 Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestMultiTenantJSON-79526981-project Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 231bcdffa2a24df1a6ba1f1128e209e1 Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-79526981-project Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: {"server": {"name": "c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3_new"}} Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3', 'body': {'server': {'name': 'c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3_new'}}} Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:23:00.060590 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:00.073275 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:00.079255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] Returning 404 to user: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:00.082118 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b20ce1c-ba0e-4459-a229-fb220e2f168e tempest-ServersNegativeTestMultiTenantJSON-79526981 tempest-ServersNegativeTestMultiTenantJSON-79526981-project] 10.222.0.27 "PUT /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 404 len: 111 microversion: 2.1 time: 0.165824 Oct 17 13:23:00.083917 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3033/6350] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:22:59 2022] PUT /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:23:00.099919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:00.102344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:00.121710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:00.124704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:00.125895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:00.129228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:00.130570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:00.133129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:00.249571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:23:00.467439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:00.573307 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70a68198-e3be-46cb-9b60-846dc00cc166 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 204 len: 0 microversion: 2.1 time: 0.480188 Oct 17 13:23:00.576230 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3034/6351] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:23:00 2022] DELETE /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:23:00.630943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:00.633942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:00.666579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:00.667726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:00.668231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:00.673171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:00.677926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:00.679191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:01.274323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:01.275420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:01.276910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:01.277287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:01.278224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:01.302219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:01.303054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:01.303714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:01.304851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:01.310441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:01.311286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:01.357888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:01.384184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:01.419453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:01.429557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:01.435970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:01.446467 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d55dbb3-da01-4d2b-a25d-b40e1b6aac73 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.867093 Oct 17 13:23:01.452448 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3035/6352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:00 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:01.458956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:01.469395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:01.495570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:01.497294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:01.506518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:01.507682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:01.508453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:01.512471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:01.624681 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e009b149-5fd3-411c-8435-2731334f1362 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.237715 Oct 17 13:23:01.645834 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3318/6353] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:23:01.651651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65be9461-1f5a-4e7d-9f23-a745c7eaaf18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:01.660318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65be9461-1f5a-4e7d-9f23-a745c7eaaf18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:01.803983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65be9461-1f5a-4e7d-9f23-a745c7eaaf18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:01.821284 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65be9461-1f5a-4e7d-9f23-a745c7eaaf18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1192 microversion: 2.1 time: 0.173571 Oct 17 13:23:01.838792 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3319/6354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:01 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1192 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:02.483297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:02.485402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:02.511622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:02.516708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:02.520617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:02.524336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:02.527095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:02.529491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:02.983698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:02.995291 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18dd0666-fa32-4b04-aadb-aca4bb03e06c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.519156 Oct 17 13:23:03.000308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3320/6355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:02 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:03.012738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:03.013710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:03.042780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:03.043718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:03.044759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:03.045986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:03.046839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:03.047582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:03.174292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:03.189297 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c72215f-adb0-44ac-8f55-341613be8868 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1196 microversion: 2.1 time: 0.187508 Oct 17 13:23:03.211513 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3321/6356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:03 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1196 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:03.753124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:03.779758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8c7d5968-2afe-4e9f-9578-ddc742cbbbe1 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1534 microversion: 2.1 time: 2.312939 Oct 17 13:23:03.789269 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3036/6357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:01 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1534 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:04.032456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:04.034392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:04.069042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.075795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.079924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.083698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.084540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.086709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.235916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:04.237403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:04.241930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:04.258292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.261488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.263560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.264663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.267818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.268633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.636996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:04.651498 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-715e3668-a3af-4305-83e3-9f83fc52f3be tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1244 microversion: 2.1 time: 0.419974 Oct 17 13:23:04.669036 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3037/6358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:04 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1244 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:04.824834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:04.826924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:04.854833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.857942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.858870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.859653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.860186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.860658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:05.775741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:05.805105 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de816d8f-1922-49da-a52f-20ecfa093ebf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 1.776787 Oct 17 13:23:05.840575 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3322/6359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:04 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:05.864774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6ef8d16c-1961-4509-a9d8-092d939bd0de req-75fbb1ad-5ff8-4390-ab1f-46672b1a4a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3", "name": "network-vif-unplugged", "status": "completed", "tag": "8219affe-a396-4088-8c5a-419f52c703b9"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:05.904265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6ef8d16c-1961-4509-a9d8-092d939bd0de req-75fbb1ad-5ff8-4390-ab1f-46672b1a4a91 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:05.904968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6ef8d16c-1961-4509-a9d8-092d939bd0de req-75fbb1ad-5ff8-4390-ab1f-46672b1a4a91 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:05.905619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6ef8d16c-1961-4509-a9d8-092d939bd0de req-75fbb1ad-5ff8-4390-ab1f-46672b1a4a91 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.005062 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6ef8d16c-1961-4509-a9d8-092d939bd0de req-75fbb1ad-5ff8-4390-ab1f-46672b1a4a91 service nova] Creating event network-vif-unplugged:8219affe-a396-4088-8c5a-419f52c703b9 for instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 on n-h1-853316-12 Oct 17 13:23:06.036045 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6ef8d16c-1961-4509-a9d8-092d939bd0de req-75fbb1ad-5ff8-4390-ab1f-46672b1a4a91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181665 Oct 17 13:23:06.042845 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3323/6360] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:06.086603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:06.095103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:06.136087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.145261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.146531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.157917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.159206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.162445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.771543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:06.789550 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5fa2ff79-cfdf-4a08-8156-3173bc685085 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1250 microversion: 2.1 time: 0.744790 Oct 17 13:23:06.801087 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3324/6361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:06 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1250 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:06.854868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:06.856076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:06.873863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.875162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.876046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.877721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.879180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.879857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:07.125450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:07.136327 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5edfd85a-983f-4fbd-8d00-7f8003fed273 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1534 microversion: 2.1 time: 2.317560 Oct 17 13:23:07.140457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:07.154120 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-121ec124-e7b6-4602-97b2-6db3a6bf8ee4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.304071 Oct 17 13:23:07.166962 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3038/6362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:04 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1534 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:07.194856 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3325/6363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:06 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:07.581162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4ad203b1-7009-481f-9933-74dbba42ebf6 req-79e998e5-9636-44d5-8b37-038708a2e869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3", "name": "network-vif-deleted", "tag": "8219affe-a396-4088-8c5a-419f52c703b9"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:07.634663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4ad203b1-7009-481f-9933-74dbba42ebf6 req-79e998e5-9636-44d5-8b37-038708a2e869 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:07.639867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4ad203b1-7009-481f-9933-74dbba42ebf6 req-79e998e5-9636-44d5-8b37-038708a2e869 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:07.645343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4ad203b1-7009-481f-9933-74dbba42ebf6 req-79e998e5-9636-44d5-8b37-038708a2e869 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:07.681729 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4ad203b1-7009-481f-9933-74dbba42ebf6 req-79e998e5-9636-44d5-8b37-038708a2e869 service nova] Creating event network-vif-deleted:8219affe-a396-4088-8c5a-419f52c703b9 for instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 on n-h1-853316-12 Oct 17 13:23:07.696524 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4ad203b1-7009-481f-9933-74dbba42ebf6 req-79e998e5-9636-44d5-8b37-038708a2e869 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119478 Oct 17 13:23:07.700892 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3039/6364] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:23:07.836612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:07.837376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:07.856088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:07.856629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:07.857111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:07.857880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:07.858452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:07.868516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.158918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:08.191289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:08.193770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:08.241258 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-17f5666e-fa5b-4728-928e-cc23954df99d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1250 microversion: 2.1 time: 0.410516 Oct 17 13:23:08.271430 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3326/6365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:07 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1250 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:08.275186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.279368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.280922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.289567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.293628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:08.294836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.295623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.309021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:08.327998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.328947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.332458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.336116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.350107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.351615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.525052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.526981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.545500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.547127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lazy-loading 'fault' on Instance uuid c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:09.146997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4607f2ad6bb4daca1d86d4a7befee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd038095e25420d84384f7f7c97ff58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:09.184456 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3bf6a08f-e3a5-4691-9d02-c2a1e8667977 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 200 len: 1318 microversion: 2.1 time: 1.000669 Oct 17 13:23:09.188255 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3040/6366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:08 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 1318 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:09.307122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:09.309083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:09.311602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:09.324924 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8f26cd4d-9fb5-4bd3-b5db-40fc25d7ab8b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 1.050724 Oct 17 13:23:09.326151 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3327/6367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:08 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:09.358515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:09.359180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:09.359947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:09.360987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:09.364879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:09.365466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:10.237382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:10.239512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] [instance: c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:10.277263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:10.286520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:10.288729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:10.298773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:10.299866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:10.302762 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:10.361978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:10.387498 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c472a900-c74b-4be5-95e7-25ac53959eed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1292 microversion: 2.1 time: 1.100648 Oct 17 13:23:10.409279 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3041/6368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:09 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1292 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:10.421594 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] HTTP exception thrown: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:10.436115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Request method failure captured: Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 HTTP/1.1 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVb_fImAGK5whRi9wT04aUyOLR-rEl69yXT17lgGxGGUSW3n2oXYydiRbkR42krooZkAoDofFK_GxshC70ggAN1DBRcSzzCAl-PIm3czCe0wTwNdBAw5ajx1gnZ_ATh28FqUhUstzcCdTQaNPgl4yUrYBEvrW8g8B2wiy6_66CSUqlw Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: cbd038095e25420d84384f7f7c97ff58 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1879428498 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbd038095e25420d84384f7f7c97ff58", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbd038095e25420d84384f7f7c97ff58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbd038095e25420d84384f7f7c97ff58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbd038095e25420d84384f7f7c97ff58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1879428498 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: cbd038095e25420d84384f7f7c97ff58 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1879428498 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1879428498-project Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: c4607f2ad6bb4daca1d86d4a7befee92 Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1879428498-project Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3'} Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:10.438988 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. Oct 17 13:23:10.443954 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:10.445939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:10.452858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] Returning 404 to user: Instance c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:10.453876 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8799041d-c955-4dcd-99bb-bb43318dc030 tempest-ServersNegativeTestMultiTenantJSON-1879428498 tempest-ServersNegativeTestMultiTenantJSON-1879428498-project] 10.222.0.27 "GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3" status: 404 len: 111 microversion: 2.1 time: 0.223789 Oct 17 13:23:10.474396 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3328/6369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:10 2022] GET /compute/v2.1/servers/c81f6a1b-3e1b-44af-8a30-8a9ecf6572d3 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:23:10.489581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:10.492069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:10.494870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:10.495923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:10.499087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:10.500874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:11.049365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:11.064766 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fff7a52a-eb56-429d-bad3-41e5c9237c25 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.653102 Oct 17 13:23:11.067055 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3042/6370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:10 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:11.416810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:11.417430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:11.426488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:11.439085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:11.439605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:11.440212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:11.441544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:11.442449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:11.442908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:11.820374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:12.122845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:12.123914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:12.173893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:12.176255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:12.184108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:12.189891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:12.209662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:12.212391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:12.746475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:12.766245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-88fd2089-da85-4af6-a772-5157049f3e86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1342 microversion: 2.1 time: 0.655577 Oct 17 13:23:12.769775 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3043/6371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:12 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1342 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:12.795242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-25119353-f1c3-4034-8f9e-5f45a20253f5 req-0736d493-84b8-4aff-8a0d-3e1e19950566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d99fe1-8d75-410e-bbb4-af46d70d51e4", "tag": "85d85466-afef-43ce-be91-fa3b1c75e50b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:12.826609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-25119353-f1c3-4034-8f9e-5f45a20253f5 req-0736d493-84b8-4aff-8a0d-3e1e19950566 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:12.827277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-25119353-f1c3-4034-8f9e-5f45a20253f5 req-0736d493-84b8-4aff-8a0d-3e1e19950566 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:12.827942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-25119353-f1c3-4034-8f9e-5f45a20253f5 req-0736d493-84b8-4aff-8a0d-3e1e19950566 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:12.876864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-25119353-f1c3-4034-8f9e-5f45a20253f5 req-0736d493-84b8-4aff-8a0d-3e1e19950566 service nova] Creating event network-changed:85d85466-afef-43ce-be91-fa3b1c75e50b for instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 on n-h1-853316-12 Oct 17 13:23:12.904025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-25119353-f1c3-4034-8f9e-5f45a20253f5 req-0736d493-84b8-4aff-8a0d-3e1e19950566 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129858 Oct 17 13:23:12.905970 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3044/6372] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:13.227800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:13.262147 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-269ee589-2b00-4998-853f-47113ef3f8e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1292 microversion: 2.1 time: 1.848607 Oct 17 13:23:13.267898 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3329/6373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:11 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1292 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:13.819407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:13.828705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:13.867278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:13.869978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:13.874452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:13.878706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:13.880306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:13.883717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:14.312417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:14.317319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:14.332273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:14.336026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:14.337510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:14.339186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:14.343742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:14.344946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:14.522157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:14.537004 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e81863e4-d5bb-40a5-bf4d-583d566e0f75 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1388 microversion: 2.1 time: 0.732931 Oct 17 13:23:14.537709 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3045/6374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:13 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1388 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:14.690280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:14.699369 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0fc482c6-5eb3-423d-9177-5feab8676118 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1292 microversion: 2.1 time: 0.402312 Oct 17 13:23:14.703386 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3330/6375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:14 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1292 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:15.567806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:15.568629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:15.590927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:15.592842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:15.593342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:15.597541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:15.598405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:15.599038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:15.731789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:15.732769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:15.737979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:15.780710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:15.781494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:15.782215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:15.783337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:15.784041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:15.785302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:16.351965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:16.366590 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b6482885-f3b3-4242-af93-90941f91ce36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1376 microversion: 2.1 time: 0.803250 Oct 17 13:23:16.369170 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3046/6376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:15 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1376 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:16.510662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:16.548033 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2ba82b0f-dd26-44b9-b169-c2dfe38429f3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1292 microversion: 2.1 time: 0.814484 Oct 17 13:23:16.549901 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3331/6377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:15 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1292 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:17.403600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:17.410321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:17.435970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.437214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.438288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.440018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.441642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.442673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.591549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:17.598395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:17.631909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.649278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.651773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.653401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.656708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.663405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:18.249523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:18.279057 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0e92afe7-1d75-4cf6-bb19-c0a97c6ff8e3 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1292 microversion: 2.1 time: 0.697927 Oct 17 13:23:18.282342 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3332/6378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:17 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1292 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:18.554527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:18.570550 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab73aefa-1d02-4574-9a88-10556fa3cd1c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1376 microversion: 2.1 time: 1.176421 Oct 17 13:23:18.571894 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3047/6379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:17 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1376 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:19.322893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:19.323719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:19.344070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:19.347491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:19.349920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:19.354870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:19.355969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:19.356759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:19.599239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:19.600157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:19.626549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:19.631201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:19.633138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:19.635897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:19.640893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:19.641684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.090977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:20.116729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:20.140013 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-14b331c1-e618-4b07-858a-225a7fb60d04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1376 microversion: 2.1 time: 0.543507 Oct 17 13:23:20.141094 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c6c9b1b-6d8b-43d8-8d05-9672015b5d58 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1292 microversion: 2.1 time: 0.821783 Oct 17 13:23:20.141985 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3048/6380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:19 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1376 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:20.144428 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3333/6381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:19 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1292 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:20.150302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cf5520bb-7f89-43a6-b27c-51f52e687b67 req-4b64d0bc-bd5a-4fe5-8808-290d18f8d649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d99fe1-8d75-410e-bbb4-af46d70d51e4", "name": "network-vif-plugged", "status": "completed", "tag": "85d85466-afef-43ce-be91-fa3b1c75e50b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:20.164825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cf5520bb-7f89-43a6-b27c-51f52e687b67 req-4b64d0bc-bd5a-4fe5-8808-290d18f8d649 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:20.166615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cf5520bb-7f89-43a6-b27c-51f52e687b67 req-4b64d0bc-bd5a-4fe5-8808-290d18f8d649 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:20.167284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cf5520bb-7f89-43a6-b27c-51f52e687b67 req-4b64d0bc-bd5a-4fe5-8808-290d18f8d649 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.197188 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cf5520bb-7f89-43a6-b27c-51f52e687b67 req-4b64d0bc-bd5a-4fe5-8808-290d18f8d649 service nova] Creating event network-vif-plugged:85d85466-afef-43ce-be91-fa3b1c75e50b for instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 on n-h1-853316-12 Oct 17 13:23:20.208853 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cf5520bb-7f89-43a6-b27c-51f52e687b67 req-4b64d0bc-bd5a-4fe5-8808-290d18f8d649 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064764 Oct 17 13:23:20.211587 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3049/6382] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:21.175659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:21.178189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:21.191967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:21.192295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:21.193588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:21.194491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:21.195644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.197349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:21.198546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:21.200567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.205965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:21.207140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:21.209006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.210217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:21.211094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:21.212279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.424783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:21.443757 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56dc0099-21f2-47ff-8bae-048383d29ad4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1376 microversion: 2.1 time: 0.275125 Oct 17 13:23:21.445728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3334/6383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:21 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1376 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:21.629245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:21.654712 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-105641e7-6d8f-4b2a-8ba4-f2d4783cd7b7 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1292 microversion: 2.1 time: 0.472987 Oct 17 13:23:21.663396 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3050/6384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:21 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1292 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:22.472668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:22.473501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:22.491723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:22.492227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:22.496918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:22.497725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:22.501338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:22.502018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:22.693841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:22.695370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:22.719116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:22.720318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:22.721077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:22.722449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:22.723358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:22.724243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:22.867594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:22.923434 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-462862b0-6673-40e5-b3dd-d06d4cdd2eef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1376 microversion: 2.1 time: 0.450947 Oct 17 13:23:22.925232 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3335/6385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:22 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1376 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:23.111374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:23.134086 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71749ed7-e0c2-4b39-93cb-fafed86b239b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1473 microversion: 2.1 time: 0.449645 Oct 17 13:23:23.134719 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3051/6386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:22 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:23.422203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1655877266", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:23.573251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] validate_networks() for [('d655af17-e1cc-4020-9487-2d7bb4d8b86d', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:23:23.953129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:23.958611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:23.978720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:23.979308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:23.980119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:23.981369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:23.989729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:23.991028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:24.323805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:24.334131 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-91305a00-0c80-4d47-bb7d-465072c79c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1376 microversion: 2.1 time: 0.389395 Oct 17 13:23:24.349175 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3052/6387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:23 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1376 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:24.754546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:24.755312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:24.756178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:24.756714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:24.757556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:24.788548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:24.790055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:24.794978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:24.798462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:24.802300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:24.806051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:24.888767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:24.896867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:24.926854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:24.929683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:25.123452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-5ce51e0a-fac2-47fe-854a-041fe300d645 req-12940758-6e82-45fe-af8e-1d2dc3fa461a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d639a073-e2d1-442c-bb29-a462e2f91566", "name": "network-vif-plugged", "status": "completed", "tag": "7655af64-e6f5-4c7b-bcdc-451127b727e4"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:25.145174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ce51e0a-fac2-47fe-854a-041fe300d645 req-12940758-6e82-45fe-af8e-1d2dc3fa461a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:25.151690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ce51e0a-fac2-47fe-854a-041fe300d645 req-12940758-6e82-45fe-af8e-1d2dc3fa461a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:25.153176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ce51e0a-fac2-47fe-854a-041fe300d645 req-12940758-6e82-45fe-af8e-1d2dc3fa461a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:25.161602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:25.166084 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-06e1973c-c730-4ca1-aa9a-536ef8178698 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742402 Oct 17 13:23:25.168017 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3336/6388] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:23:25.202958 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-5ce51e0a-fac2-47fe-854a-041fe300d645 req-12940758-6e82-45fe-af8e-1d2dc3fa461a service nova] Creating event network-vif-plugged:7655af64-e6f5-4c7b-bcdc-451127b727e4 for instance d639a073-e2d1-442c-bb29-a462e2f91566 on n-h2-853316-12 Oct 17 13:23:25.215836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-30057e8c-2868-41b7-8379-d58279b1b62c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:25.216246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-30057e8c-2868-41b7-8379-d58279b1b62c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:25.228291 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-5ce51e0a-fac2-47fe-854a-041fe300d645 req-12940758-6e82-45fe-af8e-1d2dc3fa461a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109334 Oct 17 13:23:25.230175 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3053/6389] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:23:25.290541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-30057e8c-2868-41b7-8379-d58279b1b62c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:23:25.397334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:25.398282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:25.418099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:25.418853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:25.419337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:25.420105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:25.420586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:25.421034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:25.948248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:25.961307 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0bef2196-9da9-432b-9277-c4e1ef191083 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1376 microversion: 2.1 time: 0.569538 Oct 17 13:23:25.961987 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3054/6390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:25 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1376 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:25.985672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.scheduler.client.report [None req-30057e8c-2868-41b7-8379-d58279b1b62c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Deleted allocations for instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f Oct 17 13:23:26.009882 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.compute.api [None req-30057e8c-2868-41b7-8379-d58279b1b62c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f] Instance Mapping does not exist while attempting local delete cleanup. Oct 17 13:23:26.013374 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-30057e8c-2868-41b7-8379-d58279b1b62c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f" status: 204 len: 0 microversion: 2.1 time: 0.834795 Oct 17 13:23:26.014737 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3337/6391] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:23:25 2022] DELETE /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:23:26.038624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3311613d-e3ee-43b1-b673-25be8b3f9419 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:26.039267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3311613d-e3ee-43b1-b673-25be8b3f9419 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:26.056562 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-3311613d-e3ee-43b1-b673-25be8b3f9419 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3311613d-e3ee-43b1-b673-25be8b3f9419 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f HTTP/1.1 Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f'} Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:26.058303 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:26.063793 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:26.063793 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:26.063793 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:26.063793 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:23:26.063793 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:26.063793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3311613d-e3ee-43b1-b673-25be8b3f9419 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:26.063793 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3311613d-e3ee-43b1-b673-25be8b3f9419 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f" status: 404 len: 111 microversion: 2.1 time: 0.040653 Oct 17 13:23:26.070626 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3055/6392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:26 2022] GET /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:23:26.259260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-728162369", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "d655af17-e1cc-4020-9487-2d7bb4d8b86d"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:26.343083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] validate_networks() for [('d655af17-e1cc-4020-9487-2d7bb4d8b86d', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:23:27.002502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:27.004065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:27.034468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.035108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.035593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.038559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.039363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.039929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.261594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:27.262774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:27.264244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:27.265143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:27.265813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:27.287978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.288384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.289089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.289859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.290352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.290787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.310869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:27.331107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:27.341645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:27.353199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:27.355860 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3155481a-be21-48fb-a416-57ade16cb240 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1561 microversion: 2.1 time: 0.359408 Oct 17 13:23:27.357895 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3056/6393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:26 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1561 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:27.385953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:27.386641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:27.408843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.412370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:27.416074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.417556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.419556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.420063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.420654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.423615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:27.522365 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-becf222d-9fdd-4491-ace2-f7f878f07103 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268183 Oct 17 13:23:27.530394 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3338/6394] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:23:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:23:27.536466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d4d8dca-554f-4081-947a-70cf61a770db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:27.537360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d4d8dca-554f-4081-947a-70cf61a770db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:27.622517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0d4d8dca-554f-4081-947a-70cf61a770db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:27.633002 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d4d8dca-554f-4081-947a-70cf61a770db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1220 microversion: 2.1 time: 0.101092 Oct 17 13:23:27.649441 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3339/6395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:27 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:27.818934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:27.858821 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c6a1b346-f5ae-4d4a-bd10-99534c66cd86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1561 microversion: 2.1 time: 0.477895 Oct 17 13:23:27.862392 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3057/6396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:27 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1561 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:28.073015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:28.073527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:28.082320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:28.083072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:28.083552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:28.084339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:28.085133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:28.095339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:28.164659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:23:28.383056 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-22c78a4c-96ce-41e2-9a24-c321ce383531 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 204 len: 0 microversion: 2.1 time: 0.314925 Oct 17 13:23:28.384455 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3340/6397] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:23:28 2022] DELETE /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:23:28.392783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:28.393424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:28.401508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:28.402022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:28.402508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:28.403248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:28.403724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:28.404174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:28.660648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:28.661714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:28.678602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:28.679161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:28.681570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:28.683599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:28.686134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:28.687170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:28.753266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:28.764549 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc93675e-0100-4a7e-8898-c72c9ca73d0e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1567 microversion: 2.1 time: 0.375682 Oct 17 13:23:28.765882 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3058/6398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:28 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1567 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:28.833486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:28.855802 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bc6afb89-aabb-475d-9a67-30f10594b147 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1224 microversion: 2.1 time: 0.200961 Oct 17 13:23:28.856405 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3341/6399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:28 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1224 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:29.792227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:29.793016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:29.820256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.826031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.826769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:29.829581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.830450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.833316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:29.882803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:29.884065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:29.895772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.908539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.913357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:29.914600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.924601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.927026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.047221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:30.057551 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b75845e1-f2f1-4f84-90ce-10a319bf2b82 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1272 microversion: 2.1 time: 0.179276 Oct 17 13:23:30.059199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3342/6400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:29 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:30.287647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:30.301353 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89778ace-366c-4692-b837-aec29798255e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1567 microversion: 2.1 time: 0.513482 Oct 17 13:23:30.301952 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3059/6401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:29 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1567 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:30.966276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-fa0fb484-5483-415d-b839-db63ab0a469c req-e3a303dd-66f5-4926-99ef-7e1d4284ba47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d639a073-e2d1-442c-bb29-a462e2f91566", "name": "network-vif-deleted", "tag": "7655af64-e6f5-4c7b-bcdc-451127b727e4"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:30.998503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fa0fb484-5483-415d-b839-db63ab0a469c req-e3a303dd-66f5-4926-99ef-7e1d4284ba47 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:30.999826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fa0fb484-5483-415d-b839-db63ab0a469c req-e3a303dd-66f5-4926-99ef-7e1d4284ba47 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.000536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fa0fb484-5483-415d-b839-db63ab0a469c req-e3a303dd-66f5-4926-99ef-7e1d4284ba47 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.046787 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-fa0fb484-5483-415d-b839-db63ab0a469c req-e3a303dd-66f5-4926-99ef-7e1d4284ba47 service nova] Creating event network-vif-deleted:7655af64-e6f5-4c7b-bcdc-451127b727e4 for instance d639a073-e2d1-442c-bb29-a462e2f91566 on n-h2-853316-12 Oct 17 13:23:31.077732 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-fa0fb484-5483-415d-b839-db63ab0a469c req-e3a303dd-66f5-4926-99ef-7e1d4284ba47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114973 Oct 17 13:23:31.083770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:31.085127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:31.096511 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3343/6402] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:31.102720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.103675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.104389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.105384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.106088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.106796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.183496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:31.197455 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-562a88ca-e8cc-4948-bb7d-5faa3e716dde tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1278 microversion: 2.1 time: 0.117988 Oct 17 13:23:31.198970 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3060/6403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:31 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:31.333684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:31.334442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:31.348715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.349225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.349674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.354809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.355241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.360741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.514988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:31.528602 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58e4255e-efc0-4458-8f26-80c9759dfca0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1361 microversion: 2.1 time: 0.201755 Oct 17 13:23:31.529202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3344/6404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:31 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:32.240401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:32.247517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:32.280532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.285595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.286931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.288571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.292218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.293404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.566809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:32.568292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:32.611749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.622444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.623645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.627726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.636344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.637247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.681762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:32.712521 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8db2d4ef-5e7e-4a46-b608-c4fa2dc46190 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1320 microversion: 2.1 time: 0.492320 Oct 17 13:23:32.717846 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3061/6405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:32 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:32.817939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:32.839230 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40a4f710-5cad-4924-87f5-8b5514bc9862 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1361 microversion: 2.1 time: 0.286292 Oct 17 13:23:32.840168 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3345/6406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:32 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:33.118444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-08d18ca5-25fb-4700-84d5-b27c71c7fcd7 tempest-ExtensionsTest-1028026206 tempest-ExtensionsTest-1028026206-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:33.120290 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-08d18ca5-25fb-4700-84d5-b27c71c7fcd7 tempest-ExtensionsTest-1028026206 tempest-ExtensionsTest-1028026206-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.397138 Oct 17 13:23:33.121846 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3062/6407] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 17 13:23:32 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:33.131863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6790de28-af14-499a-af4b-b632bc113e99 tempest-ExtensionsTest-1028026206 tempest-ExtensionsTest-1028026206-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:33.134967 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6790de28-af14-499a-af4b-b632bc113e99 tempest-ExtensionsTest-1028026206 tempest-ExtensionsTest-1028026206-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007284 Oct 17 13:23:33.135601 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3346/6408] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 17 13:23:33 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:23:33.699963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-81e3ed02-8879-4073-9c8f-acdd1f0854b3 req-8ce44ca6-bf2d-44ad-a366-1a4b6b8dc6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff62d7b-ad7f-4e1e-a208-fb9d01b68116", "tag": "f6a49e78-da5c-47da-9ccc-ed323d99e159"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:33.725401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-81e3ed02-8879-4073-9c8f-acdd1f0854b3 req-8ce44ca6-bf2d-44ad-a366-1a4b6b8dc6a1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.728704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-81e3ed02-8879-4073-9c8f-acdd1f0854b3 req-8ce44ca6-bf2d-44ad-a366-1a4b6b8dc6a1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.731502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-81e3ed02-8879-4073-9c8f-acdd1f0854b3 req-8ce44ca6-bf2d-44ad-a366-1a4b6b8dc6a1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.747161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:33.747776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:33.754823 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-81e3ed02-8879-4073-9c8f-acdd1f0854b3 req-8ce44ca6-bf2d-44ad-a366-1a4b6b8dc6a1 service nova] Creating event network-changed:f6a49e78-da5c-47da-9ccc-ed323d99e159 for instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 on n-h2-853316-12 Oct 17 13:23:33.755538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.756036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.763550 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-81e3ed02-8879-4073-9c8f-acdd1f0854b3 req-8ce44ca6-bf2d-44ad-a366-1a4b6b8dc6a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.549325 Oct 17 13:23:33.765256 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3063/6409] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:33.766898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.767897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.768369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.769958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.869776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:33.871039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:33.882786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.884753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.885569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.886984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.887915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.888665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:34.030195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:34.049544 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5dcafde1-418a-471e-90c3-56a1d32c3b44 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1361 microversion: 2.1 time: 0.187655 Oct 17 13:23:34.051690 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3064/6410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:33 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:34.339582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:34.363579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-abb37c81-4ab1-4577-b859-dc52db54c30d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1320 microversion: 2.1 time: 0.620613 Oct 17 13:23:34.379650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3347/6411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:33 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1320 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:35.072917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:35.073558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:35.077908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=56 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:35.098906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.099482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.099956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.100844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.101327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.101775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.221416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:35.230609 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-071af527-cb7c-46af-9731-186f203571bc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1361 microversion: 2.1 time: 0.161276 Oct 17 13:23:35.231452 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3065/6412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:35 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:35.390183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:35.391647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:35.400669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.401540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.402260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.403673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.404454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.405320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.782946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:35.800485 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1023352-f486-420c-8b17-261dae4a7e45 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1320 microversion: 2.1 time: 0.415369 Oct 17 13:23:35.803014 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3348/6413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:35 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:36.258811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:36.261238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:36.272182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.273609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.274763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.275873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.277045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.277886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.379877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:36.388348 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eaa0cdfc-04c2-446b-9311-d9c136a86db6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1361 microversion: 2.1 time: 0.136113 Oct 17 13:23:36.389347 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3066/6414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:36 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1361 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:36.516617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b97abf8-be39-4d6b-8736-d75c11c21dd3 tempest-ComputeTenantNetworksTest-768399373 tempest-ComputeTenantNetworksTest-768399373-project] Calling method '.version_select at 0x7fa820cc7e50>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:36.801978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b97abf8-be39-4d6b-8736-d75c11c21dd3 tempest-ComputeTenantNetworksTest-768399373 tempest-ComputeTenantNetworksTest-768399373-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.471201 Oct 17 13:23:36.802868 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3349/6415] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 17 13:23:36 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:23:36.817968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-282bb52c-e597-4143-bfe0-a901fa645acf tempest-ComputeTenantNetworksTest-768399373 tempest-ComputeTenantNetworksTest-768399373-project] Calling method '.version_select at 0x7fa8252c23a0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:36.837881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:36.838703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:36.852126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.853692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.855055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.855984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.856555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.857099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.004045 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-282bb52c-e597-4143-bfe0-a901fa645acf tempest-ComputeTenantNetworksTest-768399373 tempest-ComputeTenantNetworksTest-768399373-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/2a27aee2-848f-4616-a53d-d3113753d764" status: 200 len: 140 microversion: 2.1 time: 0.191358 Oct 17 13:23:37.005958 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3067/6416] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 13:23:36 2022] GET /compute/v2.1/os-tenant-networks/2a27aee2-848f-4616-a53d-d3113753d764 => generated 140 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:37.195986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:37.213432 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-525cead0-0cb0-4326-b891-5582d8e8706a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1320 microversion: 2.1 time: 0.380077 Oct 17 13:23:37.222782 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3350/6417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:36 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:37.416252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:37.416893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:37.423587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:37.424388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:37.425970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.427407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:37.428364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:37.428988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.547011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:37.556288 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-322b20c2-1ed1-4065-963a-acc1c8e11162 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1361 microversion: 2.1 time: 0.145738 Oct 17 13:23:37.576644 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3068/6418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:37 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:38.258115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:38.258768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:38.260773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:38.262303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=16 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:38.270144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:38.270834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:38.271354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.272156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:38.272713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:38.273214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.590055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:38.592492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:38.625530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:38.626746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:38.631642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.633141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:38.638622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:38.642672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.798746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:38.817286 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6a1081b6-58bc-4604-8f4c-e52a7fc8a19c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 200 len: 1361 microversion: 2.1 time: 0.238770 Oct 17 13:23:38.830290 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3069/6419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:38 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:39.085317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8d16eff4-f5aa-474c-af0b-28a25b532167 req-ad37b768-51e1-48f5-9bf4-1417b75b97eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff62d7b-ad7f-4e1e-a208-fb9d01b68116", "name": "network-vif-plugged", "status": "completed", "tag": "f6a49e78-da5c-47da-9ccc-ed323d99e159"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:39.124336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8d16eff4-f5aa-474c-af0b-28a25b532167 req-ad37b768-51e1-48f5-9bf4-1417b75b97eb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.127542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8d16eff4-f5aa-474c-af0b-28a25b532167 req-ad37b768-51e1-48f5-9bf4-1417b75b97eb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.131564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8d16eff4-f5aa-474c-af0b-28a25b532167 req-ad37b768-51e1-48f5-9bf4-1417b75b97eb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.165143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:39.174805 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6228302-cd11-4407-a4f3-2dcadfa39ea4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1320 microversion: 2.1 time: 0.920612 Oct 17 13:23:39.195516 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3351/6420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:38 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1320 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:39.199085 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8d16eff4-f5aa-474c-af0b-28a25b532167 req-ad37b768-51e1-48f5-9bf4-1417b75b97eb service nova] Creating event network-vif-plugged:f6a49e78-da5c-47da-9ccc-ed323d99e159 for instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 on n-h2-853316-12 Oct 17 13:23:39.206015 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8d16eff4-f5aa-474c-af0b-28a25b532167 req-ad37b768-51e1-48f5-9bf4-1417b75b97eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125512 Oct 17 13:23:39.207759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3070/6421] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:39.861070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:39.861686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:39.879748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.880427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.881082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.881807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.882278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.882858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.901050 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 HTTP/1.1 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd639a073-e2d1-442c-bb29-a462e2f91566'} Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:39.902866 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-03514362-2cce-4bef-84dc-db47353787b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 404 len: 111 microversion: 2.1 time: 0.047370 Oct 17 13:23:39.907638 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3352/6422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:39 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:23:40.205522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:40.207220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:40.217378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:40.219366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:40.220447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:40.225330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:40.226227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:40.226912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:40.447079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:40.457915 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-107ed25c-dfe7-4531-adf3-2d18a768a82e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1320 microversion: 2.1 time: 0.260008 Oct 17 13:23:40.458757 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3071/6423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:40 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:41.496756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.501164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:41.522263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.523084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.523732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.525338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.525985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.526924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.776036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:41.784116 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7982d3cf-bccc-45ed-bd73-e3a5cccd2653 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1501 microversion: 2.1 time: 0.299192 Oct 17 13:23:41.787440 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3353/6424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:41 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1501 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:41.813013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.814299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:41.823760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.825004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.825621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.826557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.827180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.827888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.602282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:42.629367 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b03330a3-8db5-4823-9fd9-873e1c8292c6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1501 microversion: 2.1 time: 0.819837 Oct 17 13:23:42.631574 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3072/6425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:41 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1501 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:42.658136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.659384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:42.674751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.675881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.676245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.678287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.681022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.681512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.723819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:23:42.844148 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81ee8f40-cb53-4d91-b065-62e0228c48ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 204 len: 0 microversion: 2.1 time: 0.190396 Oct 17 13:23:42.844748 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3354/6426] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:23:42 2022] DELETE /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:23:42.854075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.854817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:42.867155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.868260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.868906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.870152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.871090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.872020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.111043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:43.122932 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-659ef84f-439e-417a-98ff-636ef420b934 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1507 microversion: 2.1 time: 0.273284 Oct 17 13:23:43.123524 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3073/6427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:42 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:44.148921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:44.150506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:44.158547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.163161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.163867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.165055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.165775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.166509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.503271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:44.527323 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91cdc67f-8b36-43b7-9a0e-f3ee72690877 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1507 microversion: 2.1 time: 0.382366 Oct 17 13:23:44.534296 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3355/6428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:44 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:45.016998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-140a167d-909e-410d-8dd9-e0eec0b817b0 req-1a22ec7b-b58c-470f-b4dc-3b2647bec32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff62d7b-ad7f-4e1e-a208-fb9d01b68116", "name": "network-vif-deleted", "tag": "f6a49e78-da5c-47da-9ccc-ed323d99e159"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:45.061776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-140a167d-909e-410d-8dd9-e0eec0b817b0 req-1a22ec7b-b58c-470f-b4dc-3b2647bec32e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.066806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-140a167d-909e-410d-8dd9-e0eec0b817b0 req-1a22ec7b-b58c-470f-b4dc-3b2647bec32e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.067773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-140a167d-909e-410d-8dd9-e0eec0b817b0 req-1a22ec7b-b58c-470f-b4dc-3b2647bec32e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.096396 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-140a167d-909e-410d-8dd9-e0eec0b817b0 req-1a22ec7b-b58c-470f-b4dc-3b2647bec32e service nova] Creating event network-vif-deleted:f6a49e78-da5c-47da-9ccc-ed323d99e159 for instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 on n-h2-853316-12 Oct 17 13:23:45.116046 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-140a167d-909e-410d-8dd9-e0eec0b817b0 req-1a22ec7b-b58c-470f-b4dc-3b2647bec32e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103331 Oct 17 13:23:45.116687 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3074/6429] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:45.561698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:45.564263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:45.570906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:45.576728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.577761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.578976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.580831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.582065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.584124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.610790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:45.735736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.738694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.739435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.740278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lazy-loading 'fault' on Instance uuid 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:45.849973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:45.859988 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-746fe14c-1570-4f14-859e-2cc51e31c38f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 200 len: 1310 microversion: 2.1 time: 0.305141 Oct 17 13:23:45.860693 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3356/6430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:45 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 1310 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:46.660995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:46.667073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:46.686923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.693465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.694264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.695271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.695963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.701603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.791611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:46.824147 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b204341-ee54-4f3b-8312-390aa47181b3 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.171994 Oct 17 13:23:46.824747 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3075/6431] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 13:23:46 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:46.885589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:46.900355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:46.937812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.938345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.938778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.951615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.961544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.962313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.989872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:46.990433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:46.997450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.998414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.999048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.999977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.000645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.002869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.015690 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 HTTP/1.1 Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '6ff62d7b-ad7f-4e1e-a208-fb9d01b68116'} Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:47.017381 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:47.027457 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-536f2964-6a6a-4a4d-bcb4-5060aa8898ef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 404 len: 111 microversion: 2.1 time: 0.137578 Oct 17 13:23:47.028549 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3357/6432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:46 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:23:47.040408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aeab13ed-255b-4800-b41e-e12468d9a439 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: .version_select at 0x7fa820ccc0d0>, body: {"keypair": {"name": "tempest-key-8636529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbYnTq8EGW8OhD4CTVLHTgrdECmyj4r/hRRM6RyaCKsUmCco5XhdfVV+KbpdDK9WPfIk5wlNqiBA31lv5komYjsFzFuD8Q8DRTMcW+ssgSOhhP9G+n+T9Zne9cMJ7mIhw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:47.054087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:23:47.120893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-aeab13ed-255b-4800-b41e-e12468d9a439 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:47.138910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-aeab13ed-255b-4800-b41e-e12468d9a439 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:47.205851 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aeab13ed-255b-4800-b41e-e12468d9a439 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 379 microversion: 2.1 time: 0.167761 Oct 17 13:23:47.218360 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3358/6433] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:23:47 2022] POST /compute/v2.1/os-keypairs => generated 379 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:47.225555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c410f98-ef3c-4667-81db-6cbf107d6185 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '.version_select at 0x7fa825209700>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:47.239956 n-d-853316-12 devstack@n-api.service[127540]: WARNING oslo_db.sqlalchemy.utils [None req-9c410f98-ef3c-4667-81db-6cbf107d6185 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:23:47.250746 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c410f98-ef3c-4667-81db-6cbf107d6185 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 348 microversion: 2.1 time: 0.033273 Oct 17 13:23:47.251607 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3359/6434] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 13:23:47 2022] GET /compute/v2.1/os-keypairs => generated 348 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:23:47.267100 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ca6d6ba-94ee-47c5-ad18-9e3b0e110962 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 204 len: 0 microversion: 2.20 time: 0.279880 Oct 17 13:23:47.269493 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3076/6435] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:23:46 2022] DELETE /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:23:47.278863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:47.279693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:47.288466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.288977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.289439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.292343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.293572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.294734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.554517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-147499080", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-key-8636529", "networks": [{"uuid": "d655af17-e1cc-4020-9487-2d7bb4d8b86d"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:47.676194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:47.694444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:47.700324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:47.703651 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-496e5d28-6cba-4b8b-88e8-bb826ba7a3db tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.428128 Oct 17 13:23:47.706099 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3360/6436] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:47 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:47.707853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] validate_networks() for [('d655af17-e1cc-4020-9487-2d7bb4d8b86d', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:23:48.543527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:48.544189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:48.545056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:48.545647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:48.546315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:48.566871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:48.570569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:48.571246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.572233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:48.572887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:48.573590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.600313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:48.607158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:48.623832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:48.626784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:48.709803 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ca448b67-cec3-485d-a009-4969e38e7274 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180129 Oct 17 13:23:48.712801 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3077/6437] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:23:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:23:48.734140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:48.735028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f2793b6e-5fc0-4215-8ecc-82a6fcafd374 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:48.735474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:48.736437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f2793b6e-5fc0-4215-8ecc-82a6fcafd374 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:48.757852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:48.758841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:48.760543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.762149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:48.763417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:48.764495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.864632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f2793b6e-5fc0-4215-8ecc-82a6fcafd374 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:48.873487 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f2793b6e-5fc0-4215-8ecc-82a6fcafd374 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1225 microversion: 2.1 time: 0.145568 Oct 17 13:23:48.889796 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3361/6438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:48 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1225 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:48.906377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:48.907133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:48.923188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:48.923697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:48.924148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.925592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:48.926314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:48.926801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.958678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:23:49.076180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1dd0dbeb-3e3a-4bc0-9187-600ae913f4ae tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 204 len: 0 microversion: 2.1 time: 0.183570 Oct 17 13:23:49.077383 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3362/6439] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:23:48 2022] DELETE /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:23:49.090018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:49.092795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:49.102752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.104015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.105557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.106839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.108113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.108925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.285588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:49.297068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:49.298698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:49.301831 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f3e8f98f-3500-461b-95b0-3065b261fdaf tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.571202 Oct 17 13:23:49.303320 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3078/6440] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:48 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:23:49.448933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:49.478353 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9684b51c-fd25-448f-97cd-18488c2457f5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1409 microversion: 2.1 time: 0.396664 Oct 17 13:23:49.479058 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3363/6441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:49 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:49.918674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:49.919690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:49.937574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.941213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.942676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.945378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.945908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.946417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:50.116021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:50.167418 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-196d8598-6b7c-4b25-8b0c-995a52e108ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1229 microversion: 2.1 time: 0.255751 Oct 17 13:23:50.175956 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3079/6442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:49 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1229 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:50.342815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:50.343440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:50.365299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:50.379066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:50.381660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:50.385898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:50.387977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:50.388446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:50.526742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:50.529837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:50.559099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:50.562922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:50.564254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:50.565450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:50.566878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:50.572710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.044814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.058059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-66f998b8-6b1b-4194-ad8b-aac4ba79e843 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1409 microversion: 2.1 time: 0.535389 Oct 17 13:23:51.074199 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3080/6443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:50 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1409 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:51.116743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.149450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.162125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.163426 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7466f7c3-f41f-4223-8854-2121c7b7a782 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1724 microversion: 2.20 time: 0.827657 Oct 17 13:23:51.164069 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3364/6444] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:50 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1724 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:51.201327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:51.202443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:51.209715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.210587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.211519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.212492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.213172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.213824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.343548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.370436 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3cd70a8d-5193-422f-83c2-31ba61100117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1285 microversion: 2.1 time: 0.173347 Oct 17 13:23:51.393474 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3081/6445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:51 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:52.041146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2556aa2e-7b26-4ffc-b4ae-626914597eae req-fce65489-185e-499b-aaf0-e6cf29f8827e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33b1c54-ee87-45e8-9f4f-d43caf4f12c7", "name": "network-vif-deleted", "tag": "0bcf46e2-ba54-473e-9ad8-aceac756e571"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:52.059710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2556aa2e-7b26-4ffc-b4ae-626914597eae req-fce65489-185e-499b-aaf0-e6cf29f8827e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.060842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2556aa2e-7b26-4ffc-b4ae-626914597eae req-fce65489-185e-499b-aaf0-e6cf29f8827e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.061642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2556aa2e-7b26-4ffc-b4ae-626914597eae req-fce65489-185e-499b-aaf0-e6cf29f8827e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.078596 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2556aa2e-7b26-4ffc-b4ae-626914597eae req-fce65489-185e-499b-aaf0-e6cf29f8827e service nova] Creating event network-vif-deleted:0bcf46e2-ba54-473e-9ad8-aceac756e571 for instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 on n-h2-853316-12 Oct 17 13:23:52.085648 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2556aa2e-7b26-4ffc-b4ae-626914597eae req-fce65489-185e-499b-aaf0-e6cf29f8827e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048700 Oct 17 13:23:52.086880 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3365/6446] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:52.112898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:52.113558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:52.140831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.141394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.141900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.155769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.155769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.156098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.194966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:52.197277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:52.209889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.218498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.219157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.220241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.222769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.224661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.377386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.398432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.427710 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eaa5277e-df3d-4525-be06-bc4fa3351994 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1202 microversion: 2.1 time: 0.318123 Oct 17 13:23:52.428453 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3082/6447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:52 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1202 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:52.446216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.446216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.447734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2acb43d-ff5b-4fa7-86fd-b27dc5be67ae tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1656 microversion: 2.20 time: 0.259272 Oct 17 13:23:52.463277 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3366/6448] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:52 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1656 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:52.468310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:52.479121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:52.486326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.488669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.489483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.495313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.498285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.499050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.695997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.715722 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c8c68ea-9ecb-4f90-b75a-06355233a5bb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1283 microversion: 2.1 time: 0.256090 Oct 17 13:23:52.726288 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3083/6449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:52 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:52.898885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-dff93cdd-fb69-4d6a-9db3-4ca62b9ca92f req-91f4b1b5-d717-4cdf-a68b-ed76f4e8c1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62aae524-015b-4a15-aafa-9000a2183d87", "name": "network-vif-deleted", "tag": "da7a58b2-ab1e-4bb4-8804-af0f51d82900"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:53.012878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dff93cdd-fb69-4d6a-9db3-4ca62b9ca92f req-91f4b1b5-d717-4cdf-a68b-ed76f4e8c1d7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.015774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dff93cdd-fb69-4d6a-9db3-4ca62b9ca92f req-91f4b1b5-d717-4cdf-a68b-ed76f4e8c1d7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.021733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dff93cdd-fb69-4d6a-9db3-4ca62b9ca92f req-91f4b1b5-d717-4cdf-a68b-ed76f4e8c1d7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.087886 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-dff93cdd-fb69-4d6a-9db3-4ca62b9ca92f req-91f4b1b5-d717-4cdf-a68b-ed76f4e8c1d7 service nova] Creating event network-vif-deleted:da7a58b2-ab1e-4bb4-8804-af0f51d82900 for instance 62aae524-015b-4a15-aafa-9000a2183d87 on n-h1-853316-12 Oct 17 13:23:53.110859 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-dff93cdd-fb69-4d6a-9db3-4ca62b9ca92f req-91f4b1b5-d717-4cdf-a68b-ed76f4e8c1d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219068 Oct 17 13:23:53.117257 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3367/6450] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:53.469027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:53.474106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.495079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:53.495930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.506041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.508480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.512116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.512385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.517497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.518571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.521550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.522938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.523142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.525103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.532522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.533531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.705516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.705920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.718798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.720827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lazy-loading 'fault' on Instance uuid 62aae524-015b-4a15-aafa-9000a2183d87 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:53.912167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.927621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.942725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28c5de5f487848a8a91ab2669a81149a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f98949744c40cca4df9d331462cd0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.944051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2718e668-2fdb-414e-a64a-c400782da39b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 200 len: 1370 microversion: 2.20 time: 0.457535 Oct 17 13:23:53.953986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.956739 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3368/6451] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:53 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 1370 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:53.964738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:53.965443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.974227 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-50809e80-9462-4132-9f00-56dfe2ff3b45 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1202 microversion: 2.1 time: 0.514010 Oct 17 13:23:53.988436 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3084/6452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:53 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1202 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:54.035957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.036556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.037117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.037923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.038895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.039342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.685860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:54.695885 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-47f63574-785e-4642-a769-432540206d9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1325 microversion: 2.1 time: 0.735687 Oct 17 13:23:54.700659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3369/6453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:53 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1325 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:54.975179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:54.976220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:54.990561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.991334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.993891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.994914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.996836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.997964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.030486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.031104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:55.059854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.062340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.066035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.068970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.071847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.072956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.087570 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] HTTP exception thrown: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Request method failure captured: Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 HTTP/1.1 Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUaSGB2bnWIQ4NApeb5zGIshTtHUM3JnaRwMpTQ47_bm3D0YV-MA8BR9wdXHf0OUXdfkBO-WfMMBbXFqbs9nlQAxcmMEcu3pl6EZ8-JnX2jZ-VwboxNzAEW2iwJc2tr5QP9fmmySlVZTlnqQCU8h6RdMCoIt5qm-jwRNFns4l2ByUQ Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26f98949744c40cca4df9d331462cd0d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 28c5de5f487848a8a91ab2669a81149a Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '62aae524-015b-4a15-aafa-9000a2183d87'} Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.091125 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Returning 404 to user: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:55.097274 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44706b58-8c1f-4f20-afeb-2d1c1eb60812 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 404 len: 111 microversion: 2.20 time: 0.123546 Oct 17 13:23:55.106105 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3085/6454] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:54 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:23:55.127033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-20f79a68-7fe5-4241-be40-8dc25f476834 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '.version_select at 0x7fa825205940>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.235572 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-20f79a68-7fe5-4241-be40-8dc25f476834 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602245950" status: 204 len: 0 microversion: 2.20 time: 0.123990 Oct 17 13:23:55.243805 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3086/6455] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 13:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602245950 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:23:55.499361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:55.556844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d75da7d-d2a0-4950-84f8-c1b28f5ec84b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1202 microversion: 2.1 time: 0.530976 Oct 17 13:23:55.617034 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3370/6456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1202 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:55.739221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.740450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:55.851490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.852003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.852459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.863139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.863835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.864296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.278092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1a4f83a7-9795-45e2-8b80-58dc7be2209e req-0b5bd10e-5131-4360-bc94-ebabfd9bcfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3", "tag": "d851366b-6f62-45e0-b92e-853c572d1ae3"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:56.319023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1a4f83a7-9795-45e2-8b80-58dc7be2209e req-0b5bd10e-5131-4360-bc94-ebabfd9bcfe6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.320048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1a4f83a7-9795-45e2-8b80-58dc7be2209e req-0b5bd10e-5131-4360-bc94-ebabfd9bcfe6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.320984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1a4f83a7-9795-45e2-8b80-58dc7be2209e req-0b5bd10e-5131-4360-bc94-ebabfd9bcfe6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.393139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1a4f83a7-9795-45e2-8b80-58dc7be2209e req-0b5bd10e-5131-4360-bc94-ebabfd9bcfe6 service nova] Creating event network-changed:d851366b-6f62-45e0-b92e-853c572d1ae3 for instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 on n-h2-853316-12 Oct 17 13:23:56.459358 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1a4f83a7-9795-45e2-8b80-58dc7be2209e req-0b5bd10e-5131-4360-bc94-ebabfd9bcfe6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202155 Oct 17 13:23:56.466634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:56.469232 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3371/6457] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:56.517539 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b4f4e8c-53a0-4226-a440-091185b857c5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1325 microversion: 2.1 time: 0.783879 Oct 17 13:23:56.522718 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3087/6458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1325 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:56.638069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:56.639342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:56.679449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.680257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.680999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.691781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.699984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.705304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.466129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:57.480898 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60d19b26-a752-4f7d-b72c-b5d0885485d0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1202 microversion: 2.1 time: 0.851661 Oct 17 13:23:57.481489 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3372/6459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:56 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1202 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:57.548301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:57.549018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:57.566927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.568012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.568476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.569223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.569695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.570137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.992527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:58.007636 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d13a45fc-cf2e-4597-9968-db04b5758759 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1325 microversion: 2.1 time: 0.463900 Oct 17 13:23:58.014421 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3088/6460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:57 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1325 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:58.507544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:58.508386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:58.525317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:58.525814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:58.526491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:58.529773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:58.530945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:58.532443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:58.737196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:58.756694 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fffa3b5-ed1c-4765-b24b-de7d3620f756 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1202 microversion: 2.1 time: 0.254213 Oct 17 13:23:58.761941 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3373/6461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:58 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1202 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:59.051140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:59.053837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:59.061807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.082539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.098900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.102392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.102899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.103644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.106526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.107241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.634618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:59.653006 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55668db1-e998-487c-a551-9a7f2207ddc2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1325 microversion: 2.1 time: 0.604329 Oct 17 13:23:59.654573 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3089/6462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:59 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1325 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:59.784145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:59.785873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:59.790332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.811249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.812830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.813538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.817476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.818535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.820661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.962689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:59.999180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea14241c-961b-4340-8f08-c964dd043ebb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1202 microversion: 2.1 time: 0.221159 Oct 17 13:24:00.000204 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3374/6463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:59 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1202 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:00.689735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:00.692458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:00.706644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:00.708290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:00.709334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:00.713215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:00.716306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:00.718862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.027416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:01.028865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:01.038514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.039757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.040408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.041459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.042318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.042995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.101309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:01.121365 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ad277cce-3dfc-4441-b89e-74b25f0d8faa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1325 microversion: 2.1 time: 0.439034 Oct 17 13:24:01.122017 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3090/6464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:00 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:01.354702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:01.370721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d75e1d67-8913-4215-81f2-be7ef60b7978 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1202 microversion: 2.1 time: 0.348883 Oct 17 13:24:01.381793 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3375/6465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:01 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1202 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:02.179371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:02.181469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:02.223266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:02.223753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:02.224205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:02.224960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:02.225436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:02.231242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:02.402067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:02.403825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:02.424391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:02.425997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:02.426668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:02.431949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:02.432748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:02.432986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:02.471242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:02.522386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:02.525987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:02.526711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:02.527355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lazy-loading 'fault' on Instance uuid c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:24:02.598156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:02.635460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:02.642310 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd7c04ba-a7de-4ef6-9d6d-1b3e2be436ec tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1325 microversion: 2.1 time: 0.487014 Oct 17 13:24:02.647049 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3091/6466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:02 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1325 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:02.658854 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0bc88254-fe23-45ed-906e-0fbc48890c26 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 200 len: 1207 microversion: 2.1 time: 0.263523 Oct 17 13:24:02.662737 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3376/6467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:02 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 1207 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:03.283656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-4d0a2d9d-2e5a-49ed-b796-53e1ab66c78d req-27fcd4bf-8441-4429-9476-086d40b0d8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3", "name": "network-vif-plugged", "status": "completed", "tag": "d851366b-6f62-45e0-b92e-853c572d1ae3"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:03.312796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4d0a2d9d-2e5a-49ed-b796-53e1ab66c78d req-27fcd4bf-8441-4429-9476-086d40b0d8fb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.313304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4d0a2d9d-2e5a-49ed-b796-53e1ab66c78d req-27fcd4bf-8441-4429-9476-086d40b0d8fb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.317369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-4d0a2d9d-2e5a-49ed-b796-53e1ab66c78d req-27fcd4bf-8441-4429-9476-086d40b0d8fb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.365768 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-4d0a2d9d-2e5a-49ed-b796-53e1ab66c78d req-27fcd4bf-8441-4429-9476-086d40b0d8fb service nova] Creating event network-vif-plugged:d851366b-6f62-45e0-b92e-853c572d1ae3 for instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 on n-h2-853316-12 Oct 17 13:24:03.376543 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-4d0a2d9d-2e5a-49ed-b796-53e1ab66c78d req-27fcd4bf-8441-4429-9476-086d40b0d8fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099294 Oct 17 13:24:03.377542 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3092/6468] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:03.679144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:03.682869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:03.738748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:03.740499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:03.747350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.748678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.754122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.759796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.763747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.764691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.790530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.791587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.792473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.795608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.797618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.800876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.883079 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 HTTP/1.1 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'c33b1c54-ee87-45e8-9f4f-d43caf4f12c7'} Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:03.892478 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.903394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:03.903394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:03.903394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:03.903394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:03.903394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:03.903394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:03.903394 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.905565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:03.910463 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f2b53a7-cf1e-4ea0-8bdc-150967179c86 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 404 len: 111 microversion: 2.1 time: 0.205628 Oct 17 13:24:03.912887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3093/6469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:03 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:04.150840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:04.211148 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce9b1cae-62dc-49c8-a42b-27bf9f4c79f0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1325 microversion: 2.1 time: 0.537082 Oct 17 13:24:04.217939 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3377/6470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:03 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1325 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:04.366852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:04.367602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:04.402357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.402918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.410497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.411871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.415976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.418008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.449350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:04.488945 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] HTTP exception thrown: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Request method failure captured: Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 HTTP/1.1 Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUaSGB2bnWIQ4NApeb5zGIshTtHUM3JnaRwMpTQ47_bm3D0YV-MA8BR9wdXHf0OUXdfkBO-WfMMBbXFqbs9nlQAxcmMEcu3pl6EZ8-JnX2jZ-VwboxNzAEW2iwJc2tr5QP9fmmySlVZTlnqQCU8h6RdMCoIt5qm-jwRNFns4l2ByUQ Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26f98949744c40cca4df9d331462cd0d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 28c5de5f487848a8a91ab2669a81149a Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '62aae524-015b-4a15-aafa-9000a2183d87'} Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:04.499501 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.510606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Returning 404 to user: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:04.526772 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d677d1ce-138a-4924-847f-d58bbb382f53 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 404 len: 111 microversion: 2.20 time: 0.166362 Oct 17 13:24:04.528050 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3094/6471] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:24:04 2022] DELETE /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:24:04.538377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:04.538994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: 62aae524-015b-4a15-aafa-9000a2183d87] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:04.571553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.572504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.573329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.574418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.574992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.575516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.610048 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] HTTP exception thrown: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Request method failure captured: Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 HTTP/1.1 Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVUaSGB2bnWIQ4NApeb5zGIshTtHUM3JnaRwMpTQ47_bm3D0YV-MA8BR9wdXHf0OUXdfkBO-WfMMBbXFqbs9nlQAxcmMEcu3pl6EZ8-JnX2jZ-VwboxNzAEW2iwJc2tr5QP9fmmySlVZTlnqQCU8h6RdMCoIt5qm-jwRNFns4l2ByUQ Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26f98949744c40cca4df9d331462cd0d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 28c5de5f487848a8a91ab2669a81149a Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '62aae524-015b-4a15-aafa-9000a2183d87'} Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.622075 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Returning 404 to user: Instance 62aae524-015b-4a15-aafa-9000a2183d87 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db948b41-e4ae-4120-a71b-4a3e7e77641b tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87" status: 404 len: 111 microversion: 2.20 time: 0.091316 Oct 17 13:24:04.629594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3378/6472] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:04 2022] GET /compute/v2.1/servers/62aae524-015b-4a15-aafa-9000a2183d87 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:24:05.268141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:05.270293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:05.287340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:05.291354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.292298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.292940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.293875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.294547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.295170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.842787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:05.857098 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-256fac9d-4a41-4b0a-bc21-60bd1840ddad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1506 microversion: 2.1 time: 0.597817 Oct 17 13:24:05.862972 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3095/6473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:05 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:05.890850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:05.892967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:05.906807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.908352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.909811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.913785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.916044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.916691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.522694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:06.538991 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cdb76dec-422b-4ef9-acd9-16fe6dd98bc4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1506 microversion: 2.1 time: 0.650673 Oct 17 13:24:06.541968 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3379/6474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:05 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:06.589003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:06.589517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:06.599908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.604524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.607918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.609212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.610084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.618530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.694486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:24:06.929659 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-83953083-6747-4b8b-888c-b5bd5c239a0f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 204 len: 0 microversion: 2.1 time: 0.345175 Oct 17 13:24:06.937439 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3096/6475] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:06 2022] DELETE /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:24:06.943258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:06.944015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:06.962407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.962929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.963456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.964198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.964659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.965089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:07.457585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:07.521407 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d31ab5ac-da8c-42e7-9b39-7528e40f6470 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1512 microversion: 2.1 time: 0.578449 Oct 17 13:24:07.545696 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3380/6476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:06 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1512 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:08.555646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:08.564537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:08.596417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:08.598181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:08.603723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.605084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.606948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.609610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.613643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.615918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.616502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.617150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.619678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.621143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.621626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.622067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.663005 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 HTTP/1.1 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd639a073-e2d1-442c-bb29-a462e2f91566'} Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:08.664993 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.671081 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.676208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:08.678647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-95ed0959-8c9a-44cf-beed-d6069516116d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 404 len: 111 microversion: 2.1 time: 0.088948 Oct 17 13:24:08.682250 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3381/6477] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:08 2022] DELETE /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:24:08.696633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:08.698759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: d639a073-e2d1-442c-bb29-a462e2f91566] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:08.717425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.718265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.719908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.722263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.724425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.726225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.762737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 HTTP/1.1 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd639a073-e2d1-442c-bb29-a462e2f91566'} Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:08.766898 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.774595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:08.774595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:08.774595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:08.774595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:08.774595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:08.774595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. Oct 17 13:24:08.774595 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:08.777335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance d639a073-e2d1-442c-bb29-a462e2f91566 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:08.778387 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d32faedb-4834-4919-8540-892b9114ca56 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566" status: 404 len: 111 microversion: 2.1 time: 0.092046 Oct 17 13:24:08.779608 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3382/6478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:08 2022] GET /compute/v2.1/servers/d639a073-e2d1-442c-bb29-a462e2f91566 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:09.412110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:09.465359 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f3cd01ea-e8b7-44a0-a803-67d199acc83f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1512 microversion: 2.1 time: 0.916057 Oct 17 13:24:09.479913 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3097/6479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:08 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1512 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:09.835223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-51f5cd01-58f5-409c-9492-028aa9cffadf req-ec89a1ce-1740-4f53-bb98-3a5aec8e647d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3", "name": "network-vif-deleted", "tag": "d851366b-6f62-45e0-b92e-853c572d1ae3"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:09.867321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-51f5cd01-58f5-409c-9492-028aa9cffadf req-ec89a1ce-1740-4f53-bb98-3a5aec8e647d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:09.874704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-51f5cd01-58f5-409c-9492-028aa9cffadf req-ec89a1ce-1740-4f53-bb98-3a5aec8e647d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:09.875598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-51f5cd01-58f5-409c-9492-028aa9cffadf req-ec89a1ce-1740-4f53-bb98-3a5aec8e647d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:09.911002 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-51f5cd01-58f5-409c-9492-028aa9cffadf req-ec89a1ce-1740-4f53-bb98-3a5aec8e647d service nova] Creating event network-vif-deleted:d851366b-6f62-45e0-b92e-853c572d1ae3 for instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 on n-h2-853316-12 Oct 17 13:24:09.939571 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-51f5cd01-58f5-409c-9492-028aa9cffadf req-ec89a1ce-1740-4f53-bb98-3a5aec8e647d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114428 Oct 17 13:24:09.944037 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3383/6480] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:10.505712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:10.507168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:10.521370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:10.522399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:10.530959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.532950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.534969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.535734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.536453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.536957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.537988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.538990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.539731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.540478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.541171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.541849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.577961 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 HTTP/1.1 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'c33b1c54-ee87-45e8-9f4f-d43caf4f12c7'} Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:10.582904 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.587610 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.591904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:10.596295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4edd02cf-39ac-4944-8426-234b493f2c87 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 404 len: 111 microversion: 2.1 time: 0.079509 Oct 17 13:24:10.598120 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3384/6481] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:10 2022] DELETE /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:24:10.610402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:10.612761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: c33b1c54-ee87-45e8-9f4f-d43caf4f12c7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:10.627571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.630766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.631998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.632502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.633025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.633556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.634418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.635111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lazy-loading 'fault' on Instance uuid d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:24:10.637785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.638535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.665055 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 HTTP/1.1 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'c33b1c54-ee87-45e8-9f4f-d43caf4f12c7'} Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:10.666893 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:10.673498 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ff01c9f-5bc0-4b5f-abf5-085847745cb6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7" status: 404 len: 111 microversion: 2.1 time: 0.068504 Oct 17 13:24:10.677890 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3385/6482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:10 2022] GET /compute/v2.1/servers/c33b1c54-ee87-45e8-9f4f-d43caf4f12c7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:10.822220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01254551-4480-4650-81f8-b78436ec693f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: .version_select at 0x7fa820b13ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-297218142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrrYR8ic1pPxl9c59vAF26o+FI70Oxx1M0MARWPKBzdWKBKwHYfsQbu7SlLMZmBiB6eakjCsWgQK1UNrexHHOSYfNvnzpU4FodLzEIF0/hgJb4+zMMj3jCYXj3/KQbe5w=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:10.877674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-01254551-4480-4650-81f8-b78436ec693f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:10.898613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-01254551-4480-4650-81f8-b78436ec693f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:10.972779 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01254551-4480-4650-81f8-b78436ec693f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.144653 Oct 17 13:24:10.974594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3386/6483] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:24:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:11.554567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:11.566308 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d940b07d-481f-45ea-90eb-b69f74f67b96 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 200 len: 1315 microversion: 2.1 time: 1.062584 Oct 17 13:24:11.572285 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3098/6484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:10 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:11.821280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:11.821951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:11.834732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:11.835446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:11.836047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:11.837316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:11.837779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:11.838243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:11.868047 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] HTTP exception thrown: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Request method failure captured: Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb HTTP/1.1 Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVUaSGB2bnWIQ4NApeb5zGIshTtHUM3JnaRwMpTQ47_bm3D0YV-MA8BR9wdXHf0OUXdfkBO-WfMMBbXFqbs9nlQAxcmMEcu3pl6EZ8-JnX2jZ-VwboxNzAEW2iwJc2tr5QP9fmmySlVZTlnqQCU8h6RdMCoIt5qm-jwRNFns4l2ByUQ Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26f98949744c40cca4df9d331462cd0d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 28c5de5f487848a8a91ab2669a81149a Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'f3001998-79dc-4411-aec7-cd86e6c72deb'} Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:11.869991 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Returning 404 to user: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0bedff5-c13d-4ada-a6c2-86e149c1db62 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 404 len: 111 microversion: 2.20 time: 0.057188 Oct 17 13:24:11.891321 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3387/6485] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 13:24:11 2022] DELETE /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:24:11.896590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:11.896590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] [instance: f3001998-79dc-4411-aec7-cd86e6c72deb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:11.907526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:11.908051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:11.908791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:11.911163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:11.917534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:11.918155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:11.947959 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] HTTP exception thrown: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Request method failure captured: Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb HTTP/1.1 Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVUaSGB2bnWIQ4NApeb5zGIshTtHUM3JnaRwMpTQ47_bm3D0YV-MA8BR9wdXHf0OUXdfkBO-WfMMBbXFqbs9nlQAxcmMEcu3pl6EZ8-JnX2jZ-VwboxNzAEW2iwJc2tr5QP9fmmySlVZTlnqQCU8h6RdMCoIt5qm-jwRNFns4l2ByUQ Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26f98949744c40cca4df9d331462cd0d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26f98949744c40cca4df9d331462cd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 26f98949744c40cca4df9d331462cd0d Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319630143 Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 28c5de5f487848a8a91ab2669a81149a Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319630143-project Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'f3001998-79dc-4411-aec7-cd86e6c72deb'} Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.949830 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] Returning 404 to user: Instance f3001998-79dc-4411-aec7-cd86e6c72deb could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2e843bd-4dc4-497a-baab-842d75a49a83 tempest-AttachVolumeShelveTestJSON-319630143 tempest-AttachVolumeShelveTestJSON-319630143-project] 10.222.0.27 "GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb" status: 404 len: 111 microversion: 2.20 time: 0.073393 Oct 17 13:24:11.954981 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3099/6486] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:11 2022] GET /compute/v2.1/servers/f3001998-79dc-4411-aec7-cd86e6c72deb => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:24:12.596050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:12.597226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:12.608709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:12.609693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:12.610409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:12.611806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:12.613027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:12.614249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:12.636612 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 HTTP/1.1 Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd2c9d57a-5b9e-4f98-86df-ae06a65ee1d3'} Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:12.638691 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:12.645963 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:12.645963 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:12.645963 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:12.645963 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:12.645963 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:12.645963 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:24:12.645963 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:24:12.649282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:12.650744 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f17b7a59-7301-4ab5-92cb-027cf0dadd4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 404 len: 111 microversion: 2.1 time: 0.059168 Oct 17 13:24:12.652200 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3388/6487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:12 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:12.664770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-184d7645-0eef-4212-92d8-edf19bf51325 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '.version_select at 0x7fa8250a0820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:12.700438 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-184d7645-0eef-4212-92d8-edf19bf51325 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-8636529" status: 202 len: 0 microversion: 2.1 time: 0.040556 Oct 17 13:24:12.712216 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3100/6488] 10.222.0.27 () {58 vars in 1200 bytes} [Mon Oct 17 13:24:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-8636529 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:12.944059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1232094039", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "d655af17-e1cc-4020-9487-2d7bb4d8b86d"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:12.958712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:13.035304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] validate_networks() for [('d655af17-e1cc-4020-9487-2d7bb4d8b86d', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:24:13.841750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:24:13.842207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:24:13.842837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:24:13.843256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:24:13.843761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:24:13.855171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:13.856009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:13.856623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:13.857879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:13.858897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:13.859508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:13.884157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:13.891045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:13.924320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:24:13.933911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:13.991334 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16de5a91-656b-4365-84b9-10de768501f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052785 Oct 17 13:24:13.996187 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3389/6489] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:24:14.011961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-146ee8c7-bde3-4c73-903f-42217d61dd8c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:14.011961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-146ee8c7-bde3-4c73-903f-42217d61dd8c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:14.099837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-146ee8c7-bde3-4c73-903f-42217d61dd8c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:14.111396 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-146ee8c7-bde3-4c73-903f-42217d61dd8c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1209 microversion: 2.1 time: 0.108953 Oct 17 13:24:14.122279 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3101/6490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:13 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:15.142188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:15.143483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:15.158908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:15.159861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:15.160308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:15.161196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:15.161655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:15.166445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:15.344335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:15.366818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f4eb45c-0cf5-4b8b-a3c1-191f757394ce tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1205 microversion: 2.1 time: 0.228968 Oct 17 13:24:15.378861 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3390/6491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:15 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1205 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:16.410188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:16.411046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:16.430330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:16.437561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:16.438915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:16.441632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:16.444378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:16.445064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:16.774917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:16.796591 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1884486d-9629-4c8e-95a5-daea45fe4016 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1267 microversion: 2.1 time: 0.390370 Oct 17 13:24:16.797837 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3102/6492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:16 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1267 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:17.824608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:17.825231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:17.840279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.841329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.841984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.843019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.843856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.844471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.954644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:17.974320 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de7db336-07cc-4059-945d-94281786e641 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1267 microversion: 2.1 time: 0.155549 Oct 17 13:24:17.976833 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3391/6493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:17 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:18.998889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:18.999525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:19.026100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:19.026665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:19.027136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:19.027892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:19.028373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:19.028824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:19.540513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:19.565036 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-edd078f5-dc85-4b80-a6c9-437b2cc97749 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1309 microversion: 2.1 time: 0.562885 Oct 17 13:24:19.567096 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3103/6494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:18 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1309 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:20.390657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4c8632ba-ab21-4e20-b3c6-0855b858c227 req-44756336-3b54-4a13-858d-ed1d4802d249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3605b64-7077-46e8-8ca0-2279833fd52f", "tag": "ae1f56c2-fedd-4e7e-8e8b-bc218bd222b8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:20.435132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c8632ba-ab21-4e20-b3c6-0855b858c227 req-44756336-3b54-4a13-858d-ed1d4802d249 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:20.436254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c8632ba-ab21-4e20-b3c6-0855b858c227 req-44756336-3b54-4a13-858d-ed1d4802d249 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:20.438438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4c8632ba-ab21-4e20-b3c6-0855b858c227 req-44756336-3b54-4a13-858d-ed1d4802d249 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:20.477008 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4c8632ba-ab21-4e20-b3c6-0855b858c227 req-44756336-3b54-4a13-858d-ed1d4802d249 service nova] Creating event network-changed:ae1f56c2-fedd-4e7e-8e8b-bc218bd222b8 for instance b3605b64-7077-46e8-8ca0-2279833fd52f on n-h2-853316-12 Oct 17 13:24:20.486285 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4c8632ba-ab21-4e20-b3c6-0855b858c227 req-44756336-3b54-4a13-858d-ed1d4802d249 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100116 Oct 17 13:24:20.492814 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3392/6495] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:20.591427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:20.593041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:20.601593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:20.602659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:20.603525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:20.605404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:20.606689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:20.607810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:21.102307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:21.120955 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd97c166-4940-4f52-83a0-acd959f88677 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1309 microversion: 2.1 time: 0.532723 Oct 17 13:24:21.123396 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3104/6496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:20 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1309 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:22.156602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:22.157529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:22.181755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:22.182531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:22.183166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:22.184182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:22.185039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:22.187851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:22.600412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:22.609647 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2567a657-d551-45fd-9bc8-6be23964e496 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1309 microversion: 2.1 time: 0.459501 Oct 17 13:24:22.626705 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3393/6497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:22 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1309 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:23.636036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:23.636782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:23.651702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:23.652584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:23.653102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:23.654816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:23.655739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:23.656462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:23.959188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:24.006855 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c386631a-98b8-4736-a7ef-30fdb1513a51 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1309 microversion: 2.1 time: 0.376213 Oct 17 13:24:24.007885 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3105/6498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:23 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1309 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:25.033632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:25.036833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:25.085134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:25.086888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:25.089298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:25.090062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:25.091267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:25.092781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:25.093901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:25.094591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:25.639524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:25.653649 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0dafde4e-5681-453f-b88b-04b144b884ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1309 microversion: 2.1 time: 0.624687 Oct 17 13:24:25.654291 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3394/6499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:25 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:26.683010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:26.683693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:26.726383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:26.734673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:26.736902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:26.742297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:26.744537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:26.746970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:26.751102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:27.672057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:27.682527 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4512c2cc-5356-477c-8027-162877bf4dcf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1309 microversion: 2.1 time: 1.004183 Oct 17 13:24:27.689133 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3106/6500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:26 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1309 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:28.067854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-896851f5-2963-4c36-bc4d-f9de2788d3c0 req-080dd4ec-f42b-4dc5-94d8-bfd58e29f3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3605b64-7077-46e8-8ca0-2279833fd52f", "name": "network-vif-plugged", "status": "completed", "tag": "ae1f56c2-fedd-4e7e-8e8b-bc218bd222b8"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:28.085176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-896851f5-2963-4c36-bc4d-f9de2788d3c0 req-080dd4ec-f42b-4dc5-94d8-bfd58e29f3ec service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:28.085964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-896851f5-2963-4c36-bc4d-f9de2788d3c0 req-080dd4ec-f42b-4dc5-94d8-bfd58e29f3ec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:28.087443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-896851f5-2963-4c36-bc4d-f9de2788d3c0 req-080dd4ec-f42b-4dc5-94d8-bfd58e29f3ec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:28.102809 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-896851f5-2963-4c36-bc4d-f9de2788d3c0 req-080dd4ec-f42b-4dc5-94d8-bfd58e29f3ec service nova] Creating event network-vif-plugged:ae1f56c2-fedd-4e7e-8e8b-bc218bd222b8 for instance b3605b64-7077-46e8-8ca0-2279833fd52f on n-h2-853316-12 Oct 17 13:24:28.112010 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-896851f5-2963-4c36-bc4d-f9de2788d3c0 req-080dd4ec-f42b-4dc5-94d8-bfd58e29f3ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050574 Oct 17 13:24:28.113893 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3395/6501] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:28.715288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:28.716076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:28.725993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:28.727042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:28.727723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:28.728690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:28.730193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:28.730887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:29.160093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:29.188939 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0dc09ab-0d86-41e4-b40e-adc1675ec583 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1309 microversion: 2.1 time: 0.477905 Oct 17 13:24:29.194530 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3107/6502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:28 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:30.317739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:30.321596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:30.371148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:30.371148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:30.373255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:30.374514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:30.377521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:30.378877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:30.991515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:31.029430 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7646c288-baf3-4ba9-8c61-343ed8608c16 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1489 microversion: 2.1 time: 0.802162 Oct 17 13:24:31.061322 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3396/6503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:30 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1489 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:31.331758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1232094039", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "d655af17-e1cc-4020-9487-2d7bb4d8b86d"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:31.531475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] validate_networks() for [('d655af17-e1cc-4020-9487-2d7bb4d8b86d', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:24:33.616917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:24:33.617905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:24:33.617905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:24:33.619014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:24:33.619450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:24:33.645217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:33.645731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:33.647018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:33.647893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:33.648376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:33.648820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:33.716414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:33.758080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:33.779868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:24:33.784592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:33.982647 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d9fc964-70d7-4105-a581-83afca707e50 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.661534 Oct 17 13:24:33.983334 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3108/6504] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:24:33.995629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1150c24e-30fe-4341-a8b9-53ae9c86e4d6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:33.996343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1150c24e-30fe-4341-a8b9-53ae9c86e4d6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:34.212655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1150c24e-30fe-4341-a8b9-53ae9c86e4d6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:34.224473 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1150c24e-30fe-4341-a8b9-53ae9c86e4d6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1209 microversion: 2.1 time: 0.232580 Oct 17 13:24:34.225098 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3397/6505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:33 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1209 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:35.262458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-63c253c8-4ddf-4927-ad92-5189c9f0ff43 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:35.262458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-63c253c8-4ddf-4927-ad92-5189c9f0ff43 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:35.561631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63c253c8-4ddf-4927-ad92-5189c9f0ff43 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:35.572909 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-63c253c8-4ddf-4927-ad92-5189c9f0ff43 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1209 microversion: 2.1 time: 0.325016 Oct 17 13:24:35.576419 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3109/6506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:35 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1209 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:36.609922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:36.613088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:36.645432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:36.645936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:36.646426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:36.649081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:36.649563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:36.650048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:36.661285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=76 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:36.894925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:36.937977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88f775bf-4d10-45a2-a7b8-5ca76205ace2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1269 microversion: 2.1 time: 0.334190 Oct 17 13:24:36.954531 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3398/6507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:36 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1269 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:37.967401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:37.968108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:38.009370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:38.010963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:38.011467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:38.019015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:38.024111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:38.024723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:38.025182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:38.110555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:38.311723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:38.328377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-81421ee1-dd8b-487a-a0df-500d50834c2a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1267 microversion: 2.1 time: 0.366418 Oct 17 13:24:38.329067 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3110/6508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:37 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1267 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:39.357121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:39.357758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:39.367107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.367601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.368038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:39.368746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.369201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.369633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:40.067382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4df78053-3eed-4784-b43e-a9d409d4ef99 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: .version_select at 0x7fa820463af0>, body: {"keypair": {"name": "tempest-keypair-666507356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4wvNI+DyEhaCldtWdGp9rZte/6XKqFR9WhcB/LetAUeAxVcTBVD0eb662Q/mFA+ZDjdwagiAS+DcNFGhAZGPVHViOjjigHSQv+KrS8k25m94KTqWA1PiklxHhvNAoWDg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:40.139922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-4df78053-3eed-4784-b43e-a9d409d4ef99 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for project 3bc91c516177497fa5d502d401b13efa. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:40.176260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-4df78053-3eed-4784-b43e-a9d409d4ef99 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for user 6a7a84e3905a4b5e887825b601e3d964 and project 3bc91c516177497fa5d502d401b13efa. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:40.248247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:40.259281 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4df78053-3eed-4784-b43e-a9d409d4ef99 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.449642 Oct 17 13:24:40.275754 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ffc24a96-42cc-4562-bcbc-45ae16eb07c1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1309 microversion: 2.1 time: 0.914482 Oct 17 13:24:40.276429 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3399/6510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:39 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1309 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:40.276666 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3111/6510] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:24:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:41.298036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:41.299233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:41.312981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.313518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.319278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.320508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.322436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.327664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.771608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:41.780159 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-774f67c6-acd5-4a60-9b89-5c474a990d9c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1309 microversion: 2.1 time: 0.486233 Oct 17 13:24:41.790397 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3400/6511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:41 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1309 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:42.154124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-99e3d72f-f2ae-45e1-b393-be253f4c43a9 req-d7161af2-2b0b-4012-9524-0debf6cbe404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef935a4-79af-4755-ac05-50fdce1b70bd", "tag": "46aa16d9-0499-4d7d-bbba-d2c0a65c4435"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:42.180087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-99e3d72f-f2ae-45e1-b393-be253f4c43a9 req-d7161af2-2b0b-4012-9524-0debf6cbe404 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:42.186413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-99e3d72f-f2ae-45e1-b393-be253f4c43a9 req-d7161af2-2b0b-4012-9524-0debf6cbe404 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:42.186901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-99e3d72f-f2ae-45e1-b393-be253f4c43a9 req-d7161af2-2b0b-4012-9524-0debf6cbe404 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:42.235255 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-99e3d72f-f2ae-45e1-b393-be253f4c43a9 req-d7161af2-2b0b-4012-9524-0debf6cbe404 service nova] Creating event network-changed:46aa16d9-0499-4d7d-bbba-d2c0a65c4435 for instance 3ef935a4-79af-4755-ac05-50fdce1b70bd on n-h1-853316-12 Oct 17 13:24:42.258811 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-99e3d72f-f2ae-45e1-b393-be253f4c43a9 req-d7161af2-2b0b-4012-9524-0debf6cbe404 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109475 Oct 17 13:24:42.259738 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3112/6512] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:42.829326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:42.831727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:42.889838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:42.894056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:42.896986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:42.901392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:42.907823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:42.913466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:43.811574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:43.816914 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f6315a28-c44d-44a5-a2f1-d8a781398560 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1309 microversion: 2.1 time: 0.998065 Oct 17 13:24:43.818032 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3401/6513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:42 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1309 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:44.851995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:44.853098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:44.856401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:44.880543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:44.883159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:44.883873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:44.885796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:44.887272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:44.888765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:45.550003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:45.560325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55cb7a97-60ec-418d-bbe3-dfb6413daa5e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1309 microversion: 2.1 time: 0.719746 Oct 17 13:24:45.572424 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3113/6514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:44 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1309 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:46.617284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:46.618369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:46.650475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:46.651272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:46.658761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:46.660695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:46.661469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:46.668464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:46.669257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:46.670296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:47.099464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:47.118462 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-902de547-d8d4-4269-961f-dba577760654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1309 microversion: 2.1 time: 0.507640 Oct 17 13:24:47.122577 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3402/6515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:46 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1309 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:48.158355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:48.161118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:48.177107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1170789293", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb30fe9b-9188-4fd9-81ae-fbd2ab091675"}], "security_groups": [{"name": "tempest-securitygroup--1825061455"}], "key_name": "tempest-keypair-666507356", "user_data": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:48.192690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:48.198028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:48.201784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:48.204824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:48.208484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:48.211665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:48.461511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] validate_networks() for [('fb30fe9b-9188-4fd9-81ae-fbd2ab091675', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:24:48.845905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:48.885363 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f6a06316-4463-43a3-b272-bffa59c01464 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1309 microversion: 2.1 time: 0.735593 Oct 17 13:24:48.886265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3114/6516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:48 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1309 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:49.305620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:24:49.306657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:24:49.307411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:24:49.307953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:24:49.308683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:24:49.328399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:49.329412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:49.330233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:49.332064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:49.332739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:49.333404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:49.381231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for project 3bc91c516177497fa5d502d401b13efa. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:49.401220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for user 6a7a84e3905a4b5e887825b601e3d964 and project 3bc91c516177497fa5d502d401b13efa. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:49.443866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:24:49.447405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:49.551365 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-155f4288-1860-497e-8fb9-4bdc2a0ef8d3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.378758 Oct 17 13:24:49.552425 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3403/6517] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:24:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:24:49.568378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-07247380-6dfd-4a29-ad98-31af2fd934c3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:49.569025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-07247380-6dfd-4a29-ad98-31af2fd934c3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:49.811522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-07247380-6dfd-4a29-ad98-31af2fd934c3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:49.828170 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-07247380-6dfd-4a29-ad98-31af2fd934c3 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1241 microversion: 2.1 time: 0.265571 Oct 17 13:24:49.838618 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3115/6518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:49 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1241 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:49.925689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:49.936751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:49.980909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:49.981677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:49.982520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:49.984089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:49.984829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.008354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.262984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-166103e2-81db-473b-801c-93e88e2e8951 req-6d0cbe9b-e3ac-41e2-8a19-c69f606abfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ef935a4-79af-4755-ac05-50fdce1b70bd", "name": "network-vif-plugged", "status": "completed", "tag": "46aa16d9-0499-4d7d-bbba-d2c0a65c4435"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:50.310744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-166103e2-81db-473b-801c-93e88e2e8951 req-6d0cbe9b-e3ac-41e2-8a19-c69f606abfc8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.311681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-166103e2-81db-473b-801c-93e88e2e8951 req-6d0cbe9b-e3ac-41e2-8a19-c69f606abfc8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.312378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-166103e2-81db-473b-801c-93e88e2e8951 req-6d0cbe9b-e3ac-41e2-8a19-c69f606abfc8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.351486 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-166103e2-81db-473b-801c-93e88e2e8951 req-6d0cbe9b-e3ac-41e2-8a19-c69f606abfc8 service nova] Creating event network-vif-plugged:46aa16d9-0499-4d7d-bbba-d2c0a65c4435 for instance 3ef935a4-79af-4755-ac05-50fdce1b70bd on n-h1-853316-12 Oct 17 13:24:50.358369 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-166103e2-81db-473b-801c-93e88e2e8951 req-6d0cbe9b-e3ac-41e2-8a19-c69f606abfc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102684 Oct 17 13:24:50.362347 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3116/6519] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:50.892861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:50.912615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:50.947301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.948250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.949073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.956899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.957891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.958832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:51.319624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:51.348000 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a34a053e-94ce-49c5-b09a-9aab28e45c0b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1245 microversion: 2.1 time: 0.476995 Oct 17 13:24:51.354287 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3117/6520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:50 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1245 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:51.495053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:51.510548 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f8c68f99-fc58-4b8e-b9f1-069d5a080bae tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1309 microversion: 2.1 time: 1.598193 Oct 17 13:24:51.522884 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3404/6521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:49 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1309 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:52.391421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:52.395996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:52.421481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:52.422973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:52.424265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:52.428051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:52.430099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:52.432836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:52.561615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:52.563206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:52.587252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:52.588047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:52.588516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:52.600000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:52.600629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:52.601000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:52.711744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:52.724288 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-00db3808-0cfd-480a-9b06-7a5f03a49fff tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1311 microversion: 2.1 time: 0.340829 Oct 17 13:24:52.724962 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3118/6522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:52 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1311 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:52.928675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:52.940404 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c0459f04-409b-45e8-a2a1-cfb4f8cfd957 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1309 microversion: 2.1 time: 0.392187 Oct 17 13:24:52.954861 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3405/6523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:52 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:53.345787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1658017595", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-297218142", "security_groups": [{"name": "tempest-secgroup-smoke-2022424257"}], "block_device_mapping_v2": [{"uuid": "93dac824-6996-4b9a-9c24-190f4259f811", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb1e7600-e122-4b5e-9526-e08a5b9bce6b"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:53.666087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] validate_networks() for [('eb1e7600-e122-4b5e-9526-e08a5b9bce6b', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:24:53.766731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:53.768907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:53.784781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.785188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.786022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:53.787354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.788140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.788915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.026911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:54.057317 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5916072f-582c-4011-bdce-70c21c15478a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1299 microversion: 2.1 time: 0.299072 Oct 17 13:24:54.075889 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3406/6524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:53 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1299 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:54.119345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:54.124404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:54.157128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.158470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.161598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.168420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.169388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.177352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.854108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:54.903981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d62c0a83-b67c-42ac-8a78-e8097a6fdab5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1489 microversion: 2.1 time: 0.825573 Oct 17 13:24:54.908697 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3407/6525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:54 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1489 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:54.952102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:54.952659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:54.960848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.961458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.961914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.962928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.963393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.963828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.286466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:24:55.287239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:24:55.287948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:24:55.290225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:24:55.290675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:24:55.305291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.306225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.307085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.308050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.308974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.310138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.341627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:55.359418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:55.378347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:55.389501 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0697f88-7fd0-4076-92ae-6e76b96c8a97 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1489 microversion: 2.1 time: 0.441905 Oct 17 13:24:55.390106 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3408/6526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:54 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1489 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:55.422847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:55.434620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:55.451538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.453796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.455209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.455648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.456258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.456621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.608533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:24:55.611877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93dac824-6996-4b9a-9c24-190f4259f811',volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:55.934299 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f31b22fb-bbee-48e4-ac85-e7e1a6d9af0f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.593184 Oct 17 13:24:55.942271 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3119/6527] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:24:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 2602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:24:55.947838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:55.948528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:55.960327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.960682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.961127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.962184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.963088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.963698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.010497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:56.024727 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aae30758-6fe1-4148-8c4b-045c7341d154 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1367 microversion: 2.1 time: 0.632154 Oct 17 13:24:56.035619 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3409/6528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:55 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1367 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:56.046605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf6ee81c-944c-4e9b-aa14-61a8d77f7b8d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.048985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cf6ee81c-944c-4e9b-aa14-61a8d77f7b8d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:56.140324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cf6ee81c-944c-4e9b-aa14-61a8d77f7b8d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:56.170603 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf6ee81c-944c-4e9b-aa14-61a8d77f7b8d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1094 microversion: 2.1 time: 0.133713 Oct 17 13:24:56.171979 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3410/6529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:56 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:56.515321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:56.528448 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a2cf9bc-554e-4b36-b225-65b4dd09ef74 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1489 microversion: 2.1 time: 0.584728 Oct 17 13:24:56.531193 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3120/6530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:55 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1489 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:56.561982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.562841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:56.580017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.582326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.583178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.588717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.590198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.590878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.628630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:24:56.831640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3cfa1401-4382-4efa-99af-fa6357f3483f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 204 len: 0 microversion: 2.1 time: 0.272238 Oct 17 13:24:56.833262 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3411/6531] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:56 2022] DELETE /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:24:56.841584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.842497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:56.856054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.856573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.857054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.857683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.859837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.860330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.061247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:57.063310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:57.070429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.071810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.072561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.073542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.074131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.074670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.149003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:57.160706 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5f460830-782b-442a-9808-16b3404a4760 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1495 microversion: 2.1 time: 0.323306 Oct 17 13:24:57.163315 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3121/6532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:56 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1495 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:57.203507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:57.204542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:57.217725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.218758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.219915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.220705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.221519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.222619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.468780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:57.474129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:57.486724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15824481-7d59-4962-bbaf-5ef60e8dd1ef tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1144 microversion: 2.1 time: 0.294115 Oct 17 13:24:57.488084 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3122/6533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:57 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1144 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:57.493211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d538b3bb-538d-4a54-8532-a1ba28fcc10e req-43f3243a-8265-4386-97e3-0b6fb22bb384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe66c5b-310b-4e0c-a261-16961bc6f6b4", "tag": "2c309a3d-7109-4ba2-9bdd-269aa28c310c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:57.500321 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a10a9c1c-e042-48d7-bd91-769042298838 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1367 microversion: 2.1 time: 0.443938 Oct 17 13:24:57.530208 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3412/6534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:57 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:57.543426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d538b3bb-538d-4a54-8532-a1ba28fcc10e req-43f3243a-8265-4386-97e3-0b6fb22bb384 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.544851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d538b3bb-538d-4a54-8532-a1ba28fcc10e req-43f3243a-8265-4386-97e3-0b6fb22bb384 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.545586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d538b3bb-538d-4a54-8532-a1ba28fcc10e req-43f3243a-8265-4386-97e3-0b6fb22bb384 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.562838 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d538b3bb-538d-4a54-8532-a1ba28fcc10e req-43f3243a-8265-4386-97e3-0b6fb22bb384 service nova] Creating event network-changed:2c309a3d-7109-4ba2-9bdd-269aa28c310c for instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 on n-h2-853316-12 Oct 17 13:24:57.584058 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d538b3bb-538d-4a54-8532-a1ba28fcc10e req-43f3243a-8265-4386-97e3-0b6fb22bb384 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094499 Oct 17 13:24:57.592419 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3123/6535] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:58.201387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:58.202293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:58.242116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:58.245505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:58.250202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:58.250984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:58.251461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:58.251895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:58.514449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:58.527484 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad9e29d0-d1a5-412d-a7ce-ac05a2f703aa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1495 microversion: 2.1 time: 0.332472 Oct 17 13:24:58.535314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:58.536040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:58.554031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:58.554847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:58.555025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:58.555764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:58.556235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:58.556879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:58.557400 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3413/6536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:58 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1495 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:58.571060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:58.571819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:58.585285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:58.589440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:58.590266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:58.591712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:58.593562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:58.598097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:58.717253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:58.726003 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de908a52-f516-4e0b-805f-c5baab8673dd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1192 microversion: 2.1 time: 0.196617 Oct 17 13:24:58.733755 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3124/6537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:58 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1192 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:58.894567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:58.897512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:58.917560 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-005db074-66fb-4dc1-935d-9bc6f8abb757 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1367 microversion: 2.1 time: 0.358884 Oct 17 13:24:58.930920 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3414/6538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:58 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:59.561575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:59.567011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:59.597708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:59.606203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:59.606940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:59.608180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:59.608855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:59.610495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:59.761785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:59.776135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:59.779403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:59.795209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:59.796463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:59.797518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:59.799109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:59.818335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:59.819463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.033194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:00.046987 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b29ccff-3618-4aef-b6dd-404da84f1f50 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1210 microversion: 2.1 time: 0.292803 Oct 17 13:25:00.047518 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3415/6539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:59 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1210 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:00.061836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.062816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:00.085799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.086459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.094834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.095604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.096091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.096646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.499184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:00.534956 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-669ed5c6-ac6c-4fb0-a7d5-238e2a49741f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1367 microversion: 2.1 time: 0.485057 Oct 17 13:25:00.559169 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3416/6540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1367 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:00.793520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:00.838664 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9e97852f-1aa0-4844-a98f-458723928cef tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1495 microversion: 2.1 time: 1.284491 Oct 17 13:25:00.839931 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3125/6541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:59 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1495 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:01.090071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:01.090969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:01.106759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.114864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.124784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:01.131093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.136303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.140413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:01.314612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e6ab38f2-0de5-4521-a692-642f55da1d2d req-5cb6a639-8f96-4a2c-80cf-1fa0f2088526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ef935a4-79af-4755-ac05-50fdce1b70bd", "name": "network-vif-deleted", "tag": "46aa16d9-0499-4d7d-bbba-d2c0a65c4435"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:01.352124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:01.363857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e6ab38f2-0de5-4521-a692-642f55da1d2d req-5cb6a639-8f96-4a2c-80cf-1fa0f2088526 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.365358 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db313e95-20a0-47bf-bcf7-49c5d44521b1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1210 microversion: 2.1 time: 0.277552 Oct 17 13:25:01.366025 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3417/6542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:01 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1210 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:01.366728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e6ab38f2-0de5-4521-a692-642f55da1d2d req-5cb6a639-8f96-4a2c-80cf-1fa0f2088526 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.369387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e6ab38f2-0de5-4521-a692-642f55da1d2d req-5cb6a639-8f96-4a2c-80cf-1fa0f2088526 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:01.407350 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e6ab38f2-0de5-4521-a692-642f55da1d2d req-5cb6a639-8f96-4a2c-80cf-1fa0f2088526 service nova] Creating event network-vif-deleted:46aa16d9-0499-4d7d-bbba-d2c0a65c4435 for instance 3ef935a4-79af-4755-ac05-50fdce1b70bd on n-h1-853316-12 Oct 17 13:25:01.450365 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e6ab38f2-0de5-4521-a692-642f55da1d2d req-5cb6a639-8f96-4a2c-80cf-1fa0f2088526 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150565 Oct 17 13:25:01.464480 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3126/6543] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:01.603942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:01.608103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:01.666033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.669874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.670650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:01.671652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.672360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.673970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:01.867956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:01.869377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:01.884992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.886994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.902748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:01.905846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.907237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.907876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:01.995098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.999090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.999978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.000471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lazy-loading 'fault' on Instance uuid 3ef935a4-79af-4755-ac05-50fdce1b70bd {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:25:02.079012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:02.105919 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7922cfc7-8fbe-4b3c-85dc-f283a297df1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1367 microversion: 2.1 time: 0.525743 Oct 17 13:25:02.108134 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3418/6544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:01 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:02.216761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:02.244182 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17829b52-d4b8-4649-95dc-fd2eeeb612dd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 200 len: 1299 microversion: 2.1 time: 0.381547 Oct 17 13:25:02.244797 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3127/6545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:01 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 1299 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:02.393954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:02.395964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:02.415584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.416630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.417384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.418758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.420596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.421642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.572757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:02.582534 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-786a1762-984f-4da1-be87-cbe05d7ccbda tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1210 microversion: 2.1 time: 0.195502 Oct 17 13:25:02.599395 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3419/6546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:02 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1210 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:03.164616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:03.165326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:03.191079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.191427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.191840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.192735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.193560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.208960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.274392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:03.275409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:03.288246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.302023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.302636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.304921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.307158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.308216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.363914 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd HTTP/1.1 Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '3ef935a4-79af-4755-ac05-50fdce1b70bd'} Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:03.368873 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:25:03.374625 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:03.374625 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:03.374625 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:03.374625 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:03.374625 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:03.374625 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:25:03.374625 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:25:03.377658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:03.380131 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca6f349d-0c27-42c0-ae9e-05631d378f28 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 404 len: 111 microversion: 2.1 time: 0.110636 Oct 17 13:25:03.383994 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3420/6547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:03 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:25:03.403934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:03.410211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:03.445953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.452470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.453230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.454181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.457098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.460628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.537971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:03.714227 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e9bb3531-1aff-4673-80cf-f816cd3135a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 204 len: 0 microversion: 2.1 time: 0.325108 Oct 17 13:25:03.715101 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3421/6548] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:03 2022] DELETE /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:25:03.730073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:03.734127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:03.747162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.748083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.749009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.750434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.754900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.755725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.102464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:04.111099 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-13ef0da1-678c-4d70-9fe0-00730525b76a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1278 microversion: 2.1 time: 0.393528 Oct 17 13:25:04.115413 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3422/6549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:03 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1278 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:04.151945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:04.153151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:04.176542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:04.179566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:04.181989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.183155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:04.189743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:04.190640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.495545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:04.531192 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b75aa485-5cd3-48f8-b1fb-9a61a74e1a6c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1367 microversion: 2.1 time: 1.377815 Oct 17 13:25:04.539400 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3128/6550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:03 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1367 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:04.558852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d7bd7850-7be6-44c9-9d21-2fb60cb93ecb req-6ab675f3-f321-45bd-af3a-9a83be2d1a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe66c5b-310b-4e0c-a261-16961bc6f6b4", "name": "network-vif-plugged", "status": "completed", "tag": "2c309a3d-7109-4ba2-9bdd-269aa28c310c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:04.604922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7bd7850-7be6-44c9-9d21-2fb60cb93ecb req-6ab675f3-f321-45bd-af3a-9a83be2d1a6f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:04.608159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7bd7850-7be6-44c9-9d21-2fb60cb93ecb req-6ab675f3-f321-45bd-af3a-9a83be2d1a6f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:04.608804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d7bd7850-7be6-44c9-9d21-2fb60cb93ecb req-6ab675f3-f321-45bd-af3a-9a83be2d1a6f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.663768 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d7bd7850-7be6-44c9-9d21-2fb60cb93ecb req-6ab675f3-f321-45bd-af3a-9a83be2d1a6f service nova] Creating event network-vif-plugged:2c309a3d-7109-4ba2-9bdd-269aa28c310c for instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 on n-h2-853316-12 Oct 17 13:25:04.679180 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d7bd7850-7be6-44c9-9d21-2fb60cb93ecb req-6ab675f3-f321-45bd-af3a-9a83be2d1a6f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137023 Oct 17 13:25:04.686828 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3129/6551] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:05.144122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:05.145696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:05.162556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.164964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.167806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.168820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.171409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.171823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:05.172775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.185959 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e990d540-17c1-4519-ba31-4144f693f09b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1495 microversion: 2.1 time: 1.051799 Oct 17 13:25:05.187461 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3423/6552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:04 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1495 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:05.326535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:05.392483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=20 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:05.904515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Calling method '.version_select at 0x7fa820e49d30>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:05.907408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:05.907919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.908215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.910780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.920790 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9c9e319-df3c-40db-9406-4c08f700a096 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1278 microversion: 2.1 time: 0.782974 Oct 17 13:25:05.922273 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3130/6553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:05 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1278 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:05.929458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:05.930854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:05.937985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.938992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.939707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.945323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.946341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.947626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.958215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.961526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.961985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.992897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.993786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.994495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.015637 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac478fb2-4ffa-48fc-a30c-38badf8f3f55 tempest-PortsAdminExtendedAttrsTestJSON-1963058785 tempest-PortsAdminExtendedAttrsTestJSON-1963058785-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.607029 Oct 17 13:25:06.016692 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3424/6554] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:25:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:06.184446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:06.209854 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72538dce-fac6-4a4b-a8ac-32330e175bb5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1367 microversion: 2.1 time: 0.285741 Oct 17 13:25:06.210862 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3131/6555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:05 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:06.234013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:06.239766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:06.243368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:06.284716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.286823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.286823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.305690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.307867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.310518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.411916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3c324fc8-028c-4e24-98c5-9a7e92c9a45c req-bd2fb8b6-1f11-4e12-be4c-7c606617bb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3605b64-7077-46e8-8ca0-2279833fd52f", "name": "network-vif-deleted", "tag": "ae1f56c2-fedd-4e7e-8e8b-bc218bd222b8"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:06.443645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3c324fc8-028c-4e24-98c5-9a7e92c9a45c req-bd2fb8b6-1f11-4e12-be4c-7c606617bb94 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.451432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3c324fc8-028c-4e24-98c5-9a7e92c9a45c req-bd2fb8b6-1f11-4e12-be4c-7c606617bb94 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.451899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3c324fc8-028c-4e24-98c5-9a7e92c9a45c req-bd2fb8b6-1f11-4e12-be4c-7c606617bb94 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.485385 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3c324fc8-028c-4e24-98c5-9a7e92c9a45c req-bd2fb8b6-1f11-4e12-be4c-7c606617bb94 service nova] Creating event network-vif-deleted:ae1f56c2-fedd-4e7e-8e8b-bc218bd222b8 for instance b3605b64-7077-46e8-8ca0-2279833fd52f on n-h2-853316-12 Oct 17 13:25:06.500109 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3c324fc8-028c-4e24-98c5-9a7e92c9a45c req-bd2fb8b6-1f11-4e12-be4c-7c606617bb94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092436 Oct 17 13:25:06.505343 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3132/6556] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:06.538201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:06.548759 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a94a789-21a1-4cf6-aea2-3e0a14f37c55 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 200 len: 1453 microversion: 2.1 time: 0.320650 Oct 17 13:25:06.571092 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3425/6557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:06 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 1453 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:06.947337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:06.948068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:06.960307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.960823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.961281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.962012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.967066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.967940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.969387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d3fc55cf-8bc1-49b2-ab02-f3dcacb1e098 req-87a74d48-9b0d-4c6b-b31d-c41e2b25bfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f71859-e12f-4df0-b035-67d3529c87cb", "tag": "b54ba56a-e0ff-43bd-9462-5288a810e084"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:06.980992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=100 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:06.991148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3fc55cf-8bc1-49b2-ab02-f3dcacb1e098 req-87a74d48-9b0d-4c6b-b31d-c41e2b25bfb4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.991148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3fc55cf-8bc1-49b2-ab02-f3dcacb1e098 req-87a74d48-9b0d-4c6b-b31d-c41e2b25bfb4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.991148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3fc55cf-8bc1-49b2-ab02-f3dcacb1e098 req-87a74d48-9b0d-4c6b-b31d-c41e2b25bfb4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.011877 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d3fc55cf-8bc1-49b2-ab02-f3dcacb1e098 req-87a74d48-9b0d-4c6b-b31d-c41e2b25bfb4 service nova] Creating event network-changed:b54ba56a-e0ff-43bd-9462-5288a810e084 for instance 13f71859-e12f-4df0-b035-67d3529c87cb on n-h1-853316-12 Oct 17 13:25:07.023357 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d3fc55cf-8bc1-49b2-ab02-f3dcacb1e098 req-87a74d48-9b0d-4c6b-b31d-c41e2b25bfb4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057538 Oct 17 13:25:07.023973 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3426/6558] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:07.234761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.235529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.259671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.268086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.268567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.269421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.269813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.270476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.493376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.508030 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d78dcc05-4892-4f60-b1d7-06f1332df51d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1557 microversion: 2.1 time: 0.277458 Oct 17 13:25:07.509067 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3427/6559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1557 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:07.535096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.536020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.546532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.547652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.548325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.550420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.551210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.551869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.671437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.683063 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-611128df-f28d-42ce-9639-e880aa3ec31d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1278 microversion: 2.1 time: 0.740263 Oct 17 13:25:07.683674 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3133/6560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:06 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1278 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:07.693410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.694277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.712164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.721737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.724149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.729090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.729644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.730123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.738373 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d60ed71-5fe9-4a40-980f-888c16643a41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209134 Oct 17 13:25:07.742255 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3428/6561] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:07.759714 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f HTTP/1.1 Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'b3605b64-7077-46e8-8ca0-2279833fd52f'} Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:07.763260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:07.772771 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:07.772771 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:07.772771 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:07.772771 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:07.772771 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:07.772771 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:25:07.772771 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:07.772771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:07.776062 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f3466d4-f327-4b0a-a9d1-7c6b0c8570db tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 404 len: 111 microversion: 2.1 time: 0.088403 Oct 17 13:25:07.776062 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3134/6562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:25:07.976447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1230566476", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "d655af17-e1cc-4020-9487-2d7bb4d8b86d"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:08.079678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] validate_networks() for [('d655af17-e1cc-4020-9487-2d7bb4d8b86d', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:08.713241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:08.714131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:08.716944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:08.736279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.738639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.739306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.744379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.745139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.746009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.774399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:09.793628 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2e011ebe-4e55-43a7-aa90-8a50e7544ef0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1278 microversion: 2.1 time: 1.084532 Oct 17 13:25:09.794297 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3135/6563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:08 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1278 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:09.950671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:09.953223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:09.954056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:09.954713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:09.956326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:09.974011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.974946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.975720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.976949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.977738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.978508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.005347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:10.018962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:10.047082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:10.055556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:10.126998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:10.193607 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-035b9aad-65ed-40f0-81d5-e31e250f271c tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.221163 Oct 17 13:25:10.199850 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3429/6564] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:25:10.211716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e37564eb-5ab8-4b2c-8a77-ced4b88f79cb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:10.212806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e37564eb-5ab8-4b2c-8a77-ced4b88f79cb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:10.299833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e37564eb-5ab8-4b2c-8a77-ced4b88f79cb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:10.312620 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e37564eb-5ab8-4b2c-8a77-ced4b88f79cb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1209 microversion: 2.1 time: 0.106987 Oct 17 13:25:10.313235 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3136/6565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:10 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:10.818812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:10.819643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:10.839565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.840682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.841506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.842740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.843466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.844373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.342683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:11.343996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:11.364090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.366545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.367492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.369285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.369951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.370623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.526324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:11.542191 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19201b20-d34f-4e65-ba2f-2df434c3b3ce tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.727901 Oct 17 13:25:11.567126 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3430/6566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:10 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:11.614428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:11.642241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f7da407a-6d3d-4d9b-bf1f-3b43b60a59f2 req-b721f852-ea88-44d9-92f9-8484f506df0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe66c5b-310b-4e0c-a261-16961bc6f6b4", "tag": "2c309a3d-7109-4ba2-9bdd-269aa28c310c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:11.644113 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab556274-ec2d-4c72-b581-8a6e03d2ea47 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1261 microversion: 2.1 time: 0.308105 Oct 17 13:25:11.652225 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3137/6567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:11 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1261 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:11.675009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7da407a-6d3d-4d9b-bf1f-3b43b60a59f2 req-b721f852-ea88-44d9-92f9-8484f506df0a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.675529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7da407a-6d3d-4d9b-bf1f-3b43b60a59f2 req-b721f852-ea88-44d9-92f9-8484f506df0a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.676710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f7da407a-6d3d-4d9b-bf1f-3b43b60a59f2 req-b721f852-ea88-44d9-92f9-8484f506df0a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.735464 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f7da407a-6d3d-4d9b-bf1f-3b43b60a59f2 req-b721f852-ea88-44d9-92f9-8484f506df0a service nova] Creating event network-changed:2c309a3d-7109-4ba2-9bdd-269aa28c310c for instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 on n-h2-853316-12 Oct 17 13:25:11.756271 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f7da407a-6d3d-4d9b-bf1f-3b43b60a59f2 req-b721f852-ea88-44d9-92f9-8484f506df0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118201 Oct 17 13:25:11.758563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3431/6568] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:12.597061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:12.598485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:12.607216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.608057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.608751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.609751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.610613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.611322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.675201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:12.676026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:12.699054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.699910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.700542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.701440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.702280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.703195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.880187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:12.884519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:12.897130 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-71bb70b7-ac57-4662-a6c3-0eedddc38cb5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1267 microversion: 2.1 time: 0.227579 Oct 17 13:25:12.898542 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3432/6569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:12 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:12.960700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:12.974732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb77fabf-34bf-45e3-8fff-b0b15fb421d5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.383648 Oct 17 13:25:12.977081 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3138/6570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:12 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:13.926900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:13.929327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:13.962182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.965371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.966356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.976275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.976875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.978757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.005499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:14.006543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:14.055096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:14.060521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:14.062823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.064276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:14.067103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:14.074909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.599709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:14.620434 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e67e94da-5755-4ef8-8cd4-aca009e96a18 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1309 microversion: 2.1 time: 0.698665 Oct 17 13:25:14.622257 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3433/6571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:13 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1309 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:14.646506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:14.658055 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c1afda70-ed03-4340-b93e-f8b655205abe tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.660511 Oct 17 13:25:14.672508 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3139/6572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:13 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:15.655173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:15.656126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:15.672572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f2e73cb6-003a-4186-b01b-896633ddce03 req-67b4787e-bd82-4543-9fd9-4e7db074a418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94cfa12d-32a2-4c6c-8339-e8f8cf464264", "tag": "4a25d3e9-401a-455b-9b96-e94d20a35f0b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:15.684816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f2e73cb6-003a-4186-b01b-896633ddce03 req-67b4787e-bd82-4543-9fd9-4e7db074a418 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.685867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f2e73cb6-003a-4186-b01b-896633ddce03 req-67b4787e-bd82-4543-9fd9-4e7db074a418 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.686543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f2e73cb6-003a-4186-b01b-896633ddce03 req-67b4787e-bd82-4543-9fd9-4e7db074a418 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.686755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.687608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.688367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.689821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.691194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.696240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.702011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f2e73cb6-003a-4186-b01b-896633ddce03 req-67b4787e-bd82-4543-9fd9-4e7db074a418 service nova] Creating event network-changed:4a25d3e9-401a-455b-9b96-e94d20a35f0b for instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 on n-h2-853316-12 Oct 17 13:25:15.707963 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f2e73cb6-003a-4186-b01b-896633ddce03 req-67b4787e-bd82-4543-9fd9-4e7db074a418 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413968 Oct 17 13:25:15.709187 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3434/6573] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:15.715026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:15.716431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:15.725535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.726537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.727346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.728305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.728989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.729657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.069196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:16.101169 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ad561c9-2e79-470d-a666-eb78e2f6fe36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.390176 Oct 17 13:25:16.105091 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3435/6574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:15 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:16.130507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:16.156744 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75b53332-c4a2-44ca-9299-912c485420ed tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1309 microversion: 2.1 time: 0.512450 Oct 17 13:25:16.158006 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3140/6575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:15 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1309 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:17.132014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:17.133234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:17.141410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.142261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.142885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.143852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.144500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.145347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.182132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:17.183567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:17.194917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.198872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.199682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.200739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.203651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.204363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.697903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:17.713693 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3000fc2-fed5-4bfc-aaf8-3bce546ce28b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.585297 Oct 17 13:25:17.719121 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3436/6576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:17 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:17.733626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:17.746016 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9770ce1-474b-4e4a-bbd5-f12b7f377cfc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1309 microversion: 2.1 time: 0.567355 Oct 17 13:25:17.786369 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3141/6577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:17 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1309 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:18.747478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:18.748413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:18.772135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:18.772893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:18.773661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:18.774938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:18.775713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:18.776441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:18.798662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:18.800631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:18.830375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:18.831680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:18.832341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:18.836460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:18.839593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:18.863939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:19.075248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:19.114057 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c626b2a0-d092-481e-8b31-01a92e0a6016 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.370780 Oct 17 13:25:19.126804 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3437/6578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:18 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:19.251031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:19.293652 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d001b97-da5a-45b6-b044-aff1e744f31d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1309 microversion: 2.1 time: 0.483098 Oct 17 13:25:19.299527 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3142/6579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:18 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:20.152756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:20.154826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:20.163807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:20.165245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:20.175279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:20.176249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:20.176912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:20.177846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:20.178653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:20.179286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:20.325814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:20.326480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:20.331162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:20.343337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:20.345920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:20.346676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:20.351302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:20.352230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:20.352700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:20.521899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:20.554872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-413159db-c3c1-43a9-8782-172c87782f1d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.406308 Oct 17 13:25:20.557891 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3438/6580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:20 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:20.726998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:20.743443 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab93cbf5-e4dd-47b8-9b49-fc2b1aed5cd0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1309 microversion: 2.1 time: 0.422202 Oct 17 13:25:20.745356 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3143/6581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:20 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1309 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:21.591711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:21.593143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:21.607479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.611378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.613853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:21.616635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.621463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.622477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:21.774589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:21.775479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:21.802016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.803250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.804436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:21.806139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.807429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.810547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:22.072552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:22.091217 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e7e3af5a-70ab-4848-a00a-f50f6923098f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.503601 Oct 17 13:25:22.092744 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3439/6582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:21 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:22.232421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:22.247213 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10aec24a-a30a-4383-8025-0fce5c5e7682 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1309 microversion: 2.1 time: 0.477911 Oct 17 13:25:22.249449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3144/6583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:21 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1309 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:22.677972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-aff8de71-4f1a-4be8-8ef5-1be57713106e req-e6c936a0-c9b9-41cb-89c8-323e6df5cefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94cfa12d-32a2-4c6c-8339-e8f8cf464264", "name": "network-vif-plugged", "status": "completed", "tag": "4a25d3e9-401a-455b-9b96-e94d20a35f0b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:22.693027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-aff8de71-4f1a-4be8-8ef5-1be57713106e req-e6c936a0-c9b9-41cb-89c8-323e6df5cefd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:22.694745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-aff8de71-4f1a-4be8-8ef5-1be57713106e req-e6c936a0-c9b9-41cb-89c8-323e6df5cefd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:22.696140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-aff8de71-4f1a-4be8-8ef5-1be57713106e req-e6c936a0-c9b9-41cb-89c8-323e6df5cefd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:22.713753 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-aff8de71-4f1a-4be8-8ef5-1be57713106e req-e6c936a0-c9b9-41cb-89c8-323e6df5cefd service nova] Creating event network-vif-plugged:4a25d3e9-401a-455b-9b96-e94d20a35f0b for instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 on n-h2-853316-12 Oct 17 13:25:22.725269 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-aff8de71-4f1a-4be8-8ef5-1be57713106e req-e6c936a0-c9b9-41cb-89c8-323e6df5cefd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.630873 Oct 17 13:25:22.726810 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3440/6584] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:23.138409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:23.140246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:23.154662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:23.156793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:23.157980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:23.160144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:23.161075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:23.162687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:23.279627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:23.281498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:23.300356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:23.304482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:23.307719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:23.310581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:23.341261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:23.342807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:23.591484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:23.609752 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-905e334d-54a1-4b45-94b2-f170e94928a4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.479731 Oct 17 13:25:23.616211 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3145/6585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:23 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:23.841977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:23.861392 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d61ad8cc-2211-4509-8a15-a8b922dc94eb tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1309 microversion: 2.1 time: 0.588197 Oct 17 13:25:23.862772 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3441/6586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:23 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1309 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:24.644194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:24.645007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:24.657680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.658234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.659303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.664374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.664890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.665352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.775767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d3355bef-9335-4875-9223-405fde10d1eb req-ceef3d3f-b23f-45e8-93e4-61996cbbb7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f71859-e12f-4df0-b035-67d3529c87cb", "name": "network-vif-plugged", "status": "completed", "tag": "b54ba56a-e0ff-43bd-9462-5288a810e084"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:24.833401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3355bef-9335-4875-9223-405fde10d1eb req-ceef3d3f-b23f-45e8-93e4-61996cbbb7ef service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.834296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3355bef-9335-4875-9223-405fde10d1eb req-ceef3d3f-b23f-45e8-93e4-61996cbbb7ef service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.835064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d3355bef-9335-4875-9223-405fde10d1eb req-ceef3d3f-b23f-45e8-93e4-61996cbbb7ef service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.899460 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d3355bef-9335-4875-9223-405fde10d1eb req-ceef3d3f-b23f-45e8-93e4-61996cbbb7ef service nova] Creating event network-vif-plugged:b54ba56a-e0ff-43bd-9462-5288a810e084 for instance 13f71859-e12f-4df0-b035-67d3529c87cb on n-h1-853316-12 Oct 17 13:25:24.914721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d3355bef-9335-4875-9223-405fde10d1eb req-ceef3d3f-b23f-45e8-93e4-61996cbbb7ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146756 Oct 17 13:25:24.925444 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3442/6587] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:24.935677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:24.937043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:24.965878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.975690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.976545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.977846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.978727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.979505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:25.111100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:25.125190 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bfc46c95-e048-4d49-9070-364740b6eb17 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.484849 Oct 17 13:25:25.130137 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3146/6588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:24 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:25.591421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:25.601725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-704df99c-c39b-49a3-89c8-47da7b79b150 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1489 microversion: 2.1 time: 0.674318 Oct 17 13:25:25.605767 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3443/6589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:24 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1489 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:25.653524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:25.656849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:25.676364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:25.677489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:25.685816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:25.688055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:25.689112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:25.690901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:25.874153 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6c04860f-858e-43ac-ba54-c59a1e177e02 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "PUT /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1084 microversion: 2.1 time: 0.233896 Oct 17 13:25:25.876778 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3147/6590] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:25:25 2022] PUT /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1084 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:25.908469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:25.910033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:25.942634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:25.943294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:25.943835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:25.959968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:25.960744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:25.961268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:26.170955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:26.171684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:26.193132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:26.194094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:26.200601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:26.203058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:26.204414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:26.206526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:26.499024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:26.509450 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9bbfc63d-a995-4c55-a452-6ae63efaff04 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1266 microversion: 2.1 time: 0.343924 Oct 17 13:25:26.514110 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3148/6591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:26 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:27.161701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:27.179989 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18b5354c-2d00-4850-8313-a434633bac71 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1510 microversion: 2.1 time: 1.280542 Oct 17 13:25:27.183864 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3444/6592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:25 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1510 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:27.225712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:27.231211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:27.262592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.278733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.279332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.280696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.282437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.283549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.536193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:27.536994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:27.550768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.552612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.555272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.558954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.562064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.570554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.605897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:27.620247 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ae9bfb2a-beb8-402f-be2d-e3f61e0632a1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1510 microversion: 2.1 time: 0.411005 Oct 17 13:25:27.623330 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3149/6593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:27 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:27.648195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:27.652476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:27.676382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.680359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.684510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.687139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.692946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.693596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.841070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:27.845394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:27.974258 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2173d8d1-cfa4-4f0c-a586-2e51f313db6d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 204 len: 0 microversion: 2.1 time: 0.330234 Oct 17 13:25:27.980340 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3150/6594] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:27 2022] DELETE /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:27.992488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:27.993939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:28.015304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:28.016403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:28.016943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:28.017776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:28.018968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:28.019494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:28.037327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:28.053700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8f091a86-2370-43cf-8ded-1df348a86389 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1451 microversion: 2.1 time: 0.524606 Oct 17 13:25:28.058227 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3445/6595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:27 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1451 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:28.084725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:28.085281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:28.110945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:28.112645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:28.114468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:28.116171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:28.116827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:28.117455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:28.374357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:28.392515 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79e33715-3f0c-450a-811c-cb654b55184d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1516 microversion: 2.1 time: 0.410170 Oct 17 13:25:28.392723 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3151/6596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:27 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1516 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:28.459613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:28.476695 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ecd481ad-ca21-4965-b2e2-5564c33ffb88 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1451 microversion: 2.1 time: 0.396631 Oct 17 13:25:28.482820 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3446/6597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:28 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1451 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:29.419482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:29.420272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:29.434100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:29.434950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:29.439359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:29.440905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:29.441593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:29.442053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:30.160887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:30.173968 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b412d26-665f-426b-98d0-c323978b542e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1516 microversion: 2.1 time: 0.758262 Oct 17 13:25:30.175589 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3152/6598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:29 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1516 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:31.058202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9491e363-e770-4aef-84af-a96c76d8802d req-5c2d0887-6495-4f76-81a0-53fc68feb23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94cfa12d-32a2-4c6c-8339-e8f8cf464264", "name": "network-vif-deleted", "tag": "4a25d3e9-401a-455b-9b96-e94d20a35f0b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:31.089092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9491e363-e770-4aef-84af-a96c76d8802d req-5c2d0887-6495-4f76-81a0-53fc68feb23b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:31.089599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9491e363-e770-4aef-84af-a96c76d8802d req-5c2d0887-6495-4f76-81a0-53fc68feb23b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:31.090044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9491e363-e770-4aef-84af-a96c76d8802d req-5c2d0887-6495-4f76-81a0-53fc68feb23b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:31.180160 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9491e363-e770-4aef-84af-a96c76d8802d req-5c2d0887-6495-4f76-81a0-53fc68feb23b service nova] Creating event network-vif-deleted:4a25d3e9-401a-455b-9b96-e94d20a35f0b for instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 on n-h2-853316-12 Oct 17 13:25:31.198589 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9491e363-e770-4aef-84af-a96c76d8802d req-5c2d0887-6495-4f76-81a0-53fc68feb23b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148923 Oct 17 13:25:31.201558 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3447/6599] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:31.205290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:31.207546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:31.248791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:31.250458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:31.254567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:31.255874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:31.256589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:31.261614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:31.654773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:31.704067 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aad558b3-012b-4aaa-a0cb-af594cf49f5f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 200 len: 1315 microversion: 2.1 time: 0.503730 Oct 17 13:25:31.746278 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3153/6600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:31 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:32.187541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-09242a73-a2f7-4dbf-a7fd-5d77e12ac51d tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-599304348", "availability_zone": "foo_zone"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:32.195515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.aggregate [None req-09242a73-a2f7-4dbf-a7fd-5d77e12ac51d tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Generated uuid 625206e9-37eb-4776-a113-82a83a11245a for aggregate {{(pid=127540) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:25:32.250327 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-09242a73-a2f7-4dbf-a7fd-5d77e12ac51d tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.637559 Oct 17 13:25:32.261901 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3448/6601] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 17 13:25:31 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:32.270747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5eb2783f-7fa2-4396-b8c1-fbcde85f51a6 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:32.365526 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5eb2783f-7fa2-4396-b8c1-fbcde85f51a6 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.102587 Oct 17 13:25:32.366804 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3154/6602] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 13:25:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:32.380421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91e3873b-dd24-41cd-b610-7239c1e36183 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:32.386003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91e3873b-dd24-41cd-b610-7239c1e36183 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.387645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91e3873b-dd24-41cd-b610-7239c1e36183 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.389701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91e3873b-dd24-41cd-b610-7239c1e36183 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.391721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91e3873b-dd24-41cd-b610-7239c1e36183 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.392439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91e3873b-dd24-41cd-b610-7239c1e36183 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.394113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91e3873b-dd24-41cd-b610-7239c1e36183 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.441152 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91e3873b-dd24-41cd-b610-7239c1e36183 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.065153 Oct 17 13:25:32.453272 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3449/6603] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 17 13:25:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:32.455951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a885bb13-f75f-4188-8f87-8ac210f66109 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:32.479542 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a885bb13-f75f-4188-8f87-8ac210f66109 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.028262 Oct 17 13:25:32.482132 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3155/6604] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 17 13:25:32 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:32.493421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e759c2df-3a94-4446-a42c-8d549d084d8b tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853316-12"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:32.519380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e759c2df-3a94-4446-a42c-8d549d084d8b tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.520362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e759c2df-3a94-4446-a42c-8d549d084d8b tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.528077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e759c2df-3a94-4446-a42c-8d549d084d8b tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.739387 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e759c2df-3a94-4446-a42c-8d549d084d8b tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.249799 Oct 17 13:25:32.749559 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3450/6605] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 13:25:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:32.757284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:32.758006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:32.766577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9bb01aa2-dea7-4da1-b6f2-c2a383c56a7f tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:32.775025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.776627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.777079 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9bb01aa2-dea7-4da1-b6f2-c2a383c56a7f tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.014435 Oct 17 13:25:32.777344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.779270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.781117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.784679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.786538 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3451/6606] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 13:25:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:32.792078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ee5a355-67eb-4c00-8092-5c899f10fb2f tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2006630671", "availability_zone": "foo_zone"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:32.821403 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 HTTP/1.1 Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '94cfa12d-32a2-4c6c-8339-e8f8cf464264'} Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:32.826187 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:32.829260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:32.829260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:32.829260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:32.829260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:32.829260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:32.829260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:25:32.829260 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:25:32.832701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:32.833861 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e91cf6fe-2260-4f4d-8692-6b9df1a2cb7a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 404 len: 111 microversion: 2.1 time: 0.085468 Oct 17 13:25:32.835069 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3156/6607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:32 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:25:32.885406 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ee5a355-67eb-4c00-8092-5c899f10fb2f tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.097244 Oct 17 13:25:32.887281 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3452/6608] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 17 13:25:32 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:32.902580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e97a9d6b-0aa7-474c-a85d-b78997b8b4bc tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:32.944857 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e97a9d6b-0aa7-474c-a85d-b78997b8b4bc tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.046878 Oct 17 13:25:32.947868 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3157/6609] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 13:25:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:32.967187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6a24f9c-e954-4645-ae68-b93f2c70d05b tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:32.982496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6a24f9c-e954-4645-ae68-b93f2c70d05b tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.025130 Oct 17 13:25:32.983487 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3453/6610] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 17 13:25:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:32.998257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5a80b6e4-7d15-4e35-be83-b938164429a0 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853316-12"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:33.014733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a80b6e4-7d15-4e35-be83-b938164429a0 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:33.015582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a80b6e4-7d15-4e35-be83-b938164429a0 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:33.016284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a80b6e4-7d15-4e35-be83-b938164429a0 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:33.016880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1331392228", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "d655af17-e1cc-4020-9487-2d7bb4d8b86d"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:33.105694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] validate_networks() for [('d655af17-e1cc-4020-9487-2d7bb4d8b86d', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:33.514084 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5a80b6e4-7d15-4e35-be83-b938164429a0 tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.521456 Oct 17 13:25:33.518928 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3158/6611] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 17 13:25:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:33.539633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52075a44-318c-4552-936b-c0b7b38bfa6f tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:33.592188 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52075a44-318c-4552-936b-c0b7b38bfa6f tempest-TestAggregatesBasicOps-47638738 tempest-TestAggregatesBasicOps-47638738-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.066770 Oct 17 13:25:33.592841 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3159/6612] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 13:25:33 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:25:34.540426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:34.543079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:34.544215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:34.544998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:34.546689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:34.567089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:34.568808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:34.571345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:34.574858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:34.576088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:34.576746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:34.635544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:34.652431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Getting quotas for user 7b89f4a38d474d3ea520b8cea339e400 and project a82957ceca74450ca15f0ae6ffe8672a. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:34.691418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:34.695893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:34.840971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-99f9e3f7-2087-41f0-8729-6f7f5e8c68a4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824460 Oct 17 13:25:34.842953 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3454/6613] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:25:34.860215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c7913a9-fa2a-4b3e-8ec4-94276310d4c9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:34.862144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c7913a9-fa2a-4b3e-8ec4-94276310d4c9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:35.042933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c7913a9-fa2a-4b3e-8ec4-94276310d4c9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:35.112405 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c7913a9-fa2a-4b3e-8ec4-94276310d4c9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1209 microversion: 2.1 time: 0.258330 Oct 17 13:25:35.130202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3160/6614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:34 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1209 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:35.276483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8233ea06-5c84-4a0a-aeab-d2604915ef91 req-8075a1fb-3640-4451-93f0-5a53f42e0951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f71859-e12f-4df0-b035-67d3529c87cb", "tag": "b54ba56a-e0ff-43bd-9462-5288a810e084"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:35.312198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8233ea06-5c84-4a0a-aeab-d2604915ef91 req-8075a1fb-3640-4451-93f0-5a53f42e0951 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:35.312842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8233ea06-5c84-4a0a-aeab-d2604915ef91 req-8075a1fb-3640-4451-93f0-5a53f42e0951 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:35.313559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8233ea06-5c84-4a0a-aeab-d2604915ef91 req-8075a1fb-3640-4451-93f0-5a53f42e0951 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:35.345712 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8233ea06-5c84-4a0a-aeab-d2604915ef91 req-8075a1fb-3640-4451-93f0-5a53f42e0951 service nova] Creating event network-changed:b54ba56a-e0ff-43bd-9462-5288a810e084 for instance 13f71859-e12f-4df0-b035-67d3529c87cb on n-h1-853316-12 Oct 17 13:25:35.354353 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8233ea06-5c84-4a0a-aeab-d2604915ef91 req-8075a1fb-3640-4451-93f0-5a53f42e0951 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087424 Oct 17 13:25:35.355805 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3455/6615] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:36.153070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:36.153758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:36.176699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:36.177588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:36.191404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:36.193152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:36.195500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:36.195973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:36.838014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:36.873619 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a12db38d-1bab-4476-b375-4cf1cd5741e6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1213 microversion: 2.1 time: 0.726760 Oct 17 13:25:36.879043 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3161/6616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:36 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1213 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:37.910709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:37.916352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:37.951420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:37.957296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:37.960629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:37.963898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:37.966141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:37.974738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:38.229905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:38.246580 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b5fcec41-18aa-4e14-a5c1-f4e87b75f6ac tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1279 microversion: 2.1 time: 0.346688 Oct 17 13:25:38.249449 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3456/6617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:37 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1279 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:39.082702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:39.088216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:39.128795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:39.156896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.157412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.157871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.165119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.165863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.166534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.282065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:39.283046 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3305143a-b9e9-4b94-a5a3-cb2a38d6ea2f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.212644 Oct 17 13:25:39.285674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:39.292530 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3162/6618] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:25:39 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/ips => generated 150 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:39.314606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.323596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.324221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.325115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.326689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.328032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.650843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:39.666909 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-000fdc1c-73ce-4b1e-917d-29ea1db464f1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1267 microversion: 2.1 time: 0.392962 Oct 17 13:25:39.675460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3457/6619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:39 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1267 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:40.519665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-118741313", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "ddcb57f3-e4ec-44a7-9f9b-07667553de3f"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:40.617255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] validate_networks() for [('ddcb57f3-e4ec-44a7-9f9b-07667553de3f', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:40.715022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:40.715745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:40.724049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:40.739225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:40.741448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:40.743982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:40.745396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:40.746301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:40.747288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:40.789396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=100 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:41.564388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:41.588099 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-67d6bf0e-8d39-4ec6-b7af-b61db367c963 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1309 microversion: 2.1 time: 0.879408 Oct 17 13:25:41.602245 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3458/6620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:40 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1309 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:42.617540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:42.618625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:42.633207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:42.633944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:42.634552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:42.637112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:42.639821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:42.641360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.204960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:43.219361 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2c5f69d1-03df-4c9a-be2a-e2d0633e72fe tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1309 microversion: 2.1 time: 0.606684 Oct 17 13:25:43.220078 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3459/6621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:42 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1309 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:43.463536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:43.465693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:43.467019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:43.483060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:43.484841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:43.560618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:43.561765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:43.562667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.564186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:43.580825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:43.582301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.696458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Getting quotas for project ce200b7601234bd1bc1b6ffea2f166be. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:43.725858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Getting quotas for user f7507bede7554576bda2726b4702f9ff and project ce200b7601234bd1bc1b6ffea2f166be. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:43.779706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:43.784426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:43.888200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:43.895057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:43.910600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:43.912209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:43.913301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.914874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:43.916000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:43.917096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.991447 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d9826baa-5e89-49bb-8f8d-5b2e9196a14d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.483411 Oct 17 13:25:44.004108 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3163/6622] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:25:44.026420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-06e233cb-3cf6-4ef0-918c-cfd365233ab6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:44.028146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-06e233cb-3cf6-4ef0-918c-cfd365233ab6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:44.422454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-06e233cb-3cf6-4ef0-918c-cfd365233ab6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:44.448872 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-06e233cb-3cf6-4ef0-918c-cfd365233ab6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1213 microversion: 2.1 time: 0.440064 Oct 17 13:25:44.475113 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3164/6623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:44 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1213 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:44.503960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:44.508972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:44.559996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:44.564390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:44.570331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:44.574290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:44.578408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:44.585956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:44.614457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:44.644689 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2dde463-2edd-4ee2-9820-ec9a8561c4ef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764366 Oct 17 13:25:44.654325 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3460/6624] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:25:43 2022] POST /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:45.125600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:45.147573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-ab713b9d-9e71-41b6-bf6d-19cf51b98af6 req-3adaa518-8f42-4c64-a152-3febea111b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efda4db7-fc11-46b0-abba-7924ea8d9fb3", "tag": "46603093-bf62-472d-9f25-dbac893b8c79"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:45.180597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ab713b9d-9e71-41b6-bf6d-19cf51b98af6 req-3adaa518-8f42-4c64-a152-3febea111b4c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:45.181584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ab713b9d-9e71-41b6-bf6d-19cf51b98af6 req-3adaa518-8f42-4c64-a152-3febea111b4c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:45.182681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ab713b9d-9e71-41b6-bf6d-19cf51b98af6 req-3adaa518-8f42-4c64-a152-3febea111b4c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:45.201003 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-ab713b9d-9e71-41b6-bf6d-19cf51b98af6 req-3adaa518-8f42-4c64-a152-3febea111b4c service nova] Creating event network-changed:46603093-bf62-472d-9f25-dbac893b8c79 for instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 on n-h2-853316-12 Oct 17 13:25:45.209388 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-ab713b9d-9e71-41b6-bf6d-19cf51b98af6 req-3adaa518-8f42-4c64-a152-3febea111b4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085671 Oct 17 13:25:45.212923 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3461/6625] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:45.363726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:45.395094 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dae1fe2d-9b3b-4780-a423-db12fc33ad68 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1309 microversion: 2.1 time: 0.909754 Oct 17 13:25:45.396024 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3165/6626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:44 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1309 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:45.507429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:45.520416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:45.531792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:45.537278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:45.540392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:45.541927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:45.546610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:45.547739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:45.961654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:45.976543 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6adf6ffd-af75-47f3-a9cf-19cef57556dd tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1265 microversion: 2.1 time: 0.486137 Oct 17 13:25:45.979268 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3462/6627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:45 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1265 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:46.421773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:46.422665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:46.448072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:46.448072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:46.448072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:46.448072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:46.449012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:46.450106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:47.007840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:47.009855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:47.028578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:47.030779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:47.031516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:47.046380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:47.053184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:47.055441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:47.056487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:47.070863 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f6759a9-b3d1-4567-b86c-114393a06eaa tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1309 microversion: 2.1 time: 0.653214 Oct 17 13:25:47.082726 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3166/6628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:46 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1309 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:47.218240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:47.250064 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe1ae175-6ce1-4d19-b594-501988bdeffc tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1271 microversion: 2.1 time: 0.250069 Oct 17 13:25:47.251952 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3463/6629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:46 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:48.104885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:48.107168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:48.122337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:48.123203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:48.125194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:48.128616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:48.130632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:48.132266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:48.340078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:48.345292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:48.359942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:48.361367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:48.363928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:48.365443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:48.366708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:48.367744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:48.567845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:48.585844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-197dc7af-4ba7-485e-8beb-60dec8ae7172 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1271 microversion: 2.1 time: 0.307972 Oct 17 13:25:48.588056 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3464/6630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:48 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:48.886954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:48.907104 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8365815d-e8ef-4577-93a4-466df4b46215 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1309 microversion: 2.1 time: 0.808379 Oct 17 13:25:48.908486 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3167/6631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:48 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1309 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:49.626249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:49.627031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:49.644282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:49.647065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:49.648733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:49.649794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:49.652142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:49.657752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:49.947107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:49.947888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:49.961936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:49.962492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:49.976614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:49.980315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:49.981093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:49.981730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:50.223655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:50.244169 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a0b3de5-0a27-44c8-8355-4636a728c5d6 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.625915 Oct 17 13:25:50.262774 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3465/6632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:49 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:50.520821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:50.535257 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e2267845-6e8d-4ccb-9994-4a025fae56e0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1309 microversion: 2.1 time: 0.592920 Oct 17 13:25:50.537822 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3168/6633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:49 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1309 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:51.304278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:51.305357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:51.352887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.356624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.359722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.362697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.364522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.373143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.585749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:51.593379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:51.660114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.668638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.669654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.682983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.685377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.688576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.772265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:51.789246 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c331826-d2e9-45b6-a522-d2593306145c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.501622 Oct 17 13:25:51.792256 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3466/6634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:51 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:52.112694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-dfb8cba8-21c4-464f-8edc-4a5bb211253b req-ab63859d-ae61-4877-afcc-9b5b2bb94884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efda4db7-fc11-46b0-abba-7924ea8d9fb3", "name": "network-vif-plugged", "status": "completed", "tag": "46603093-bf62-472d-9f25-dbac893b8c79"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:52.139497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dfb8cba8-21c4-464f-8edc-4a5bb211253b req-ab63859d-ae61-4877-afcc-9b5b2bb94884 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:52.142005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dfb8cba8-21c4-464f-8edc-4a5bb211253b req-ab63859d-ae61-4877-afcc-9b5b2bb94884 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:52.163252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-dfb8cba8-21c4-464f-8edc-4a5bb211253b req-ab63859d-ae61-4877-afcc-9b5b2bb94884 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:52.195422 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-dfb8cba8-21c4-464f-8edc-4a5bb211253b req-ab63859d-ae61-4877-afcc-9b5b2bb94884 service nova] Creating event network-vif-plugged:46603093-bf62-472d-9f25-dbac893b8c79 for instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 on n-h2-853316-12 Oct 17 13:25:52.206540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-dfb8cba8-21c4-464f-8edc-4a5bb211253b req-ab63859d-ae61-4877-afcc-9b5b2bb94884 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097073 Oct 17 13:25:52.207935 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3467/6635] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:52.819639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:52.820536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:52.849776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:52.850574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:52.854858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:52.856051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:52.857206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:52.858065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.069555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:53.090974 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dcec402a-4771-40a4-bb12-bcc1cb87a440 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1309 microversion: 2.1 time: 1.518181 Oct 17 13:25:53.091972 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3169/6636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:51 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1309 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:53.188539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:53.203721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c7681063-2b58-4966-bbc3-c9cf3d6a0e4a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.389351 Oct 17 13:25:53.204694 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3468/6637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:52 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:53.568047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-492fd816-aa00-4f13-bb7b-38f061f67673 req-6cc3b2b7-df36-4fe4-bf1c-f08a7ccfe3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92718a3-c104-45c8-be30-b20fc81d1d1b", "tag": "fed8dbdc-bae0-494f-8f1e-9cf299bc782d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:53.631464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-492fd816-aa00-4f13-bb7b-38f061f67673 req-6cc3b2b7-df36-4fe4-bf1c-f08a7ccfe3d3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.632904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-492fd816-aa00-4f13-bb7b-38f061f67673 req-6cc3b2b7-df36-4fe4-bf1c-f08a7ccfe3d3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.633266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-492fd816-aa00-4f13-bb7b-38f061f67673 req-6cc3b2b7-df36-4fe4-bf1c-f08a7ccfe3d3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.656756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:53.668203 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-492fd816-aa00-4f13-bb7b-38f061f67673 req-6cc3b2b7-df36-4fe4-bf1c-f08a7ccfe3d3 service nova] Creating event network-changed:fed8dbdc-bae0-494f-8f1e-9cf299bc782d for instance b92718a3-c104-45c8-be30-b20fc81d1d1b on n-h1-853316-12 Oct 17 13:25:53.676191 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-492fd816-aa00-4f13-bb7b-38f061f67673 req-6cc3b2b7-df36-4fe4-bf1c-f08a7ccfe3d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119811 Oct 17 13:25:53.677618 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3170/6638] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:54.134521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.136149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:54.148164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.148987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.150045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.151695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.152765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.153785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.247123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.248813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:54.259670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.261161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.262418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.264079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.264808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.265330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.443501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=10 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:54.491772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.519435 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-673fe58b-8c78-4a1b-b13c-26f3e225b117 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1309 microversion: 2.1 time: 0.390853 Oct 17 13:25:54.527470 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3469/6639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1309 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:54.655121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.675999 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab1ab3ae-e51c-4ebb-b333-623e8ce7d05c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.433408 Oct 17 13:25:54.696587 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3171/6640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:55.554938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.560031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:55.601190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.602426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.603341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.606066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.607050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.609026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.720338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.722341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:55.740591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.741161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.741818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.742686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.743148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.743762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.044970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.051834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.066688 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ced3fa45-f9d0-4560-8fc8-aafb8a2bb2f8 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.349729 Oct 17 13:25:56.071158 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ff15597-b762-4a26-b854-cdc0c0fe7259 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1489 microversion: 2.1 time: 0.526333 Oct 17 13:25:56.086194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3470/6641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:55 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1489 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.086430 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3172/6642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:55 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:56.107841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2093845622"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:56.112676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:56.123073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.123784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.124491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.125562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.126392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.128060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.224496 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4625f1e3-6dff-461c-a73c-ecdf8e74592d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "PUT /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1074 microversion: 2.1 time: 0.123726 Oct 17 13:25:56.225350 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3471/6643] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:25:56 2022] PUT /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1074 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.247574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:56.248580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:56.258302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.259441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.260663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.261770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.262509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.263189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.421997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.431456 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c1074b7-4de5-4e8e-8d75-7dd7cc116fdc tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1500 microversion: 2.1 time: 0.188476 Oct 17 13:25:56.433771 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3173/6644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:56 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.456378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:56.457410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:56.464646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.466482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.466482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.466704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.467010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.467588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.832767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.841124 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d55b788f-b4f5-4739-9815-64eeed759c9f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1500 microversion: 2.1 time: 0.390055 Oct 17 13:25:56.841715 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3472/6645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:56 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1500 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.874872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-314ad308-f2a9-4bb7-b583-7ff7d0c41f3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:56.885120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-314ad308-f2a9-4bb7-b583-7ff7d0c41f3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.885864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-314ad308-f2a9-4bb7-b583-7ff7d0c41f3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.886425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-314ad308-f2a9-4bb7-b583-7ff7d0c41f3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.902809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:56.921672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-314ad308-f2a9-4bb7-b583-7ff7d0c41f3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:25:56.987234 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-314ad308-f2a9-4bb7-b583-7ff7d0c41f3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "POST /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3/action" status: 202 len: 0 microversion: 2.1 time: 0.117441 Oct 17 13:25:56.994776 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3174/6646] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:25:56 2022] POST /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:25:57.000528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.006609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:57.020876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.021477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.021936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.023131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.024099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.024772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.095656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.097763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:57.106750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.107260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.107715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.108452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.109091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.109796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.441488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:57.454139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e9f0c73-8665-4237-ba83-d41f79b525b9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.457850 Oct 17 13:25:57.457737 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3473/6647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:56 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:57.497569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:57.512159 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd25b2b3-747f-4b9f-878b-578b3dfe6a1c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.423464 Oct 17 13:25:57.523505 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3175/6648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:57 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:58.490354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.490354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:58.542689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.543513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.546406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.549403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.551364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.553162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.554356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:58.555251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.592334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:58.603795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.605225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.606568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.608173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.609164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.611287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.953293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:58.972637 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34f4ecca-cc87-4649-bd1d-cb3dfc2a3d82 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.434914 Oct 17 13:25:58.974555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3176/6649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:58 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:59.010435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:59.034442 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b3cd1f2-d1f5-442d-87ab-9d45883f77bf tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.553990 Oct 17 13:25:59.036481 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3474/6650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:58 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:00.016425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:00.017251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:00.026925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.027978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.030194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.031468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.032279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.032986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.081206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:00.082758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:00.108849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.113346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.120017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.124952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.125481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.125922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.315830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.332162 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f414d005-9029-43de-b2f8-2ffd008fcda4 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.320516 Oct 17 13:26:00.332981 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3177/6651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:00 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:00.387186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e03a1fbb-07cf-4710-86e7-2d8bd29530d8 req-f5f9d1f3-b8ed-440f-a6ab-08b8bd9e0588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92718a3-c104-45c8-be30-b20fc81d1d1b", "name": "network-vif-plugged", "status": "completed", "tag": "fed8dbdc-bae0-494f-8f1e-9cf299bc782d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:00.444560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e03a1fbb-07cf-4710-86e7-2d8bd29530d8 req-f5f9d1f3-b8ed-440f-a6ab-08b8bd9e0588 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.445713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e03a1fbb-07cf-4710-86e7-2d8bd29530d8 req-f5f9d1f3-b8ed-440f-a6ab-08b8bd9e0588 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.446674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e03a1fbb-07cf-4710-86e7-2d8bd29530d8 req-f5f9d1f3-b8ed-440f-a6ab-08b8bd9e0588 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.474517 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e03a1fbb-07cf-4710-86e7-2d8bd29530d8 req-f5f9d1f3-b8ed-440f-a6ab-08b8bd9e0588 service nova] Creating event network-vif-plugged:fed8dbdc-bae0-494f-8f1e-9cf299bc782d for instance b92718a3-c104-45c8-be30-b20fc81d1d1b on n-h1-853316-12 Oct 17 13:26:00.482225 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e03a1fbb-07cf-4710-86e7-2d8bd29530d8 req-f5f9d1f3-b8ed-440f-a6ab-08b8bd9e0588 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099727 Oct 17 13:26:00.483522 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3178/6652] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:00.644014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.691227 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f2e74e7-4567-40d0-abdb-d37272ca1ec1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.617993 Oct 17 13:26:00.692277 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3475/6653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:00 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:00.925582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-109096af-2ff1-4d5d-a157-5580373148be tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: .version_select at 0x7fa82046aa60>, body: {"keypair": {"name": "tempest-keypair-710317149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFIrlZWs6s/5aGSMmWswayCCjBx1X7NTxs0jDfPzlyGcXsAIIAc02w3nDf1lib1gFQx40OZ5ianzHCFsj/4i6Mpcab3UFTNBhb6S1E8Nr7WBRLs1J9BhPDmbNvBJFfAVw=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:00.965728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-109096af-2ff1-4d5d-a157-5580373148be tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for project 3bc91c516177497fa5d502d401b13efa. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:00.984288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-109096af-2ff1-4d5d-a157-5580373148be tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for user 6a7a84e3905a4b5e887825b601e3d964 and project 3bc91c516177497fa5d502d401b13efa. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:01.028440 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-109096af-2ff1-4d5d-a157-5580373148be tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107682 Oct 17 13:26:01.030745 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3179/6654] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:26:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:01.362133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:01.363001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:01.391952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.392452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.393106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.393897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.400906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.401517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.717943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:01.718900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:01.734324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.736063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.738338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.739743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.742296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.743379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.997537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:02.011981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18516686-7069-4c56-8eec-b381dbd40116 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1313 microversion: 2.1 time: 0.654851 Oct 17 13:26:02.012582 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3476/6655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:01 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:02.086814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:02.118664 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1076b40d-f588-4c5f-9b12-39be0ca7c093 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.403616 Oct 17 13:26:02.121149 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3180/6656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:01 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:03.055350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.059646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.089891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.090728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.095564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.097880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.099458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.100301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.160128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.162379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.190948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.197958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.203181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.207171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.208506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.209447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.483338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:03.499283 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e9d183d-3c54-4ef7-aa49-b9f1ab7a9af5 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1497 microversion: 2.1 time: 0.448938 Oct 17 13:26:03.499849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3477/6657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:03 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1497 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:03.738935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:03.765402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8a3396a4-66f0-4c6e-a4ca-bd86140748df tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.609590 Oct 17 13:26:03.785239 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3181/6658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:03 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:04.187332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.188017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.196401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.196928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.197662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.198761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.199570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.200493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.246912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:04.407506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a34d2d04-04e5-4f5d-a54a-1b407c7ed1c3 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 204 len: 0 microversion: 2.1 time: 0.224407 Oct 17 13:26:04.410411 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3478/6659] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:04 2022] DELETE /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:04.429837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.432288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.456053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.457264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.458396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.460020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.461201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.462662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.807054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.808615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.816406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.817406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.818500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.819758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.820537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.821226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.869889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:04.882089 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-27cbabf5-594b-4aa9-b0b4-7923726fd21b tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1503 microversion: 2.1 time: 0.466663 Oct 17 13:26:04.903197 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3182/6660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1503 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:05.027618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1173788503", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb30fe9b-9188-4fd9-81ae-fbd2ab091675"}], "security_groups": [{"name": "tempest-securitygroup--289372058"}], "key_name": "tempest-keypair-710317149", "user_data": "}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:05.087970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:05.112394 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f5e8cf6c-23d6-43a1-8019-e1fcfc078082 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.313134 Oct 17 13:26:05.113457 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3479/6661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:05.363344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] validate_networks() for [('fb30fe9b-9188-4fd9-81ae-fbd2ab091675', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:26:05.916371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.917954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.928180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.929139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.929660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.930676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.931208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.931797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.127620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:06.161716 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7ed72b7-a528-4ca9-9787-2317eebaba96 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1503 microversion: 2.1 time: 0.250460 Oct 17 13:26:06.176503 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3480/6662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:06.184289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:06.186978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:06.194500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.195342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.195981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.196986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.197698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.198373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.386276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:06.396317 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7f307e9-9c2e-4c75-9868-1a756d4ab8b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.216999 Oct 17 13:26:06.397248 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3481/6663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:06 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:06.417356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:26:06.417842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:26:06.418281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:26:06.418702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:26:06.419122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:26:06.430305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.430808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.431260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.431999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.432457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.433148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.454232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for project 3bc91c516177497fa5d502d401b13efa. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:06.460626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for user 6a7a84e3905a4b5e887825b601e3d964 and project 3bc91c516177497fa5d502d401b13efa. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:06.476995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:26:06.479502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:26:06.555497 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-47e5189c-3029-4fed-879a-12807abdf6f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.536292 Oct 17 13:26:06.556362 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3183/6664] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:26:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:26:06.572485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ba433ad-bfab-4bda-ad05-030795dab4ec tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:06.573541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ba433ad-bfab-4bda-ad05-030795dab4ec tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:06.671472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ba433ad-bfab-4bda-ad05-030795dab4ec tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:06.683363 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ba433ad-bfab-4bda-ad05-030795dab4ec tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1241 microversion: 2.1 time: 0.116695 Oct 17 13:26:06.684212 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3482/6665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:06 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:07.190573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.192070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:07.204951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.215312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.226602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.230806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-18027aef-42f2-4c37-af1a-897d1cc5f9ea req-2f8793b0-6330-4228-b662-ce593a7664f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92718a3-c104-45c8-be30-b20fc81d1d1b", "name": "network-vif-deleted", "tag": "fed8dbdc-bae0-494f-8f1e-9cf299bc782d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:07.234392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.235574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.238498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.253184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-18027aef-42f2-4c37-af1a-897d1cc5f9ea req-2f8793b0-6330-4228-b662-ce593a7664f2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.254239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-18027aef-42f2-4c37-af1a-897d1cc5f9ea req-2f8793b0-6330-4228-b662-ce593a7664f2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.254996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-18027aef-42f2-4c37-af1a-897d1cc5f9ea req-2f8793b0-6330-4228-b662-ce593a7664f2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.275303 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-18027aef-42f2-4c37-af1a-897d1cc5f9ea req-2f8793b0-6330-4228-b662-ce593a7664f2 service nova] Creating event network-vif-deleted:fed8dbdc-bae0-494f-8f1e-9cf299bc782d for instance b92718a3-c104-45c8-be30-b20fc81d1d1b on n-h1-853316-12 Oct 17 13:26:07.284992 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-18027aef-42f2-4c37-af1a-897d1cc5f9ea req-2f8793b0-6330-4228-b662-ce593a7664f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063246 Oct 17 13:26:07.286270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3483/6666] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:07.427430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.428470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:07.440219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.440998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.441216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.445344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.446053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.446651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.653332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:07.663689 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad89a264-180f-4e6b-a3c9-831dfabada3f tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.241054 Oct 17 13:26:07.664596 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3484/6667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.722668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.723368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:07.731086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.732076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.732764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.733815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.734650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.736164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.745227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:07.769696 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-96e732c5-90c8-4582-ae71-72033144c4db tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 200 len: 1461 microversion: 2.1 time: 0.582004 Oct 17 13:26:07.771513 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3184/6668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 1461 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.843353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:07.858972 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b3f2e15-c2c4-414a-b764-b0542f5a0062 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1293 microversion: 2.1 time: 0.141153 Oct 17 13:26:07.860012 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3485/6669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:08.706766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:08.708513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:08.723650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.725049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.726357 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.728086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.729380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.730511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.799600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:08.804460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: b92718a3-c104-45c8-be30-b20fc81d1d1b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:08.828874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.830212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.831313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.832945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.833447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.833889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.859506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] HTTP exception thrown: Instance b92718a3-c104-45c8-be30-b20fc81d1d1b could not be found. Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Request method failure captured: Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b HTTP/1.1 Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVfP85NZYjwBg2DFEYQopFnmR9_8E9SgNLVB9EYY3JtMWNdWryYX7lpdI2saX5bqlW1hG2jHOyAb-3skHpI9dXAe3JvxPDURHnII264DUo57gIWqtIZ3HFxA4RinaMICCJv63jkh02xFx04O14GkrHHYCNsy25KzU0VrTeuxtB5sqgg Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ce200b7601234bd1bc1b6ffea2f166be Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-VolumesActionsTest-1380562738 Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ce200b7601234bd1bc1b6ffea2f166be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ce200b7601234bd1bc1b6ffea2f166be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ce200b7601234bd1bc1b6ffea2f166be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ce200b7601234bd1bc1b6ffea2f166be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-VolumesActionsTest-1380562738 Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ce200b7601234bd1bc1b6ffea2f166be Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-VolumesActionsTest-1380562738 Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-VolumesActionsTest-1380562738-project Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f7507bede7554576bda2726b4702f9ff Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-VolumesActionsTest-1380562738-project Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance b92718a3-c104-45c8-be30-b20fc81d1d1b could not be found. Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b92718a3-c104-45c8-be30-b20fc81d1d1b'} Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92718a3-c104-45c8-be30-b20fc81d1d1b could not be found. Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92718a3-c104-45c8-be30-b20fc81d1d1b could not be found. Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:08.866794 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.875083 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:08.875083 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:08.875083 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:08.875083 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:08.875083 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:08.875083 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92718a3-c104-45c8-be30-b20fc81d1d1b could not be found. Oct 17 13:26:08.875083 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.878813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Returning 404 to user: Instance b92718a3-c104-45c8-be30-b20fc81d1d1b could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:08.884700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae87d2a7-2025-4998-aec3-5b8bfdf4d97f tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b" status: 404 len: 111 microversion: 2.1 time: 0.091871 Oct 17 13:26:08.886246 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3486/6670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:08 2022] GET /compute/v2.1/servers/b92718a3-c104-45c8-be30-b20fc81d1d1b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:08.900992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:08.902896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:08.912753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.913444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.914372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.916051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.916819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.917555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:09.089690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:09.099051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-101328da-af78-4441-aea9-6489c4fa66b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1299 microversion: 2.1 time: 0.202325 Oct 17 13:26:09.100025 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3487/6671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:08 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:09.118799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-388312966", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "ddcb57f3-e4ec-44a7-9f9b-07667553de3f"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:09.156992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:09.183052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f7d96647-54cd-4099-9251-3cd3f1df226e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.484694 Oct 17 13:26:09.186177 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3185/6672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:08 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:09.203807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] validate_networks() for [('ddcb57f3-e4ec-44a7-9f9b-07667553de3f', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:26:09.940123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:26:09.941653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:26:09.942664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:26:09.943840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:26:09.944818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:26:09.965751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:09.967693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:09.969032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:09.971728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:09.973132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:09.974408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.005459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Getting quotas for project ce200b7601234bd1bc1b6ffea2f166be. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:10.013351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Getting quotas for user f7507bede7554576bda2726b4702f9ff and project ce200b7601234bd1bc1b6ffea2f166be. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:10.032645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:26:10.036123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:26:10.102248 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aaf80e12-d4dd-4349-a0a9-bf2489e745be tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999015 Oct 17 13:26:10.103188 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3488/6673] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:26:10.116904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa9822ae-4928-449d-a89d-b2d1d49e1295 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:10.117541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa9822ae-4928-449d-a89d-b2d1d49e1295 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:10.129755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:10.130149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:10.145302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.145822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.146307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.147095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.147621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.148073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.241982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa9822ae-4928-449d-a89d-b2d1d49e1295 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:10.269566 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa9822ae-4928-449d-a89d-b2d1d49e1295 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1213 microversion: 2.1 time: 0.157905 Oct 17 13:26:10.274201 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3186/6674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:10 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:10.294043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:10.298691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:10.324733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.328645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.329560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.336225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.337236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.338603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.435418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:10.451068 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f7ee609-6f5d-441b-8144-ffa851b50a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1366 microversion: 2.1 time: 0.326326 Oct 17 13:26:10.452113 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3489/6675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:10 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:10.615806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:10.625319 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1784a823-4c57-4d0e-a9e5-84c98732d307 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.349189 Oct 17 13:26:10.626017 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3187/6676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:10 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:10.815296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-538d0add-d4a8-4656-9f3c-4cbd7333a056 req-86765a3c-d5ef-461d-bc92-3c4f4c26dc8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa4488d-15f6-4103-970f-83ab4b0283c5", "tag": "c40d3154-5570-487a-8814-972b9571e233"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:10.824384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:10.840784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-538d0add-d4a8-4656-9f3c-4cbd7333a056 req-86765a3c-d5ef-461d-bc92-3c4f4c26dc8d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.841300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-538d0add-d4a8-4656-9f3c-4cbd7333a056 req-86765a3c-d5ef-461d-bc92-3c4f4c26dc8d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.842414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-538d0add-d4a8-4656-9f3c-4cbd7333a056 req-86765a3c-d5ef-461d-bc92-3c4f4c26dc8d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.862276 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-538d0add-d4a8-4656-9f3c-4cbd7333a056 req-86765a3c-d5ef-461d-bc92-3c4f4c26dc8d service nova] Creating event network-changed:c40d3154-5570-487a-8814-972b9571e233 for instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 on n-h2-853316-12 Oct 17 13:26:10.869188 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-538d0add-d4a8-4656-9f3c-4cbd7333a056 req-86765a3c-d5ef-461d-bc92-3c4f4c26dc8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063990 Oct 17 13:26:10.870397 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3490/6677] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:11.297164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:11.297718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:11.303401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:11.309526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.310241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.310776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.311591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.312142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.312662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.384604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:11.392869 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2081aac5-6c3e-4b0b-9b61-533ae7a62e54 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1265 microversion: 2.1 time: 0.099651 Oct 17 13:26:11.393839 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3188/6678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:11 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:11.477776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:11.478798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:11.485561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.486176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.487676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.488665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.489245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.489767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.651558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:11.652808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:11.671614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.672267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.672816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.673761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.674643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.675451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.819672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:11.839793 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-efc0ea24-c4d9-4b78-8122-76320b871e00 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1366 microversion: 2.1 time: 0.365952 Oct 17 13:26:11.840701 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3491/6679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:11 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:12.175794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:12.185816 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cae7f2d5-ffe5-4a71-8c8c-cf8d12a2750e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.540304 Oct 17 13:26:12.200769 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3189/6680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:11 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:12.417623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:12.418262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:12.425647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:12.426144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:12.426619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:12.427322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:12.428447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:12.428776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:12.510004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:12.518622 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-308a41b7-2159-4a0d-94c9-b84a617fcf3a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1271 microversion: 2.1 time: 0.105457 Oct 17 13:26:12.519218 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3492/6681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:12 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:12.873019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:12.873694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:12.881178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:12.881803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:12.882455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:12.883391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:12.883998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:12.884577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.141696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:13.150107 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c3b24218-a564-41b1-bad3-899faa4199a1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1366 microversion: 2.1 time: 0.281085 Oct 17 13:26:13.151359 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3190/6682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:12 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:13.216403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:13.217854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:13.233408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.234558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.236809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.237791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.238292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.238727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.243275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:13.486441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-be79e88f-ddf8-4a09-9ec5-ee6ab3f832c3 req-ce589662-9e29-4b2b-84de-7b97131071ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15a359a-4afc-49df-9b68-66710d13891b", "tag": "f4a5fd6e-984a-4f8e-b581-7c9584e4f236"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:13.502335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-be79e88f-ddf8-4a09-9ec5-ee6ab3f832c3 req-ce589662-9e29-4b2b-84de-7b97131071ce service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.503183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-be79e88f-ddf8-4a09-9ec5-ee6ab3f832c3 req-ce589662-9e29-4b2b-84de-7b97131071ce service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.504052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-be79e88f-ddf8-4a09-9ec5-ee6ab3f832c3 req-ce589662-9e29-4b2b-84de-7b97131071ce service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.519786 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-be79e88f-ddf8-4a09-9ec5-ee6ab3f832c3 req-ce589662-9e29-4b2b-84de-7b97131071ce service nova] Creating event network-changed:f4a5fd6e-984a-4f8e-b581-7c9584e4f236 for instance d15a359a-4afc-49df-9b68-66710d13891b on n-h1-853316-12 Oct 17 13:26:13.527375 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-be79e88f-ddf8-4a09-9ec5-ee6ab3f832c3 req-ce589662-9e29-4b2b-84de-7b97131071ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049750 Oct 17 13:26:13.528230 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3191/6683] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:13.545691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:13.546498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:13.556240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.556750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.557994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.558761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.559661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.560263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.599910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:13.608837 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-43cca547-cead-4bee-9764-3d15598079d5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.401854 Oct 17 13:26:13.609954 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3493/6684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:13 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:13.810991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:13.823840 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf45ee07-b9cd-4369-8428-4c9954ca26a7 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1313 microversion: 2.1 time: 0.283589 Oct 17 13:26:13.825616 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3192/6685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:13 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:14.177424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:14.178602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:14.185164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.185658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.186099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.186849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.187305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.187741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.448450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:14.458334 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-839a07de-4b8b-4c6d-a0b0-0b6eca79ed3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1366 microversion: 2.1 time: 0.287986 Oct 17 13:26:14.458932 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3494/6686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:14 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:14.634241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:14.634882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:14.642039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.642591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.643068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.645238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.645238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.645238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.820036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:14.833850 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74aa46db-3225-4c38-a3b6-c94af231b5e5 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.203694 Oct 17 13:26:14.834490 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3193/6687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:14 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:14.852028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:14.853010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:14.860645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.861213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.862524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.863421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.864077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.864847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.006563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:15.014740 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8dc558a1-d6c5-4127-af17-6711da76c0de tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1313 microversion: 2.1 time: 0.168760 Oct 17 13:26:15.015328 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3495/6688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:14 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:15.483325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:15.484102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:15.491795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.492347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.493041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.493955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.494470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.494921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.497923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:15.737401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:15.747430 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1da85214-9d03-44b4-9c30-80f7a74498e8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1366 microversion: 2.1 time: 0.268173 Oct 17 13:26:15.758680 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3194/6689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:15 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:15.861042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:15.861683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:15.869930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.870560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.871169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.871923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.872505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.872972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:16.019630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:16.031922 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0cf66062-81ca-4a2a-b0e4-8aaa075e0f4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.174685 Oct 17 13:26:16.048047 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3496/6690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:15 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:16.053170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:16.053942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:16.060978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.061478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.062194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:16.063078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.063626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.064219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:16.221212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:16.229482 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa59a974-5070-4889-b1f8-19b7b31aa191 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1313 microversion: 2.1 time: 0.181327 Oct 17 13:26:16.230048 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3195/6691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:16 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:16.772943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:16.773852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:16.780648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.781230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.781829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:16.783114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.785011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.786036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.061811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:17.062898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:17.067759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:17.075187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:17.086002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.087760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.089353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.091210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.092986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.094313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.097970 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ce89c92-a237-4c21-a79d-666459c70756 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1366 microversion: 2.1 time: 0.328713 Oct 17 13:26:17.108726 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3497/6692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:16 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:17.252963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:17.253572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:17.260132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.260893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.261494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.262305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.262772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.263191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.280180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:17.292483 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9c3d9cf2-cf38-4d77-b41a-d580cdaa0055 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.238890 Oct 17 13:26:17.293383 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3196/6693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:17 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:17.525442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:17.533461 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44fc09dc-5969-47af-89bb-1bebc4de9e7a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1313 microversion: 2.1 time: 0.284616 Oct 17 13:26:17.534729 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3498/6694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:17 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:17.740064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b0ca45f0-dd76-4bdb-9632-5f1d4eddb203 req-12ad2b2d-3d8b-4ec5-8bfc-13b77b17fe24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa4488d-15f6-4103-970f-83ab4b0283c5", "name": "network-vif-plugged", "status": "completed", "tag": "c40d3154-5570-487a-8814-972b9571e233"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:17.752042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0ca45f0-dd76-4bdb-9632-5f1d4eddb203 req-12ad2b2d-3d8b-4ec5-8bfc-13b77b17fe24 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.753420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0ca45f0-dd76-4bdb-9632-5f1d4eddb203 req-12ad2b2d-3d8b-4ec5-8bfc-13b77b17fe24 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.754107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b0ca45f0-dd76-4bdb-9632-5f1d4eddb203 req-12ad2b2d-3d8b-4ec5-8bfc-13b77b17fe24 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.767232 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b0ca45f0-dd76-4bdb-9632-5f1d4eddb203 req-12ad2b2d-3d8b-4ec5-8bfc-13b77b17fe24 service nova] Creating event network-vif-plugged:c40d3154-5570-487a-8814-972b9571e233 for instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 on n-h2-853316-12 Oct 17 13:26:17.773887 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b0ca45f0-dd76-4bdb-9632-5f1d4eddb203 req-12ad2b2d-3d8b-4ec5-8bfc-13b77b17fe24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040039 Oct 17 13:26:17.774887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3197/6695] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:18.125234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:18.126459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:18.133722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.134246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.134895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.135606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.136214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.136797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.299784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:18.309210 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-afffdf9b-486b-492e-a901-cb4637f4603a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1366 microversion: 2.1 time: 0.187073 Oct 17 13:26:18.310309 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3499/6696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:18 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:18.320368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:18.321644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:18.332446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.333168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.333797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.334727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.335353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.335974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.479413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:18.489708 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6836a389-18e4-4a3d-af58-87011c0a52f2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.175028 Oct 17 13:26:18.490368 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3198/6697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:18 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:18.561314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:18.562593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:18.574123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.575358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.576171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.577957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.578964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.579819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.868023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:18.877105 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2af53be0-a5fd-4b30-a068-d7c615c95c67 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1313 microversion: 2.1 time: 0.323391 Oct 17 13:26:18.890313 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3500/6698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:18 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:19.333563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:19.334432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:19.342368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.342892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.343356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.344344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.344850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.345310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.506431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:19.514920 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-08f41d07-d510-49e5-b2c3-327ba5bedc93 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1556 microversion: 2.1 time: 0.185720 Oct 17 13:26:19.515675 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3199/6699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:19 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:19.529601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:19.531250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:19.542242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.542658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.543415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.543656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:19.544568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.544837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:19.545537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.546324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.555340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.555931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.556313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.557387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.557743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.558416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.706606 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b3ad9e81-bf6c-4237-8afb-ede2b9c2fb36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167604 Oct 17 13:26:19.715206 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3200/6700] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:26:19 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:19.720337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:19.743286 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3485130-5fc8-405c-bffc-9e1d50fb5dc9 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.221335 Oct 17 13:26:19.744577 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3501/6701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:19 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:19.907137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:19.908080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:19.916502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.917326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.917817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.918830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.919588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.920057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:20.236132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:20.251142 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba25cc77-a465-4a3d-ba6c-74eb26fe144a tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1313 microversion: 2.1 time: 0.348039 Oct 17 13:26:20.255356 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3201/6702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:19 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:20.409868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-10434ffb-7d74-4114-a96c-a9ba7a428332 req-501a9051-d7d9-404e-a258-569b1e57cd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15a359a-4afc-49df-9b68-66710d13891b", "name": "network-vif-plugged", "status": "completed", "tag": "f4a5fd6e-984a-4f8e-b581-7c9584e4f236"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:20.429391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:20.430617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:20.434381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-10434ffb-7d74-4114-a96c-a9ba7a428332 req-501a9051-d7d9-404e-a258-569b1e57cd56 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:20.435484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-10434ffb-7d74-4114-a96c-a9ba7a428332 req-501a9051-d7d9-404e-a258-569b1e57cd56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:20.436208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-10434ffb-7d74-4114-a96c-a9ba7a428332 req-501a9051-d7d9-404e-a258-569b1e57cd56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:20.460959 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-10434ffb-7d74-4114-a96c-a9ba7a428332 req-501a9051-d7d9-404e-a258-569b1e57cd56 service nova] Creating event network-vif-plugged:f4a5fd6e-984a-4f8e-b581-7c9584e4f236 for instance d15a359a-4afc-49df-9b68-66710d13891b on n-h1-853316-12 Oct 17 13:26:20.468196 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-10434ffb-7d74-4114-a96c-a9ba7a428332 req-501a9051-d7d9-404e-a258-569b1e57cd56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065769 Oct 17 13:26:20.470290 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3502/6703] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:20.771589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:20.772231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:20.774663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:20.782519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:20.783034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:20.784528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:20.785310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:20.785801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:20.786286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:21.214412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:21.225991 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-668e655f-a773-481d-a7b0-889c62c04298 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1510 microversion: 2.1 time: 0.460381 Oct 17 13:26:21.227871 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3202/6704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:20 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:21.278382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:21.279265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:21.289843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:21.295377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:21.296224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:21.297252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:21.299466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:21.299926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:21.329420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c8003778-eac7-409e-81fe-f455797ad69a req-f95d3614-dcdf-4ec0-a518-cafdcd16ab2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa4488d-15f6-4103-970f-83ab4b0283c5", "tag": "c40d3154-5570-487a-8814-972b9571e233"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:21.340134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c8003778-eac7-409e-81fe-f455797ad69a req-f95d3614-dcdf-4ec0-a518-cafdcd16ab2f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:21.341026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c8003778-eac7-409e-81fe-f455797ad69a req-f95d3614-dcdf-4ec0-a518-cafdcd16ab2f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:21.341865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c8003778-eac7-409e-81fe-f455797ad69a req-f95d3614-dcdf-4ec0-a518-cafdcd16ab2f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:21.355531 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c8003778-eac7-409e-81fe-f455797ad69a req-f95d3614-dcdf-4ec0-a518-cafdcd16ab2f service nova] Creating event network-changed:c40d3154-5570-487a-8814-972b9571e233 for instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 on n-h2-853316-12 Oct 17 13:26:21.362363 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c8003778-eac7-409e-81fe-f455797ad69a req-f95d3614-dcdf-4ec0-a518-cafdcd16ab2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035667 Oct 17 13:26:21.363503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3203/6705] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:21.572886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:21.581311 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac4bb08b-a545-4eff-bd29-75a712f21d21 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1313 microversion: 2.1 time: 0.308013 Oct 17 13:26:21.594573 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3503/6706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:21 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:22.269761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:22.277286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:22.306933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.309542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.310801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.312031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.312031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.312506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.530996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:22.542053 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1dac424c-d143-4af9-8133-825e6a9e2b4e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1487 microversion: 2.1 time: 0.281709 Oct 17 13:26:22.546852 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3204/6707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:22 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1487 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:22.566144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-319579464"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:22.569505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:22.577584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.577584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.577584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.578307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.578765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.584599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.608071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:22.610241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:22.621770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.622937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.623894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.625300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.626500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.627485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.691320 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1bab3a3-6400-4df5-a822-861f9d61f993 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "PUT /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1059 microversion: 2.1 time: 0.129050 Oct 17 13:26:22.696325 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3504/6708] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:26:22 2022] PUT /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1059 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:22.715235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:22.716093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:22.724880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.725685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.726463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.727322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.727995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.728670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.889330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:22.901598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe8281a8-3f6f-483d-b510-708d5095d3d0 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1486 microversion: 2.1 time: 0.191116 Oct 17 13:26:22.902822 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3505/6709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:22 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1486 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:22.936385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:22.937265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:22.945509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:22.946330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.946835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.947434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.948151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.948601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.949213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.956601 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89c68506-53a9-4ec9-9b34-f11b2085fb2c tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1496 microversion: 2.1 time: 0.355364 Oct 17 13:26:22.963975 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3205/6710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:22 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1496 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:23.122527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:23.132625 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-140f0a0a-06d9-47c3-b8c1-e2e0b3e68823 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1486 microversion: 2.1 time: 0.205244 Oct 17 13:26:23.133378 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3506/6711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:22 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1486 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:23.156162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:23.157053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:23.164371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:23.164871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:23.165377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.166097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:23.166595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:23.167032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.196881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:23.292777 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2ea06be7-a565-40b2-8e98-33d2ddfde969 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 204 len: 0 microversion: 2.1 time: 0.140238 Oct 17 13:26:23.293491 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3206/6712] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:23 2022] DELETE /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:23.305859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:23.307138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:23.314022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:23.314700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:23.315367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.316384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:23.317056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:23.317673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.482699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:23.492689 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c211287b-7a1b-4f2a-bdf1-71e958cca6b4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1492 microversion: 2.1 time: 0.193852 Oct 17 13:26:23.506567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3507/6713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:23 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1492 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:23.539374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:23.540104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:23.547495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:23.548195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:23.548724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.550295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:23.550848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:23.551373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.585783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:23.678011 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5b1ebe16-1b50-437d-b852-6f68d1dbef3d tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 204 len: 0 microversion: 2.1 time: 0.142705 Oct 17 13:26:23.678869 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3207/6714] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:23 2022] DELETE /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:23.687043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:23.687665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:23.701368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:23.701859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:23.702336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.703049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:23.703505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:23.703927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.881693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:23.890565 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bf13292f-28a7-4274-b117-1c080d323590 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1502 microversion: 2.1 time: 0.207324 Oct 17 13:26:23.891457 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3508/6715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:23 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:24.519270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:24.521080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:24.529553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.530319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.531011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.531758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.532665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.533902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.804289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:24.813493 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c69833d4-4a8a-4cfb-b192-fb2f9e384211 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 200 len: 1492 microversion: 2.1 time: 0.299683 Oct 17 13:26:24.814398 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3208/6716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:24 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 1492 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:24.919016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:24.919716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:24.928356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.928854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.929490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.930417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.930809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.931436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.162662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6a3c2014-35af-4f83-abd2-e3fa6254b79c req-55a697d2-72aa-4b9f-a63d-c46c0b72907b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efda4db7-fc11-46b0-abba-7924ea8d9fb3", "name": "network-vif-deleted", "tag": "46603093-bf62-472d-9f25-dbac893b8c79"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:25.184279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6a3c2014-35af-4f83-abd2-e3fa6254b79c req-55a697d2-72aa-4b9f-a63d-c46c0b72907b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.190756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6a3c2014-35af-4f83-abd2-e3fa6254b79c req-55a697d2-72aa-4b9f-a63d-c46c0b72907b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.191378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6a3c2014-35af-4f83-abd2-e3fa6254b79c req-55a697d2-72aa-4b9f-a63d-c46c0b72907b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.209471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:25.233085 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6a3c2014-35af-4f83-abd2-e3fa6254b79c req-55a697d2-72aa-4b9f-a63d-c46c0b72907b service nova] Creating event network-vif-deleted:46603093-bf62-472d-9f25-dbac893b8c79 for instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 on n-h2-853316-12 Oct 17 13:26:25.244625 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6a3c2014-35af-4f83-abd2-e3fa6254b79c req-55a697d2-72aa-4b9f-a63d-c46c0b72907b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086048 Oct 17 13:26:25.245519 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3209/6717] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:25.320081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:25.322865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:25.332234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-368a4ed7-261d-41ca-aafa-eed7e1c94869 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1502 microversion: 2.1 time: 0.417237 Oct 17 13:26:25.351246 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3509/6718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:24 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1502 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:25.841956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:25.843702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:25.852770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.853279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.853728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.854554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.855019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.855513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.875766 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 HTTP/1.1 Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'efda4db7-fc11-46b0-abba-7924ea8d9fb3'} Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:25.878760 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a0a6258-9615-4a69-af41-565ce5493b2e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 404 len: 111 microversion: 2.1 time: 0.046188 Oct 17 13:26:25.886251 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3210/6719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:25 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:25.898512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:25.899018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:25.905591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.906079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.906721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.907420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.907873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.909127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.923602 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 HTTP/1.1 Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'efda4db7-fc11-46b0-abba-7924ea8d9fb3'} Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:25.926565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31e4e7d0-5ae8-4e0f-8a77-94915f3cfe84 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 404 len: 111 microversion: 2.1 time: 0.034408 Oct 17 13:26:25.930946 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3510/6720] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:25 2022] DELETE /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:25.937670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:25.938497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: efda4db7-fc11-46b0-abba-7924ea8d9fb3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:25.946493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.947004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.947486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.948366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.949115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.949792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.965793 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 HTTP/1.1 Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'efda4db7-fc11-46b0-abba-7924ea8d9fb3'} Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:25.967467 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance efda4db7-fc11-46b0-abba-7924ea8d9fb3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7477f92e-d7b0-46d8-80d7-3ecd7c134d8b tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3" status: 404 len: 111 microversion: 2.1 time: 0.036116 Oct 17 13:26:25.971343 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3211/6721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:25 2022] GET /compute/v2.1/servers/efda4db7-fc11-46b0-abba-7924ea8d9fb3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:25.977444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:25.977942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:25.984835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.985330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.985763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.986677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.987140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.987568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.001650 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 HTTP/1.1 Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '94cfa12d-32a2-4c6c-8339-e8f8cf464264'} Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.004416 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.008770 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fc7b4ad9-acca-467e-bfca-abd69cdcad9a tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 404 len: 111 microversion: 2.1 time: 0.032327 Oct 17 13:26:26.009533 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3511/6722] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:25 2022] DELETE /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.018988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.020212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 94cfa12d-32a2-4c6c-8339-e8f8cf464264] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.031072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.031638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.032093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.032851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.033407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.034608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.049770 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 HTTP/1.1 Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '94cfa12d-32a2-4c6c-8339-e8f8cf464264'} Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.051623 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 94cfa12d-32a2-4c6c-8339-e8f8cf464264 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.054995 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-424fde50-d405-4759-859c-32df95b02bdd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264" status: 404 len: 111 microversion: 2.1 time: 0.042220 Oct 17 13:26:26.055682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3212/6723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/94cfa12d-32a2-4c6c-8339-e8f8cf464264 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.063117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.063618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.071142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.071633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.072068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.072774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.073228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.073686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.088540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd HTTP/1.1 Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '3ef935a4-79af-4755-ac05-50fdce1b70bd'} Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.090393 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69a1ae84-5bac-4e61-8471-1eac2ad917f4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 404 len: 111 microversion: 2.1 time: 0.032695 Oct 17 13:26:26.093593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3512/6724] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:26 2022] DELETE /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:26:26.100737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.101549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 3ef935a4-79af-4755-ac05-50fdce1b70bd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.108372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.108994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.109524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.110380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.110985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.111612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.126570 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd HTTP/1.1 Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '3ef935a4-79af-4755-ac05-50fdce1b70bd'} Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.128675 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 3ef935a4-79af-4755-ac05-50fdce1b70bd could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b2f924eb-1a1f-4921-8f77-5309d9703801 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd" status: 404 len: 111 microversion: 2.1 time: 0.033527 Oct 17 13:26:26.134940 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3213/6725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/3ef935a4-79af-4755-ac05-50fdce1b70bd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.141388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.141881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.149333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.149821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.150302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.150990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.151439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.151864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.168922 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f HTTP/1.1 Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b3605b64-7077-46e8-8ca0-2279833fd52f'} Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.171126 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bdb714e5-156b-4a19-a05a-bd06530313ad tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 404 len: 111 microversion: 2.1 time: 0.034907 Oct 17 13:26:26.176287 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3513/6726] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:26 2022] DELETE /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.181828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.182493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: b3605b64-7077-46e8-8ca0-2279833fd52f] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.189135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.189713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.190201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.191093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.191892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.192537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.204182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4843c408-a057-4ba5-aeaf-0ed3734477f7 req-e6b0265e-4d76-41d1-af25-391653db2242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15a359a-4afc-49df-9b68-66710d13891b", "name": "network-vif-deleted", "tag": "f4a5fd6e-984a-4f8e-b581-7c9584e4f236"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:26.231013 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f HTTP/1.1 Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'b3605b64-7077-46e8-8ca0-2279833fd52f'} Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.233060 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.238320 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.238320 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.238320 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.238320 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.238320 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.238320 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. Oct 17 13:26:26.238320 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.239058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4843c408-a057-4ba5-aeaf-0ed3734477f7 req-e6b0265e-4d76-41d1-af25-391653db2242 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.239197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4843c408-a057-4ba5-aeaf-0ed3734477f7 req-e6b0265e-4d76-41d1-af25-391653db2242 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.240231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4843c408-a057-4ba5-aeaf-0ed3734477f7 req-e6b0265e-4d76-41d1-af25-391653db2242 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.241220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance b3605b64-7077-46e8-8ca0-2279833fd52f could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.242416 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-717415f6-26a4-4bb6-9802-20ebc1e7c654 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f" status: 404 len: 111 microversion: 2.1 time: 0.064745 Oct 17 13:26:26.243512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3214/6727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/b3605b64-7077-46e8-8ca0-2279833fd52f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.252200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.253063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.260290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.261134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.261792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.262755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.263463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.264170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.270436 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4843c408-a057-4ba5-aeaf-0ed3734477f7 req-e6b0265e-4d76-41d1-af25-391653db2242 service nova] Creating event network-vif-deleted:f4a5fd6e-984a-4f8e-b581-7c9584e4f236 for instance d15a359a-4afc-49df-9b68-66710d13891b on n-h1-853316-12 Oct 17 13:26:26.287479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4843c408-a057-4ba5-aeaf-0ed3734477f7 req-e6b0265e-4d76-41d1-af25-391653db2242 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089987 Oct 17 13:26:26.288653 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3514/6728] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:26.305196 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 HTTP/1.1 Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'd2c9d57a-5b9e-4f98-86df-ae06a65ee1d3'} Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.307166 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.311686 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.316122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.317690 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-99b7415c-37b7-490c-b2f0-fc0ce3cd6acd tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 404 len: 111 microversion: 2.1 time: 0.070016 Oct 17 13:26:26.319324 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3215/6729] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:26 2022] DELETE /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.327899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.328927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.336491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.337360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.338048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.338907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.339582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.340471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.358193 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.360619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 HTTP/1.1 Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd2c9d57a-5b9e-4f98-86df-ae06a65ee1d3'} Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.360885 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.367569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c995e918-231d-43f0-ac08-9dbaae9530a2 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3" status: 404 len: 111 microversion: 2.1 time: 0.039541 Oct 17 13:26:26.368472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.368574 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3515/6730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/d2c9d57a-5b9e-4f98-86df-ae06a65ee1d3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.371688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.372410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.374792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.375379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.376744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.378361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.379445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.379954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.380191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.380398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.381012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.381135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.381580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.382015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.404175 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 HTTP/1.1 Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '6ff62d7b-ad7f-4e1e-a208-fb9d01b68116'} Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.405837 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b5a7bbf-2f2c-46d6-be5e-78d6ca3d3250 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 404 len: 111 microversion: 2.1 time: 0.039675 Oct 17 13:26:26.410813 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3516/6731] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:26 2022] DELETE /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.417981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.418825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.427363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.427849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.428289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.429281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.429740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.430183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.439855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.440978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.441856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.442658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lazy-loading 'fault' on Instance uuid d15a359a-4afc-49df-9b68-66710d13891b {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:26:26.453301 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 HTTP/1.1 Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '6ff62d7b-ad7f-4e1e-a208-fb9d01b68116'} Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.457159 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance 6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b8617dda-8182-4368-a398-330fa4b46c9d tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116" status: 404 len: 111 microversion: 2.1 time: 0.046149 Oct 17 13:26:26.461456 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3517/6732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/6ff62d7b-ad7f-4e1e-a208-fb9d01b68116 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.469353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d804f5a-00c5-49b2-8aca-3b2da16a62e1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.469778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d804f5a-00c5-49b2-8aca-3b2da16a62e1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.475927 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-7d804f5a-00c5-49b2-8aca-3b2da16a62e1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d804f5a-00c5-49b2-8aca-3b2da16a62e1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f HTTP/1.1 Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f'} Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.477458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d804f5a-00c5-49b2-8aca-3b2da16a62e1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d804f5a-00c5-49b2-8aca-3b2da16a62e1 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f" status: 404 len: 111 microversion: 2.1 time: 0.015558 Oct 17 13:26:26.484345 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3518/6733] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:26 2022] DELETE /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:26:26.491833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e2d201c7-c7ea-41be-b2d7-54576d89f623 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.492331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e2d201c7-c7ea-41be-b2d7-54576d89f623 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e2d201c7-c7ea-41be-b2d7-54576d89f623 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e2d201c7-c7ea-41be-b2d7-54576d89f623 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f HTTP/1.1 Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f'} Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.501862 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e2d201c7-c7ea-41be-b2d7-54576d89f623 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:26.507918 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e2d201c7-c7ea-41be-b2d7-54576d89f623 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f" status: 404 len: 111 microversion: 2.1 time: 0.016616 Oct 17 13:26:26.510656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.518063 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3519/6734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/a6d6bd65-f7d0-46b7-877b-ab32ca27fb4f => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:26.520882 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc4f8afc-a0bc-4057-9f46-bf35c9c1d608 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1303 microversion: 2.1 time: 0.165904 Oct 17 13:26:26.524039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.524552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.530786 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3216/6735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:26.531407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.531912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.532357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.533076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.533541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.533971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.569879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:26.659751 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a4f7154-fee3-4f55-90b0-19bd743807c4 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 204 len: 0 microversion: 2.1 time: 0.139862 Oct 17 13:26:26.660326 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3520/6736] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:26 2022] DELETE /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:26.670260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.670473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.678712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.679287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.679849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.680663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.681188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.681629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.932860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.942050 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d7c07a7-2cda-43a8-a6a5-15b8fa1965f6 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1479 microversion: 2.1 time: 0.276222 Oct 17 13:26:26.942700 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3217/6737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1479 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:27.545774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:27.546636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:27.553681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.554202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.554661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.555359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.555814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.556274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.591411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.591896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.592335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.592783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lazy-loading 'fault' on Instance uuid d15a359a-4afc-49df-9b68-66710d13891b {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:26:27.638445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7507bede7554576bda2726b4702f9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce200b7601234bd1bc1b6ffea2f166be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:27.656403 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-de291ccf-e319-47e1-886f-d7738fd727ef tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 200 len: 1303 microversion: 2.1 time: 0.114748 Oct 17 13:26:27.669167 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3521/6738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:27 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:27.972844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:27.973608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:27.984605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.985075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.985551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.987454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.988427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.988621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:28.621566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:28.629929 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3acac6f5-e603-4b0b-8da1-d847f3444d10 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1479 microversion: 2.1 time: 0.662629 Oct 17 13:26:28.630950 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3218/6739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:27 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1479 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:28.685008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:28.685890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] [instance: d15a359a-4afc-49df-9b68-66710d13891b] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:28.693841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:28.694676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:28.695116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:28.696029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:28.696484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:28.696936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:28.712960 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] HTTP exception thrown: Instance d15a359a-4afc-49df-9b68-66710d13891b could not be found. Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Request method failure captured: Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b HTTP/1.1 Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVfP85NZYjwBg2DFEYQopFnmR9_8E9SgNLVB9EYY3JtMWNdWryYX7lpdI2saX5bqlW1hG2jHOyAb-3skHpI9dXAe3JvxPDURHnII264DUo57gIWqtIZ3HFxA4RinaMICCJv63jkh02xFx04O14GkrHHYCNsy25KzU0VrTeuxtB5sqgg Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ce200b7601234bd1bc1b6ffea2f166be Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-VolumesActionsTest-1380562738 Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ce200b7601234bd1bc1b6ffea2f166be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ce200b7601234bd1bc1b6ffea2f166be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ce200b7601234bd1bc1b6ffea2f166be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ce200b7601234bd1bc1b6ffea2f166be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-VolumesActionsTest-1380562738 Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ce200b7601234bd1bc1b6ffea2f166be Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-VolumesActionsTest-1380562738 Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-VolumesActionsTest-1380562738-project Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: f7507bede7554576bda2726b4702f9ff Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-VolumesActionsTest-1380562738-project Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d15a359a-4afc-49df-9b68-66710d13891b could not be found. Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd15a359a-4afc-49df-9b68-66710d13891b'} Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15a359a-4afc-49df-9b68-66710d13891b could not be found. Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15a359a-4afc-49df-9b68-66710d13891b could not be found. Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:28.714702 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15a359a-4afc-49df-9b68-66710d13891b could not be found. Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] Returning 404 to user: Instance d15a359a-4afc-49df-9b68-66710d13891b could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:28.724181 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-782398d5-7db0-42f6-b441-f8ec6a780454 tempest-VolumesActionsTest-1380562738 tempest-VolumesActionsTest-1380562738-project] 10.222.0.27 "GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b" status: 404 len: 111 microversion: 2.1 time: 0.038914 Oct 17 13:26:28.726896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3522/6740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:28 2022] GET /compute/v2.1/servers/d15a359a-4afc-49df-9b68-66710d13891b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:29.202275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9c7ef690-1b52-48b2-85f6-f35a0afec289 req-fde29c1c-2693-4c3c-aa4a-c4b50807810d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d99fe1-8d75-410e-bbb4-af46d70d51e4", "name": "network-vif-deleted", "tag": "85d85466-afef-43ce-be91-fa3b1c75e50b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:29.219783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9c7ef690-1b52-48b2-85f6-f35a0afec289 req-fde29c1c-2693-4c3c-aa4a-c4b50807810d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.220290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9c7ef690-1b52-48b2-85f6-f35a0afec289 req-fde29c1c-2693-4c3c-aa4a-c4b50807810d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.221285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9c7ef690-1b52-48b2-85f6-f35a0afec289 req-fde29c1c-2693-4c3c-aa4a-c4b50807810d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.245749 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9c7ef690-1b52-48b2-85f6-f35a0afec289 req-fde29c1c-2693-4c3c-aa4a-c4b50807810d service nova] Creating event network-vif-deleted:85d85466-afef-43ce-be91-fa3b1c75e50b for instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 on n-h1-853316-12 Oct 17 13:26:29.265763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9c7ef690-1b52-48b2-85f6-f35a0afec289 req-fde29c1c-2693-4c3c-aa4a-c4b50807810d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067026 Oct 17 13:26:29.267460 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3219/6741] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:29.656401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:29.657035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:29.671860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.672438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.673291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.675611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.676324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.677217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.736246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.736913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.737507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.738021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lazy-loading 'fault' on Instance uuid d7d99fe1-8d75-410e-bbb4-af46d70d51e4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:26:29.844322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b89f4a38d474d3ea520b8cea339e400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82957ceca74450ca15f0ae6ffe8672a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:29.856609 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c76bb7c8-2172-4423-ab89-458ba979280e tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 200 len: 1282 microversion: 2.1 time: 0.204369 Oct 17 13:26:29.858140 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3523/6742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:29 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 1282 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:30.901970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:30.902939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] [instance: d7d99fe1-8d75-410e-bbb4-af46d70d51e4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:30.914132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.915210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.915922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.917848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.918431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.918953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.948036 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] HTTP exception thrown: Instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 could not be found. Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Request method failure captured: Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 HTTP/1.1 Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVcy5YbAirXLerpGV64kfrLj3u1mW76uvI91m3xtBbfpZR3UL7CgzesZ-Ixk4cD53R1H-My0dkKN0tLbiZOr20oQuHbXoa1GEFe6dRqvmLcfWT4rkZEzPUFqolGyRU1Ui3NJ2ZaTP7qLx7Tq_eBjPkYjk17mRgktxQworPS1JVqN7ks Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a82957ceca74450ca15f0ae6ffe8672a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a82957ceca74450ca15f0ae6ffe8672a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersTestJSON-1262367617 Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a82957ceca74450ca15f0ae6ffe8672a Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersTestJSON-1262367617 Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 7b89f4a38d474d3ea520b8cea339e400 Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersTestJSON-1262367617-project Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 could not be found. Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'd7d99fe1-8d75-410e-bbb4-af46d70d51e4'} Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 could not be found. Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 could not be found. Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:30.950479 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:30.954602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:30.954602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:30.954602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:30.954602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:30.954602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:30.954602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 could not be found. Oct 17 13:26:30.954602 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:30.955626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] Returning 404 to user: Instance d7d99fe1-8d75-410e-bbb4-af46d70d51e4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:30.956700 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44e2e4a7-0edc-4366-9357-1d497b44a070 tempest-ServersTestJSON-1262367617 tempest-ServersTestJSON-1262367617-project] 10.222.0.27 "GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4" status: 404 len: 111 microversion: 2.1 time: 0.060952 Oct 17 13:26:30.960218 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3220/6743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:30 2022] GET /compute/v2.1/servers/d7d99fe1-8d75-410e-bbb4-af46d70d51e4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:39.352419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1b91ae7-12ff-4194-a87c-65a7b16f645c tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Action: 'create', calling method: .version_select at 0x7fa820950790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1514316386", "metadata": {"Type": "work"}}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:39.737002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:39.849579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:40.167569 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b1b91ae7-12ff-4194-a87c-65a7b16f645c tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.992074 Oct 17 13:26:40.169160 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3524/6744] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 17 13:26:39 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 995 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 13:26:40.182202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8564b021-27ee-4f96-9b13-0d454ffbf1de tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa82039b4c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:40.277968 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8564b021-27ee-4f96-9b13-0d454ffbf1de tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 200 len: 353 microversion: 2.1 time: 0.099420 Oct 17 13:26:40.286928 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3221/6745] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:40 2022] GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:41.296366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e825d4e0-9a10-40ac-b073-d43de5c2bbef tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa820873940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:41.419034 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e825d4e0-9a10-40ac-b073-d43de5c2bbef tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 200 len: 353 microversion: 2.1 time: 0.129894 Oct 17 13:26:41.419615 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3525/6746] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:41 2022] GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:42.435677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7528570d-3586-4feb-9199-bfda0ae9b647 tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa8204cd310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:42.449765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:42.450953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=37 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:42.574379 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7528570d-3586-4feb-9199-bfda0ae9b647 tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 200 len: 354 microversion: 2.1 time: 0.142827 Oct 17 13:26:42.575145 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3222/6747] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:42 2022] GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:42.597552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5e18329-431a-4a51-97c0-17a46e3c3f74 tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa8214dc4c0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:42.724656 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c5e18329-431a-4a51-97c0-17a46e3c3f74 tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 200 len: 354 microversion: 2.1 time: 0.140026 Oct 17 13:26:42.725631 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3526/6748] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:42 2022] GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:42.749180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f17bb8cc-5ec9-4c53-9cf9-859daa16da42 tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa820452e50>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:42.915631 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f17bb8cc-5ec9-4c53-9cf9-859daa16da42 tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 202 len: 0 microversion: 2.1 time: 0.172413 Oct 17 13:26:42.917503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3223/6749] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:26:42 2022] DELETE /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:26:42.936001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18564477-310b-4c3d-a0d1-95ce75f6471c tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa8209500d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:43.051979 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18564477-310b-4c3d-a0d1-95ce75f6471c tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 200 len: 353 microversion: 2.1 time: 0.128210 Oct 17 13:26:43.052988 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3527/6750] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:42 2022] GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:44.075092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-471566d5-dcb8-44c3-852f-cfd26195bfa6 tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa8204189d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:44.170816 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-471566d5-dcb8-44c3-852f-cfd26195bfa6 tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 200 len: 353 microversion: 2.1 time: 0.102046 Oct 17 13:26:44.171755 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3224/6751] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:44 2022] GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:45.185081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20ab7b9a-ad47-4bdc-8aa3-e560c9960dfc tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa8209e9790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:45.310077 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20ab7b9a-ad47-4bdc-8aa3-e560c9960dfc tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 200 len: 353 microversion: 2.1 time: 0.127978 Oct 17 13:26:45.311000 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3528/6752] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:45 2022] GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:46.332170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b483778-58c6-41ed-af78-725bc9e6697e tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Calling method '.version_select at 0x7fa820418280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.387027 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-8b483778-58c6-41ed-af78-725bc9e6697e tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] HTTP exception thrown: Volume 2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 could not be found. Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b483778-58c6-41ed-af78-725bc9e6697e tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Request method failure captured: Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 HTTP/1.1 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVgP7uWTK6e9RaecrB3eXMIuXOawIBEoKp2qUDit_RGuAm_w06z5bvtz11GKzgFm9QE5puSRjJ4HS_N3aX3ril6BAKnS7NW4id-qpRqBLiPY6_dal-aBmZYJj7YtxvNtwU0SeKZo6kTmMmGr6y2H6XbTflSSLHQrwm3jaA3SxfuRRc0 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 50643c885dbf4697b8907882e44c80ab Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesGetTestJSON-507367544 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50643c885dbf4697b8907882e44c80ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50643c885dbf4697b8907882e44c80ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50643c885dbf4697b8907882e44c80ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50643c885dbf4697b8907882e44c80ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesGetTestJSON-507367544 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 50643c885dbf4697b8907882e44c80ab Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesGetTestJSON-507367544 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesGetTestJSON-507367544-project Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 9842115ba8cc419b8b15f1e07178c921 Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesGetTestJSON-507367544-project Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: exception: Volume 2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 could not be found. Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7'} Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 could not be found. (HTTP 404) (Request-ID: req-e87e8a1b-fedf-42d9-a403-388755accd56) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:26:46.394656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 could not be found. Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 could not be found. Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 could not be found. Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b483778-58c6-41ed-af78-725bc9e6697e tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] Returning 404 to user: Volume 2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b483778-58c6-41ed-af78-725bc9e6697e tempest-VolumesGetTestJSON-507367544 tempest-VolumesGetTestJSON-507367544-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7" status: 404 len: 109 microversion: 2.1 time: 0.076415 Oct 17 13:26:46.400258 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3225/6753] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/v2.1/os-volumes/2d6b00f9-629e-4fab-9fff-a1f1dac6a3f7 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:56.094421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.095968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.117916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.120961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.122021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.124867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.129199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.130003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.221684 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69f654db-a2a3-4bd6-a3d2-e7553e4b2f8e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5/ips" status: 200 len: 150 microversion: 2.1 time: 0.133625 Oct 17 13:26:56.223375 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3529/6754] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5/ips => generated 150 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:56.238237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:56.250721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.271130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.271754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.272232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.273379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.274066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.276080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.525794 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Invalid volume: volume 092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8 is already attached to instances: abe66c5b-310b-4e0c-a261-16961bc6f6b4 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5/os-volume_attachments HTTP/1.1 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 74 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: {"volumeAttachment": {"volumeId": "092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8"}} Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid volume: volume 092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8 is already attached to instances: abe66c5b-310b-4e0c-a261-16961bc6f6b4 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '3aa4488d-15f6-4103-970f-83ab4b0283c5', 'body': {'volumeAttachment': {'volumeId': '092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8'}}} Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8 is already attached to instances: abe66c5b-310b-4e0c-a261-16961bc6f6b4 Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:26:56.532482 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8 is already attached to instances: abe66c5b-310b-4e0c-a261-16961bc6f6b4 Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8 is already attached to instances: abe66c5b-310b-4e0c-a261-16961bc6f6b4 Oct 17 13:26:56.537079 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:26:56.539006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 400 to user: Invalid volume: volume 092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8 is already attached to instances: abe66c5b-310b-4e0c-a261-16961bc6f6b4 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:56.540445 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-667c8c62-4b8b-4867-a72e-400cb1080605 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.308607 Oct 17 13:26:56.551144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.551782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.556273 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3226/6755] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:26:56 2022] POST /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5/os-volume_attachments => generated 174 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:26:56.570497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.572984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.577197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.578421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.579099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.582444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.667589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:56.886749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5fee10c0-683b-462d-917d-c639df69b216 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 204 len: 0 microversion: 2.1 time: 0.340291 Oct 17 13:26:56.890962 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3530/6756] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:56 2022] DELETE /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:26:56.907874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.910104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.937639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.941903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.942673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.946112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.946981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.950468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.209558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:57.221297 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-364273db-c04f-4104-9251-8177a903a128 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1681 microversion: 2.1 time: 0.321502 Oct 17 13:26:57.222818 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3227/6757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:58.250410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:58.251297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:58.276145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:58.278323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:58.278971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.284967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:58.292763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:58.293437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.728633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:58.755582 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-92bb07a3-2efa-475d-8d2d-62a7fe050ec2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1681 microversion: 2.1 time: 0.508536 Oct 17 13:26:58.766239 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3531/6758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:58 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1681 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:59.836982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.838287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:59.865747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.865986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.876140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.881793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.883482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.885072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.061253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c0e2dd01-a667-4984-832b-63954f5f8f17 req-e8a9f484-3cfa-4310-85ad-35c99bc54030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa4488d-15f6-4103-970f-83ab4b0283c5", "name": "network-vif-deleted", "tag": "c40d3154-5570-487a-8814-972b9571e233"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:00.125508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c0e2dd01-a667-4984-832b-63954f5f8f17 req-e8a9f484-3cfa-4310-85ad-35c99bc54030 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.127342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.130744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c0e2dd01-a667-4984-832b-63954f5f8f17 req-e8a9f484-3cfa-4310-85ad-35c99bc54030 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.131441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c0e2dd01-a667-4984-832b-63954f5f8f17 req-e8a9f484-3cfa-4310-85ad-35c99bc54030 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.144740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8724551e-8213-4039-ae7e-a5dbc25ebf7b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1614 microversion: 2.1 time: 0.326732 Oct 17 13:27:00.170588 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3228/6759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1614 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:00.178975 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c0e2dd01-a667-4984-832b-63954f5f8f17 req-e8a9f484-3cfa-4310-85ad-35c99bc54030 service nova] Creating event network-vif-deleted:c40d3154-5570-487a-8814-972b9571e233 for instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 on n-h2-853316-12 Oct 17 13:27:00.193452 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c0e2dd01-a667-4984-832b-63954f5f8f17 req-e8a9f484-3cfa-4310-85ad-35c99bc54030 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136303 Oct 17 13:27:00.198259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3532/6760] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:27:01.177625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:01.179915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:01.204045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.210290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.210996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.211914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.212535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.213128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.315863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.317167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.318514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.319743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lazy-loading 'fault' on Instance uuid 3aa4488d-15f6-4103-970f-83ab4b0283c5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:27:01.454300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:01.481806 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b8096947-40c1-4791-88cc-25c03c1677f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 200 len: 1331 microversion: 2.1 time: 0.312387 Oct 17 13:27:01.483053 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3229/6761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:01 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 1331 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:02.510566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:02.511581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:02.530748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.531454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.532729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.536603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.537562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.540087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.571662 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 HTTP/1.1 Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '3aa4488d-15f6-4103-970f-83ab4b0283c5'} Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:02.574417 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:02.582054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:02.582054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:02.582054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:02.582054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:02.582054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:02.582054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:27:02.582054 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:02.584888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:02.586045 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-174e8b8d-b43e-4a4d-9db2-0f1a9edef1e7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 404 len: 111 microversion: 2.1 time: 0.080643 Oct 17 13:27:02.591668 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3533/6762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:02 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:02.598114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bbacb21a-11f0-421a-a301-f7ad812645b5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '.version_select at 0x7fa81bdf2dc0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:02.646739 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bbacb21a-11f0-421a-a301-f7ad812645b5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-710317149" status: 202 len: 0 microversion: 2.1 time: 0.052623 Oct 17 13:27:02.650338 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3230/6763] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 13:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-710317149 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:27:03.811026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:03.812215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:03.821404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:03.822152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:03.822829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:03.823731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:03.824351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:03.824927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:03.953557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lazy-loading 'services' on Instance uuid abe66c5b-310b-4e0c-a261-16961bc6f6b4 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:27:04.091829 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aea8c3e6-2c58-4e5c-8598-9435a015a197 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments/092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8" status: 202 len: 0 microversion: 2.1 time: 0.284783 Oct 17 13:27:04.092636 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3534/6764] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:27:03 2022] DELETE /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments/092c3eee-5be4-41ab-8dc9-8b2d0b60e4c8 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:27:04.108422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:04.115058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:04.127983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:04.130239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:04.131084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:04.132937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:04.133800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:04.134878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:04.245846 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e7b7252-4391-47f9-b592-76310101a4c1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148385 Oct 17 13:27:04.246487 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3231/6765] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:27:04 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:05.264347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:05.267878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:05.295821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.296321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.296768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.297496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.304188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.304736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.397514 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f3502189-c81d-433b-bfd2-d44b57243e79 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139314 Oct 17 13:27:05.402571 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3535/6766] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:27:05 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:06.409526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:06.411820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:06.434068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:06.435235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:06.436291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:06.447860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:06.448977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:06.449808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:06.545681 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15080990-e8d0-477a-895b-bee5dbf7e67f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140213 Oct 17 13:27:06.546736 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3232/6767] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:27:06 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:27:07.564972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:07.567439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:07.588756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.589528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.593786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.595040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.595811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.596712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.694861 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e12be5ff-f578-48a7-9c19-7712138b5ade tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137643 Oct 17 13:27:07.695967 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3536/6768] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:27:07 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:08.707762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:08.711040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:08.718700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:08.719922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:08.721155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:08.722319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:08.723431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:08.724950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:08.800983 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0d67ad90-4c10-4879-a7bf-7d50026fdb60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097414 Oct 17 13:27:08.811133 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3233/6769] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:27:08 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:09.819963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:09.829451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:09.849790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:09.851111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:09.872694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:09.873409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:09.874028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:09.876693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:09.975287 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf13073e-4b04-49f7-9bb5-eeaf38da006c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161952 Oct 17 13:27:09.984078 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3537/6770] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:27:09 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:10.993404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:10.996814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:11.015903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.019273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.020180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.023296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.024110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.024781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.123692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62059acd-f909-4d56-b6e1-b0a8df302189 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135974 Oct 17 13:27:11.124292 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3234/6771] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:27:10 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:12.136700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:12.140342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:12.148832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.149592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.150053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.150808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.151266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.151695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.230403 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-40d358e4-e7ec-4a56-b2ce-964b2d25ef77 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097944 Oct 17 13:27:12.231219 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3538/6772] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:27:12 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:27:12.324452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:12.325000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:12.335054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.335568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.336017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.336750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.337452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.338070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.371420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:12.522043 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7aa0b0f1-06b0-47f5-a5ce-12a8cf703f36 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 204 len: 0 microversion: 2.1 time: 0.197490 Oct 17 13:27:12.522043 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3235/6773] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:27:12 2022] DELETE /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:27:12.526980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:12.527614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:12.535220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.535790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.536240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.536982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.537559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.538221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.145166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:13.156151 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7db80cfc-1f22-4816-852c-8621f471c8ad tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1682 microversion: 2.1 time: 0.634154 Oct 17 13:27:13.157495 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3539/6774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:12 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1682 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:14.185733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:14.186603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:14.198635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.199755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.200430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.201378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.202303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.203276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.431294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:14.443352 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-86fed159-04ca-411e-96ea-a5fc52d06cf1 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1682 microversion: 2.1 time: 0.262906 Oct 17 13:27:14.444014 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3236/6775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:14 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1682 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:15.474151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:15.474947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:15.494807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.495391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.495848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.496738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.500407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.500844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.659757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:15.685876 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b7f1e1c-f089-4807-9e9d-70723e74b044 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 200 len: 1614 microversion: 2.1 time: 0.218323 Oct 17 13:27:15.686944 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3540/6776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:15 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 1614 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:15.761551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d9013428-d382-4d58-905c-2f5a5067e0df req-5d3e9551-3e1e-458e-8f86-070bdee6220a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe66c5b-310b-4e0c-a261-16961bc6f6b4", "name": "network-vif-deleted", "tag": "2c309a3d-7109-4ba2-9bdd-269aa28c310c"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:15.808608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d9013428-d382-4d58-905c-2f5a5067e0df req-5d3e9551-3e1e-458e-8f86-070bdee6220a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.809072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d9013428-d382-4d58-905c-2f5a5067e0df req-5d3e9551-3e1e-458e-8f86-070bdee6220a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.809518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d9013428-d382-4d58-905c-2f5a5067e0df req-5d3e9551-3e1e-458e-8f86-070bdee6220a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.848198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d9013428-d382-4d58-905c-2f5a5067e0df req-5d3e9551-3e1e-458e-8f86-070bdee6220a service nova] Creating event network-vif-deleted:2c309a3d-7109-4ba2-9bdd-269aa28c310c for instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 on n-h2-853316-12 Oct 17 13:27:15.873944 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d9013428-d382-4d58-905c-2f5a5067e0df req-5d3e9551-3e1e-458e-8f86-070bdee6220a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116186 Oct 17 13:27:15.874801 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3237/6777] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:16.717094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:16.718542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:16.737082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.739015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.740595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.743960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.745242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.745886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.765282 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 HTTP/1.1 Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'abe66c5b-310b-4e0c-a261-16961bc6f6b4'} Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:16.767731 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:16.771436 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:16.771436 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:16.771436 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:16.771436 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:16.771436 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:16.771436 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:27:16.771436 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:16.773936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:16.775124 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b83944a-f630-4340-a0ca-a56c8649610c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 404 len: 111 microversion: 2.1 time: 0.063437 Oct 17 13:27:16.776328 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3541/6778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:16 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:27:16.788153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc28da79-9332-47bb-bc54-e0b24d6ed145 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '.version_select at 0x7fa8203df700>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:16.826678 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc28da79-9332-47bb-bc54-e0b24d6ed145 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-666507356" status: 202 len: 0 microversion: 2.1 time: 0.043864 Oct 17 13:27:16.827811 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3238/6779] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 13:27:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-666507356 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:27:18.040521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e123d6f6-6150-40d5-9b75-8728e9a437bd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: .version_select at 0x7fa820950e50>, body: {"keypair": {"name": "tempest-keypair-1232896935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyVe9d/UpSzoTNT2or1+YgxgirbULSagt9CCpwboYRSIynuB/p1e7kR/LNOUH4ctGuZ1CAtNtUkM4G6B1ICBWldFZbafbuiOAZZH0idCBjM5Wdc7dgOsVlhZ5z0/r//vQ=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:18.066977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-e123d6f6-6150-40d5-9b75-8728e9a437bd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for project 3bc91c516177497fa5d502d401b13efa. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:18.075785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-e123d6f6-6150-40d5-9b75-8728e9a437bd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for user 6a7a84e3905a4b5e887825b601e3d964 and project 3bc91c516177497fa5d502d401b13efa. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:18.113024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e123d6f6-6150-40d5-9b75-8728e9a437bd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076818 Oct 17 13:27:18.114527 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3542/6780] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:27:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:21.099293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-278800216", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb30fe9b-9188-4fd9-81ae-fbd2ab091675"}], "security_groups": [{"name": "tempest-securitygroup--1377621908"}], "key_name": "tempest-keypair-1232896935", "user_data": "}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:21.313149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] validate_networks() for [('fb30fe9b-9188-4fd9-81ae-fbd2ab091675', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:22.034297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:22.034747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:22.035280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:22.035707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:22.036179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:22.048038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.049614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.050318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.051687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.052336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.053222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.079414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for project 3bc91c516177497fa5d502d401b13efa. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:22.088860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for user 6a7a84e3905a4b5e887825b601e3d964 and project 3bc91c516177497fa5d502d401b13efa. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:22.113507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:22.117467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:22.200793 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c33c5e7c-40c9-4231-901e-b85c361a5f05 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.108533 Oct 17 13:27:22.204042 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3239/6781] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:22.217384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-012c3eae-6060-4ee9-970c-dda2238c78ab tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:22.218009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-012c3eae-6060-4ee9-970c-dda2238c78ab tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:22.348122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-012c3eae-6060-4ee9-970c-dda2238c78ab tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:22.357282 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-012c3eae-6060-4ee9-970c-dda2238c78ab tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1241 microversion: 2.1 time: 0.144557 Oct 17 13:27:22.366402 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3543/6782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:22 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:23.385790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:23.386799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:23.405784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.410627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.412375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.414990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.416252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.417661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.712546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:23.739721 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48addfb8-f6ad-4bc3-a675-a24971a84b3b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1293 microversion: 2.1 time: 0.359607 Oct 17 13:27:23.740756 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3240/6783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:23 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1293 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:24.780725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:24.781641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:24.798626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.799722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.800094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.801040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.801681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.802301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.985688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:25.007653 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4f6d065c-e871-45a9-b4b0-39579a09c54e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1299 microversion: 2.1 time: 0.231940 Oct 17 13:27:25.010389 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3544/6784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:24 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:26.050147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:26.052910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:26.071011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.072062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.072954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.073916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.074565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.075168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.437623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:26.462706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:26.469479 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f729970-8347-473a-8b5b-0173b150683e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1367 microversion: 2.1 time: 0.424543 Oct 17 13:27:26.470958 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3241/6785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:26 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:26.897997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-36171703-5905-4b1d-9b14-bb2a3996c0c0 req-54b35f86-3eb0-475c-bb00-0ceff71f228d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5b79d6-ba94-43d7-acb5-ec175c05cf38", "tag": "068d9ccc-38e4-4659-bc6a-8de3400007ce"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:26.917790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:26.929690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-36171703-5905-4b1d-9b14-bb2a3996c0c0 req-54b35f86-3eb0-475c-bb00-0ceff71f228d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.930742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-36171703-5905-4b1d-9b14-bb2a3996c0c0 req-54b35f86-3eb0-475c-bb00-0ceff71f228d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.931465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-36171703-5905-4b1d-9b14-bb2a3996c0c0 req-54b35f86-3eb0-475c-bb00-0ceff71f228d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.948670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:26.973854 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-36171703-5905-4b1d-9b14-bb2a3996c0c0 req-54b35f86-3eb0-475c-bb00-0ceff71f228d service nova] Creating event network-changed:068d9ccc-38e4-4659-bc6a-8de3400007ce for instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 on n-h2-853316-12 Oct 17 13:27:26.983940 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-36171703-5905-4b1d-9b14-bb2a3996c0c0 req-54b35f86-3eb0-475c-bb00-0ceff71f228d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093113 Oct 17 13:27:26.985594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3545/6786] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:27.514263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:27.516297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:27.521053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:27.534637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:27.536003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:27.536695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:27.537667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:27.538430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:27.539054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:27.961143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:27.994117 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d7aa146-b8d4-4ba7-b64e-3984396e26e9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1367 microversion: 2.1 time: 0.486105 Oct 17 13:27:27.995508 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3242/6787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:27 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:29.036644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:29.037975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:29.050213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.050784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.051294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.052075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.052598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.053093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.456509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:29.472664 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b4808847-a84f-4f0c-8573-bbb58311d326 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1367 microversion: 2.1 time: 0.441165 Oct 17 13:27:29.473269 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3546/6788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:29 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:29.756070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:29.757390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:29.785702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.786721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.787560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.788935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.789725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.790545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.846781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:29.976745 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b87fb28e-e4ed-4437-b1d4-e1a61271879e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 204 len: 0 microversion: 2.1 time: 0.695885 Oct 17 13:27:29.980991 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3243/6789] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:27:29 2022] DELETE /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:27:29.986122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:29.988414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:30.000912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:30.002594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:30.004384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:30.005195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:30.005780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:30.006111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:30.250205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:30.267847 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b46b801a-d4ee-44e1-b49a-0ec7090f13ee tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1574 microversion: 2.1 time: 0.284449 Oct 17 13:27:30.273143 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3547/6790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:29 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1574 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:30.509337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:30.511935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:30.529344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:30.530540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:30.531774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:30.534960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:30.536997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:30.538649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:30.877594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:30.896868 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55ebe270-9231-4c50-aa28-db2af1f45486 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1367 microversion: 2.1 time: 0.399887 Oct 17 13:27:30.897680 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3244/6791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:30 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:31.308940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:31.311004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:31.327533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.328747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.330260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.332619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.333963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.335126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.610084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:31.624144 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-28a498b2-2271-4755-8662-019c37c67a8e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1574 microversion: 2.1 time: 0.319362 Oct 17 13:27:31.625852 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3548/6792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:31 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1574 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:31.926749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:31.927686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:31.940341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.943999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.952532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.953830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.954477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.955085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.069988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:32.102640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:32.255386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f6888bc1-62e3-4c6c-8920-97cebb5e3376 req-fdedd401-1576-4f7e-849d-02e4714690b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5b79d6-ba94-43d7-acb5-ec175c05cf38", "name": "network-vif-plugged", "status": "completed", "tag": "068d9ccc-38e4-4659-bc6a-8de3400007ce"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:32.273588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f6888bc1-62e3-4c6c-8920-97cebb5e3376 req-fdedd401-1576-4f7e-849d-02e4714690b7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.274088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f6888bc1-62e3-4c6c-8920-97cebb5e3376 req-fdedd401-1576-4f7e-849d-02e4714690b7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.274636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f6888bc1-62e3-4c6c-8920-97cebb5e3376 req-fdedd401-1576-4f7e-849d-02e4714690b7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.306316 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f6888bc1-62e3-4c6c-8920-97cebb5e3376 req-fdedd401-1576-4f7e-849d-02e4714690b7 service nova] Creating event network-vif-plugged:068d9ccc-38e4-4659-bc6a-8de3400007ce for instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 on n-h2-853316-12 Oct 17 13:27:32.318625 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f6888bc1-62e3-4c6c-8920-97cebb5e3376 req-fdedd401-1576-4f7e-849d-02e4714690b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067510 Oct 17 13:27:32.322907 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3549/6793] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:27:32.603175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:32.616924 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-064eaf26-3964-43b6-b8ff-1f8a312fcf71 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1367 microversion: 2.1 time: 0.696530 Oct 17 13:27:32.620175 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3245/6794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:31 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1367 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:32.658584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:32.659311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:32.664360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:32.678641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.679292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.680011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.682961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.684831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.685969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:33.020561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:33.039050 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d9117aaf-256b-42d9-8ede-1987383f60c2 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1574 microversion: 2.1 time: 0.384960 Oct 17 13:27:33.042910 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3550/6795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:32 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1574 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:33.662712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:33.663543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:33.693399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:33.696094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:33.698662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:33.701299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:33.702777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:33.706707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:33.844158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-647424c1-645b-4420-a7af-fe97ed541ac8 req-7f5e9e0c-505d-48df-be1c-0e9e031f4fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f71859-e12f-4df0-b035-67d3529c87cb", "name": "network-vif-deleted", "tag": "b54ba56a-e0ff-43bd-9462-5288a810e084"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:33.891021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-647424c1-645b-4420-a7af-fe97ed541ac8 req-7f5e9e0c-505d-48df-be1c-0e9e031f4fb9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:33.908102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-647424c1-645b-4420-a7af-fe97ed541ac8 req-7f5e9e0c-505d-48df-be1c-0e9e031f4fb9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:33.908918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-647424c1-645b-4420-a7af-fe97ed541ac8 req-7f5e9e0c-505d-48df-be1c-0e9e031f4fb9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:34.023657 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-647424c1-645b-4420-a7af-fe97ed541ac8 req-7f5e9e0c-505d-48df-be1c-0e9e031f4fb9 service nova] Creating event network-vif-deleted:b54ba56a-e0ff-43bd-9462-5288a810e084 for instance 13f71859-e12f-4df0-b035-67d3529c87cb on n-h1-853316-12 Oct 17 13:27:34.059098 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-647424c1-645b-4420-a7af-fe97ed541ac8 req-7f5e9e0c-505d-48df-be1c-0e9e031f4fb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222654 Oct 17 13:27:34.060126 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3551/6796] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:34.109827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:34.111619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:34.154424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:34.155241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:34.156005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:34.157246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:34.158130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:34.170852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:34.255950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:34.283753 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-642955a4-8ddf-41f1-a000-791235d4763a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1367 microversion: 2.1 time: 0.637637 Oct 17 13:27:34.289808 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3246/6797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:33 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1367 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:34.382324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:34.399236 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a6510d2-ecba-40c8-a0e0-6ec891722586 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1225 microversion: 2.1 time: 0.320880 Oct 17 13:27:34.414046 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3552/6798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:34 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1225 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:35.320721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:35.321576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:35.347607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:35.355060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:35.356156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:35.360269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:35.362725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:35.371085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:35.444399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:35.445153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:35.457914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:35.458806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:35.459365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:35.460662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:35.463076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:35.464376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:35.762963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:35.799194 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fd130af7-9dca-4da9-9622-de4aa3dce3eb tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1557 microversion: 2.1 time: 0.472239 Oct 17 13:27:35.804923 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3247/6799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:35 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1557 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:35.831085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:35.853409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:35.854147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:35.856316 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ef5482ed-1f5e-482c-b715-465c98790a6b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1225 microversion: 2.1 time: 0.421712 Oct 17 13:27:35.864323 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3553/6800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:35 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1225 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:35.872576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:35.872576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:35.872576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:35.872576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:35.872576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:35.878326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.117655 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90d3865c-e699-4c8a-a5cb-da7b11d4297a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.269125 Oct 17 13:27:36.119054 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3248/6801] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:27:35 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-interface => generated 284 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:36.898887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:36.902364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:36.926958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.927707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.928048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.928789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.929260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.929848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:37.095816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:37.128979 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f5fdbad-4bc3-4e29-a3a1-d72a0968ecb4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1225 microversion: 2.1 time: 0.247130 Oct 17 13:27:37.129956 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3554/6802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:36 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1225 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:38.181102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:38.182262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:38.202799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:38.204285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:38.210086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:38.211473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:38.212324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:38.214203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:38.283477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6cd9c2af-2452-4572-908c-c8efe66f8d8e req-5e08de69-aa6b-4662-aabf-0f6fcf66ed85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5b79d6-ba94-43d7-acb5-ec175c05cf38", "tag": "068d9ccc-38e4-4659-bc6a-8de3400007ce"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:38.323836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6cd9c2af-2452-4572-908c-c8efe66f8d8e req-5e08de69-aa6b-4662-aabf-0f6fcf66ed85 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:38.336994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6cd9c2af-2452-4572-908c-c8efe66f8d8e req-5e08de69-aa6b-4662-aabf-0f6fcf66ed85 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:38.338363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6cd9c2af-2452-4572-908c-c8efe66f8d8e req-5e08de69-aa6b-4662-aabf-0f6fcf66ed85 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:38.365111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6cd9c2af-2452-4572-908c-c8efe66f8d8e req-5e08de69-aa6b-4662-aabf-0f6fcf66ed85 service nova] Creating event network-changed:068d9ccc-38e4-4659-bc6a-8de3400007ce for instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 on n-h2-853316-12 Oct 17 13:27:38.370680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:38.376304 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6cd9c2af-2452-4572-908c-c8efe66f8d8e req-5e08de69-aa6b-4662-aabf-0f6fcf66ed85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107109 Oct 17 13:27:38.379078 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3555/6803] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:38.431570 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-99b96085-41a3-41f9-965d-764cd91df076 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1225 microversion: 2.1 time: 0.240933 Oct 17 13:27:38.444815 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3249/6804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:38 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1225 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:39.471465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:39.491811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:39.533502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:39.537175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:39.543213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:39.578066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:39.579229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:39.581703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:39.927958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:39.943122 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e6be09d5-aee8-4468-a248-0dda19c58524 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1225 microversion: 2.1 time: 0.481922 Oct 17 13:27:39.944932 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3556/6805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:39 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1225 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:40.969471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:40.971046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:40.979861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.980708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.981340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:40.982437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.982904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.983341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:41.121147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:41.138565 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d49aa216-b12a-449f-bd2d-47ca80d41949 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1225 microversion: 2.1 time: 0.168126 Oct 17 13:27:41.140115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3250/6806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:40 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:42.185120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:42.186381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:42.223714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:42.234449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:42.235497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:42.249024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:42.249910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:42.250733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:42.482243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:42.514724 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8e9742f-6ff2-44ae-8bb4-01057a0edf6f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1225 microversion: 2.1 time: 0.336264 Oct 17 13:27:42.531299 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3557/6807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:42 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1225 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:43.585751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:43.588619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:43.615479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.617718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.618261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.619239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.620399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.621035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.667053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.669084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.669743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.670833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lazy-loading 'fault' on Instance uuid 13f71859-e12f-4df0-b035-67d3529c87cb {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:27:43.777378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:43.793634 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-50f30419-7302-4d51-908d-dea6d3125703 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 200 len: 1230 microversion: 2.1 time: 0.237132 Oct 17 13:27:43.795377 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3251/6808] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:43 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 1230 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:44.837416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:44.838417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:44.871565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:44.872457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:44.873121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.879759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:44.880506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:44.885922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.922199 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb HTTP/1.1 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '13f71859-e12f-4df0-b035-67d3529c87cb'} Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:44.925844 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:44.933093 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:44.933093 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:44.933093 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:44.933093 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:44.933093 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:44.933093 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:27:44.933093 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:27:44.934667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:44.936377 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55739e49-bff2-4e3e-92ea-9a24ff09a970 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 404 len: 111 microversion: 2.1 time: 0.108262 Oct 17 13:27:44.937360 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3558/6809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:44 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:45.137819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2139954074", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-297218142", "security_groups": [{"name": "tempest-secgroup-smoke-2022424257"}], "block_device_mapping_v2": [{"uuid": "93dac824-6996-4b9a-9c24-190f4259f811", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb1e7600-e122-4b5e-9526-e08a5b9bce6b"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:45.352272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] validate_networks() for [('eb1e7600-e122-4b5e-9526-e08a5b9bce6b', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:46.247953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:46.248863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:46.250246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:46.253156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:46.256261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:46.300769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.304575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.306534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.308102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.309337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.310031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.348581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:46.360278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:46.577497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:46.583530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93dac824-6996-4b9a-9c24-190f4259f811',volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:46.906383 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9c22e737-2526-4961-91ae-017dfbc1a69a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.778003 Oct 17 13:27:46.909003 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3252/6810] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:46.926734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cc520b24-69bb-4e56-885a-10e9b36ba4ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:46.928124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cc520b24-69bb-4e56-885a-10e9b36ba4ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:47.031678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cc520b24-69bb-4e56-885a-10e9b36ba4ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:47.049347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cc520b24-69bb-4e56-885a-10e9b36ba4ab tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1094 microversion: 2.1 time: 0.127296 Oct 17 13:27:47.051146 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3559/6811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:46 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1094 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:48.077169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:48.078131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:48.091652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:48.101580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:48.102126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:48.102940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:48.103427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:48.103874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:48.281526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:48.317479 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-53366986-6480-4a70-82c5-6737f667841a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1192 microversion: 2.1 time: 0.244181 Oct 17 13:27:48.318597 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3253/6812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:48 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1192 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:49.359392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:49.361425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:49.376676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.380360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.382688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.383616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.384244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.387337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.652229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:49.677491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-22c6c83e-6125-41d2-8db7-bda7da5307bb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1210 microversion: 2.1 time: 0.322943 Oct 17 13:27:49.680130 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3560/6813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:49 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1210 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:50.715173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:50.723764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:50.757021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:50.757893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:50.778290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:50.798950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:50.799979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:50.800600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:51.471093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:51.485571 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8655337d-2802-4fa0-b13e-f61a39df2505 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1278 microversion: 2.1 time: 0.779644 Oct 17 13:27:51.497170 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3254/6814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:50 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1278 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:52.530745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:52.532050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:52.551862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:52.553485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:52.559181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:52.560285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:52.560955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:52.561643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.404103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-30748ba2-f878-4813-8b91-eaea53bb9587 req-cd7b8329-2a5a-42b7-87a2-86387f16136d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7374cde0-5da5-47d6-8b1f-5ca242b62b97", "tag": "b1698594-bf34-4d1a-9177-41d7f3e5f30e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:53.441470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30748ba2-f878-4813-8b91-eaea53bb9587 req-cd7b8329-2a5a-42b7-87a2-86387f16136d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:53.445389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30748ba2-f878-4813-8b91-eaea53bb9587 req-cd7b8329-2a5a-42b7-87a2-86387f16136d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:53.447162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30748ba2-f878-4813-8b91-eaea53bb9587 req-cd7b8329-2a5a-42b7-87a2-86387f16136d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.499614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:53.519894 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-30748ba2-f878-4813-8b91-eaea53bb9587 req-cd7b8329-2a5a-42b7-87a2-86387f16136d service nova] Creating event network-changed:b1698594-bf34-4d1a-9177-41d7f3e5f30e for instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 on n-h1-853316-12 Oct 17 13:27:53.524617 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7424a089-2021-4c19-827d-cc985542fa79 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1278 microversion: 2.1 time: 0.998326 Oct 17 13:27:53.525157 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3561/6815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:52 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1278 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:53.535055 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-30748ba2-f878-4813-8b91-eaea53bb9587 req-cd7b8329-2a5a-42b7-87a2-86387f16136d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150529 Oct 17 13:27:53.536766 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3255/6816] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:27:54.560232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:54.560922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:54.577128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.577874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.578518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.580148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.580765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.581356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.064740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:55.077292 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1bb2c1db-48ff-4f20-b688-7498ae60ad80 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1278 microversion: 2.1 time: 0.520894 Oct 17 13:27:55.079082 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3562/6817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:54 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1278 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:56.123411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:56.124571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:56.168720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:56.169506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:56.170339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:56.171639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:56.172474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:56.173866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:56.324171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:56.382038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:56.896722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:56.949088 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3a4e9e1a-864d-49a0-9d37-98370dbe59da tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1278 microversion: 2.1 time: 0.833962 Oct 17 13:27:56.968640 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3256/6818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:56 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1278 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:58.003864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:58.005338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:58.014061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:58.037381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:58.038899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:58.040651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:58.044490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:58.045344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:58.046259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:58.744254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:58.765013 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2fa910c-78dc-4f66-97fa-30bedeb15bdf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1278 microversion: 2.1 time: 0.765973 Oct 17 13:27:58.765573 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3563/6819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:57 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1278 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:59.808514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:59.809846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:59.813028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:59.825191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:59.826086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:59.826836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:59.827870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:59.830330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:59.833676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:59.867781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:00.574871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:00.596065 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-380a479b-9982-4692-ba42-38dce4edc034 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.793694 Oct 17 13:28:00.598317 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3257/6820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:59 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:01.700728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:01.703086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:01.725517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=40 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:01.728760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:01.730703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:01.731822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:01.733587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:01.734748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:01.736020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:01.828196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=88 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:02.275354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:02.289307 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e51ab1ad-8659-45af-818b-7089de6670b9 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.653574 Oct 17 13:28:02.291291 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3564/6821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:01 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:03.322946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:03.324204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:03.352878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:03.354250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:03.355523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:03.356755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:03.357444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:03.358850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:03.664373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:03.681480 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f5b07bc6-45fa-4bcc-b7c7-9c82c75043cb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.364040 Oct 17 13:28:03.694696 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3258/6822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:03 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:04.731327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:04.732944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:04.758379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:04.759263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:04.759848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:04.760613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:04.761089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:04.761525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:05.247316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:05.259466 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8babf438-b0e4-443e-9b9e-0b922e7c07c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.557726 Oct 17 13:28:05.269961 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3565/6823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:04 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:06.292557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:06.293801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:06.318738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:06.319645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:06.320292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.321216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:06.321848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:06.322560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.633492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:06.644438 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f6c44cb-d92a-408a-8e5c-be2d0d1db3c0 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.355695 Oct 17 13:28:06.645335 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3259/6824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:06 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:07.428836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:07.430033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:07.444833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.444833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.444833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.444833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.446116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.446116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.523374 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ff7a5fb2-2136-4045-a134-a124d082739d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/ips" status: 200 len: 149 microversion: 2.1 time: 0.099811 Oct 17 13:28:07.524736 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3566/6825] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:28:07 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/ips => generated 149 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:07.678504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:07.681827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:07.696622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.697527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.698240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.699206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.700049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.700731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:08.551849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:08.598498 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41bf8533-21c0-4903-838a-c9f3c6aa1e70 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.931944 Oct 17 13:28:08.601363 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3260/6826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:07 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:09.638434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:09.640043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:09.667119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:09.668791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:09.669679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:09.670869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:09.671675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:09.673754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:09.985285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:10.015944 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-816ee9fa-4fd8-4ffe-92f1-9be0730e2306 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.382520 Oct 17 13:28:10.022512 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3567/6827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:09 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:10.758422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c42a0ea-157b-48a4-9e4a-264586b83db8"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:10.764234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:10.776182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:10.777129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:10.777722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:10.778819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:10.779701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:10.780446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.072166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:11.073063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:11.093745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.094852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.096835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.099992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.105334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.107649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.354463 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-354ebea8-6cb0-4863-9c7e-5b247e372f30 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.603144 Oct 17 13:28:11.358047 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3261/6828] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:28:10 2022] POST /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 194 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:28:11.587164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:11.600864 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3780acaf-c837-45ee-8781-88ac7e5b14b6 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.544059 Oct 17 13:28:11.604156 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3568/6829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:11 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:12.650474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:12.651811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:12.666290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:12.666779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:12.674742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:12.681184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:12.681947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:12.682773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.076130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:13.094633 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1947ddb5-e4cd-4968-b6b7-433d7ebe5a5c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.450212 Oct 17 13:28:13.103122 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3262/6830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:12 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:13.394317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8a2c4c66-1202-4712-a66f-92e4aaef2a27 req-60e36838-7716-489d-b1e4-bfe5386e7d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7374cde0-5da5-47d6-8b1f-5ca242b62b97", "name": "network-vif-plugged", "status": "completed", "tag": "b1698594-bf34-4d1a-9177-41d7f3e5f30e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:13.431361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8a2c4c66-1202-4712-a66f-92e4aaef2a27 req-60e36838-7716-489d-b1e4-bfe5386e7d4d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:13.433376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8a2c4c66-1202-4712-a66f-92e4aaef2a27 req-60e36838-7716-489d-b1e4-bfe5386e7d4d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:13.435459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8a2c4c66-1202-4712-a66f-92e4aaef2a27 req-60e36838-7716-489d-b1e4-bfe5386e7d4d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.481782 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8a2c4c66-1202-4712-a66f-92e4aaef2a27 req-60e36838-7716-489d-b1e4-bfe5386e7d4d service nova] Creating event network-vif-plugged:b1698594-bf34-4d1a-9177-41d7f3e5f30e for instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 on n-h1-853316-12 Oct 17 13:28:13.490438 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8a2c4c66-1202-4712-a66f-92e4aaef2a27 req-60e36838-7716-489d-b1e4-bfe5386e7d4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105154 Oct 17 13:28:13.491886 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3569/6831] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:14.131784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:14.132603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:14.147401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:14.148241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:14.149020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:14.150014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:14.150713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:14.151398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:14.623413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:14.637000 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-225d045a-c0cb-43d3-ad3f-44cbef535dea tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1266 microversion: 2.1 time: 0.511279 Oct 17 13:28:14.637857 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3263/6832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:14 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1266 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:15.678623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:15.684186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:15.704805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:15.706039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:15.708386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:15.709493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:15.710311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:15.717197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:16.380584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:16.407286 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-473a0eb2-4cbd-46fc-b00f-ef1d3c51dbc7 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1451 microversion: 2.1 time: 0.736003 Oct 17 13:28:16.413017 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3570/6833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:15 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1451 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:16.445205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:16.446050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:16.471435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:16.477484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:16.479915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:16.491285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:16.492181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:16.492882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:17.383993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:17.401297 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af9006b1-352c-410f-917c-6b5607da938e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1451 microversion: 2.1 time: 0.959435 Oct 17 13:28:17.402393 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3264/6834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:16 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1451 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:21.206639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-75330632-559a-4c5c-9adc-9a8977619c2b req-0710c7ab-d869-4631-b618-ca5392b962bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7374cde0-5da5-47d6-8b1f-5ca242b62b97", "tag": "b1698594-bf34-4d1a-9177-41d7f3e5f30e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:21.245483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-75330632-559a-4c5c-9adc-9a8977619c2b req-0710c7ab-d869-4631-b618-ca5392b962bd service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.246837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-75330632-559a-4c5c-9adc-9a8977619c2b req-0710c7ab-d869-4631-b618-ca5392b962bd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.248117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-75330632-559a-4c5c-9adc-9a8977619c2b req-0710c7ab-d869-4631-b618-ca5392b962bd service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.273485 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-75330632-559a-4c5c-9adc-9a8977619c2b req-0710c7ab-d869-4631-b618-ca5392b962bd service nova] Creating event network-changed:b1698594-bf34-4d1a-9177-41d7f3e5f30e for instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 on n-h1-853316-12 Oct 17 13:28:21.290565 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-75330632-559a-4c5c-9adc-9a8977619c2b req-0710c7ab-d869-4631-b618-ca5392b962bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091136 Oct 17 13:28:21.293494 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3571/6835] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:28:27.425500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c42a0ea-157b-48a4-9e4a-264586b83db8"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:27.442015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:27.462667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=15 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:27.467103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:27.495335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.496576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.497553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.502449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.503697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.504815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.687864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Invalid volume: volume 5c42a0ea-157b-48a4-9e4a-264586b83db8 is already attached to instances: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments HTTP/1.1 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 74 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: {"volumeAttachment": {"volumeId": "5c42a0ea-157b-48a4-9e4a-264586b83db8"}} Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid volume: volume 5c42a0ea-157b-48a4-9e4a-264586b83db8 is already attached to instances: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '8b5b79d6-ba94-43d7-acb5-ec175c05cf38', 'body': {'volumeAttachment': {'volumeId': '5c42a0ea-157b-48a4-9e4a-264586b83db8'}}} Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5c42a0ea-157b-48a4-9e4a-264586b83db8 is already attached to instances: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:28:27.690616 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5c42a0ea-157b-48a4-9e4a-264586b83db8 is already attached to instances: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5c42a0ea-157b-48a4-9e4a-264586b83db8 is already attached to instances: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 Oct 17 13:28:27.694666 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:27.701807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 400 to user: Invalid volume: volume 5c42a0ea-157b-48a4-9e4a-264586b83db8 is already attached to instances: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:27.702586 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-38b22941-7b32-4d6e-846a-1d9fda4a27c7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.289645 Oct 17 13:28:27.707299 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3265/6836] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:28:27 2022] POST /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 174 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:28:27.855518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:27.856232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:27.877261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.879502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.883367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.885380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.886976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.890783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.136493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lazy-loading 'services' on Instance uuid 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:28:28.407645 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cec460d8-c3b0-43ad-b761-51f010a509ce tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments/5c42a0ea-157b-48a4-9e4a-264586b83db8" status: 202 len: 0 microversion: 2.1 time: 0.553744 Oct 17 13:28:28.409475 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3572/6837] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:28:27 2022] DELETE /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments/5c42a0ea-157b-48a4-9e4a-264586b83db8 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:28:28.424597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:28.432566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:28.465917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.466730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.467021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.467969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.468879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.469597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.543607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dcbd3df3-1230-40db-866f-f132fad377c8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127760 Oct 17 13:28:28.544892 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3266/6838] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:28 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:29.590095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:29.612699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:29.686364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.720406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.722118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.747529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.749272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.750388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.946137 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eece7c4c-ca2c-4bb4-987a-ae23acdb412a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.386631 Oct 17 13:28:29.949500 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3573/6839] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:29 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:30.968707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:30.973974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:31.030046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.030966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.031761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.033570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.054724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.062233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.279199 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9db10592-0381-425f-95c6-65d48d67d01d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.313995 Oct 17 13:28:31.291432 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3267/6840] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:30 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:32.304881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:32.323377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:32.342084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=20 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:32.350060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.351560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.357649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.363536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.371303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.373003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.387774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:32.518127 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3575e8b9-99f4-4d6d-86cc-e42ce6b5a59a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216955 Oct 17 13:28:32.523047 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3574/6841] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:32 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:33.572474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:33.601677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:33.645863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:33.658381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:33.662684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:33.664370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:33.673844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:33.675253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:33.902910 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-01bebefd-9a51-4b2a-a1ae-7a6550873926 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.359476 Oct 17 13:28:33.907710 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3268/6842] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:33 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:34.926807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:34.929593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:34.997403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.010465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.014819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.018069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.022980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.024151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.154149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-325f51a9-472b-4d53-a3e4-ce35d736f8bc tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.237428 Oct 17 13:28:35.155498 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3575/6843] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:34 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:36.171402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.175959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:36.206199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.218461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.221454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.227438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.229644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.232438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.424241 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4e9913e0-eccb-4676-abda-dc0d337e2fee tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259940 Oct 17 13:28:36.432298 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3269/6844] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:37.444565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.454025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:37.477875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.479085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.480140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.481732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.483321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.484472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.556663 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2b29876a-7cdc-4d23-8a4d-7e00d0653603 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118428 Oct 17 13:28:37.558814 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3576/6845] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:38.577808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:38.587948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:38.618456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:38.620450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:38.621247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:38.622570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:38.628349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:38.629191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:38.696117 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a403f3f-cc5d-449c-9ff1-9ac9be7ca59c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126184 Oct 17 13:28:38.696117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3270/6846] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:38 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:39.712023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.715858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:39.747628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.759824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.761032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.764376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.765171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.765847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.951620 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2ad9e69-8c39-4e09-b58a-53caa83b2be6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.249896 Oct 17 13:28:39.953147 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3577/6847] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:28:39 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38/os-volume_attachments => generated 25 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:40.114121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.115059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.131605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.134256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.135445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.138301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.139487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.140485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.220842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:28:40.457776 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4404af51-2d39-4e8c-9448-626e8abf7cd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 204 len: 0 microversion: 2.1 time: 0.353858 Oct 17 13:28:40.460833 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3271/6848] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:40 2022] DELETE /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:28:40.472389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.473067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.487048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.487915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.491152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.495161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.499665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.502333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:41.391479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:41.425806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25598e4f-1566-43bf-a3c3-76ff4f6a7ca7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1681 microversion: 2.1 time: 0.958145 Oct 17 13:28:41.427036 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3578/6849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:40 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1681 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:42.460290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:42.462697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:42.485544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.486724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.487676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:42.492517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.499973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.502150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:43.478840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:43.505009 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d6a94f8-0a9d-4e5b-ab84-561ea23e80f4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1681 microversion: 2.1 time: 1.046723 Oct 17 13:28:43.524201 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3272/6850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:42 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1681 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:44.534628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:44.535398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:44.557557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.558060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.558536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.559617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.560123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.560625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.744116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-bd13f0fe-9c59-4536-a1e6-882a3ca064cd req-ef5968b1-8170-4518-ab6a-3dfff5209edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5b79d6-ba94-43d7-acb5-ec175c05cf38", "name": "network-vif-deleted", "tag": "068d9ccc-38e4-4659-bc6a-8de3400007ce"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:44.767011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd13f0fe-9c59-4536-a1e6-882a3ca064cd req-ef5968b1-8170-4518-ab6a-3dfff5209edb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.767960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd13f0fe-9c59-4536-a1e6-882a3ca064cd req-ef5968b1-8170-4518-ab6a-3dfff5209edb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.767960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd13f0fe-9c59-4536-a1e6-882a3ca064cd req-ef5968b1-8170-4518-ab6a-3dfff5209edb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.797437 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-bd13f0fe-9c59-4536-a1e6-882a3ca064cd req-ef5968b1-8170-4518-ab6a-3dfff5209edb service nova] Creating event network-vif-deleted:068d9ccc-38e4-4659-bc6a-8de3400007ce for instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 on n-h2-853316-12 Oct 17 13:28:44.831154 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-bd13f0fe-9c59-4536-a1e6-882a3ca064cd req-ef5968b1-8170-4518-ab6a-3dfff5209edb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249056 Oct 17 13:28:44.832060 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3273/6851] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:44.838638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:44.860937 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f5972ca5-d6a0-4780-b575-785d2faa463f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 200 len: 1613 microversion: 2.1 time: 0.332414 Oct 17 13:28:44.861866 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3579/6852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:44 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 1613 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:45.889522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:45.896427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:45.923232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.928155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.940031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.942794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.943892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.945919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.021276 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 HTTP/1.1 Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8b5b79d6-ba94-43d7-acb5-ec175c05cf38'} Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:46.031384 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d3b7a91-055f-4697-ad19-1d2a5ffb015d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 404 len: 111 microversion: 2.1 time: 0.161184 Oct 17 13:28:46.045572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3274/6853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:45 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:46.060386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06c65bb5-93c5-4cb8-bc14-3b5f07879a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '.version_select at 0x7fa8227705e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:46.132838 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-06c65bb5-93c5-4cb8-bc14-3b5f07879a27 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232896935" status: 202 len: 0 microversion: 2.1 time: 0.079791 Oct 17 13:28:46.134448 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3580/6854] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:28:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232896935 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:28:48.366889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c690d103-9a7d-4687-aa88-13984912f7fa tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: .version_select at 0x7fa820467160>, body: {"keypair": {"name": "tempest-keypair-1906263869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHck4iDLwK2mSxIIaFMy7qf6QPhyQkQNPNENObHYIBT38UxUNQp01BeqjUA97Dv0/Rer4vANqxLRGvbKRfInREVHGNIlRMRtDPlfZvXSLk4PVM6SBIvCWsCl8uNvGm/JCA=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:48.403538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c690d103-9a7d-4687-aa88-13984912f7fa tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for project 3bc91c516177497fa5d502d401b13efa. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:28:48.421368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c690d103-9a7d-4687-aa88-13984912f7fa tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for user 6a7a84e3905a4b5e887825b601e3d964 and project 3bc91c516177497fa5d502d401b13efa. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:28:48.484096 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c690d103-9a7d-4687-aa88-13984912f7fa tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130401 Oct 17 13:28:48.493225 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3275/6855] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:28:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:52.880543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1007605318", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb30fe9b-9188-4fd9-81ae-fbd2ab091675"}], "security_groups": [{"name": "tempest-securitygroup--1523650239"}], "key_name": "tempest-keypair-1906263869", "user_data": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:53.215964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] validate_networks() for [('fb30fe9b-9188-4fd9-81ae-fbd2ab091675', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:28:54.858955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=35 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:55.271225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:55.271874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:55.272903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:55.273629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:55.279551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:55.311647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.318414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.321155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.322811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.325764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.328953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.403918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for project 3bc91c516177497fa5d502d401b13efa. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:28:55.428668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Getting quotas for user 6a7a84e3905a4b5e887825b601e3d964 and project 3bc91c516177497fa5d502d401b13efa. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:28:55.482193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:28:55.489656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:28:55.705314 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [ea64873f-0855-4521-8e24-2c7f045884cf] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:28:56.720679 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [ea64873f-0855-4521-8e24-2c7f045884cf] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 56338. Oct 17 13:28:56.726476 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-09987d66-2ab6-4024-8817-dd61040b11d5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.861857 Oct 17 13:28:56.734502 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3581/6856] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:28:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:28:56.741009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3bb47f0e-c77d-48dc-80cc-d165813d888a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:56.741857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3bb47f0e-c77d-48dc-80cc-d165813d888a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:56.747226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:57.982873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3bb47f0e-c77d-48dc-80cc-d165813d888a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:57.998697 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3bb47f0e-c77d-48dc-80cc-d165813d888a tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1242 microversion: 2.1 time: 1.261036 Oct 17 13:28:58.003291 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3276/6857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:56 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1242 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:59.033692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:59.036579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:59.062067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:59.082359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:59.083931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:59.085969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:59.087023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:59.087960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:59.354601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:59.370706 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-edc53e99-a266-4d5c-b354-74b5769491e2 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1300 microversion: 2.1 time: 0.347499 Oct 17 13:28:59.372497 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3582/6858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:59 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1300 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:00.401188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:00.409242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:00.432745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:00.457614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:00.466769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:00.468094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:00.473134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:00.474749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:00.479837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:01.032566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:01.057528 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dfc07bfb-cf0b-4734-8dfb-c2a859b69fa6 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1368 microversion: 2.1 time: 0.665865 Oct 17 13:29:01.058905 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3277/6859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:00 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1368 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:02.091795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:02.095354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:02.122047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:02.127238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:02.132551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:02.136863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:02.154331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:02.163106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:02.898641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:02.915774 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6a6723b3-a049-4605-a072-95250e1b0526 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1368 microversion: 2.1 time: 0.833524 Oct 17 13:29:02.920014 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3583/6860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:02 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1368 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:03.327797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-0ac06b4f-f97f-4cb6-88fb-1e73bdddacce req-164203ee-f971-45b5-8573-756bab043b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07b8550-e661-4850-9ac0-faec451bf1f8", "tag": "c6064ad5-eb45-4358-92a3-7db3b0c3a626"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:03.358452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0ac06b4f-f97f-4cb6-88fb-1e73bdddacce req-164203ee-f971-45b5-8573-756bab043b8a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:03.362210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0ac06b4f-f97f-4cb6-88fb-1e73bdddacce req-164203ee-f971-45b5-8573-756bab043b8a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:03.362862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0ac06b4f-f97f-4cb6-88fb-1e73bdddacce req-164203ee-f971-45b5-8573-756bab043b8a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:03.387119 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-0ac06b4f-f97f-4cb6-88fb-1e73bdddacce req-164203ee-f971-45b5-8573-756bab043b8a service nova] Creating event network-changed:c6064ad5-eb45-4358-92a3-7db3b0c3a626 for instance b07b8550-e661-4850-9ac0-faec451bf1f8 on n-h2-853316-12 Oct 17 13:29:03.394635 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-0ac06b4f-f97f-4cb6-88fb-1e73bdddacce req-164203ee-f971-45b5-8573-756bab043b8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070823 Oct 17 13:29:03.396722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3278/6861] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:29:03.982941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:03.984509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:04.000539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:04.013056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:04.054490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:04.055595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:04.056766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:04.058036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:04.059954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:04.333935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:04.352978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5c82948c-0a70-4306-ab1f-09ac65353df8 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1368 microversion: 2.1 time: 0.390666 Oct 17 13:29:04.356638 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3584/6862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:03 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1368 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:05.380524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:05.381180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:05.394754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:05.395433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:05.396004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:05.397023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:05.397748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:05.398693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:06.005806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:06.021870 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-58dc1c11-5e52-41e7-809b-117de1905c56 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1368 microversion: 2.1 time: 0.644897 Oct 17 13:29:06.022948 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3279/6863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:05 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1368 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:07.059200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:07.060379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:07.075612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:07.088968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:07.099015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:07.099923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:07.100610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:07.101734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:07.102629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:07.108103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:07.933173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:07.948121 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7ab7b379-0b03-44cb-a719-ee14ef2587b7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1368 microversion: 2.1 time: 0.895436 Oct 17 13:29:07.962196 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3585/6864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:07 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1368 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:09.021544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:09.022645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:09.036135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:09.052717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:09.053416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:09.053889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:09.054728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:09.055263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:09.056046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:09.389644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:09.415053 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6597a850-5d43-40e9-ac89-297f764f64a9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1368 microversion: 2.1 time: 0.394505 Oct 17 13:29:09.416321 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3280/6865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:09 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1368 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:10.457086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:10.458496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:10.477342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:10.478794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:10.479434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:10.483643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:10.484341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:10.485025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:10.690851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6abc4f76-b954-447c-b075-e3cedb8df396 req-b7411ec5-dd84-462a-97fd-8a036d6167cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07b8550-e661-4850-9ac0-faec451bf1f8", "name": "network-vif-plugged", "status": "completed", "tag": "c6064ad5-eb45-4358-92a3-7db3b0c3a626"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:10.714599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6abc4f76-b954-447c-b075-e3cedb8df396 req-b7411ec5-dd84-462a-97fd-8a036d6167cb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:10.717414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6abc4f76-b954-447c-b075-e3cedb8df396 req-b7411ec5-dd84-462a-97fd-8a036d6167cb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:10.718329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6abc4f76-b954-447c-b075-e3cedb8df396 req-b7411ec5-dd84-462a-97fd-8a036d6167cb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:10.752563 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6abc4f76-b954-447c-b075-e3cedb8df396 req-b7411ec5-dd84-462a-97fd-8a036d6167cb service nova] Creating event network-vif-plugged:c6064ad5-eb45-4358-92a3-7db3b0c3a626 for instance b07b8550-e661-4850-9ac0-faec451bf1f8 on n-h2-853316-12 Oct 17 13:29:10.766721 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6abc4f76-b954-447c-b075-e3cedb8df396 req-b7411ec5-dd84-462a-97fd-8a036d6167cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080108 Oct 17 13:29:10.769082 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3281/6866] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:29:10.843452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:10.854285 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-741d2fd5-5c8c-4370-b593-432a8c01c5b4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1368 microversion: 2.1 time: 0.403389 Oct 17 13:29:10.859688 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3586/6867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:10 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1368 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:11.899580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:11.902364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:11.925434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:11.926482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:11.930182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:11.931198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:11.932257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:11.932917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:12.695683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:12.711899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-57ead740-ebaa-4b98-bd03-069ea2924131 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1368 microversion: 2.1 time: 0.817086 Oct 17 13:29:12.713727 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3282/6868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:11 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1368 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:13.744050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:13.750061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:13.801406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:13.802467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:13.803480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:13.804634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:13.805287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:13.805882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:14.273237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:14.289515 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b7bb0ed-1547-4521-8a89-5dd213bbad60 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1559 microversion: 2.1 time: 0.552053 Oct 17 13:29:14.291054 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3587/6869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:13 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1559 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:14.359367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:14.360724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:14.386092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:14.386976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:14.389060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:14.390406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:14.397360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:14.403655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:14.652591 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0b9795aa-9617-461a-8160-c515eb2f854d tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.302186 Oct 17 13:29:14.659152 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3283/6870] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:29:14 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-interface => generated 285 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:17.709194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2fe19734-c3bb-401b-8c61-965267f42aa0 req-8cb10364-0f5a-42de-9f01-5cfa00eab628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07b8550-e661-4850-9ac0-faec451bf1f8", "tag": "c6064ad5-eb45-4358-92a3-7db3b0c3a626"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:17.732231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2fe19734-c3bb-401b-8c61-965267f42aa0 req-8cb10364-0f5a-42de-9f01-5cfa00eab628 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.732353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2fe19734-c3bb-401b-8c61-965267f42aa0 req-8cb10364-0f5a-42de-9f01-5cfa00eab628 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.732740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2fe19734-c3bb-401b-8c61-965267f42aa0 req-8cb10364-0f5a-42de-9f01-5cfa00eab628 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.747776 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2fe19734-c3bb-401b-8c61-965267f42aa0 req-8cb10364-0f5a-42de-9f01-5cfa00eab628 service nova] Creating event network-changed:c6064ad5-eb45-4358-92a3-7db3b0c3a626 for instance b07b8550-e661-4850-9ac0-faec451bf1f8 on n-h2-853316-12 Oct 17 13:29:17.754152 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2fe19734-c3bb-401b-8c61-965267f42aa0 req-8cb10364-0f5a-42de-9f01-5cfa00eab628 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048831 Oct 17 13:29:17.755375 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3588/6871] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:49.788431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=13 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:49.789199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=32 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:50.088340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=9 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:50.090427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=40 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:50.104576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1176078934", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "66ad531f-2950-44ab-bb63-80a837e861ba"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:50.148175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:50.151082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:50.165769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.170929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.172099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.173107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.175609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.182835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.231952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d5062e16-74cc-41ed-b77a-c52a69dda246 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/ips" status: 200 len: 151 microversion: 2.1 time: 0.445679 Oct 17 13:29:50.242202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3284/6872] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:29:49 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/ips => generated 151 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:50.261166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] validate_networks() for [('66ad531f-2950-44ab-bb63-80a837e861ba', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:29:51.540973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:29:51.547792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:29:51.549583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:29:51.551859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:29:51.553902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:29:51.580445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.581518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.583578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.585761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.588108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.588747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.638016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Getting quotas for project 00295086b15e43b3ae6cd80f149f0dab. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:29:51.660575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Getting quotas for user 0d1551f5f8a34acc9823a4ce2c2f849b and project 00295086b15e43b3ae6cd80f149f0dab. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:29:51.703461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:29:51.707837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:29:51.828090 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a3dd31df-1720-41cb-9a9f-7541a6738aff tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743983 Oct 17 13:29:51.832797 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3589/6873] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:29:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:29:51.842705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e03bcd4c-a7eb-4e47-aee1-022c2cde7370 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:51.843354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e03bcd4c-a7eb-4e47-aee1-022c2cde7370 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:52.019810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e03bcd4c-a7eb-4e47-aee1-022c2cde7370 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:52.045006 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e03bcd4c-a7eb-4e47-aee1-022c2cde7370 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1219 microversion: 2.1 time: 0.207044 Oct 17 13:29:52.062793 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3285/6874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:51 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1219 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:53.071210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:53.072747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:53.089062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.089828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.091541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.093450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.094450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.095454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.226241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:53.242182 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c474d33-ab9e-498b-a837-67c6eafd9739 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1215 microversion: 2.1 time: 0.176111 Oct 17 13:29:53.245038 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3590/6875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:53 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:53.498432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "599fa336-fea9-41d3-9956-ed2baf58c8da"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:53.508296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:53.526579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.527572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.528346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.529429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.532835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.533505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.167923 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d92b864d-980f-400d-9786-6f9079ff9a17 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "POST /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673654 Oct 17 13:29:54.175784 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3286/6876] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:29:53 2022] POST /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:54.309362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:54.312225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:54.361542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:54.366412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:54.368494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.369255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:54.369725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:54.374966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.611844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:54.630604 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a884088-1bc0-4f0e-ad12-f1dc7e0c9bfd tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1277 microversion: 2.1 time: 0.346118 Oct 17 13:29:54.635967 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3591/6877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:54 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1277 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:55.659702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:55.661062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:55.699032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:55.699563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:55.700030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:55.700975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:55.701549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:55.702000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:56.057373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:56.071287 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f34b3dff-fd1e-47d6-a169-03bb98d6f34b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.416753 Oct 17 13:29:56.071957 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3287/6878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:55 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:57.101473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:57.102105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:57.117324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.118860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.119590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.122991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.129284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.131669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.513231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:57.528736 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-259b8142-e6a2-4aa2-86cb-69a8e43fab59 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.430835 Oct 17 13:29:57.532275 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3592/6879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:57 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:58.486068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2edae763-0cc4-4817-9155-758892b02629 req-b4d9098f-2fc1-4bad-b477-1cf017fcc69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "702b69df-02fe-4858-a6fd-6b1666e632a1", "tag": "72e5dfc5-b219-46c7-a78b-7cd063f24974"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:58.522718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2edae763-0cc4-4817-9155-758892b02629 req-b4d9098f-2fc1-4bad-b477-1cf017fcc69c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.529633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2edae763-0cc4-4817-9155-758892b02629 req-b4d9098f-2fc1-4bad-b477-1cf017fcc69c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.530495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2edae763-0cc4-4817-9155-758892b02629 req-b4d9098f-2fc1-4bad-b477-1cf017fcc69c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.558220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:58.559882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:58.572477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.573257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.574020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.575225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.576855 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2edae763-0cc4-4817-9155-758892b02629 req-b4d9098f-2fc1-4bad-b477-1cf017fcc69c service nova] Creating event network-changed:72e5dfc5-b219-46c7-a78b-7cd063f24974 for instance 702b69df-02fe-4858-a6fd-6b1666e632a1 on n-h1-853316-12 Oct 17 13:29:58.577302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.577888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.591997 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2edae763-0cc4-4817-9155-758892b02629 req-b4d9098f-2fc1-4bad-b477-1cf017fcc69c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110962 Oct 17 13:29:58.606670 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3288/6880] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:29:58.998875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:59.012382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d32015de-8d7c-41c4-9e7e-b560726feb0d tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.459815 Oct 17 13:29:59.013527 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3593/6881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:58 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:00.042194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:00.042974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:00.056927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.059196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.059785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.060593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.061086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.061588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.334137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:00.355685 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-53e8a3f0-77bc-4bd6-9f39-4e5d1db7a27c tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.312240 Oct 17 13:30:00.365002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3289/6882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:00 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:01.398998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:01.400188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:01.417060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.417883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.419139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.421129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.425403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.426139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.609579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:01.698151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:01.715989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:01.782674 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-becda68c-bad8-4d69-b2c4-4397d19f1ead tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.386827 Oct 17 13:30:01.795388 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3594/6883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:01 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:02.832330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:02.834154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:02.867285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:02.877802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.881116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.881531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.882920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.890018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.897485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.516885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:03.555998 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db0be06a-f282-4eb1-ab3a-a0db4085140e tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.721547 Oct 17 13:30:03.557000 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3290/6884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:02 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:04.587843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:04.588629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:04.601566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:04.603200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:04.607164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:04.608716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:04.611218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:04.612027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.503458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:05.514960 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-53e14d8d-35dc-4f40-82ed-a917662d2ba9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.933615 Oct 17 13:30:05.534231 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3595/6885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:04 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:06.564966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:06.564966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:06.582019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.582567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.583075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.583745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.584212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.584652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:07.025765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:07.062648 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-103d6ed4-6a90-4f74-8149-726590b59b15 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.494769 Oct 17 13:30:07.069385 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3291/6886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:06 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:08.101109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:08.107422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:08.126199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:08.132494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:08.137137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:08.143216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:08.143952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:08.148190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:08.337776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3e4ba997-e8e5-490e-b19b-1d9bd47d7102 req-0702e7cb-e2bf-45eb-9d93-6b7f2de1e25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702b69df-02fe-4858-a6fd-6b1666e632a1", "name": "network-vif-plugged", "status": "completed", "tag": "72e5dfc5-b219-46c7-a78b-7cd063f24974"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:08.372707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3e4ba997-e8e5-490e-b19b-1d9bd47d7102 req-0702e7cb-e2bf-45eb-9d93-6b7f2de1e25a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:08.373356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3e4ba997-e8e5-490e-b19b-1d9bd47d7102 req-0702e7cb-e2bf-45eb-9d93-6b7f2de1e25a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:08.373817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3e4ba997-e8e5-490e-b19b-1d9bd47d7102 req-0702e7cb-e2bf-45eb-9d93-6b7f2de1e25a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:08.415531 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3e4ba997-e8e5-490e-b19b-1d9bd47d7102 req-0702e7cb-e2bf-45eb-9d93-6b7f2de1e25a service nova] Creating event network-vif-plugged:72e5dfc5-b219-46c7-a78b-7cd063f24974 for instance 702b69df-02fe-4858-a6fd-6b1666e632a1 on n-h1-853316-12 Oct 17 13:30:08.433589 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3e4ba997-e8e5-490e-b19b-1d9bd47d7102 req-0702e7cb-e2bf-45eb-9d93-6b7f2de1e25a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099588 Oct 17 13:30:08.439129 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3292/6887] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:08.632414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:08.650851 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3895a3b5-11a3-48d4-8d4c-b6ce2c4189a0 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.558153 Oct 17 13:30:08.677506 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3596/6888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:08 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:09.700885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:09.706490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:09.731271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.732250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.734292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.736879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.767976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.770975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.989974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:10.001989 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8de521e-0566-4398-b5b2-235e091b90dc tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1319 microversion: 2.1 time: 0.314653 Oct 17 13:30:10.018996 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3293/6889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:09 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:11.037404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:11.038337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:11.048006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.048726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.049540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.050526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.051858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.052525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.287791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1351961636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-297218142", "security_groups": [{"name": "tempest-secgroup-smoke-2022424257"}], "block_device_mapping_v2": [{"uuid": "cdf5fee5-e5bd-4beb-9eeb-7f0d9698d996", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb1e7600-e122-4b5e-9526-e08a5b9bce6b"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:11.983950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] validate_networks() for [('eb1e7600-e122-4b5e-9526-e08a5b9bce6b', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:30:12.036842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:12.059341 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1f0c5d89-4b28-47fe-bcf7-f547f24be7df tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1506 microversion: 2.1 time: 1.034880 Oct 17 13:30:12.074273 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3597/6890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:11 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1506 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:12.149525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:12.150595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:12.160134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.162718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.163791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.164660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.165269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.165847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.325695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lazy-loading 'services' on Instance uuid b07b8550-e661-4850-9ac0-faec451bf1f8 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:30:12.432248 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ccdad7ee-7c87-4a3d-840f-bcb8c76d3560 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments/599fa336-fea9-41d3-9956-ed2baf58c8da" status: 202 len: 0 microversion: 2.1 time: 0.286485 Oct 17 13:30:12.432872 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3598/6891] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:30:12 2022] DELETE /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments/599fa336-fea9-41d3-9956-ed2baf58c8da => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:30:12.444861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:12.447451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:12.459859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.460450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.460970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.461748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.462675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.463340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.543927 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-401d4352-3cd4-4077-a538-ff914df41eb7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100667 Oct 17 13:30:12.545246 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3599/6892] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:12 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:30:13.547537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:30:13.549591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:30:13.550304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:30:13.550901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:30:13.551519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:30:13.559903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:13.563480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:13.568730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:13.569528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:13.570230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:13.572022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:13.572697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:13.573416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:13.581991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:13.582732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:13.583400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:13.587123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:13.588818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:13.595087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:13.598386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:13.605350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Getting quotas for user 153bc53fa8c442aebefd9a7758497262 and project 63df7b8b34b0430dab9ba603f6eab380. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:13.670383 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0906b814-a285-4462-90d9-1f4da45eced0 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115028 Oct 17 13:30:13.670995 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3600/6893] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:13 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:13.696968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:30:13.699536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdf5fee5-e5bd-4beb-9eeb-7f0d9698d996',volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:30:14.069841 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74dde48e-c519-416e-8791-d7591f031c1a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.793937 Oct 17 13:30:14.071210 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3294/6894] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:30:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 2797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:30:14.087191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93bc3426-95c0-4c46-b8f7-72c925e20c6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:14.087809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-93bc3426-95c0-4c46-b8f7-72c925e20c6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:14.267474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-93bc3426-95c0-4c46-b8f7-72c925e20c6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:14.275252 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-93bc3426-95c0-4c46-b8f7-72c925e20c6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1094 microversion: 2.1 time: 0.192311 Oct 17 13:30:14.283263 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3601/6895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:14 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1094 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:14.691046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:14.694127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:14.722174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:14.724178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:14.724988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:14.726219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:14.727047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:14.727709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:14.800614 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2bb621c-8929-4581-85cd-43a812140cc9 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115334 Oct 17 13:30:14.805124 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3295/6896] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:14 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:15.318609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9b13c001-d1bd-47c9-9c9f-0b0756546354 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:15.320247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9b13c001-d1bd-47c9-9c9f-0b0756546354 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:15.580257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9b13c001-d1bd-47c9-9c9f-0b0756546354 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:15.591541 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9b13c001-d1bd-47c9-9c9f-0b0756546354 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1094 microversion: 2.1 time: 0.277966 Oct 17 13:30:15.595492 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3602/6897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:15 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1094 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:15.839892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:15.842216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:15.868796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:15.870407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:15.870885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:15.871644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:15.872127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:15.873423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:15.956325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-714e5ce5-b17c-4dc7-8693-b222026771fd tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139599 Oct 17 13:30:15.959694 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3296/6898] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:15 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:16.625983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:16.628027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:16.645667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:16.646661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:16.649061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:16.654803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:16.655906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:16.657753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:16.972214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:16.975032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:16.991345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:16.998191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:17.001008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:17.003279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:17.004008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:17.006335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:17.101412 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b4a1068a-535d-46f2-ab87-767f2c2a6115 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133509 Oct 17 13:30:17.108135 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3297/6899] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:16 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:30:17.194099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:17.208925 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5105b2c9-e211-4663-b1b4-0a682f48b4ba tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1210 microversion: 2.1 time: 0.591498 Oct 17 13:30:17.230517 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3603/6900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:16 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1210 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:18.120962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:18.123272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:18.137882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:18.144634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:18.145341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.146332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:18.146977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:18.147585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.224761 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e3f325ed-c1ce-42a9-a916-cfc68ab7504f tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107926 Oct 17 13:30:18.230352 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3298/6901] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:18 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:18.236917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:18.238696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:18.270444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:18.271529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:18.273571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.280093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:18.281359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:18.283384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.538517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:18.553455 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f2c1f3b0-d7df-4464-8da8-30bed354204c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1210 microversion: 2.1 time: 0.324007 Oct 17 13:30:18.554309 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3604/6902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:18 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1210 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:19.245868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:19.248550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:19.264353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:19.267414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:19.268429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:19.272017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:19.278445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:19.279296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:19.330826 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-156fe780-ca20-4ade-9c85-7543dd2e5809 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089407 Oct 17 13:30:19.337282 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3299/6903] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:19 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:19.591712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:19.592235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:19.613432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:19.615871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:19.616919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:19.619546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:19.624221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:19.625203 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:19.966794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:19.988819 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d1fb2fd-9b73-40e8-8f07-bac348145aa4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1278 microversion: 2.1 time: 0.401502 Oct 17 13:30:19.997373 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3605/6904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:19 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1278 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:20.343911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:20.353545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:20.363336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:20.373634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:20.374193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:20.374650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:20.375945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:20.376416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:20.388895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:20.409676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:20.517623 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e2403ff-2414-41ea-8c93-e506e1dee810 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176618 Oct 17 13:30:20.518468 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3300/6905] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:20 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:20.692804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6a23e231-46bb-4fd6-9a4e-1a92b5dbfcef req-29917cd1-3d8a-44df-b0a2-4bf16ce2e489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96cc7e10-18d1-4269-8c1c-573074830656", "tag": "96cb164a-4439-4eea-b7a8-497100c170d5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:20.717964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:20.726210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a23e231-46bb-4fd6-9a4e-1a92b5dbfcef req-29917cd1-3d8a-44df-b0a2-4bf16ce2e489 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:20.726707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a23e231-46bb-4fd6-9a4e-1a92b5dbfcef req-29917cd1-3d8a-44df-b0a2-4bf16ce2e489 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:20.730934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a23e231-46bb-4fd6-9a4e-1a92b5dbfcef req-29917cd1-3d8a-44df-b0a2-4bf16ce2e489 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:20.754666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:20.783886 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6a23e231-46bb-4fd6-9a4e-1a92b5dbfcef req-29917cd1-3d8a-44df-b0a2-4bf16ce2e489 service nova] Creating event network-changed:96cb164a-4439-4eea-b7a8-497100c170d5 for instance 96cc7e10-18d1-4269-8c1c-573074830656 on n-h2-853316-12 Oct 17 13:30:20.807989 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6a23e231-46bb-4fd6-9a4e-1a92b5dbfcef req-29917cd1-3d8a-44df-b0a2-4bf16ce2e489 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122771 Oct 17 13:30:20.809827 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3606/6906] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:30:21.022528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:21.026008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:21.081428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:21.084323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:21.085127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:21.085907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:21.086427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:21.088205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:21.532982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:21.535820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:21.557135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:21.561758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:21.565200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:21.569344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:21.570788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:21.572236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:21.655294 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c0394f7-5d6f-491d-a0a0-a5057722b738 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127787 Oct 17 13:30:21.662297 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3607/6907] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:30:21 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:30:21.751180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:21.777206 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9381affe-1141-4e1a-ad86-65617ef1c356 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1278 microversion: 2.1 time: 0.756494 Oct 17 13:30:21.779151 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3301/6908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:21 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1278 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:21.842040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:21.842040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:21.860929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:21.861556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:21.862072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:21.863796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:21.864351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:21.864853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:21.897224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:30:22.036217 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-074b7433-f2e8-4f3a-b603-391787f169f5 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 204 len: 0 microversion: 2.1 time: 0.205766 Oct 17 13:30:22.038016 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3608/6909] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:21 2022] DELETE /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:22.052417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:22.053134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:22.068166 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:22.068792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:22.069261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:22.070025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:22.070518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:22.070975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:22.416124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:22.429508 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5f7e9975-d697-4923-bfd4-d9715d14deef tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1684 microversion: 2.1 time: 0.383523 Oct 17 13:30:22.438842 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3302/6910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:22 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1684 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:22.849721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:22.853696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:22.869689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:22.876600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:22.877815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:22.880251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:22.884877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:22.887238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:23.453341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:23.458356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:23.467962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:23.487627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:23.490341 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-92448198-af78-4445-93c7-1ec695d7dd36 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1278 microversion: 2.1 time: 0.658905 Oct 17 13:30:23.490809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:23.491460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:23.493727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:23.493989 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3609/6911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:22 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1278 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:23.498742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:23.499260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:23.591408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:23.629785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:24.195544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:24.245343 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cb5424d2-9189-4c54-8441-7caa2b15ad41 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1684 microversion: 2.1 time: 0.771673 Oct 17 13:30:24.255512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3303/6912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:23 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1684 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:24.532750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:24.533297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:24.546145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:24.556204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:24.557118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:24.558066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:24.558989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:24.561130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:24.938741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:24.959229 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6100d385-671f-436e-91cf-2885eb1380b8 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1278 microversion: 2.1 time: 0.430562 Oct 17 13:30:24.960507 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3610/6913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:24 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1278 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:25.279628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:25.283262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:25.309889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:25.316104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:25.318550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:25.322113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:25.325744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:25.332924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:25.589296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:25.599724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-99c151b1-4af4-4621-ab76-c482d4d5db69 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1616 microversion: 2.1 time: 0.325165 Oct 17 13:30:25.605314 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3304/6914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:25 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1616 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:26.003379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:26.004401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:26.019830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:26.022283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:26.022997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:26.023652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:26.026876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:26.027576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:26.028177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:26.731231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:26.756225 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3ece70f8-0ca4-479d-b495-b94993d2764f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1278 microversion: 2.1 time: 0.759280 Oct 17 13:30:26.794490 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3611/6915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:25 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1278 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:26.800976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:26.821974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:26.852321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:26.853197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:26.853853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:26.876240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-73e688a0-e959-4ae0-83d9-ff6c2be9b1d6 req-2d71d004-c1de-4a59-b755-2f7bfb02a337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07b8550-e661-4850-9ac0-faec451bf1f8", "name": "network-vif-deleted", "tag": "c6064ad5-eb45-4358-92a3-7db3b0c3a626"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:26.879382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:26.880189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:26.892330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:26.922859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-73e688a0-e959-4ae0-83d9-ff6c2be9b1d6 req-2d71d004-c1de-4a59-b755-2f7bfb02a337 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:26.923588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-73e688a0-e959-4ae0-83d9-ff6c2be9b1d6 req-2d71d004-c1de-4a59-b755-2f7bfb02a337 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:26.929787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-73e688a0-e959-4ae0-83d9-ff6c2be9b1d6 req-2d71d004-c1de-4a59-b755-2f7bfb02a337 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:26.992966 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-73e688a0-e959-4ae0-83d9-ff6c2be9b1d6 req-2d71d004-c1de-4a59-b755-2f7bfb02a337 service nova] Creating event network-vif-deleted:c6064ad5-eb45-4358-92a3-7db3b0c3a626 for instance b07b8550-e661-4850-9ac0-faec451bf1f8 on n-h2-853316-12 Oct 17 13:30:27.037047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-73e688a0-e959-4ae0-83d9-ff6c2be9b1d6 req-2d71d004-c1de-4a59-b755-2f7bfb02a337 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.842192 Oct 17 13:30:27.041531 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3305/6916] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:27.103810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.108358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.109757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:27.110913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lazy-loading 'fault' on Instance uuid b07b8550-e661-4850-9ac0-faec451bf1f8 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:30:27.288419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a7a84e3905a4b5e887825b601e3d964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc91c516177497fa5d502d401b13efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:27.333258 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-80acfe4b-ba2e-48b2-9521-09e254346080 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 200 len: 1332 microversion: 2.1 time: 0.534231 Oct 17 13:30:27.337131 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3612/6917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:26 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 1332 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:27.801334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:27.802057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:27.827411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.829192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.837675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:27.845736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.854140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.854830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:28.375333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:28.375999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:28.383851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:28.384627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:28.385055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:28.385496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:28.391632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:28.392620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:28.396516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:28.413080 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-56cefdac-3237-435f-8188-af2cdfa28ddc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1278 microversion: 2.1 time: 0.611505 Oct 17 13:30:28.413844 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3306/6918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:27 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1278 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:28.459132 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 HTTP/1.1 Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'b07b8550-e661-4850-9ac0-faec451bf1f8'} Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:28.468316 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:28.474067 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:28.474067 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:28.474067 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:28.474067 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:28.474067 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:28.474067 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:28.474067 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:28.476342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:28.479113 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88cf908f-3f08-4780-ac5e-da48f98fa671 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 404 len: 111 microversion: 2.1 time: 0.108029 Oct 17 13:30:28.482685 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3613/6919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:28 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:28.491368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48e9c5e9-4da2-4c4b-a37b-7a2e8dcf6944 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '.version_select at 0x7fa8204baa60>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:28.550789 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48e9c5e9-4da2-4c4b-a37b-7a2e8dcf6944 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906263869" status: 202 len: 0 microversion: 2.1 time: 0.064301 Oct 17 13:30:28.556619 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3307/6920] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:30:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906263869 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:30:29.438370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:29.443325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:29.457489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:29.457997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:29.458467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:29.459186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:29.466389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:29.466921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:29.883174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:29.899601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d58f2a44-0a50-49ff-84c5-bf8bd645ce54 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1278 microversion: 2.1 time: 0.462508 Oct 17 13:30:29.900725 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3614/6921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:29 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1278 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:30.931463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:30.932771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:30.961648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:30.962823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:30.964373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:30.967039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:30.968389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:30.970635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:31.295700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:31.307767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a4d8cfb2-eea6-447e-b7ed-bc643b443346 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1278 microversion: 2.1 time: 0.382357 Oct 17 13:30:31.308975 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3308/6922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:30 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1278 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:32.332852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:32.334260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:32.347372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.348728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.349849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.351230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.351953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.352739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.667995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:32.707824 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ff9e97f-e224-4aae-b466-16581cb56559 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 0.379696 Oct 17 13:30:32.713626 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3615/6923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:32 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:33.733813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:33.737185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:33.759615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:33.769335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:33.770809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:33.778724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:33.779617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:33.780382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:34.066398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:34.082490 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5f22db92-8bf7-47e7-828b-056e02c52263 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 0.350626 Oct 17 13:30:34.084121 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3309/6924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:33 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:35.112946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:35.113844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:35.125520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.126278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.127233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.128089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.128672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.129207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.288888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:35.292074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:35.304103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.304906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.305424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.306184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.306809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.307436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.329190 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 HTTP/1.1 Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'b07b8550-e661-4850-9ac0-faec451bf1f8'} Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:35.331544 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.336622 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.339022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:35.340595 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-83551590-6978-4b5d-a17f-29f6aa105654 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 404 len: 111 microversion: 2.1 time: 0.056170 Oct 17 13:30:35.341711 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3310/6925] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:35 2022] DELETE /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:35.354413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:35.355994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: b07b8550-e661-4850-9ac0-faec451bf1f8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:35.366592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.367640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.368861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.371255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.372425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.373531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.395278 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 HTTP/1.1 Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'b07b8550-e661-4850-9ac0-faec451bf1f8'} Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:35.397591 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance b07b8550-e661-4850-9ac0-faec451bf1f8 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6c0e5ac9-464c-4cd4-a65b-9901b4cf210b tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8" status: 404 len: 111 microversion: 2.1 time: 0.052153 Oct 17 13:30:35.407364 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3311/6926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:35 2022] GET /compute/v2.1/servers/b07b8550-e661-4850-9ac0-faec451bf1f8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:35.440999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:35.462506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c1cd055c-ee0f-4132-aaac-7ae11b77517d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 0.351314 Oct 17 13:30:35.478273 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3616/6927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:35 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:36.494923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:36.496371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:36.508814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:36.509327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:36.509818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:36.510567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:36.511045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:36.511486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:36.823112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:36.838242 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-380a00c7-f1f3-48cd-a05f-91c2f6d2ad95 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 0.347656 Oct 17 13:30:36.839605 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3312/6928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:36 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:37.862802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:37.864471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:37.881503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:37.884891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:37.885599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:37.888538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:37.889712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:37.891324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:38.272759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:38.293489 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a3097b4-bef1-4d7e-a2fb-8bbe0814959e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 0.434770 Oct 17 13:30:38.299168 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3617/6929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:37 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:39.319693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:39.320984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:39.339231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:39.346338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:39.354795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:39.357256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:39.361053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:39.361779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:39.662199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:39.672383 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48598efb-c24a-4928-a83e-0f2f3f324685 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 0.356466 Oct 17 13:30:39.682991 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3313/6930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:39 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:40.708163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:40.712885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:40.754332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:40.756878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:40.759806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:40.765540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:40.769402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:40.771190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.216645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:41.222009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:41.248647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.255734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.256524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.259933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.260884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.261659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.312413 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 HTTP/1.1 Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8b5b79d6-ba94-43d7-acb5-ec175c05cf38'} Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:41.314691 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.318772 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.327453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:41.331363 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-413effc6-4175-411a-bd73-c18c23393e1c tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 404 len: 111 microversion: 2.1 time: 0.122445 Oct 17 13:30:41.336743 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3314/6931] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:41 2022] DELETE /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:41.362689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:41.365853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 8b5b79d6-ba94-43d7-acb5-ec175c05cf38] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:41.390871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.392896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.396161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.400016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.401240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.401907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.443456 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 HTTP/1.1 Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8b5b79d6-ba94-43d7-acb5-ec175c05cf38'} Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:41.447990 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.455935 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.455935 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:41.455935 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:41.455935 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:41.455935 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:41.455935 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. Oct 17 13:30:41.455935 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.458105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance 8b5b79d6-ba94-43d7-acb5-ec175c05cf38 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:41.462198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-96252a54-6cb1-4eec-a948-757e32b39898 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38" status: 404 len: 111 microversion: 2.1 time: 0.123206 Oct 17 13:30:41.465124 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3315/6932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:41 2022] GET /compute/v2.1/servers/8b5b79d6-ba94-43d7-acb5-ec175c05cf38 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:41.480805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:41.483096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:41.508415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.509219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.509881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.510946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.513116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.521644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.558370 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 HTTP/1.1 Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '3aa4488d-15f6-4103-970f-83ab4b0283c5'} Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:41.565053 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.571798 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.584770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:41.586749 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ae573a9-1567-4f32-a459-808dd971fb9e tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 404 len: 111 microversion: 2.1 time: 0.117555 Oct 17 13:30:41.588478 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3316/6933] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:41 2022] DELETE /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:41.600918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:41.605870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: 3aa4488d-15f6-4103-970f-83ab4b0283c5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:41.633628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.637588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.653676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.657234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.664623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.666206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.675063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:41.700429 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d08d1b7f-6c85-407b-a1ab-c546e5bcdaf5 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 1.000292 Oct 17 13:30:41.704501 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3618/6934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:40 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:41.712012 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 HTTP/1.1 Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '3aa4488d-15f6-4103-970f-83ab4b0283c5'} Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:41.713819 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance 3aa4488d-15f6-4103-970f-83ab4b0283c5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:41.721488 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e346e62d-5a53-4319-8371-0b3b0d371995 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5" status: 404 len: 111 microversion: 2.1 time: 0.121703 Oct 17 13:30:41.725292 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3317/6935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:41 2022] GET /compute/v2.1/servers/3aa4488d-15f6-4103-970f-83ab4b0283c5 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:42.734463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:42.735714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:42.757560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.762488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.763215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:42.774115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.775486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.777001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:43.400014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:43.433319 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8007795-c527-4e53-9896-5c24b14cda05 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 0.693466 Oct 17 13:30:43.436631 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3619/6936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:42 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:44.112277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8cf23b78-a85b-4b5a-baef-ecd9e6e4cd3e req-c1a86b5e-5c37-4346-8fe4-94655c9eb916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96cc7e10-18d1-4269-8c1c-573074830656", "name": "network-vif-plugged", "status": "completed", "tag": "96cb164a-4439-4eea-b7a8-497100c170d5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:44.134689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8cf23b78-a85b-4b5a-baef-ecd9e6e4cd3e req-c1a86b5e-5c37-4346-8fe4-94655c9eb916 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.137501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8cf23b78-a85b-4b5a-baef-ecd9e6e4cd3e req-c1a86b5e-5c37-4346-8fe4-94655c9eb916 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.138554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8cf23b78-a85b-4b5a-baef-ecd9e6e4cd3e req-c1a86b5e-5c37-4346-8fe4-94655c9eb916 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.168790 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8cf23b78-a85b-4b5a-baef-ecd9e6e4cd3e req-c1a86b5e-5c37-4346-8fe4-94655c9eb916 service nova] Creating event network-vif-plugged:96cb164a-4439-4eea-b7a8-497100c170d5 for instance 96cc7e10-18d1-4269-8c1c-573074830656 on n-h2-853316-12 Oct 17 13:30:44.174760 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8cf23b78-a85b-4b5a-baef-ecd9e6e4cd3e req-c1a86b5e-5c37-4346-8fe4-94655c9eb916 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.392148 Oct 17 13:30:44.180710 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3318/6937] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:44.475278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:44.477078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:44.484836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.485612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.486281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.487408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.488037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.488614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.718898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:44.732244 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0aa8ebe4-6aed-44ac-beee-83eed3f38e6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1266 microversion: 2.1 time: 0.260876 Oct 17 13:30:44.733637 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3620/6938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:44 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:45.758007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:45.758767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:45.770038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:45.770573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:45.771030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:45.771763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:45.772235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:45.772677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.081185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:46.105575 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fafea03e-44f8-49fa-baf1-3288c2045f31 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1451 microversion: 2.1 time: 0.353185 Oct 17 13:30:46.119499 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3319/6939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:45 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1451 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:46.141296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:46.142354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:46.161743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.162818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.163564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.164954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.165970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.166650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.456443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:46.473125 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-48598def-e75a-4ae7-a326-cb04742b1d41 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1451 microversion: 2.1 time: 0.339163 Oct 17 13:30:46.489063 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3621/6940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:46 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1451 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:47.736626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.740356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:47.766692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.768295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.769785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.772946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.776586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.779460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.824333 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 HTTP/1.1 Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'abe66c5b-310b-4e0c-a261-16961bc6f6b4'} Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:47.829697 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.833571 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.838725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:47.840598 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6c8e61d6-0cd9-4c94-844c-707c0fe6f1c4 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "DELETE /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 404 len: 111 microversion: 2.1 time: 0.115813 Oct 17 13:30:47.843834 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3320/6941] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:47 2022] DELETE /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:47.853109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.854491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] [instance: abe66c5b-310b-4e0c-a261-16961bc6f6b4] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:47.865014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.866334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.866805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.867537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.868088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.868533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.877085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:47.899725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a864b0e-c010-4d5f-a4d8-0d529dfc16de", "device": "/dev/sdb"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:47.904502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:47.918947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.922288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.925154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.927683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] HTTP exception thrown: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.928352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.929535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.930676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Request method failure captured: Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 HTTP/1.1 Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVeXGPGchnJlHMM7hbAqo47IWLPfgcCDDLi90uJrtRcnT6WgBzXdvOvq6WOoKITA8e_7_xtdGoqwG3a5oNrwPD_iI-XAEG3uKt-WL47Jf4nfswDL8b66MtMwcTuuqtde7VSeEt_h7Y5Qsi0qycDvFHgK9qJu1hvKcQ1pI6PkvWV1OdE Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bc91c516177497fa5d502d401b13efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bc91c516177497fa5d502d401b13efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 3bc91c516177497fa5d502d401b13efa Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-259853784 Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 6a7a84e3905a4b5e887825b601e3d964 Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-AttachVolumeNegativeTest-259853784-project Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'abe66c5b-310b-4e0c-a261-16961bc6f6b4'} Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:47.932458 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] Returning 404 to user: Instance abe66c5b-310b-4e0c-a261-16961bc6f6b4 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd77ce94-26e2-4ba4-a571-73e23c985bd7 tempest-AttachVolumeNegativeTest-259853784 tempest-AttachVolumeNegativeTest-259853784-project] 10.222.0.27 "GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4" status: 404 len: 111 microversion: 2.1 time: 0.084891 Oct 17 13:30:47.954244 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3622/6942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/servers/abe66c5b-310b-4e0c-a261-16961bc6f6b4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:48.463553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a3dc18e3-c358-46fc-80f7-43bb32aa1041 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "POST /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.579691 Oct 17 13:30:48.466759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3321/6943] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:30:47 2022] POST /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:51.267394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8ba104a1-5472-4eeb-9d41-32e4f60d19a6 req-32370dc9-1622-40ee-b94b-a0b8e8e22a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96cc7e10-18d1-4269-8c1c-573074830656", "tag": "96cb164a-4439-4eea-b7a8-497100c170d5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:51.324354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:51.332159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8ba104a1-5472-4eeb-9d41-32e4f60d19a6 req-32370dc9-1622-40ee-b94b-a0b8e8e22a6b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.343910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8ba104a1-5472-4eeb-9d41-32e4f60d19a6 req-32370dc9-1622-40ee-b94b-a0b8e8e22a6b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.346076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8ba104a1-5472-4eeb-9d41-32e4f60d19a6 req-32370dc9-1622-40ee-b94b-a0b8e8e22a6b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.379456 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8ba104a1-5472-4eeb-9d41-32e4f60d19a6 req-32370dc9-1622-40ee-b94b-a0b8e8e22a6b service nova] Creating event network-changed:96cb164a-4439-4eea-b7a8-497100c170d5 for instance 96cc7e10-18d1-4269-8c1c-573074830656 on n-h2-853316-12 Oct 17 13:30:51.417001 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8ba104a1-5472-4eeb-9d41-32e4f60d19a6 req-32370dc9-1622-40ee-b94b-a0b8e8e22a6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159529 Oct 17 13:30:51.425973 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3623/6944] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:59.092437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:59.094098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:59.381315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa0fd925-41e1-439a-ae61-6b357583981a tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Action: 'create', calling method: .version_select at 0x7fa81bccb0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-506706430"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:59.816945 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa0fd925-41e1-439a-ae61-6b357583981a tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.731756 Oct 17 13:30:59.817656 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3322/6945] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Oct 17 13:30:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 733 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 13:30:59.833472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-17603c24-0f4e-4a61-9a06-442a95fb0d1d tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81bb22c10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:59.935238 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-17603c24-0f4e-4a61-9a06-442a95fb0d1d tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 200 len: 344 microversion: 2.1 time: 0.107005 Oct 17 13:30:59.936254 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3624/6946] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:30:59 2022] GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:00.955098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f13384ef-47da-42c6-b090-82af8d4622e4 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81bcae550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.033096 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f13384ef-47da-42c6-b090-82af8d4622e4 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 200 len: 345 microversion: 2.1 time: 0.086412 Oct 17 13:31:01.033792 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3323/6947] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:31:00 2022] GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:01.052412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3cd7fb20-0093-4c1f-a6c1-c6e71c6b10d6 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Action: 'create', calling method: .version_select at 0x7fa81b95e820>, body: {"snapshot": {"volume_id": "f05c5987-90f4-43ad-95d3-550e8c025da7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-421672682"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:01.284258 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3cd7fb20-0093-4c1f-a6c1-c6e71c6b10d6 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.238314 Oct 17 13:31:01.296908 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3625/6948] 10.222.0.27 () {60 vars in 1162 bytes} [Mon Oct 17 13:31:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:31:01.302128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-99c80a5b-0c0b-473e-a26c-f3781a5255a5 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81bbf8ca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.362586 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-99c80a5b-0c0b-473e-a26c-f3781a5255a5 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 200 len: 286 microversion: 2.1 time: 0.063575 Oct 17 13:31:01.366788 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3324/6949] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:31:01.378536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6d92ca2-fab5-4b09-ac9d-26255a1feb1d tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81ba091f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.405354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:01.442744 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6d92ca2-fab5-4b09-ac9d-26255a1feb1d tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.067744 Oct 17 13:31:01.443466 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3626/6950] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:01.456283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f834c87d-dd2f-43fa-9235-6c6b09cc523d tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa8215e9310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.543760 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f834c87d-dd2f-43fa-9235-6c6b09cc523d tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 200 len: 286 microversion: 2.1 time: 0.091360 Oct 17 13:31:01.545682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3325/6951] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:02.564977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ca6ea273-d400-4cac-9c9a-b21d192ca2ea tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81bae11f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:02.624382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ca6ea273-d400-4cac-9c9a-b21d192ca2ea tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 200 len: 286 microversion: 2.1 time: 0.065437 Oct 17 13:31:02.631663 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3627/6952] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:02 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:03.645107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c680a10c-bae2-4e26-8487-3b17657c31c0 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa820418280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:03.705298 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c680a10c-bae2-4e26-8487-3b17657c31c0 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 200 len: 286 microversion: 2.1 time: 0.069115 Oct 17 13:31:03.710615 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3326/6953] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:03 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:04.727752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0b4e4cd-896d-4a6f-bd85-3ab637cb9f92 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81bae1040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:04.813805 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0b4e4cd-896d-4a6f-bd85-3ab637cb9f92 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 200 len: 287 microversion: 2.1 time: 0.097886 Oct 17 13:31:04.814611 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3628/6954] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:04 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:04.831014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd72d57b-631c-417d-a38d-14be64924e6e tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81be61f70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:04.945772 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd72d57b-631c-417d-a38d-14be64924e6e tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 202 len: 0 microversion: 2.1 time: 0.122211 Oct 17 13:31:04.947675 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3327/6955] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 17 13:31:04 2022] DELETE /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:31:04.960238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56a47c67-7a1d-4952-97d8-cde40c618f61 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81b95e310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:05.123984 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56a47c67-7a1d-4952-97d8-cde40c618f61 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 200 len: 286 microversion: 2.1 time: 0.170467 Oct 17 13:31:05.130247 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3629/6956] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:04 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:06.154983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3097184-e2b2-4315-83b5-a72a1453d859 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa8204629d0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:06.226639 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b3097184-e2b2-4315-83b5-a72a1453d859 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 200 len: 286 microversion: 2.1 time: 0.092215 Oct 17 13:31:06.241319 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3328/6957] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:06 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:07.251206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a76c1ba2-8dd9-4d46-9e16-deb47b3f66c6 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81b95e1f0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.363971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a76c1ba2-8dd9-4d46-9e16-deb47b3f66c6 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 200 len: 286 microversion: 2.1 time: 0.118117 Oct 17 13:31:07.365521 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3630/6958] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:07 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:08.414625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bac4a12e-6c78-4e7e-9d7a-d371c89969f1 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa82046a700>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.455383 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-bac4a12e-6c78-4e7e-9d7a-d371c89969f1 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] HTTP exception thrown: Snapshot 0192c489-704e-4ce7-8aba-1e02f247bead could not be found. Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bac4a12e-6c78-4e7e-9d7a-d371c89969f1 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Request method failure captured: Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead HTTP/1.1 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVkTpFuOtXmyVF7grVvyxCm9cCFalTrO01miS8lcXYJNKguNryv9bKlF07VSLa2DgX9YMu1_e5lOKW3CWXhyQ6Zwfu6qnVZyLu0FP4ck4bxdBn4_35f-WduZTOvzX9TMenjU2_X13OCTuF3HB4DoDis7tdoO6-_QQj55aAWjwBDvrgA Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a981f53696ad4676834328257a358a22 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a981f53696ad4676834328257a358a22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a981f53696ad4676834328257a358a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a981f53696ad4676834328257a358a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a981f53696ad4676834328257a358a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a981f53696ad4676834328257a358a22 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesSnapshotsTestJSON-740004456-project Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 07d53cbd6bb44901946fe6476e87b22c Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740004456-project Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: exception: Snapshot 0192c489-704e-4ce7-8aba-1e02f247bead could not be found. Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '0192c489-704e-4ce7-8aba-1e02f247bead'} Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0192c489-704e-4ce7-8aba-1e02f247bead could not be found. (HTTP 404) (Request-ID: req-77b7a7a9-0d00-4ddd-be83-8cff7134043d) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:31:08.466660 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0192c489-704e-4ce7-8aba-1e02f247bead could not be found. Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0192c489-704e-4ce7-8aba-1e02f247bead could not be found. Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0192c489-704e-4ce7-8aba-1e02f247bead could not be found. Oct 17 13:31:08.479071 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.495004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bac4a12e-6c78-4e7e-9d7a-d371c89969f1 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Returning 404 to user: Snapshot 0192c489-704e-4ce7-8aba-1e02f247bead could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:08.498579 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bac4a12e-6c78-4e7e-9d7a-d371c89969f1 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead" status: 404 len: 111 microversion: 2.1 time: 0.117495 Oct 17 13:31:08.499865 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3329/6959] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 13:31:08 2022] GET /compute/v2.1/os-snapshots/0192c489-704e-4ce7-8aba-1e02f247bead => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:08.511388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-491e2087-f868-4456-97e2-d0e4ca455b94 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81b9b7af0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.626032 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-491e2087-f868-4456-97e2-d0e4ca455b94 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 202 len: 0 microversion: 2.1 time: 0.119681 Oct 17 13:31:08.627071 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3631/6960] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:31:08 2022] DELETE /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:31:08.636511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c5648074-4f1e-4568-b64b-afa5e09f62ce tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81bcd5280>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.735971 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c5648074-4f1e-4568-b64b-afa5e09f62ce tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 200 len: 344 microversion: 2.1 time: 0.101932 Oct 17 13:31:08.738650 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3330/6961] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:31:08 2022] GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:09.769441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5937f2f-b49e-400a-8956-0e80b024771e tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81b95eaf0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:09.850948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:10.069071 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c5937f2f-b49e-400a-8956-0e80b024771e tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 200 len: 344 microversion: 2.1 time: 0.310956 Oct 17 13:31:10.069683 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3632/6962] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:31:09 2022] GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 344 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:11.095473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff14c0b5-c87c-44c1-b971-fe6f0e500f0e tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81bcd5ee0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:11.263820 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff14c0b5-c87c-44c1-b971-fe6f0e500f0e tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 200 len: 344 microversion: 2.1 time: 0.174204 Oct 17 13:31:11.265615 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3331/6963] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:31:11 2022] GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:12.290190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8f2aede1-6dbd-45c6-9593-51995d839412 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81b974550>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:12.462809 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8f2aede1-6dbd-45c6-9593-51995d839412 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 200 len: 344 microversion: 2.1 time: 0.180082 Oct 17 13:31:12.462809 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3633/6964] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:31:12 2022] GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:13.483756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2095c636-e941-4248-a17f-6111957cd7ee tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81be68a60>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:13.528459 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-2095c636-e941-4248-a17f-6111957cd7ee tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] HTTP exception thrown: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2095c636-e941-4248-a17f-6111957cd7ee tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Request method failure captured: Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 HTTP/1.1 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVkTpFuOtXmyVF7grVvyxCm9cCFalTrO01miS8lcXYJNKguNryv9bKlF07VSLa2DgX9YMu1_e5lOKW3CWXhyQ6Zwfu6qnVZyLu0FP4ck4bxdBn4_35f-WduZTOvzX9TMenjU2_X13OCTuF3HB4DoDis7tdoO6-_QQj55aAWjwBDvrgA Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a981f53696ad4676834328257a358a22 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a981f53696ad4676834328257a358a22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a981f53696ad4676834328257a358a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a981f53696ad4676834328257a358a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a981f53696ad4676834328257a358a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a981f53696ad4676834328257a358a22 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesSnapshotsTestJSON-740004456-project Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 07d53cbd6bb44901946fe6476e87b22c Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740004456-project Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: exception: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'f05c5987-90f4-43ad-95d3-550e8c025da7'} Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. (HTTP 404) (Request-ID: req-01d6b0d8-3620-4033-94cf-470c1234e2e2) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:31:13.530941 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.534950 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.543752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2095c636-e941-4248-a17f-6111957cd7ee tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Returning 404 to user: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:13.546051 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2095c636-e941-4248-a17f-6111957cd7ee tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 404 len: 109 microversion: 2.1 time: 0.068976 Oct 17 13:31:13.547641 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3332/6965] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:31:13 2022] GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:31:13.560449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55abf397-05d6-431b-95f2-d45aa7698bdf tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81b94b160>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:13.606599 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-55abf397-05d6-431b-95f2-d45aa7698bdf tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] HTTP exception thrown: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55abf397-05d6-431b-95f2-d45aa7698bdf tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Request method failure captured: Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 HTTP/1.1 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVkTpFuOtXmyVF7grVvyxCm9cCFalTrO01miS8lcXYJNKguNryv9bKlF07VSLa2DgX9YMu1_e5lOKW3CWXhyQ6Zwfu6qnVZyLu0FP4ck4bxdBn4_35f-WduZTOvzX9TMenjU2_X13OCTuF3HB4DoDis7tdoO6-_QQj55aAWjwBDvrgA Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: a981f53696ad4676834328257a358a22 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a981f53696ad4676834328257a358a22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a981f53696ad4676834328257a358a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a981f53696ad4676834328257a358a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a981f53696ad4676834328257a358a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: a981f53696ad4676834328257a358a22 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-VolumesSnapshotsTestJSON-740004456-project Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 07d53cbd6bb44901946fe6476e87b22c Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740004456-project Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: method: Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: exception: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'f05c5987-90f4-43ad-95d3-550e8c025da7'} Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. (HTTP 404) (Request-ID: req-e65e42f8-456f-4311-82ac-d6199d2460f1) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:31:13.611366 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.615791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.620345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55abf397-05d6-431b-95f2-d45aa7698bdf tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Returning 404 to user: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:13.623156 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55abf397-05d6-431b-95f2-d45aa7698bdf tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 404 len: 109 microversion: 2.1 time: 0.068798 Oct 17 13:31:13.627461 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3634/6966] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 13:31:13 2022] DELETE /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:13.638034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ffa2453b-367f-4167-aaae-f8fe03283fa4 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Calling method '.version_select at 0x7fa81beec5e0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:13.709177 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-ffa2453b-367f-4167-aaae-f8fe03283fa4 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] HTTP exception thrown: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ffa2453b-367f-4167-aaae-f8fe03283fa4 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Request method failure captured: Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 HTTP/1.1 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVkTpFuOtXmyVF7grVvyxCm9cCFalTrO01miS8lcXYJNKguNryv9bKlF07VSLa2DgX9YMu1_e5lOKW3CWXhyQ6Zwfu6qnVZyLu0FP4ck4bxdBn4_35f-WduZTOvzX9TMenjU2_X13OCTuF3HB4DoDis7tdoO6-_QQj55aAWjwBDvrgA Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: a981f53696ad4676834328257a358a22 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a981f53696ad4676834328257a358a22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a981f53696ad4676834328257a358a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a981f53696ad4676834328257a358a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a981f53696ad4676834328257a358a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: a981f53696ad4676834328257a358a22 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-740004456 Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesSnapshotsTestJSON-740004456-project Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 07d53cbd6bb44901946fe6476e87b22c Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-740004456-project Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: method: Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: exception: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'f05c5987-90f4-43ad-95d3-550e8c025da7'} Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. (HTTP 404) (Request-ID: req-8f39a899-885c-4810-9b1b-18b734091d2e) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:31:13.715757 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ffa2453b-367f-4167-aaae-f8fe03283fa4 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] Returning 404 to user: Volume f05c5987-90f4-43ad-95d3-550e8c025da7 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ffa2453b-367f-4167-aaae-f8fe03283fa4 tempest-VolumesSnapshotsTestJSON-740004456 tempest-VolumesSnapshotsTestJSON-740004456-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7" status: 404 len: 109 microversion: 2.1 time: 0.089407 Oct 17 13:31:13.721005 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3333/6967] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 13:31:13 2022] GET /compute/v2.1/os-volumes/f05c5987-90f4-43ad-95d3-550e8c025da7 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:25.554866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:25.556082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:25.566398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:25.566398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:25.567065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:25.567306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:25.567798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:25.568227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:25.675633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lazy-loading 'services' on Instance uuid 702b69df-02fe-4858-a6fd-6b1666e632a1 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:31:25.785736 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe255e71-6723-4877-9dae-0c92a8281855 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1/os-volume_attachments/5a864b0e-c010-4d5f-a4d8-0d529dfc16de" status: 202 len: 0 microversion: 2.1 time: 0.240680 Oct 17 13:31:25.786843 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3635/6968] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:31:25 2022] DELETE /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1/os-volume_attachments/5a864b0e-c010-4d5f-a4d8-0d529dfc16de => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:31:32.589930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:32.590850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:32.603482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:32.604482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:32.606576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:32.607957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:32.608801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:32.609671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:32.654985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:31:32.766779 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7bc10caa-8b0e-4dc8-bceb-b8ae34ef8bd3 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 204 len: 0 microversion: 2.1 time: 0.183927 Oct 17 13:31:32.768134 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3334/6969] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:31:32 2022] DELETE /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:31:32.780407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:32.780407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:32.787403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:32.787894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:32.789243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:32.790558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:32.791198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:32.791817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:33.021149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:33.031567 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2a6e39e7-03b8-4a18-b1ea-de6f8d3e13a4 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1512 microversion: 2.1 time: 0.258435 Oct 17 13:31:33.032276 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3636/6970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:32 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:34.060303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:34.061083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:34.069774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:34.070676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:34.071297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:34.072192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:34.072880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:34.073554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:34.318673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:34.334337 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a2aecd7-c79e-4c03-b979-f6fabedac5ad tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1512 microversion: 2.1 time: 0.280147 Oct 17 13:31:34.336397 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3335/6971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:34 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:35.365750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:35.366921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:35.386195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:35.387190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:35.387873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:35.388981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:35.389686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:35.390616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:35.550341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:35.569143 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-151eaead-27b6-4956-b2e1-bece2590a478 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 200 len: 1470 microversion: 2.1 time: 0.208715 Oct 17 13:31:35.582199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3637/6972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:35 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:35.618944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3ca68592-7197-4e46-8a8a-fe7a33891c2c req-c9d503cc-a424-46d9-9d3a-c70ed4febf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702b69df-02fe-4858-a6fd-6b1666e632a1", "name": "network-vif-deleted", "tag": "72e5dfc5-b219-46c7-a78b-7cd063f24974"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:35.646595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3ca68592-7197-4e46-8a8a-fe7a33891c2c req-c9d503cc-a424-46d9-9d3a-c70ed4febf58 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:35.649629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3ca68592-7197-4e46-8a8a-fe7a33891c2c req-c9d503cc-a424-46d9-9d3a-c70ed4febf58 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:35.653433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3ca68592-7197-4e46-8a8a-fe7a33891c2c req-c9d503cc-a424-46d9-9d3a-c70ed4febf58 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:35.686492 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3ca68592-7197-4e46-8a8a-fe7a33891c2c req-c9d503cc-a424-46d9-9d3a-c70ed4febf58 service nova] Creating event network-vif-deleted:72e5dfc5-b219-46c7-a78b-7cd063f24974 for instance 702b69df-02fe-4858-a6fd-6b1666e632a1 on n-h1-853316-12 Oct 17 13:31:35.696664 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3ca68592-7197-4e46-8a8a-fe7a33891c2c req-c9d503cc-a424-46d9-9d3a-c70ed4febf58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083430 Oct 17 13:31:35.710480 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3336/6973] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:31:36.609490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:36.610928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 702b69df-02fe-4858-a6fd-6b1666e632a1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:36.620368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:36.620368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:36.624410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:36.626333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:36.626333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:36.626333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:36.648348 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] HTTP exception thrown: Instance 702b69df-02fe-4858-a6fd-6b1666e632a1 could not be found. Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Request method failure captured: Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 HTTP/1.1 Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVhvJwCnn3toKvzuJa-F9LGQ4RVYs2rCBZSiCsgTjvbaYduNmA9B1cxla_OwN1Ukj1GM8dArLFv8q9OB2OZxBUxxV4WpJ_Y7EtrO7n8yJQ0D9AM2XKCnLuPVov0gqtM-xGn9Qqo4ZzUPt9rRsdaivPps377szWfJC0_O_PSKhSptnxk Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 00295086b15e43b3ae6cd80f149f0dab Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-VolumesSnapshotTestJSON-551727208 Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_00295086b15e43b3ae6cd80f149f0dab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00295086b15e43b3ae6cd80f149f0dab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/00295086b15e43b3ae6cd80f149f0dab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00295086b15e43b3ae6cd80f149f0dab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-VolumesSnapshotTestJSON-551727208 Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 00295086b15e43b3ae6cd80f149f0dab Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-551727208 Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-VolumesSnapshotTestJSON-551727208-project Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 0d1551f5f8a34acc9823a4ce2c2f849b Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-VolumesSnapshotTestJSON-551727208-project Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 702b69df-02fe-4858-a6fd-6b1666e632a1 could not be found. Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '702b69df-02fe-4858-a6fd-6b1666e632a1'} Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702b69df-02fe-4858-a6fd-6b1666e632a1 could not be found. Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702b69df-02fe-4858-a6fd-6b1666e632a1 could not be found. Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:36.652459 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702b69df-02fe-4858-a6fd-6b1666e632a1 could not be found. Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Returning 404 to user: Instance 702b69df-02fe-4858-a6fd-6b1666e632a1 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-432fdaf5-7047-4212-8b3c-31b0ce57ed42 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1" status: 404 len: 111 microversion: 2.1 time: 0.049357 Oct 17 13:31:36.658648 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3638/6974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:36 2022] GET /compute/v2.1/servers/702b69df-02fe-4858-a6fd-6b1666e632a1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:47.343969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:47.345091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:47.350689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1249495281", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "66ad531f-2950-44ab-bb63-80a837e861ba"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:47.462342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] validate_networks() for [('66ad531f-2950-44ab-bb63-80a837e861ba', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:31:48.092161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:31:48.093042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:31:48.093964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:31:48.094791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:31:48.095580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:31:48.109884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.110667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.110913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.112470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.113346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.113984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.145142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Getting quotas for project 00295086b15e43b3ae6cd80f149f0dab. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:31:48.156269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Getting quotas for user 0d1551f5f8a34acc9823a4ce2c2f849b and project 00295086b15e43b3ae6cd80f149f0dab. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:31:48.172896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:31:48.176296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:31:48.249307 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7ac2bf5b-daa5-49a1-b66b-27692c4f177a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907983 Oct 17 13:31:48.250464 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3337/6975] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:31:48.272138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e502be3a-1b61-4df1-9a49-a4e0f70ed1ec tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:48.275726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e502be3a-1b61-4df1-9a49-a4e0f70ed1ec tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:48.294365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:48.296377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:48.412372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e502be3a-1b61-4df1-9a49-a4e0f70ed1ec tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:48.428931 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e502be3a-1b61-4df1-9a49-a4e0f70ed1ec tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1219 microversion: 2.1 time: 0.165151 Oct 17 13:31:48.438124 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3639/6976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:48 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:49.476254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:49.477024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:49.489193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:49.489952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:49.490538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:49.491990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:49.493476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:49.494122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:49.615493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:49.626215 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f67176ee-bc8e-4174-abbb-99d008f84070 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1271 microversion: 2.1 time: 0.156982 Oct 17 13:31:49.627138 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3338/6977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:49 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:50.662352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:50.663624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:50.674821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.676006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.677062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.678062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.678787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.679438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.988133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:51.001661 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2959a3f6-87d2-44d4-88cb-62acfe8cef2a tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1319 microversion: 2.1 time: 0.343281 Oct 17 13:31:51.002641 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3640/6978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:50 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:52.039681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:52.041736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:52.052330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.053204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.053979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.054933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.055576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.056780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.147050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7072e083-8c7a-4c55-9f67-45fce37745be req-d1ea6f44-74f1-44da-83c1-853274d55a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2308a967-9b8e-45fb-b824-e0d72ec28d0a", "tag": "98950ef2-116d-485e-b363-54ad596120fc"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:52.190709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7072e083-8c7a-4c55-9f67-45fce37745be req-d1ea6f44-74f1-44da-83c1-853274d55a0e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.192328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7072e083-8c7a-4c55-9f67-45fce37745be req-d1ea6f44-74f1-44da-83c1-853274d55a0e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.193067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7072e083-8c7a-4c55-9f67-45fce37745be req-d1ea6f44-74f1-44da-83c1-853274d55a0e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.217139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7072e083-8c7a-4c55-9f67-45fce37745be req-d1ea6f44-74f1-44da-83c1-853274d55a0e service nova] Creating event network-changed:98950ef2-116d-485e-b363-54ad596120fc for instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a on n-h2-853316-12 Oct 17 13:31:52.224095 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7072e083-8c7a-4c55-9f67-45fce37745be req-d1ea6f44-74f1-44da-83c1-853274d55a0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082543 Oct 17 13:31:52.225478 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3641/6979] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:52.345174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:52.359067 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-86ac992d-0936-40ff-b195-2957c05dbc56 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1319 microversion: 2.1 time: 0.320906 Oct 17 13:31:52.371982 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3339/6980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:52 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:53.382913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:53.383692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:53.392597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.393157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.393608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.394698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.395173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.395716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.565510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:53.575586 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eca320d5-ab34-4b6b-9b7d-fe6ab9b9cc92 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1319 microversion: 2.1 time: 0.198194 Oct 17 13:31:53.583378 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3642/6981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:53 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:54.600906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:54.601659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:54.614947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:54.615740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:54.616201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:54.616941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:54.617414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:54.618110 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:54.807468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:54.815664 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8780968-7571-4f9e-9e96-8da770205016 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1319 microversion: 2.1 time: 0.218844 Oct 17 13:31:54.831153 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3340/6982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:54 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:55.847683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:55.848938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:55.862985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:55.864349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:55.865126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:55.866391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:55.867159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:55.867886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:56.208922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:56.225604 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ed39dcb0-817d-4473-8f88-5305e9fa48ca tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1319 microversion: 2.1 time: 0.386376 Oct 17 13:31:56.226581 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3643/6983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:55 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:57.260213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:57.264333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:57.288913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.291649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.293508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.295456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.297069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.298153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.349129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-431c010d-3eaa-4b9c-b99d-4485fc8eb694 req-1be77364-42e5-41d2-aea4-d44fb563e950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2308a967-9b8e-45fb-b824-e0d72ec28d0a", "name": "network-vif-plugged", "status": "completed", "tag": "98950ef2-116d-485e-b363-54ad596120fc"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:57.380506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-431c010d-3eaa-4b9c-b99d-4485fc8eb694 req-1be77364-42e5-41d2-aea4-d44fb563e950 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.381093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-431c010d-3eaa-4b9c-b99d-4485fc8eb694 req-1be77364-42e5-41d2-aea4-d44fb563e950 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.381907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-431c010d-3eaa-4b9c-b99d-4485fc8eb694 req-1be77364-42e5-41d2-aea4-d44fb563e950 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.406072 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-431c010d-3eaa-4b9c-b99d-4485fc8eb694 req-1be77364-42e5-41d2-aea4-d44fb563e950 service nova] Creating event network-vif-plugged:98950ef2-116d-485e-b363-54ad596120fc for instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a on n-h2-853316-12 Oct 17 13:31:57.422187 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-431c010d-3eaa-4b9c-b99d-4485fc8eb694 req-1be77364-42e5-41d2-aea4-d44fb563e950 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083516 Oct 17 13:31:57.423807 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3644/6984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:31:57.575994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:57.592016 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6f727aa-76b1-4261-a34d-eea1c1a48ba6 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1319 microversion: 2.1 time: 0.343499 Oct 17 13:31:57.593819 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3341/6985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:57 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:58.619193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:58.620041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:58.623613 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:31:58.623796 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:31:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a (ip 10.222.0.27) !!! Oct 17 13:31:58.626528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:58.636138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.637025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.637652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.639482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.639976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.640435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.853211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:58.867539 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e82ff51-1e5c-47a4-8548-4bc3d7bbf58b tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1506 microversion: 2.1 time: 0.253936 Oct 17 13:31:58.871362 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3645/6986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:58 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:58.901628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb3d6c85-6fef-475c-954b-565b9aaadc8d", "device": "/dev/sdb"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:58.904437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:58.907973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:58.907973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:58.917542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.918031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.918693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.919544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.920022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.920966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.257019 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-554bb010-5f9b-4573-add3-83b55d3f73a9 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "POST /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361387 Oct 17 13:31:59.257826 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3342/6987] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:31:58 2022] POST /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:16.016401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=16 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:16.017300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=28 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:16.173599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Calling method '.version_select at 0x7fa820d1a040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:16.175446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.175935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.176379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.197903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.198425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.198867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.213243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.213741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.214193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.221282 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c9453535-a9c3-4ed8-a02a-37cf93b6f2d9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1642648070-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.210585 Oct 17 13:32:16.221943 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3646/6988] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:32:16 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:22.572644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:22.573550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:22.583460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:22.584762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:22.587596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.588105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.588584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.591807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.591807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.591807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.732402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lazy-loading 'services' on Instance uuid 2308a967-9b8e-45fb-b824-e0d72ec28d0a {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:22.844699 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-df551c21-2ab3-4e6f-ac1b-ebe3e948d7c8 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a/os-volume_attachments/cb3d6c85-6fef-475c-954b-565b9aaadc8d" status: 202 len: 0 microversion: 2.1 time: 0.271044 Oct 17 13:32:22.844699 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3343/6989] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:32:22 2022] DELETE /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a/os-volume_attachments/cb3d6c85-6fef-475c-954b-565b9aaadc8d => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:32:28.370385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:28.370895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:28.373920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:28.374584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:28.380504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.381262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.382538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:28.383474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.384095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.384690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:28.412285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:28.526264 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-970d369d-1109-4e33-98a3-f03b9ef19e52 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 204 len: 0 microversion: 2.1 time: 0.160287 Oct 17 13:32:28.527096 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3647/6990] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:28 2022] DELETE /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:28.535841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:28.537126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:28.545013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.545521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.546153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:28.547242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.547680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.548433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:28.699422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:28.709322 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17975609-cc57-44f9-8037-2f267fa33968 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1512 microversion: 2.1 time: 0.177605 Oct 17 13:32:28.710540 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3344/6991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:28 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:29.734889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:29.735704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:29.743388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:29.743976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:29.744518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.745353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:29.745887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:29.746408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.951977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:29.962330 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-130f4f1e-74cb-47a4-ae8e-ab6d160f1e5f tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1512 microversion: 2.1 time: 0.231859 Oct 17 13:32:29.963404 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3648/6992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:29 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:30.598010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2a018f0d-6a0e-47d6-a616-a81b18a84f51 req-d9459a23-221c-4940-befa-874437f924f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2308a967-9b8e-45fb-b824-e0d72ec28d0a", "name": "network-vif-deleted", "tag": "98950ef2-116d-485e-b363-54ad596120fc"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:30.611592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2a018f0d-6a0e-47d6-a616-a81b18a84f51 req-d9459a23-221c-4940-befa-874437f924f8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:30.612484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2a018f0d-6a0e-47d6-a616-a81b18a84f51 req-d9459a23-221c-4940-befa-874437f924f8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:30.613105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2a018f0d-6a0e-47d6-a616-a81b18a84f51 req-d9459a23-221c-4940-befa-874437f924f8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:30.627708 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2a018f0d-6a0e-47d6-a616-a81b18a84f51 req-d9459a23-221c-4940-befa-874437f924f8 service nova] Creating event network-vif-deleted:98950ef2-116d-485e-b363-54ad596120fc for instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a on n-h2-853316-12 Oct 17 13:32:30.634663 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2a018f0d-6a0e-47d6-a616-a81b18a84f51 req-d9459a23-221c-4940-befa-874437f924f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041128 Oct 17 13:32:30.635536 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3345/6993] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:30.988507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:30.989673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:31.005238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:31.005739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:31.006859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:31.008311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:31.008929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:31.009293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:31.049979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:31.049979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:31.049979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:31.049979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lazy-loading 'fault' on Instance uuid 2308a967-9b8e-45fb-b824-e0d72ec28d0a {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:31.124183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1551f5f8a34acc9823a4ce2c2f849b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00295086b15e43b3ae6cd80f149f0dab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:31.137880 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e1e19ab-007d-4067-8877-5a67a4e76978 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 200 len: 1309 microversion: 2.1 time: 0.152862 Oct 17 13:32:31.139421 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3649/6994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:30 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:32.174087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:32.174863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] [instance: 2308a967-9b8e-45fb-b824-e0d72ec28d0a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:32.187042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.187918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.188517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:32.189363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.189946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.190699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:32.212462 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] HTTP exception thrown: Instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a could not be found. Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Request method failure captured: Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a HTTP/1.1 Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVhvJwCnn3toKvzuJa-F9LGQ4RVYs2rCBZSiCsgTjvbaYduNmA9B1cxla_OwN1Ukj1GM8dArLFv8q9OB2OZxBUxxV4WpJ_Y7EtrO7n8yJQ0D9AM2XKCnLuPVov0gqtM-xGn9Qqo4ZzUPt9rRsdaivPps377szWfJC0_O_PSKhSptnxk Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 00295086b15e43b3ae6cd80f149f0dab Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesSnapshotTestJSON-551727208 Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_00295086b15e43b3ae6cd80f149f0dab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00295086b15e43b3ae6cd80f149f0dab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/00295086b15e43b3ae6cd80f149f0dab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00295086b15e43b3ae6cd80f149f0dab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesSnapshotTestJSON-551727208 Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 00295086b15e43b3ae6cd80f149f0dab Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-551727208 Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesSnapshotTestJSON-551727208-project Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 0d1551f5f8a34acc9823a4ce2c2f849b Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesSnapshotTestJSON-551727208-project Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a could not be found. Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '2308a967-9b8e-45fb-b824-e0d72ec28d0a'} Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a could not be found. Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a could not be found. Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:32.214259 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a could not be found. Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] Returning 404 to user: Instance 2308a967-9b8e-45fb-b824-e0d72ec28d0a could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:32.219637 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b0ba81df-647d-4b5d-a66f-5a56ebc1b997 tempest-VolumesSnapshotTestJSON-551727208 tempest-VolumesSnapshotTestJSON-551727208-project] 10.222.0.27 "GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a" status: 404 len: 111 microversion: 2.1 time: 0.055785 Oct 17 13:32:32.224356 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3346/6995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:32 2022] GET /compute/v2.1/servers/2308a967-9b8e-45fb-b824-e0d72ec28d0a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:33.277084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:33.277592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:33.286475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9eb551a8-8c8c-4d09-98d1-3736e20c224f req-2010eaf7-63ce-450b-9514-d9962e5a6e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96cc7e10-18d1-4269-8c1c-573074830656", "tag": "96cb164a-4439-4eea-b7a8-497100c170d5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:33.300508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.301024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.301475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.302227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.302688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.308883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.311442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9eb551a8-8c8c-4d09-98d1-3736e20c224f req-2010eaf7-63ce-450b-9514-d9962e5a6e3c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.313796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9eb551a8-8c8c-4d09-98d1-3736e20c224f req-2010eaf7-63ce-450b-9514-d9962e5a6e3c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.314463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9eb551a8-8c8c-4d09-98d1-3736e20c224f req-2010eaf7-63ce-450b-9514-d9962e5a6e3c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.344271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9eb551a8-8c8c-4d09-98d1-3736e20c224f req-2010eaf7-63ce-450b-9514-d9962e5a6e3c service nova] Creating event network-changed:96cb164a-4439-4eea-b7a8-497100c170d5 for instance 96cc7e10-18d1-4269-8c1c-573074830656 on n-h2-853316-12 Oct 17 13:32:33.356889 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9eb551a8-8c8c-4d09-98d1-3736e20c224f req-2010eaf7-63ce-450b-9514-d9962e5a6e3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075234 Oct 17 13:32:33.359273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:33.360190 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3347/6996] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:33.601856 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ca5b935-e7f3-49c3-afac-c62e39499e06 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 204 len: 0 microversion: 2.1 time: 0.331067 Oct 17 13:32:33.602767 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3650/6997] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:33 2022] DELETE /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:32:33.612737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:33.613510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:33.627924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.628437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.628917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.629625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.635899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.638675 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:34.127526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:34.138333 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-493a930c-b3f5-4b8c-ae35-70aae9374e62 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1575 microversion: 2.1 time: 0.530757 Oct 17 13:32:34.139171 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3348/6998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:33 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1575 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:35.179900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:35.184838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:35.239217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:35.239899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:35.248241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:35.256815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:35.257399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:35.261433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:35.737419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:35.750679 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c65bf8a-7c79-4530-99f4-e1d40f6d2bcf tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1575 microversion: 2.1 time: 0.589427 Oct 17 13:32:35.751277 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3651/6999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:35 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1575 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:36.485820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fd8aabbf-e5a0-4b14-ad26-79f1b248d6a1 req-95d9ad81-7218-4dac-9f34-59767b91fb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96cc7e10-18d1-4269-8c1c-573074830656", "name": "network-vif-deleted", "tag": "96cb164a-4439-4eea-b7a8-497100c170d5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:36.513163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd8aabbf-e5a0-4b14-ad26-79f1b248d6a1 req-95d9ad81-7218-4dac-9f34-59767b91fb5d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.513685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd8aabbf-e5a0-4b14-ad26-79f1b248d6a1 req-95d9ad81-7218-4dac-9f34-59767b91fb5d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.517195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fd8aabbf-e5a0-4b14-ad26-79f1b248d6a1 req-95d9ad81-7218-4dac-9f34-59767b91fb5d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:36.572960 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fd8aabbf-e5a0-4b14-ad26-79f1b248d6a1 req-95d9ad81-7218-4dac-9f34-59767b91fb5d service nova] Creating event network-vif-deleted:96cb164a-4439-4eea-b7a8-497100c170d5 for instance 96cc7e10-18d1-4269-8c1c-573074830656 on n-h2-853316-12 Oct 17 13:32:36.601129 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fd8aabbf-e5a0-4b14-ad26-79f1b248d6a1 req-95d9ad81-7218-4dac-9f34-59767b91fb5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111774 Oct 17 13:32:36.602776 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3349/7000] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:36.781275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:36.782104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:36.833361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.833895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.834437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:36.841119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.841609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.844728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:37.025992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:37.035362 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b2a2302-6922-4eb9-b23b-19ee955b6c2a tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1225 microversion: 2.1 time: 0.258664 Oct 17 13:32:37.039547 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3652/7001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:36 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1225 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:38.062339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:38.063672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:38.080140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:38.081047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:38.081703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:38.082753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:38.084535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:38.085536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:38.207458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:38.222034 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa38941c-003d-41a8-9ebd-f7f004e5532c tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1225 microversion: 2.1 time: 0.164318 Oct 17 13:32:38.223100 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3350/7002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:38 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:39.250951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:39.252924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:39.266093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.267318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.268790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.269547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.270016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.270524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.358077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:39.367708 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f20f9e82-637b-4266-89dd-beb6a6c3afcc tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1225 microversion: 2.1 time: 0.124033 Oct 17 13:32:39.368594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3653/7003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:39 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:40.392703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:40.394068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:40.407970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.409034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.410790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.413121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.423332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.424001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.551951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:40.562486 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ddd80970-2dcd-4a35-82ee-7364586b84bd tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1225 microversion: 2.1 time: 0.173122 Oct 17 13:32:40.563322 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3351/7004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:40 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:41.593937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:41.594626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:41.602467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.603461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.604301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.605239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.605859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.606489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.734969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:41.749020 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6124044-7a7a-443e-8481-6e8683489b23 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1225 microversion: 2.1 time: 0.158987 Oct 17 13:32:41.753317 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3654/7005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:41 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1225 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:42.786138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:42.790613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:42.836290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.836817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.837287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.848842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.848842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.848842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.007095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:43.027177 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e7c13a3c-2616-4e1f-902c-9013537ebce4 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 200 len: 1225 microversion: 2.1 time: 0.252733 Oct 17 13:32:43.028073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3352/7006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:42 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 1225 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:44.056605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:44.057821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 96cc7e10-18d1-4269-8c1c-573074830656] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:44.066250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:44.067140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:44.069439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:44.070507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:44.071232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:44.071882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:44.089860 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 96cc7e10-18d1-4269-8c1c-573074830656 could not be found. Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 HTTP/1.1 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 96cc7e10-18d1-4269-8c1c-573074830656 could not be found. Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '96cc7e10-18d1-4269-8c1c-573074830656'} Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96cc7e10-18d1-4269-8c1c-573074830656 could not be found. Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96cc7e10-18d1-4269-8c1c-573074830656 could not be found. Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:44.092277 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:32:44.096582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:44.096582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:44.096582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:44.096582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:44.096582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:44.096582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96cc7e10-18d1-4269-8c1c-573074830656 could not be found. Oct 17 13:32:44.096582 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:32:44.099142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 96cc7e10-18d1-4269-8c1c-573074830656 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:44.101704 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-041657c7-5c75-433a-a9aa-c23b6a09a20b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656" status: 404 len: 111 microversion: 2.1 time: 0.050005 Oct 17 13:32:44.102990 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3655/7007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:44 2022] GET /compute/v2.1/servers/96cc7e10-18d1-4269-8c1c-573074830656 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:53.768082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:53.769410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:53.780963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=20 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:53.790047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-23affb03-702d-4e0c-a123-f2a03f4c1780 req-27d143ad-c88c-40ea-977e-0f1ae1010914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7374cde0-5da5-47d6-8b1f-5ca242b62b97", "tag": "b1698594-bf34-4d1a-9177-41d7f3e5f30e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:53.795972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:53.798344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.803635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.804574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.806442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.807107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.809973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.817909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23affb03-702d-4e0c-a123-f2a03f4c1780 req-27d143ad-c88c-40ea-977e-0f1ae1010914 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.820504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23affb03-702d-4e0c-a123-f2a03f4c1780 req-27d143ad-c88c-40ea-977e-0f1ae1010914 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.823123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-23affb03-702d-4e0c-a123-f2a03f4c1780 req-27d143ad-c88c-40ea-977e-0f1ae1010914 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.846046 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-23affb03-702d-4e0c-a123-f2a03f4c1780 req-27d143ad-c88c-40ea-977e-0f1ae1010914 service nova] Creating event network-changed:b1698594-bf34-4d1a-9177-41d7f3e5f30e for instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 on n-h1-853316-12 Oct 17 13:32:53.862208 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-23affb03-702d-4e0c-a123-f2a03f4c1780 req-27d143ad-c88c-40ea-977e-0f1ae1010914 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077947 Oct 17 13:32:53.863420 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3656/7008] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 17 13:32:53.871047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:54.056836 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4080a69f-3a5e-440d-a006-6421aaca48eb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 204 len: 0 microversion: 2.1 time: 0.290433 Oct 17 13:32:54.064988 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3353/7009] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:53 2022] DELETE /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:54.088112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:54.091552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:54.117441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.118928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.125104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.126721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.130572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.131640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.539433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:54.564437 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62b00cfb-2215-48c8-bcca-c7d3316a638d tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1576 microversion: 2.1 time: 0.491792 Oct 17 13:32:54.582624 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3657/7010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:54 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1576 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:55.610819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:55.611584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:55.620406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:55.621178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:55.621798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:55.625096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:55.627420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:55.628072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:56.154890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:56.163467 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eab25d7e-ea74-49be-bb70-f312516ab5c1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1576 microversion: 2.1 time: 0.568295 Oct 17 13:32:56.164205 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3354/7011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:55 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1576 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:56.807160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e7edae3b-3579-4c0e-b01d-e34d23d40853 req-6d14a9bc-24d8-4108-9da1-3d521d4f2bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7374cde0-5da5-47d6-8b1f-5ca242b62b97", "name": "network-vif-deleted", "tag": "b1698594-bf34-4d1a-9177-41d7f3e5f30e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:56.896740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7edae3b-3579-4c0e-b01d-e34d23d40853 req-6d14a9bc-24d8-4108-9da1-3d521d4f2bf9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:56.909876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7edae3b-3579-4c0e-b01d-e34d23d40853 req-6d14a9bc-24d8-4108-9da1-3d521d4f2bf9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:56.916974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7edae3b-3579-4c0e-b01d-e34d23d40853 req-6d14a9bc-24d8-4108-9da1-3d521d4f2bf9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:56.958180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e7edae3b-3579-4c0e-b01d-e34d23d40853 req-6d14a9bc-24d8-4108-9da1-3d521d4f2bf9 service nova] Creating event network-vif-deleted:b1698594-bf34-4d1a-9177-41d7f3e5f30e for instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 on n-h1-853316-12 Oct 17 13:32:56.971830 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e7edae3b-3579-4c0e-b01d-e34d23d40853 req-6d14a9bc-24d8-4108-9da1-3d521d4f2bf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185790 Oct 17 13:32:56.972581 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3658/7012] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:57.188979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:57.189803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:57.205843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:57.206680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:57.207300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:57.210759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:57.214586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:57.215220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:57.358237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:57.369990 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-391a07b7-d30a-42c5-88cd-3c8c9afe4f6e tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1225 microversion: 2.1 time: 0.186468 Oct 17 13:32:57.371264 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3355/7013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:57 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:58.425972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:58.427107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:58.443357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:58.447353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:58.448378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:58.449021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:58.450645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:58.451304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:58.451923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:58.491054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:58.568650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:58.584357 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-71eb8aa2-ab7d-4be7-b824-11fafb54574b tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1225 microversion: 2.1 time: 0.170376 Oct 17 13:32:58.585667 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3659/7014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:58 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:59.616180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:59.616823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:59.643832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:59.644718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:59.657826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.659177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:59.659902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:59.662593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.752132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:59.763413 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac9b33c2-a885-418f-836e-3662af725a28 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1225 microversion: 2.1 time: 0.155131 Oct 17 13:32:59.771507 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3356/7015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:59 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:00.804536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:00.805959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:00.825741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.826272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.826714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:00.827424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.827876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.828297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:01.003595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:01.017414 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2da41a8-6341-4526-9e54-ed4f4d77b76f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1225 microversion: 2.1 time: 0.219991 Oct 17 13:33:01.021951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3660/7016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:00 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1225 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:02.069291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:02.070762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:02.083226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.084479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.085233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.086373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.087098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.088095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.200359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:02.209733 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba423c6f-dc18-4f20-b25a-ed77c99c525f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1225 microversion: 2.1 time: 0.146171 Oct 17 13:33:02.223615 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3357/7017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:02 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:03.241201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:03.244623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:03.271489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.274066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.277005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.281045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.282310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.283376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.370412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.374482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.374482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.375197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lazy-loading 'fault' on Instance uuid 7374cde0-5da5-47d6-8b1f-5ca242b62b97 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:03.485484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153bc53fa8c442aebefd9a7758497262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63df7b8b34b0430dab9ba603f6eab380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:03.498578 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-96deff3b-7adb-43ec-9e30-544484e99479 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 200 len: 1230 microversion: 2.1 time: 0.264317 Oct 17 13:33:03.499534 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3661/7018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:03 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 1230 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:04.449655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-895028894", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:04.524645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:04.525305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 7374cde0-5da5-47d6-8b1f-5ca242b62b97] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:04.533599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.534452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.535672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.536750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.537008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.537699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.552329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] validate_networks() for None {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:33:04.555438 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 could not be found. Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 HTTP/1.1 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 could not be found. Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7374cde0-5da5-47d6-8b1f-5ca242b62b97'} Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 could not be found. Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 could not be found. Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:04.557998 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.562106 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:04.562106 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:04.562106 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:04.562106 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:04.562106 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:04.562106 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 could not be found. Oct 17 13:33:04.562106 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.564840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 7374cde0-5da5-47d6-8b1f-5ca242b62b97 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:04.565864 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e007c972-5718-4b44-8e19-ee5ec842fcb1 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97" status: 404 len: 111 microversion: 2.1 time: 0.046897 Oct 17 13:33:04.571964 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3662/7019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:04 2022] GET /compute/v2.1/servers/7374cde0-5da5-47d6-8b1f-5ca242b62b97 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:33:05.111948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:33:05.112592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:33:05.113117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:33:05.114365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:33:05.114980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:33:05.134678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.135441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.136169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.137521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.141631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.144769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.176570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Getting quotas for project f4c1ba01fd0b4cab8debde6a34578513. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:05.184355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Getting quotas for user 3d7152fdbbf64dc9b1b435ef02b280e0 and project f4c1ba01fd0b4cab8debde6a34578513. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:05.211091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:33:05.215227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:33:05.357714 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d471cf0-2ecc-4f3c-a20e-3ce579b7f078 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912000 Oct 17 13:33:05.373041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18b34a7e-33f1-4e97-b70f-9734644f5221 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:05.373787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18b34a7e-33f1-4e97-b70f-9734644f5221 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:05.378492 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3358/7020] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:33:05.437406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-18b34a7e-33f1-4e97-b70f-9734644f5221 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:05.447891 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18b34a7e-33f1-4e97-b70f-9734644f5221 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1213 microversion: 2.1 time: 0.078390 Oct 17 13:33:05.448885 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3663/7021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:05 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:05.691763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:05.691763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:05.706489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.709280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.710025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.730040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.730772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.731971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.748348 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb HTTP/1.1 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '13f71859-e12f-4df0-b035-67d3529c87cb'} Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:05.750316 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70271f20-b6bf-425e-aec2-52e579204268 tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 404 len: 111 microversion: 2.1 time: 0.067719 Oct 17 13:33:05.755769 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3359/7022] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:33:05 2022] DELETE /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:05.765674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:05.766580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [instance: 13f71859-e12f-4df0-b035-67d3529c87cb] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:05.785336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.786234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.788717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.790390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.792352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.793181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.820563 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] HTTP exception thrown: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Request method failure captured: Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb HTTP/1.1 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVWn_0YNICqU6kdgH7eDmH2pqQnavVdJUH7FaxuE0j0oBe3KPmwx6ZjmnkMSGmvGE0706v8q8FCZfdxVUR2aLTJyi8E8wDL7b1MTDgHY6d4qNE98jtin2IXsJOrC6bvhDwenzty_VPxWY_yk1Jgi5BfuHwgXhNEsJXRhiYGlU9Uuir4 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63df7b8b34b0430dab9ba603f6eab380", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63df7b8b34b0430dab9ba603f6eab380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 63df7b8b34b0430dab9ba603f6eab380 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1132208721 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 153bc53fa8c442aebefd9a7758497262 Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBootPattern-1132208721-project Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '13f71859-e12f-4df0-b035-67d3529c87cb'} Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:05.824064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.831545 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.831545 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:05.831545 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:05.831545 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:05.831545 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:05.831545 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. Oct 17 13:33:05.831545 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.835012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Returning 404 to user: Instance 13f71859-e12f-4df0-b035-67d3529c87cb could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:05.842042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8031dd65-5887-4dcb-9ebc-0f25100b9e3f tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb" status: 404 len: 111 microversion: 2.1 time: 0.078503 Oct 17 13:33:05.842915 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3664/7023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:05 2022] GET /compute/v2.1/servers/13f71859-e12f-4df0-b035-67d3529c87cb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:06.486985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:06.488020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:06.503401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.505303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.506041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.507040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.510310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.511101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.689834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:06.703619 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62705ba2-a757-4076-a1ac-3080c7a662d9 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1217 microversion: 2.1 time: 0.225018 Oct 17 13:33:06.718581 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3360/7024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:06 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:07.733209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:07.735071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:07.756758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.758340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.759186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.760978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.761797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.771420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.930752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.942837 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e367ecd-146c-4e42-b145-7db5e1ce98e6 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1271 microversion: 2.1 time: 0.214780 Oct 17 13:33:07.944035 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3665/7025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:07 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:08.973077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:08.976837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:08.995836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.999430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.001951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.003042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.005658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.008498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.561854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:09.580288 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48bda1a7-0d7f-415d-bdad-9448835fcdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1313 microversion: 2.1 time: 0.612697 Oct 17 13:33:09.586699 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3361/7026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:08 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:10.618515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:10.619927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:10.630768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.631823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.632711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.633655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.634419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.635069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.902779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b57c79a7-5a87-4e6b-a643-f1514a3268d4 req-80ba7853-e0b5-42f5-93d7-550674d41e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3994fa0-153b-4aec-bdad-63d21a8a2d2a", "tag": "45186cce-1ca5-4607-867f-8366ec445e38"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:10.925950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b57c79a7-5a87-4e6b-a643-f1514a3268d4 req-80ba7853-e0b5-42f5-93d7-550674d41e3e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.929969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b57c79a7-5a87-4e6b-a643-f1514a3268d4 req-80ba7853-e0b5-42f5-93d7-550674d41e3e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.930946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b57c79a7-5a87-4e6b-a643-f1514a3268d4 req-80ba7853-e0b5-42f5-93d7-550674d41e3e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.958089 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b57c79a7-5a87-4e6b-a643-f1514a3268d4 req-80ba7853-e0b5-42f5-93d7-550674d41e3e service nova] Creating event network-changed:45186cce-1ca5-4607-867f-8366ec445e38 for instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a on n-h2-853316-12 Oct 17 13:33:10.976552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b57c79a7-5a87-4e6b-a643-f1514a3268d4 req-80ba7853-e0b5-42f5-93d7-550674d41e3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083299 Oct 17 13:33:10.977998 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3362/7027] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:11.009367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:11.020821 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db63f782-3b81-48e0-a73d-cebacb1b8cec tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1313 microversion: 2.1 time: 0.406944 Oct 17 13:33:11.021765 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3666/7028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:10 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:11.959480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34aed072-0544-4187-9506-a2076d141dcb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] Calling method '.version_select at 0x7fa81bbf8820>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:11.975868 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34aed072-0544-4187-9506-a2076d141dcb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [e842b619-549b-4674-b41f-316ff90c7a34] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:33:12.064188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:12.065372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:12.074007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.074524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.075326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.075912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.076357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.077279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.385185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.401596 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f56c61fa-2f34-4955-8226-b683332830fc tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1313 microversion: 2.1 time: 0.347338 Oct 17 13:33:12.403590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3667/7029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:12 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:12.989237 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [None req-34aed072-0544-4187-9506-a2076d141dcb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] [e842b619-549b-4674-b41f-316ff90c7a34] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 33818. Oct 17 13:33:13.021660 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34aed072-0544-4187-9506-a2076d141dcb tempest-TestVolumeBootPattern-1132208721 tempest-TestVolumeBootPattern-1132208721-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-297218142" status: 202 len: 0 microversion: 2.1 time: 1.067734 Oct 17 13:33:13.026424 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3363/7030] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 13:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-297218142 => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:13.436981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:13.437809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:13.455794 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:33:13.456770 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a (ip 10.222.0.27) !!! Oct 17 13:33:13.460122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.460952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.461632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.463353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.465437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.467201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.665980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:13.675086 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bec89602-ded5-4eba-96bb-aa28ff0fb896 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1313 microversion: 2.1 time: 0.243536 Oct 17 13:33:13.676885 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3668/7031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:13 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:14.703334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:14.705020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:14.714533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.715344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.715816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.716571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.717041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.717491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.063570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:15.074775 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-acff9bfc-14cb-4040-866c-467654656502 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1313 microversion: 2.1 time: 0.377097 Oct 17 13:33:15.092026 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3364/7032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:14 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:16.104514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:16.105078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:16.111180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:16.119467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.120882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.122477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.125013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.125835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.126532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.389060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.403733 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c68ce21c-3228-479e-b2e9-e9c0555e376c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1313 microversion: 2.1 time: 0.303201 Oct 17 13:33:16.404498 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3669/7033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:16 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:17.428475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:17.429138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:17.431345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:17.432061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:17.446642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:17.457929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:17.458591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:17.459379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:17.460064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:17.460687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.031798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:18.044806 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-64212127-f2cb-42ef-98af-f1d47ee4f10f tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1313 microversion: 2.1 time: 0.620868 Oct 17 13:33:18.045317 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3365/7034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:17 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:18.217345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-abb09087-6dd8-4546-9381-d73fbfe199a2 req-cc6a9a4d-5f03-43a8-8a42-2f84ee9f68d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3994fa0-153b-4aec-bdad-63d21a8a2d2a", "name": "network-vif-plugged", "status": "completed", "tag": "45186cce-1ca5-4607-867f-8366ec445e38"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:18.250223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-abb09087-6dd8-4546-9381-d73fbfe199a2 req-cc6a9a4d-5f03-43a8-8a42-2f84ee9f68d5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.251421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-abb09087-6dd8-4546-9381-d73fbfe199a2 req-cc6a9a4d-5f03-43a8-8a42-2f84ee9f68d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.252144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-abb09087-6dd8-4546-9381-d73fbfe199a2 req-cc6a9a4d-5f03-43a8-8a42-2f84ee9f68d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.284997 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-abb09087-6dd8-4546-9381-d73fbfe199a2 req-cc6a9a4d-5f03-43a8-8a42-2f84ee9f68d5 service nova] Creating event network-vif-plugged:45186cce-1ca5-4607-867f-8366ec445e38 for instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a on n-h2-853316-12 Oct 17 13:33:18.293077 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-abb09087-6dd8-4546-9381-d73fbfe199a2 req-cc6a9a4d-5f03-43a8-8a42-2f84ee9f68d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080841 Oct 17 13:33:18.300499 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3670/7035] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:19.069573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.070491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:19.093560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.094423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.095891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.097873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.107902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.109094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.714261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.723466 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d401da9b-f490-4fbb-bb71-e1984bd07a60 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1313 microversion: 2.1 time: 0.659086 Oct 17 13:33:19.724636 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3366/7036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:19 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:20.754946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:20.755714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:20.763825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.764468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.765033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.765850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.766445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.766977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.938423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.947901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9de45bc4-37a2-43e3-87f6-b598dc29c11c tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1461 microversion: 2.1 time: 0.197572 Oct 17 13:33:20.948591 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3671/7037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:20 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1461 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:20.987906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d43d508d-d29b-4cfb-92fa-adcada86c850", "device": "/dev/sdb"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:20.991098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:20.999048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.999570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.016621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.020335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.021089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.021709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.472728 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e4faea0a-6011-4798-9560-98a125be762b tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "POST /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487906 Oct 17 13:33:21.473741 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3367/7038] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:33:20 2022] POST /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:16.262178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-acc2d344-8d1f-462d-9826-006b4a64fbf1 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'create', calling method: .version_select at 0x7fa81b92fee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-804593646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7QHBXGOiirZrBYd7PKxmhtH/fBuOcVVzq7gCOs156zNWhhQ6fZn4Qgj9YSK80i9uzQp1RxmotyhWUKlpJOxGgWUq6YdFQBRWqV9fKja8KYnJMEFgrhzDTfn1zKDP2Ngw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.271986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=29 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:16.273046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=61 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:16.287268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-acc2d344-8d1f-462d-9826-006b4a64fbf1 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:16.293874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-acc2d344-8d1f-462d-9826-006b4a64fbf1 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for user 6d480e8e290947c48f0667345ed02cc6 and project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:16.350924 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-acc2d344-8d1f-462d-9826-006b4a64fbf1 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.092652 Oct 17 13:34:16.353632 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3672/7039] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:34:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:18.759733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1348453404", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "f38406b7-f6e6-4116-ba2f-b8d69d75dc63"}], "key_name": "tempest-TestNetworkBasicOps-804593646", "security_groups": [{"name": "tempest-secgroup-smoke-1559907545"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:18.771270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:18.772439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:19.455465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] validate_networks() for [('f38406b7-f6e6-4116-ba2f-b8d69d75dc63', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:20.377302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:20.377901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:20.378261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:20.378925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:20.379363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:20.400611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.401125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.401581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.402383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.402863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.403313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.463192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:20.472322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for user 6d480e8e290947c48f0667345ed02cc6 and project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:20.512304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:20.530078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:20.621843 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c57ba4ab-30e9-4097-83b4-f96474628ec9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.866302 Oct 17 13:34:20.623467 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3368/7040] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:20.644152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6798e4af-975f-4a2d-9d73-e45d797d66b1 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:20.644914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6798e4af-975f-4a2d-9d73-e45d797d66b1 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:20.991127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6798e4af-975f-4a2d-9d73-e45d797d66b1 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:21.003482 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6798e4af-975f-4a2d-9d73-e45d797d66b1 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1248 microversion: 2.1 time: 0.371602 Oct 17 13:34:21.004453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3673/7041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:20 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1248 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:22.028440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:22.029089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:22.041070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.041959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.042775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.043690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.044331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.044944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.169028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:22.179552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e54781c8-3bf8-4b58-baed-2e7c2fa91ca7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1300 microversion: 2.1 time: 0.155677 Oct 17 13:34:22.180968 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3369/7042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:22 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:23.209197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:23.209815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:23.222212 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.222725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.223164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.223892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.224346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.224766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.392583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:23.408794 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45c8b165-1468-4133-a851-50bf08b28b95 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1306 microversion: 2.1 time: 0.201980 Oct 17 13:34:23.423932 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3674/7043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:23 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1306 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:24.433030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:24.434376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:24.441807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:24.443133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:24.443939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:24.445210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:24.446066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:24.447177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:24.837057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:24.845321 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7d4b76e3-3ba6-49cb-80f4-ff943143bb49 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.416231 Oct 17 13:34:24.846001 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3370/7044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:24 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:25.731375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-ce05c6d2-9fb0-4934-a0ad-3c75c41f0267 req-1417aa36-a5ec-4f84-b268-c800e524256a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b1c2f0-89e2-43b6-90cb-4da04c5f3def", "tag": "3d9bc998-8488-4b0e-8786-29b981a38a3b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:25.753429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ce05c6d2-9fb0-4934-a0ad-3c75c41f0267 req-1417aa36-a5ec-4f84-b268-c800e524256a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.753917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ce05c6d2-9fb0-4934-a0ad-3c75c41f0267 req-1417aa36-a5ec-4f84-b268-c800e524256a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.754381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-ce05c6d2-9fb0-4934-a0ad-3c75c41f0267 req-1417aa36-a5ec-4f84-b268-c800e524256a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.770277 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-ce05c6d2-9fb0-4934-a0ad-3c75c41f0267 req-1417aa36-a5ec-4f84-b268-c800e524256a service nova] Creating event network-changed:3d9bc998-8488-4b0e-8786-29b981a38a3b for instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def on n-h1-853316-12 Oct 17 13:34:25.777098 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-ce05c6d2-9fb0-4934-a0ad-3c75c41f0267 req-1417aa36-a5ec-4f84-b268-c800e524256a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049430 Oct 17 13:34:25.778775 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3675/7045] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:25.869297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:25.870311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:25.879967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.881001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.881783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.883195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.884080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.886674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.423420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:26.444143 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48c90eae-e090-4a12-9715-dd06a709e5cc tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.578774 Oct 17 13:34:26.462004 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3371/7046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:25 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:27.476791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:27.478220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:27.487943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:27.488601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:27.489053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:27.489765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:27.490435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:27.491035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:27.747670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:27.755827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aaf7157b-51af-4ea8-ad60-ed8be86260aa tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.289691 Oct 17 13:34:27.756415 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3676/7047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:27 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:28.798001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:28.799626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:28.814460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.815029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.815492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.816228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.816697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.817309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.126242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:29.135581 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c6746391-aa58-4abd-af11-a1216722ef71 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.342355 Oct 17 13:34:29.151057 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3372/7048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:28 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:30.161936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:30.162753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:30.170963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.171516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.172160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.172908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.173345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.173955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.401861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:30.413510 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-afb484e6-9ba3-4af1-8a45-fabac3275ea3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.255850 Oct 17 13:34:30.414822 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3677/7049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:30 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:31.449542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:31.450925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:31.458993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:31.459777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:31.468704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.469415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.474313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.475681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.476408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.477070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.720042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:31.728408 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e9e0f59-063b-497d-aacc-26f6ec55a6d8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.283825 Oct 17 13:34:31.729398 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3373/7050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:31 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:32.753846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:32.754563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:32.760811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:32.775143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.775975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.777220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.782662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.783359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.784052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:33.110254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:33.122382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5e89889b-2c4b-48c8-bf4f-c18d054d7958 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.372982 Oct 17 13:34:33.159282 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3678/7051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:32 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:34.147284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.147910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:34.156111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.156620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.157070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.157788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.158284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.158753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.307435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:34.318895 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f2f8111e-392c-4980-ab6e-f0d08ae49368 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.175300 Oct 17 13:34:34.319684 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3374/7052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:34 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:34.608297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-40e7cc4f-b524-4770-b20b-c85f70d1846f req-0c87f9fa-5627-441e-b4b8-6e7e540b814b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b1c2f0-89e2-43b6-90cb-4da04c5f3def", "name": "network-vif-plugged", "status": "completed", "tag": "3d9bc998-8488-4b0e-8786-29b981a38a3b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:34.625869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-40e7cc4f-b524-4770-b20b-c85f70d1846f req-0c87f9fa-5627-441e-b4b8-6e7e540b814b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.626674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-40e7cc4f-b524-4770-b20b-c85f70d1846f req-0c87f9fa-5627-441e-b4b8-6e7e540b814b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.627105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-40e7cc4f-b524-4770-b20b-c85f70d1846f req-0c87f9fa-5627-441e-b4b8-6e7e540b814b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.641009 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-40e7cc4f-b524-4770-b20b-c85f70d1846f req-0c87f9fa-5627-441e-b4b8-6e7e540b814b service nova] Creating event network-vif-plugged:3d9bc998-8488-4b0e-8786-29b981a38a3b for instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def on n-h1-853316-12 Oct 17 13:34:34.647229 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-40e7cc4f-b524-4770-b20b-c85f70d1846f req-0c87f9fa-5627-441e-b4b8-6e7e540b814b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043211 Oct 17 13:34:34.648102 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3679/7053] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:35.345893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.347616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:35.360139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.360650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.361105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.364525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.365402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.366053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.534249 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:35.549295 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-76679c05-80ff-4527-ac71-62a747e1be5b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1374 microversion: 2.1 time: 0.209115 Oct 17 13:34:35.566004 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3375/7054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1374 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:36.573977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:36.574709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:36.582643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.583422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.584032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.584929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.585809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.586498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.792350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:36.813106 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b909ea4e-f26b-4029-a0f1-54a3ce8f9003 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1546 microversion: 2.1 time: 0.244333 Oct 17 13:34:36.827999 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3680/7055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:36 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1546 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:36.851266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:36.851939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:36.860699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.861335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.861805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.862597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.863074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.863524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.022565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:37.031702 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d363113b-1a30-4062-9498-d22bfa956339 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1546 microversion: 2.1 time: 0.195138 Oct 17 13:34:37.032390 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3376/7056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:36 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:39.306340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c5ca372b-cbaa-4fc8-b970-72318e81619f req-a3eb3f7f-4c2c-4daa-8599-0cb1b6f09b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b1c2f0-89e2-43b6-90cb-4da04c5f3def", "tag": "3d9bc998-8488-4b0e-8786-29b981a38a3b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:39.320107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c5ca372b-cbaa-4fc8-b970-72318e81619f req-a3eb3f7f-4c2c-4daa-8599-0cb1b6f09b07 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.320994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c5ca372b-cbaa-4fc8-b970-72318e81619f req-a3eb3f7f-4c2c-4daa-8599-0cb1b6f09b07 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.321789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c5ca372b-cbaa-4fc8-b970-72318e81619f req-a3eb3f7f-4c2c-4daa-8599-0cb1b6f09b07 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.337504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c5ca372b-cbaa-4fc8-b970-72318e81619f req-a3eb3f7f-4c2c-4daa-8599-0cb1b6f09b07 service nova] Creating event network-changed:3d9bc998-8488-4b0e-8786-29b981a38a3b for instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def on n-h1-853316-12 Oct 17 13:34:39.344434 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c5ca372b-cbaa-4fc8-b970-72318e81619f req-a3eb3f7f-4c2c-4daa-8599-0cb1b6f09b07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049770 Oct 17 13:34:39.345782 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3681/7057] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:47.605747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:47.606239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:47.615040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:47.616275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=50 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:47.621892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.623129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.624294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.625463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.626240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.626921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.785841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lazy-loading 'services' on Instance uuid c3994fa0-153b-4aec-bdad-63d21a8a2d2a {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:47.907841 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4d5ba4dc-851b-413b-9def-eee1b3f2c9d7 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a/os-volume_attachments/d43d508d-d29b-4cfb-92fa-adcada86c850" status: 202 len: 0 microversion: 2.1 time: 0.305967 Oct 17 13:34:47.908628 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3377/7058] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:34:47 2022] DELETE /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a/os-volume_attachments/d43d508d-d29b-4cfb-92fa-adcada86c850 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:34:54.657312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.657951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.665069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:54.666458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=36 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:54.669587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.671025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.671802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.672694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.673387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.673986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.716972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:54.864767 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-992b9f7a-92f6-4747-b50d-7433bf538bac tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 204 len: 0 microversion: 2.1 time: 0.212028 Oct 17 13:34:54.865777 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3682/7059] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:54 2022] DELETE /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:54.879295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.880948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.894103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.894838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.895598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.896566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.897179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.897736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.151472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:55.161284 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d129ebcc-791a-4d35-a2cb-986f8de56945 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1467 microversion: 2.1 time: 0.290292 Oct 17 13:34:55.163199 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3378/7060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:54 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:56.188329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:56.189220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:56.201580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.202090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.203704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.203704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.203704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.204210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.509594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7152fdbbf64dc9b1b435ef02b280e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c1ba01fd0b4cab8debde6a34578513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:56.521114 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f5d0373-48dd-425d-866d-d48805a6bdfe tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 200 len: 1467 microversion: 2.1 time: 0.337667 Oct 17 13:34:56.535170 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3683/7061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:56 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 1467 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:56.892533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-0dff7eeb-d84c-4ae3-a880-79e3b5cc9210 req-4d3687b2-1e1c-44b8-93df-b0ceb96b00d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3994fa0-153b-4aec-bdad-63d21a8a2d2a", "name": "network-vif-deleted", "tag": "45186cce-1ca5-4607-867f-8366ec445e38"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:56.926622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0dff7eeb-d84c-4ae3-a880-79e3b5cc9210 req-4d3687b2-1e1c-44b8-93df-b0ceb96b00d7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.927592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0dff7eeb-d84c-4ae3-a880-79e3b5cc9210 req-4d3687b2-1e1c-44b8-93df-b0ceb96b00d7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.928104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-0dff7eeb-d84c-4ae3-a880-79e3b5cc9210 req-4d3687b2-1e1c-44b8-93df-b0ceb96b00d7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.943771 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-0dff7eeb-d84c-4ae3-a880-79e3b5cc9210 req-4d3687b2-1e1c-44b8-93df-b0ceb96b00d7 service nova] Creating event network-vif-deleted:45186cce-1ca5-4607-867f-8366ec445e38 for instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a on n-h2-853316-12 Oct 17 13:34:56.949819 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-0dff7eeb-d84c-4ae3-a880-79e3b5cc9210 req-4d3687b2-1e1c-44b8-93df-b0ceb96b00d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062716 Oct 17 13:34:56.951254 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3379/7062] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:57.549736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:57.550960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] [instance: c3994fa0-153b-4aec-bdad-63d21a8a2d2a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:57.559094 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.559831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.560285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.561038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.561502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.561936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.583608 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] HTTP exception thrown: Instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a could not be found. Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Request method failure captured: Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a HTTP/1.1 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVmN-GdUueFy1iO-yp1XMQosfa0ismCh1UAwpLixc8H9yoxwQrYXraqmBYH2_-3Er-wVbOYZiDGLjFFL2VOUc3UED-i_5gA84RfP4PsYco4OI3cWWnLy5F9WMBWt4fYzHtSzr0aSsAhtcVNEwjrAthAmKWJjYgygWyd4HCAFcIa6pA0 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: f4c1ba01fd0b4cab8debde6a34578513 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-VolumesBackupsTest-876485158 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4c1ba01fd0b4cab8debde6a34578513", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4c1ba01fd0b4cab8debde6a34578513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4c1ba01fd0b4cab8debde6a34578513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4c1ba01fd0b4cab8debde6a34578513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-VolumesBackupsTest-876485158 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: f4c1ba01fd0b4cab8debde6a34578513 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-VolumesBackupsTest-876485158 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-VolumesBackupsTest-876485158-project Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 3d7152fdbbf64dc9b1b435ef02b280e0 Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-VolumesBackupsTest-876485158-project Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a could not be found. Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'c3994fa0-153b-4aec-bdad-63d21a8a2d2a'} Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a could not be found. Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a could not be found. Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:57.585616 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a could not be found. Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] Returning 404 to user: Instance c3994fa0-153b-4aec-bdad-63d21a8a2d2a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:57.591934 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d15664f-e481-4d9e-a56a-fb9c9c142ae1 tempest-VolumesBackupsTest-876485158 tempest-VolumesBackupsTest-876485158-project] 10.222.0.27 "GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a" status: 404 len: 111 microversion: 2.1 time: 0.045659 Oct 17 13:34:57.596756 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3684/7063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:57 2022] GET /compute/v2.1/servers/c3994fa0-153b-4aec-bdad-63d21a8a2d2a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:15.152750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:15.156582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:15.161037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:15.162503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:15.172066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.172900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:15.174435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:15.175771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.176422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:15.177349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:15.312537 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0f2ce9c2-2ba5-47c0-adc6-8e01ee1d5e62 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def/action" status: 200 len: 24571 microversion: 2.1 time: 0.143837 Oct 17 13:35:15.344511 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3380/7064] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:15 2022] POST /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def/action => generated 24571 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:35:58.733727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16c07974-7d3f-48c7-af1c-897dbe59f11b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'create', calling method: .version_select at 0x7fa81ba09670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1656475141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDNNHlP24ZrxsAcrkBKXM7dIwlTcrjP7Yt9zkH2r6IqrnY9Trz0HcyIa57ygXUd9VC2a7IbM/RjVh/bnUuGFdUJ0b2OgJ6v35JBg+4N/XlfRDLkTzkI6BJT0IYb+SoLuw=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:58.745737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:58.752598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:58.800652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-16c07974-7d3f-48c7-af1c-897dbe59f11b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:58.811475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-16c07974-7d3f-48c7-af1c-897dbe59f11b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for user 6d480e8e290947c48f0667345ed02cc6 and project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:58.855994 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16c07974-7d3f-48c7-af1c-897dbe59f11b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.128483 Oct 17 13:35:58.856607 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3685/7065] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:35:58 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:00.805733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-181257386", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "b31b75e2-643c-44ea-aac9-355d11e1a4d8"}], "key_name": "tempest-TestNetworkBasicOps-1656475141", "security_groups": [{"name": "tempest-secgroup-smoke-37518422"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:00.826368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:00.828045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:00.970614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] validate_networks() for [('b31b75e2-643c-44ea-aac9-355d11e1a4d8', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:01.843129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:01.844182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:01.844182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:01.844508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:01.844930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:01.855585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.855996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.856451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.857223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.861188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.862395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.916973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:01.947174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for user 6d480e8e290947c48f0667345ed02cc6 and project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:01.965879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:01.972341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:02.082775 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7ebbebe8-6fff-479f-87c1-64c7c67a801d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.284842 Oct 17 13:36:02.085517 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3381/7066] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:02.098446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-753de77b-8a2a-4ba6-8bc7-7512f78001bf tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:02.099076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-753de77b-8a2a-4ba6-8bc7-7512f78001bf tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:02.186742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-753de77b-8a2a-4ba6-8bc7-7512f78001bf tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.195369 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-753de77b-8a2a-4ba6-8bc7-7512f78001bf tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1248 microversion: 2.1 time: 0.102817 Oct 17 13:36:02.195977 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3686/7067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:02 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1248 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:03.225193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.226573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:03.236339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.237539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.238767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.240837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.242255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.242818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.345121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:03.355002 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2f5ef333-9c2c-4006-bfef-2cc1f8503f05 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1300 microversion: 2.1 time: 0.135799 Oct 17 13:36:03.355891 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3382/7068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:04.386800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.388150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:04.395513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.396299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.396734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.397619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.398317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.398909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.481063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:04.490334 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-040203ec-33b7-4d9e-8adc-318458bae443 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1306 microversion: 2.1 time: 0.108003 Oct 17 13:36:04.491524 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3687/7069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:05.517410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:05.517850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:05.530067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.534359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.535201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.537082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.538963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.540677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.832132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.848160 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c52f26eb-1d61-4e97-bccc-22ceec6145b7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1372 microversion: 2.1 time: 0.334847 Oct 17 13:36:05.850496 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3383/7070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:05 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:06.661224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e33b4e72-d110-472f-a33d-1922c3700455 req-5df721a8-11ad-4b26-979c-5ce4cda53cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad0b5455-371e-42a4-bac3-bd4dc51286b1", "tag": "e0a57346-9e85-4331-bd12-59c2368450b1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:06.674318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e33b4e72-d110-472f-a33d-1922c3700455 req-5df721a8-11ad-4b26-979c-5ce4cda53cc3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.675117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e33b4e72-d110-472f-a33d-1922c3700455 req-5df721a8-11ad-4b26-979c-5ce4cda53cc3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.675117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e33b4e72-d110-472f-a33d-1922c3700455 req-5df721a8-11ad-4b26-979c-5ce4cda53cc3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.691268 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e33b4e72-d110-472f-a33d-1922c3700455 req-5df721a8-11ad-4b26-979c-5ce4cda53cc3 service nova] Creating event network-changed:e0a57346-9e85-4331-bd12-59c2368450b1 for instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 on n-h2-853316-12 Oct 17 13:36:06.697143 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e33b4e72-d110-472f-a33d-1922c3700455 req-5df721a8-11ad-4b26-979c-5ce4cda53cc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267545 Oct 17 13:36:06.698316 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3688/7071] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:06.878525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:06.879350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:06.886565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.887298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.888008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.888975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.889624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.890272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.105524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:07.114115 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f2a3e58-8975-4731-8488-ac15d8007fd8 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1372 microversion: 2.1 time: 0.241724 Oct 17 13:36:07.127002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3384/7072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:06 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:08.141560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:08.142923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:08.149973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.150827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.151487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.152385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.153022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.153830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.352242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:08.362132 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-12ac8d02-9af0-4e18-907f-c00ad57a8e1d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1372 microversion: 2.1 time: 0.225546 Oct 17 13:36:08.378807 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3689/7073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:08 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:09.387758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.389007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.397329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.398018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.398679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.400598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.401388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.402293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.644230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:09.693391 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e1c174c1-1e89-4603-bc8a-c05d2b37bf4a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1372 microversion: 2.1 time: 0.306731 Oct 17 13:36:09.698272 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3385/7074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1372 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:10.762135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.762785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:10.772326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.773142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.773587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.775309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.775976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.776648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.008289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:11.019408 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-98e8fd9c-9441-486e-8fe2-29dcaa9c389f tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1372 microversion: 2.1 time: 0.279799 Oct 17 13:36:11.020003 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3690/7075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:10 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1372 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:12.075164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:12.076408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:12.089003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:12.091160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:12.100029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.101137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.102070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.103940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.104838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.105690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.289013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:12.299490 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0a616db9-a652-410e-be01-289ab515e3f7 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1372 microversion: 2.1 time: 0.231881 Oct 17 13:36:12.300804 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3386/7076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:12 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:12.334078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:12.422740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5e69b986-0216-46f8-a7fc-0b6d17dae328 req-12abe51d-c77b-423a-8994-8c24733abe5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0b5455-371e-42a4-bac3-bd4dc51286b1", "name": "network-vif-plugged", "status": "completed", "tag": "e0a57346-9e85-4331-bd12-59c2368450b1"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:12.433775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5e69b986-0216-46f8-a7fc-0b6d17dae328 req-12abe51d-c77b-423a-8994-8c24733abe5d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.434395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5e69b986-0216-46f8-a7fc-0b6d17dae328 req-12abe51d-c77b-423a-8994-8c24733abe5d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.435081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5e69b986-0216-46f8-a7fc-0b6d17dae328 req-12abe51d-c77b-423a-8994-8c24733abe5d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.448306 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5e69b986-0216-46f8-a7fc-0b6d17dae328 req-12abe51d-c77b-423a-8994-8c24733abe5d service nova] Creating event network-vif-plugged:e0a57346-9e85-4331-bd12-59c2368450b1 for instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 on n-h2-853316-12 Oct 17 13:36:12.453504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5e69b986-0216-46f8-a7fc-0b6d17dae328 req-12abe51d-c77b-423a-8994-8c24733abe5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125817 Oct 17 13:36:12.454103 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3691/7077] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:13.325180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:13.325838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:13.338509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.339159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.339895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.341602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.342569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.343193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.542662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:13.555126 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9af20aa2-2811-452b-9ef8-f65a9a89b128 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1372 microversion: 2.1 time: 0.235459 Oct 17 13:36:13.556362 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3387/7078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:13 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:14.580261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:14.581024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:14.589371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.589921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.590676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.591412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.591874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.592353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.780933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:14.791696 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab2885c3-4dd9-4d9b-9432-7b7e06beb80e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1545 microversion: 2.1 time: 0.216446 Oct 17 13:36:14.792677 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3692/7079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:14 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1545 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:14.836008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:14.836664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:14.847417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.847926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.848441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.849170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.849672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.850118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.031640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:15.043419 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a428e5d3-0fec-41e2-8524-db75a19a93f9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1545 microversion: 2.1 time: 0.215711 Oct 17 13:36:15.044316 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3388/7080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:14 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1545 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:24.334942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1196411373", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "e9e03dc8-f412-4726-ad08-942a8165fd62"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:24.397215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] validate_networks() for [('e9e03dc8-f412-4726-ad08-942a8165fd62', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:24.786320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=28 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:24.940139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:24.940686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:24.942038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:24.943369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:24.947065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:24.957881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.958413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.958727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.959585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.961425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.961425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.980760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Getting quotas for project db2d22f877be4ef9a59033eb04779afd. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:24.987263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Getting quotas for user d117113a225541a0b0f113a01edccc88 and project db2d22f877be4ef9a59033eb04779afd. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:25.006335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:25.010659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:25.058431 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [ea64873f-0855-4521-8e24-2c7f045884cf] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:36:26.070666 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [ea64873f-0855-4521-8e24-2c7f045884cf] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 37034. Oct 17 13:36:26.089668 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-41232d31-7b4c-48f7-844c-0202e6cfc6fa tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894788 Oct 17 13:36:26.091226 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3693/7081] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:36:26.100617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:26.100617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=44 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:26.106449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09b6a382-bda0-4253-aa00-5171fc18fc1a tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.107161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09b6a382-bda0-4253-aa00-5171fc18fc1a tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:26.182238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-09b6a382-bda0-4253-aa00-5171fc18fc1a tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:26.190931 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09b6a382-bda0-4253-aa00-5171fc18fc1a tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1214 microversion: 2.1 time: 0.092623 Oct 17 13:36:26.191802 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3389/7082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:26 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:27.216287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:27.216831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:27.223634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.224130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.224575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.225292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.225756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.226204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.310544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:27.327373 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7161e88-b29b-4f52-9d18-f6c0b741e598 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1266 microversion: 2.1 time: 0.116080 Oct 17 13:36:27.328863 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3694/7083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:27 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:28.354887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:28.355624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:28.371316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.371856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.372729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.373831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.374111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.374581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.682816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:28.695968 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-475b2ca8-4563-4695-a610-a7505cc67cce tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.344645 Oct 17 13:36:28.696887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3390/7084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:28 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:29.164311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b0821f50-7a54-4f20-ab14-34fd578ea030 req-f4d8b049-b160-44e7-8da0-c363aaa54ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "963e0959-9e15-4213-ac1f-9d48b1aeb40a", "tag": "d8521b3b-3bae-4aea-a43a-8fa7453faa1c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:29.175469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:29.186914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b0821f50-7a54-4f20-ab14-34fd578ea030 req-f4d8b049-b160-44e7-8da0-c363aaa54ebc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:29.187708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b0821f50-7a54-4f20-ab14-34fd578ea030 req-f4d8b049-b160-44e7-8da0-c363aaa54ebc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:29.188153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b0821f50-7a54-4f20-ab14-34fd578ea030 req-f4d8b049-b160-44e7-8da0-c363aaa54ebc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:29.200452 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b0821f50-7a54-4f20-ab14-34fd578ea030 req-f4d8b049-b160-44e7-8da0-c363aaa54ebc service nova] Creating event network-changed:d8521b3b-3bae-4aea-a43a-8fa7453faa1c for instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a on n-h1-853316-12 Oct 17 13:36:29.206112 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b0821f50-7a54-4f20-ab14-34fd578ea030 req-f4d8b049-b160-44e7-8da0-c363aaa54ebc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054859 Oct 17 13:36:29.207067 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3695/7085] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:29.734440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:29.735077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:29.743784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:29.744563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:29.745182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:29.746194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:29.746867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:29.747306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:29.998548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:30.009487 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ecb044b9-aa3b-4373-abca-e8ccf204d956 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.278882 Oct 17 13:36:30.010896 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3391/7086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:29 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:31.045900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:31.046529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:31.053395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:31.053882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:31.055186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:31.055897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:31.056384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:31.056789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:31.218373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:31.227102 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b7e5cb1-07c7-4cb6-8bd3-4112a3cd6d18 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.186295 Oct 17 13:36:31.227734 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3696/7087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:31 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:32.250076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:32.250820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:32.258705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.259293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.260372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.261092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.261561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.261997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.506994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:32.531211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a447b932-6a73-4e0a-b7cf-5d8a74f94a25 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.284984 Oct 17 13:36:32.532334 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3392/7088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:32 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:33.557913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:33.558672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:33.567317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:33.567729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:33.568170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:33.569022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:33.569488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:33.570752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:33.722500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:33.738435 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c725c373-d21d-476c-8e21-17e33e45f8d8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.186301 Oct 17 13:36:33.739241 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3697/7089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:33 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:34.765364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:34.766214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:34.776653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.777221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.777826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:34.778957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.779593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.780238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:34.952276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:34.962759 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-89389133-de4d-4308-9683-4b4a98680939 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.202776 Oct 17 13:36:34.963348 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3393/7090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:34 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:35.993886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:35.994572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:35.997509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:35.998891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:36.005007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.005510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.005960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.006737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.007696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.008188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.153354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:36.161762 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-114fa906-9ec7-4537-b796-270c39fc828b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.172261 Oct 17 13:36:36.162387 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3698/7091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:35 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:37.190750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:37.192956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:37.197054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:37.205699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.206539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.207327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.209411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.210187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.211511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.220939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5f43c4a9-e056-4bc1-8da6-eab281761aa5 req-ccc4b422-7c99-4a9e-bca6-02907824b879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "963e0959-9e15-4213-ac1f-9d48b1aeb40a", "name": "network-vif-plugged", "status": "completed", "tag": "d8521b3b-3bae-4aea-a43a-8fa7453faa1c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:37.246424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5f43c4a9-e056-4bc1-8da6-eab281761aa5 req-ccc4b422-7c99-4a9e-bca6-02907824b879 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.246909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5f43c4a9-e056-4bc1-8da6-eab281761aa5 req-ccc4b422-7c99-4a9e-bca6-02907824b879 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.247531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5f43c4a9-e056-4bc1-8da6-eab281761aa5 req-ccc4b422-7c99-4a9e-bca6-02907824b879 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.278322 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5f43c4a9-e056-4bc1-8da6-eab281761aa5 req-ccc4b422-7c99-4a9e-bca6-02907824b879 service nova] Creating event network-vif-plugged:d8521b3b-3bae-4aea-a43a-8fa7453faa1c for instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a on n-h1-853316-12 Oct 17 13:36:37.286286 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5f43c4a9-e056-4bc1-8da6-eab281761aa5 req-ccc4b422-7c99-4a9e-bca6-02907824b879 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068527 Oct 17 13:36:37.287899 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3699/7092] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:37.450564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:37.465288 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-14992dcc-664b-4688-9943-f0642401a3b6 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.280464 Oct 17 13:36:37.465889 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3394/7093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:37 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:38.498752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:38.499344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:38.511654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.512153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.512599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.513340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.513797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.514248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.659066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.668123 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d02080c-df2a-4773-84a9-2a6fef4158e8 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1314 microversion: 2.1 time: 0.175265 Oct 17 13:36:38.668836 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3700/7094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:38 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:39.691611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.692554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:39.708974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.709486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.709965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.711778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.712256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.712706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.867347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.876059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-60779863-885f-404b-ad6b-4ff31fc4c01c tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1498 microversion: 2.1 time: 0.188469 Oct 17 13:36:39.876817 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3395/7095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:42.315906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:42.316685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.348882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.349410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.349859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.353006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.353499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.355755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.446053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:42.654813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e548e24-b43a-4376-b75a-a43efc9f063c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 204 len: 0 microversion: 2.1 time: 0.342748 Oct 17 13:36:42.656866 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3701/7096] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:42 2022] DELETE /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:36:42.666095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:42.666823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.684220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.685033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.685654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.686677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.693149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.693893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.878589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:42.888601 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09d919b2-0d52-4884-87ff-b48d8397c2ad tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1551 microversion: 2.1 time: 0.227583 Oct 17 13:36:42.890032 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3396/7097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:42 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1551 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:43.126985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:43.127712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:43.135753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.136570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.138076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.139011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.139813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.140483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.171734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:43.285559 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a7db3c63-d435-412f-aced-9aad5366d178 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "DELETE /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 204 len: 0 microversion: 2.1 time: 0.162686 Oct 17 13:36:43.289718 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3702/7098] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:43 2022] DELETE /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:36:43.296167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:43.296937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:43.305841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.305841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.305841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.308607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.308607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.308901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.481809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:43.491740 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-601ff9a9-a822-44e4-9b43-f0c674a3903e tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1504 microversion: 2.1 time: 0.200295 Oct 17 13:36:43.492543 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3397/7099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:43 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:43.923589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:43.924379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:43.933625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.934115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.934853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.936963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.937753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.938579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.149563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:44.159315 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-57aa0bf3-a02a-4749-9eae-d5dd7095e561 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 200 len: 1551 microversion: 2.1 time: 0.240088 Oct 17 13:36:44.162871 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3703/7100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:43 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 1551 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:44.479299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7f25f4f7-fd01-4485-b576-d96efacc658c req-66ac4751-8caa-49de-bfdc-d9120e7c7f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0b5455-371e-42a4-bac3-bd4dc51286b1", "name": "network-vif-deleted", "tag": "e0a57346-9e85-4331-bd12-59c2368450b1"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:44.491943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7f25f4f7-fd01-4485-b576-d96efacc658c req-66ac4751-8caa-49de-bfdc-d9120e7c7f96 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.492553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7f25f4f7-fd01-4485-b576-d96efacc658c req-66ac4751-8caa-49de-bfdc-d9120e7c7f96 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.492761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7f25f4f7-fd01-4485-b576-d96efacc658c req-66ac4751-8caa-49de-bfdc-d9120e7c7f96 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.505759 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7f25f4f7-fd01-4485-b576-d96efacc658c req-66ac4751-8caa-49de-bfdc-d9120e7c7f96 service nova] Creating event network-vif-deleted:e0a57346-9e85-4331-bd12-59c2368450b1 for instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 on n-h2-853316-12 Oct 17 13:36:44.511474 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7f25f4f7-fd01-4485-b576-d96efacc658c req-66ac4751-8caa-49de-bfdc-d9120e7c7f96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037080 Oct 17 13:36:44.512082 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3398/7101] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:44.517957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:44.518728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:44.532029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.532524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.532957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.533662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.534110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.534584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.697017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:44.705361 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62edd8a0-32fe-48a4-960a-63f9d6e98bdf tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1504 microversion: 2.1 time: 0.192500 Oct 17 13:36:44.706201 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3704/7102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:44 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:45.194342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:45.199976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: ad0b5455-371e-42a4-bac3-bd4dc51286b1] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:45.210381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.211316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.212081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.213162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.214301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.215301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.235860 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] HTTP exception thrown: Instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 could not be found. Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Request method failure captured: Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 HTTP/1.1 Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVnOHpH4wIj1OnVxt96kwkNWomqEvEobECv2ibGrL1hstHLXdWGkfoBeordOArEwGqEWkQf3UFgZc5ptq7h5E-OYc18W7vg5aub-te98y_HBP7-IYlXhujWhLxcUkvcgxQmxQ5w4VQzeg2juxlid6Ddjukc1NNFIAij_2VlYVt9YEqc Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 26a92a0d55c5452eab084941b2cd3dfc Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26a92a0d55c5452eab084941b2cd3dfc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 26a92a0d55c5452eab084941b2cd3dfc Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkBasicOps-1037615271-project Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6d480e8e290947c48f0667345ed02cc6 Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkBasicOps-1037615271-project Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 could not be found. Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'ad0b5455-371e-42a4-bac3-bd4dc51286b1'} Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 could not be found. Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 could not be found. Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:45.237857 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 could not be found. Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Returning 404 to user: Instance ad0b5455-371e-42a4-bac3-bd4dc51286b1 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:45.244334 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f13a1c06-2596-4c29-b235-b85bffd209cd tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1" status: 404 len: 111 microversion: 2.1 time: 0.057007 Oct 17 13:36:45.245124 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3399/7103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:45 2022] GET /compute/v2.1/servers/ad0b5455-371e-42a4-bac3-bd4dc51286b1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:45.496154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ffa386aa-80c0-462c-98b1-bb4c12ab1bc6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '.version_select at 0x7fa81b93a430>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:45.529035 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ffa386aa-80c0-462c-98b1-bb4c12ab1bc6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1656475141" status: 202 len: 0 microversion: 2.1 time: 0.036855 Oct 17 13:36:45.529850 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3705/7104] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 17 13:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1656475141 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:45.729844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:45.731339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:45.739452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.740255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.740715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.741455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.742269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.742646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.783464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.783968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.784417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.784890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lazy-loading 'fault' on Instance uuid 963e0959-9e15-4213-ac1f-9d48b1aeb40a {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:45.846800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd117113a225541a0b0f113a01edccc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2d22f877be4ef9a59033eb04779afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.856962 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04f41c65-0f61-411e-9f97-bb902934938b tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 200 len: 1304 microversion: 2.1 time: 0.131547 Oct 17 13:36:45.859029 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3400/7105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:45 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:46.533466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b14f48f7-f675-435e-be33-e5ca1d2ec285 req-b8968c1d-e7ff-4498-9b3f-d4f7dd59fb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "963e0959-9e15-4213-ac1f-9d48b1aeb40a", "name": "network-vif-deleted", "tag": "d8521b3b-3bae-4aea-a43a-8fa7453faa1c"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:46.565630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b14f48f7-f675-435e-be33-e5ca1d2ec285 req-b8968c1d-e7ff-4498-9b3f-d4f7dd59fb2d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.566929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b14f48f7-f675-435e-be33-e5ca1d2ec285 req-b8968c1d-e7ff-4498-9b3f-d4f7dd59fb2d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.567657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b14f48f7-f675-435e-be33-e5ca1d2ec285 req-b8968c1d-e7ff-4498-9b3f-d4f7dd59fb2d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.585702 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b14f48f7-f675-435e-be33-e5ca1d2ec285 req-b8968c1d-e7ff-4498-9b3f-d4f7dd59fb2d service nova] Creating event network-vif-deleted:d8521b3b-3bae-4aea-a43a-8fa7453faa1c for instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a on n-h1-853316-12 Oct 17 13:36:46.592376 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b14f48f7-f675-435e-be33-e5ca1d2ec285 req-b8968c1d-e7ff-4498-9b3f-d4f7dd59fb2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065790 Oct 17 13:36:46.594052 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3706/7106] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:46.884870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:46.884870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] [instance: 963e0959-9e15-4213-ac1f-9d48b1aeb40a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:46.892639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.893162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.893950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.895144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.895705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.896233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.915763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] HTTP exception thrown: Instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a could not be found. Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Request method failure captured: Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a HTTP/1.1 Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVpWpjHLaKwNU0CMon2rKXNlG_lAsUdgkqIO6dt42DhdQ3j8S0CvymlNCrmryF7kKGFUnoh93YHgKLijGjKy3gRJ20CMLEbSrlgwJF7IaFMSNh1lVR9WUWGl7j7Cbtv3l1SyLf55StdtqdcyzAtyVdddCk5sgXpsh_6r8AARWlAxrgk Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: db2d22f877be4ef9a59033eb04779afd Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-VolumesActionsTest-1181835029 Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_db2d22f877be4ef9a59033eb04779afd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db2d22f877be4ef9a59033eb04779afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/db2d22f877be4ef9a59033eb04779afd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db2d22f877be4ef9a59033eb04779afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-VolumesActionsTest-1181835029 Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: db2d22f877be4ef9a59033eb04779afd Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-VolumesActionsTest-1181835029 Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-VolumesActionsTest-1181835029-project Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: d117113a225541a0b0f113a01edccc88 Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-VolumesActionsTest-1181835029-project Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a could not be found. Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '963e0959-9e15-4213-ac1f-9d48b1aeb40a'} Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a could not be found. Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a could not be found. Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:46.917440 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a could not be found. Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] Returning 404 to user: Instance 963e0959-9e15-4213-ac1f-9d48b1aeb40a could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:46.926054 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-84ffdfb0-ab45-411f-8135-f14cf5735664 tempest-VolumesActionsTest-1181835029 tempest-VolumesActionsTest-1181835029-project] 10.222.0.27 "GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a" status: 404 len: 111 microversion: 2.1 time: 0.042686 Oct 17 13:36:46.933466 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3401/7107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:46 2022] GET /compute/v2.1/servers/963e0959-9e15-4213-ac1f-9d48b1aeb40a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:47.871637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:47.875112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:47.891380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.892225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.892853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.894071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.894756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.895487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.930232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:47.972932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6080e635-d97c-45a8-95f8-c85342d58161 req-82ae9797-5c8c-45c2-9d86-fb6192ed9b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b1c2f0-89e2-43b6-90cb-4da04c5f3def", "tag": "3d9bc998-8488-4b0e-8786-29b981a38a3b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:47.986204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6080e635-d97c-45a8-95f8-c85342d58161 req-82ae9797-5c8c-45c2-9d86-fb6192ed9b02 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.987099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6080e635-d97c-45a8-95f8-c85342d58161 req-82ae9797-5c8c-45c2-9d86-fb6192ed9b02 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.988042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6080e635-d97c-45a8-95f8-c85342d58161 req-82ae9797-5c8c-45c2-9d86-fb6192ed9b02 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.000755 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6080e635-d97c-45a8-95f8-c85342d58161 req-82ae9797-5c8c-45c2-9d86-fb6192ed9b02 service nova] Creating event network-changed:3d9bc998-8488-4b0e-8786-29b981a38a3b for instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def on n-h1-853316-12 Oct 17 13:36:48.009370 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6080e635-d97c-45a8-95f8-c85342d58161 req-82ae9797-5c8c-45c2-9d86-fb6192ed9b02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154469 Oct 17 13:36:48.026824 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3402/7108] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:48.030097 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68da4f4d-4787-4736-ac0f-244909c8a8a4 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 204 len: 0 microversion: 2.1 time: 0.177633 Oct 17 13:36:48.033254 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3707/7109] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:47 2022] DELETE /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:36:48.044742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:48.045920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:48.059796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.060309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.060767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.061495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.061975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.062447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.243101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:48.253790 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7964494a-fda8-4330-9b3c-80bcc3612ff6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1670 microversion: 2.1 time: 0.215917 Oct 17 13:36:48.257200 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3403/7110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:48 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:49.284078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:49.285747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:49.294029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.295663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.296337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.297268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.297910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.298559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.325394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:49.479559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:49.488272 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a5f091a-f0f4-4f56-9eca-1d0898503478 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1670 microversion: 2.1 time: 0.208426 Oct 17 13:36:49.502652 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3708/7111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:49 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:50.414928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-41be8972-a3b6-4160-a0be-891b4821dac4 req-11fd455d-6f7c-4bd1-b97b-94ad5ca710a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b1c2f0-89e2-43b6-90cb-4da04c5f3def", "name": "network-vif-deleted", "tag": "3d9bc998-8488-4b0e-8786-29b981a38a3b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:50.431753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-41be8972-a3b6-4160-a0be-891b4821dac4 req-11fd455d-6f7c-4bd1-b97b-94ad5ca710a3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.442185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-41be8972-a3b6-4160-a0be-891b4821dac4 req-11fd455d-6f7c-4bd1-b97b-94ad5ca710a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.443796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-41be8972-a3b6-4160-a0be-891b4821dac4 req-11fd455d-6f7c-4bd1-b97b-94ad5ca710a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.463400 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-41be8972-a3b6-4160-a0be-891b4821dac4 req-11fd455d-6f7c-4bd1-b97b-94ad5ca710a3 service nova] Creating event network-vif-deleted:3d9bc998-8488-4b0e-8786-29b981a38a3b for instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def on n-h1-853316-12 Oct 17 13:36:50.469022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-41be8972-a3b6-4160-a0be-891b4821dac4 req-11fd455d-6f7c-4bd1-b97b-94ad5ca710a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058488 Oct 17 13:36:50.469979 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3404/7112] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:50.513936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:50.515073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:50.522300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.523450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.524135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.524885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.525364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.525787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.564403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.565487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.566132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.566632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lazy-loading 'fault' on Instance uuid 89b1c2f0-89e2-43b6-90cb-4da04c5f3def {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:50.630798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:50.642675 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e23ec78c-caa6-4c9f-bfbb-7fe8b9861e57 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 200 len: 1338 microversion: 2.1 time: 0.132605 Oct 17 13:36:50.643398 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3709/7113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:50 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 1338 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:51.668605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:51.670375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 89b1c2f0-89e2-43b6-90cb-4da04c5f3def] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:51.677538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.678204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.678862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.679843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.680457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.681027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.701200 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] HTTP exception thrown: Instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def could not be found. Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Request method failure captured: Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def HTTP/1.1 Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVnOHpH4wIj1OnVxt96kwkNWomqEvEobECv2ibGrL1hstHLXdWGkfoBeordOArEwGqEWkQf3UFgZc5ptq7h5E-OYc18W7vg5aub-te98y_HBP7-IYlXhujWhLxcUkvcgxQmxQ5w4VQzeg2juxlid6Ddjukc1NNFIAij_2VlYVt9YEqc Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 26a92a0d55c5452eab084941b2cd3dfc Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26a92a0d55c5452eab084941b2cd3dfc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 26a92a0d55c5452eab084941b2cd3dfc Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkBasicOps-1037615271-project Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6d480e8e290947c48f0667345ed02cc6 Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkBasicOps-1037615271-project Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def could not be found. Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '89b1c2f0-89e2-43b6-90cb-4da04c5f3def'} Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def could not be found. Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def could not be found. Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:51.703405 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:51.710881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:51.710881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:51.710881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:51.710881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:51.710881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:51.710881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def could not be found. Oct 17 13:36:51.710881 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:36:51.713841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Returning 404 to user: Instance 89b1c2f0-89e2-43b6-90cb-4da04c5f3def could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:51.715269 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d5168d9f-fa1f-4005-af45-78bf62be0192 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def" status: 404 len: 111 microversion: 2.1 time: 0.052028 Oct 17 13:36:51.719921 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3405/7114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:51 2022] GET /compute/v2.1/servers/89b1c2f0-89e2-43b6-90cb-4da04c5f3def => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:51.938697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29379cd1-6a15-49f9-9bd0-2d251d488825 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '.version_select at 0x7fa820aa65e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:51.992870 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29379cd1-6a15-49f9-9bd0-2d251d488825 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-804593646" status: 202 len: 0 microversion: 2.1 time: 0.058132 Oct 17 13:36:51.994888 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3710/7115] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 17 13:36:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-804593646 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:37:05.277007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5de91ede-a0d1-4641-a75f-0ea506506be6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'create', calling method: .version_select at 0x7fa81bb65790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1642907045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo2TtjEh95VHbhw5OjdCPsylG31YbPiMOSotgVKav3tKh1eLLfUgj8x1rlm5HcfNRpRaMYpMHNY3Bi3Sbz7JOf09YcbhHWQW1wQCt6wQ9G3w+/6BHie2iHBw0xkeGhjaA=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:05.285363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=38 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:05.295695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=74 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:05.326841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5de91ede-a0d1-4641-a75f-0ea506506be6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:05.344403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-5de91ede-a0d1-4641-a75f-0ea506506be6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for user 6d480e8e290947c48f0667345ed02cc6 and project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:05.408145 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5de91ede-a0d1-4641-a75f-0ea506506be6 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.134675 Oct 17 13:37:05.409650 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3406/7116] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:37:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:07.381204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-952329422", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "504dd32c-7365-44e7-8212-ffb96e87c4b3"}], "key_name": "tempest-TestNetworkBasicOps-1642907045", "security_groups": [{"name": "tempest-secgroup-smoke-1768322625"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:07.396900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=12 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:07.397955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:07.576712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] validate_networks() for [('504dd32c-7365-44e7-8212-ffb96e87c4b3', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:08.778035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:08.780016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:08.780625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:08.781124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:08.781617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:08.793869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.794502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.795162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.796362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.796902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.797450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.851464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:08.859292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Getting quotas for user 6d480e8e290947c48f0667345ed02cc6 and project 26a92a0d55c5452eab084941b2cd3dfc. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:08.884224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:08.887021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:08.966605 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07819477-fdd0-45e9-a24d-ec7508c21c83 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.589469 Oct 17 13:37:08.976610 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3711/7117] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:08.980128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-113ea783-0cc1-460f-9589-9be069c5a3cb tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:08.982793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-113ea783-0cc1-460f-9589-9be069c5a3cb tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.092648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-113ea783-0cc1-460f-9589-9be069c5a3cb tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:09.103454 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-113ea783-0cc1-460f-9589-9be069c5a3cb tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1248 microversion: 2.1 time: 0.127597 Oct 17 13:37:09.104590 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3407/7118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:08 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1248 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:10.129806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:10.130418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:10.142664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.143167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.143611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.144321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.148957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.149420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.270540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:10.289257 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a10dc0f7-2dc3-4d6c-ace1-f8f0d9e8ec0a tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1300 microversion: 2.1 time: 0.161438 Oct 17 13:37:10.309020 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3712/7119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:10 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1300 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:11.315854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:11.317973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:11.326531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.328128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.328848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.330885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.331946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.332575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.465268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:11.483072 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f61df315-b318-4eb3-b3d4-c33e5c58547e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1306 microversion: 2.1 time: 0.171010 Oct 17 13:37:11.483652 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3408/7120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:11 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1306 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:12.509423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-62b829cb-81c6-4982-bbdc-6bd93fad989c req-f0a6651f-7c3b-4ea6-bb2c-8b828e225516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986dffb6-db5d-4730-8295-c722685fd840", "tag": "3db7cccb-e851-4774-889d-eec1f9bf5fd2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:12.512755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:12.517483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:12.524595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-62b829cb-81c6-4982-bbdc-6bd93fad989c req-f0a6651f-7c3b-4ea6-bb2c-8b828e225516 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.525588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-62b829cb-81c6-4982-bbdc-6bd93fad989c req-f0a6651f-7c3b-4ea6-bb2c-8b828e225516 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.526932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-62b829cb-81c6-4982-bbdc-6bd93fad989c req-f0a6651f-7c3b-4ea6-bb2c-8b828e225516 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.535621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.536608 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.539212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.543680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.546019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.546512 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-62b829cb-81c6-4982-bbdc-6bd93fad989c req-f0a6651f-7c3b-4ea6-bb2c-8b828e225516 service nova] Creating event network-changed:3db7cccb-e851-4774-889d-eec1f9bf5fd2 for instance 986dffb6-db5d-4730-8295-c722685fd840 on n-h2-853316-12 Oct 17 13:37:12.548192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.561433 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-62b829cb-81c6-4982-bbdc-6bd93fad989c req-f0a6651f-7c3b-4ea6-bb2c-8b828e225516 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058476 Oct 17 13:37:12.562975 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3713/7121] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:12.914531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:12.934189 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7cfe1f72-da18-49b5-9e96-9a2a7aac8f5c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1374 microversion: 2.1 time: 0.423161 Oct 17 13:37:12.934189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3409/7122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:12 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1374 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:13.977567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:13.978302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:13.986539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.987285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.987724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.988656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.989287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.989732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.179289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:14.190280 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df6062c3-36c7-4610-988d-3e5a0b42b0d9 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1374 microversion: 2.1 time: 0.218610 Oct 17 13:37:14.202683 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3714/7123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:13 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1374 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:15.219189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:15.220619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:15.229790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.230332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.230904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.231856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.232829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.233498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.437167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:15.451518 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-05a24678-6016-48af-afbf-e1830c952a48 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1374 microversion: 2.1 time: 0.237383 Oct 17 13:37:15.466423 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3410/7124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:15 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:16.487301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:16.487867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:16.496220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.496719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.497165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.497879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.498372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.498822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.649214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:16.658894 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f1566070-073d-4f8b-a280-878cd79fdd7b tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1374 microversion: 2.1 time: 0.175274 Oct 17 13:37:16.659543 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3715/7125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:16 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:17.688252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:17.689045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:17.698572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.699242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.699715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.700468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.700950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.701406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.899503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:17.915711 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d5dd127-fa08-4588-b6fb-eafb483ed7e3 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1374 microversion: 2.1 time: 0.230600 Oct 17 13:37:17.916945 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3411/7126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:17 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:18.721182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-93e7e3e3-b1ef-4e9a-a28b-9b28cc2c45a6 req-368bf044-b5f4-4555-987a-54ae7ee7992c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986dffb6-db5d-4730-8295-c722685fd840", "name": "network-vif-plugged", "status": "completed", "tag": "3db7cccb-e851-4774-889d-eec1f9bf5fd2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:18.736645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-93e7e3e3-b1ef-4e9a-a28b-9b28cc2c45a6 req-368bf044-b5f4-4555-987a-54ae7ee7992c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.737699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-93e7e3e3-b1ef-4e9a-a28b-9b28cc2c45a6 req-368bf044-b5f4-4555-987a-54ae7ee7992c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.738143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-93e7e3e3-b1ef-4e9a-a28b-9b28cc2c45a6 req-368bf044-b5f4-4555-987a-54ae7ee7992c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.752733 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-93e7e3e3-b1ef-4e9a-a28b-9b28cc2c45a6 req-368bf044-b5f4-4555-987a-54ae7ee7992c service nova] Creating event network-vif-plugged:3db7cccb-e851-4774-889d-eec1f9bf5fd2 for instance 986dffb6-db5d-4730-8295-c722685fd840 on n-h2-853316-12 Oct 17 13:37:18.759169 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-93e7e3e3-b1ef-4e9a-a28b-9b28cc2c45a6 req-368bf044-b5f4-4555-987a-54ae7ee7992c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043348 Oct 17 13:37:18.760519 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3716/7127] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:18.941135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:18.941922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:18.952930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.953440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.953893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.961914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.965647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.966493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.104813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:19.169308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:19.179609 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-07a12d9b-920c-46b9-9840-4a42dd7c3b1e tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1374 microversion: 2.1 time: 0.241905 Oct 17 13:37:19.182477 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3412/7128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:18 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1374 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:20.203658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:20.205026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:20.213050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:20.214099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:20.222279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.223304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.224477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.225314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.225949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.226657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.468910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:20.478013 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cd08c6f7-d948-4664-a33b-87cd91c34777 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1547 microversion: 2.1 time: 0.275803 Oct 17 13:37:20.490597 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3717/7129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:20 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1547 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:20.503175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:20.504453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:20.512429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.513801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.515719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.517124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.517950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.518730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.720953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:20.731241 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ebf5d97-6951-4b29-9282-07d1cfde366d tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1547 microversion: 2.1 time: 0.232194 Oct 17 13:37:20.732930 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3413/7130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:20 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1547 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:22.996251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1f041124-231b-49e8-a78f-31f51a57c889 req-cf90732d-64c4-4eeb-9cc3-960264b716ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986dffb6-db5d-4730-8295-c722685fd840", "tag": "3db7cccb-e851-4774-889d-eec1f9bf5fd2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:23.013595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1f041124-231b-49e8-a78f-31f51a57c889 req-cf90732d-64c4-4eeb-9cc3-960264b716ec service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:23.014078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1f041124-231b-49e8-a78f-31f51a57c889 req-cf90732d-64c4-4eeb-9cc3-960264b716ec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:23.016347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1f041124-231b-49e8-a78f-31f51a57c889 req-cf90732d-64c4-4eeb-9cc3-960264b716ec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:23.043745 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1f041124-231b-49e8-a78f-31f51a57c889 req-cf90732d-64c4-4eeb-9cc3-960264b716ec service nova] Creating event network-changed:3db7cccb-e851-4774-889d-eec1f9bf5fd2 for instance 986dffb6-db5d-4730-8295-c722685fd840 on n-h2-853316-12 Oct 17 13:37:23.052785 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1f041124-231b-49e8-a78f-31f51a57c889 req-cf90732d-64c4-4eeb-9cc3-960264b716ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062129 Oct 17 13:37:23.054519 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3718/7131] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:39.702628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:39.703798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=36 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:39.836062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1194053797", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "085a72b7-a974-4e5c-b83f-6b697516f9de"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:39.895711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] validate_networks() for [('085a72b7-a974-4e5c-b83f-6b697516f9de', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:40.273464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:40.273971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:40.274583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:40.275072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:40.275567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:40.284860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.285444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.285903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.286891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.287429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.287966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.304698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Getting quotas for project 94ba5e8fd93a4b3ba928f3a74a1ed9af. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:40.310127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Getting quotas for user 22b87c1e3b0743119552d503da247546 and project 94ba5e8fd93a4b3ba928f3a74a1ed9af. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:40.323466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:40.325817 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:40.374657 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c83947a7-08e0-4054-b769-3f2dcc18b65e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677192 Oct 17 13:37:40.375310 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3414/7132] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:40.385558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:40.386790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=32 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:40.392161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-280b48d4-49cf-4115-a1a6-55bd7108c527 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:40.393134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-280b48d4-49cf-4115-a1a6-55bd7108c527 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:40.470932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-280b48d4-49cf-4115-a1a6-55bd7108c527 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:40.479792 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-280b48d4-49cf-4115-a1a6-55bd7108c527 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1215 microversion: 2.1 time: 0.096193 Oct 17 13:37:40.482195 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3719/7133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:40 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:41.507323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:41.508591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:41.521905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.522868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.523729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.525487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.526385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.527271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.610223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:41.621052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c6d435b2-4edc-44be-9e7e-cf1fe6bea214 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1267 microversion: 2.1 time: 0.120904 Oct 17 13:37:41.621662 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3415/7134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:41 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1267 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:42.646573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:42.647439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:42.655590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.656349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.656960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.657849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.665218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.665710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.846743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:42.856001 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec203dc2-d4e5-481e-8cc7-f6754cba6d3d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1315 microversion: 2.1 time: 0.214648 Oct 17 13:37:42.856584 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3720/7135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:42 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:43.573080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-ba52ddba-e449-423f-a312-e9286e299309 req-f23f7024-1b23-47b0-8d49-f4674ef157f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34f406b0-2478-4f9b-b001-64abd95aa3b9", "tag": "3076068d-32fc-4fb5-bfd2-01e84de71a94"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:43.594218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ba52ddba-e449-423f-a312-e9286e299309 req-f23f7024-1b23-47b0-8d49-f4674ef157f6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.594888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ba52ddba-e449-423f-a312-e9286e299309 req-f23f7024-1b23-47b0-8d49-f4674ef157f6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.595430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ba52ddba-e449-423f-a312-e9286e299309 req-f23f7024-1b23-47b0-8d49-f4674ef157f6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.613349 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-ba52ddba-e449-423f-a312-e9286e299309 req-f23f7024-1b23-47b0-8d49-f4674ef157f6 service nova] Creating event network-changed:3076068d-32fc-4fb5-bfd2-01e84de71a94 for instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 on n-h1-853316-12 Oct 17 13:37:43.620682 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-ba52ddba-e449-423f-a312-e9286e299309 req-f23f7024-1b23-47b0-8d49-f4674ef157f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055200 Oct 17 13:37:43.621782 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3416/7136] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:43.887988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.889326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:43.898644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.898644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.898990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.899471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.899946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.900374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.108370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:44.118345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-81cfba24-3034-45d0-bc93-f89e6a9f82d9 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1315 microversion: 2.1 time: 0.239037 Oct 17 13:37:44.119288 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3721/7137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:43 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:45.148214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.148936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.155277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.155773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.156225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.156996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.157403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.157844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.293484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:45.301585 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1ad86878-79a1-4d5c-b005-4fe8fde73b72 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1315 microversion: 2.1 time: 0.159081 Oct 17 13:37:45.302194 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3417/7138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:45.449325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:45.452176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.460317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.460817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.461263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.461979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.462473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.462901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.515709 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-71d5cd04-d8fd-409f-a6c3-64258af90287 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840/action" status: 200 len: 24545 microversion: 2.1 time: 0.070098 Oct 17 13:37:45.523234 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3722/7139] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:45 2022] POST /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840/action => generated 24545 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:37:46.325131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:46.325676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:46.333431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.334109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.334598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.335484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.335957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.336581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.569953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:46.577767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80067b36-512a-49c4-a9b6-f9dff52984c4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1315 microversion: 2.1 time: 0.256684 Oct 17 13:37:46.578305 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3418/7140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:46 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:47.602912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:47.603744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:47.611792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.612701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.613286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.614113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.614708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.615325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.798211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:47.807756 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ae7327d-1c5b-466a-8dcc-72df7922911d tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1315 microversion: 2.1 time: 0.210494 Oct 17 13:37:47.808336 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3723/7141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:47 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:48.832816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:48.833609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:48.843214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.844197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.845056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.846408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.847221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.848514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.987504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:48.996128 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2de5c141-f0b7-40f7-9dc2-8c49bd153b86 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1315 microversion: 2.1 time: 0.168745 Oct 17 13:37:48.996719 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3419/7142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:48 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:49.557699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-22563fc9-633c-4912-9802-0c4a17fb3b0b req-07e0e379-ce8f-4a9d-8f8c-a1a99584577f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f406b0-2478-4f9b-b001-64abd95aa3b9", "name": "network-vif-plugged", "status": "completed", "tag": "3076068d-32fc-4fb5-bfd2-01e84de71a94"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:49.570311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-22563fc9-633c-4912-9802-0c4a17fb3b0b req-07e0e379-ce8f-4a9d-8f8c-a1a99584577f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.570796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-22563fc9-633c-4912-9802-0c4a17fb3b0b req-07e0e379-ce8f-4a9d-8f8c-a1a99584577f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.571225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-22563fc9-633c-4912-9802-0c4a17fb3b0b req-07e0e379-ce8f-4a9d-8f8c-a1a99584577f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.585362 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-22563fc9-633c-4912-9802-0c4a17fb3b0b req-07e0e379-ce8f-4a9d-8f8c-a1a99584577f service nova] Creating event network-vif-plugged:3076068d-32fc-4fb5-bfd2-01e84de71a94 for instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 on n-h1-853316-12 Oct 17 13:37:49.590510 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-22563fc9-633c-4912-9802-0c4a17fb3b0b req-07e0e379-ce8f-4a9d-8f8c-a1a99584577f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036560 Oct 17 13:37:49.591118 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3724/7143] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:37:50.021971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:50.022708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.032772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.033351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.033814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.034565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.035629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.036054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.197196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:50.205127 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-85fbd686-f557-4b85-8541-3003002d66c3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1315 microversion: 2.1 time: 0.187729 Oct 17 13:37:50.205718 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3420/7144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:50 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:51.227092 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:51.233292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.234088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.243431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.243991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.244482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.245312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.245807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.246332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.404483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.415034 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46ef2306-d294-4e19-b1ab-527e5d1fdb08 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1502 microversion: 2.1 time: 0.189820 Oct 17 13:37:51.415832 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3725/7145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:51.440910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.441756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.443829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:51.444527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:51.451562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.452080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.452564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.453283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.453758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.454226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.609473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.618768 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eeb922a2-65c9-4e11-b894-a11d3d5b2e23 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1502 microversion: 2.1 time: 0.181670 Oct 17 13:37:51.619354 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3421/7146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:51.645252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:51.645893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.652641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.653226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.653729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.654548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.655084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.655509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.689249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lazy-loading 'flavor' on Instance uuid 34f406b0-2478-4f9b-b001-64abd95aa3b9 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:51.786721 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d850d062-9fbf-4fe6-a1b7-9b3ed5020964 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "POST /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9/action" status: 202 len: 0 microversion: 2.1 time: 0.145948 Oct 17 13:37:51.787374 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3726/7147] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:51 2022] POST /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:37:51.801734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.803743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.811384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.812222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.813048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.814267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.814843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.815901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.983686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.997062 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9464aa61-80a8-437e-9407-88a4b82c2fd4 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1510 microversion: 2.1 time: 0.205136 Oct 17 13:37:51.997872 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3422/7148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:52.052234 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:52.054720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:52.062719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.063373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.064084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.064909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.065486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.065920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.133787 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56114873-24d3-45fa-969e-b15403218b42 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "POST /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840/action" status: 200 len: 32617 microversion: 2.1 time: 0.087109 Oct 17 13:37:52.134953 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3727/7149] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:52 2022] POST /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840/action => generated 32617 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:37:53.024711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.025358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.033310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.033821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.034534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.035843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.036326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.036769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.213900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.226937 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9de72e57-92ea-4ef5-b7cf-4d0bee9aec6f tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1493 microversion: 2.1 time: 0.209832 Oct 17 13:37:53.241601 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3423/7150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1493 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:53.251187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:53.251813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.265402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.266126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.266865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.268314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.268799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.269397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.389020 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e55f4ef-44c7-4271-820b-c6e065bf5174 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "POST /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9/action" status: 202 len: 0 microversion: 2.1 time: 0.141823 Oct 17 13:37:53.391360 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3728/7151] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:53 2022] POST /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:37:53.401412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.402400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.416489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.417121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.417681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.419409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.419963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.420477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.430611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.431215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.447697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.448264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.450681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.453490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.454041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.454787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.516507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:53.665587 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0320b18-7992-4b3e-8072-f6930d538611 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "DELETE /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 204 len: 0 microversion: 2.1 time: 0.244168 Oct 17 13:37:53.667285 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3729/7152] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:53 2022] DELETE /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:53.679804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5ba9c5a1-dd0c-4ea5-a61d-1c605774c93d req-db49c70a-a35a-4e29-b010-5cba4cfc8e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986dffb6-db5d-4730-8295-c722685fd840", "tag": "3db7cccb-e851-4774-889d-eec1f9bf5fd2"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:53.693486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5ba9c5a1-dd0c-4ea5-a61d-1c605774c93d req-db49c70a-a35a-4e29-b010-5cba4cfc8e95 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.693976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5ba9c5a1-dd0c-4ea5-a61d-1c605774c93d req-db49c70a-a35a-4e29-b010-5cba4cfc8e95 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.694445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5ba9c5a1-dd0c-4ea5-a61d-1c605774c93d req-db49c70a-a35a-4e29-b010-5cba4cfc8e95 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.710641 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5ba9c5a1-dd0c-4ea5-a61d-1c605774c93d req-db49c70a-a35a-4e29-b010-5cba4cfc8e95 service nova] Creating event network-changed:3db7cccb-e851-4774-889d-eec1f9bf5fd2 for instance 986dffb6-db5d-4730-8295-c722685fd840 on n-h2-853316-12 Oct 17 13:37:53.717434 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5ba9c5a1-dd0c-4ea5-a61d-1c605774c93d req-db49c70a-a35a-4e29-b010-5cba4cfc8e95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047964 Oct 17 13:37:53.718333 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3730/7153] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:53.725097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.725816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.734208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.734408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.734742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.735454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.735912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.736489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.752656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.764133 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68aab33e-7ff8-405d-aa78-8b0e36a735c1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1499 microversion: 2.1 time: 0.367710 Oct 17 13:37:53.765573 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3424/7154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1499 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:53.918067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.930195 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aa902c3a-cca0-435a-a1e3-b70839371a4c tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1672 microversion: 2.1 time: 0.210384 Oct 17 13:37:53.931129 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3731/7155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1672 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:54.792174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.792803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.801175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.803144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.805899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.806870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.807477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.808406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.963721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.968226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.981333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.981951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.982537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.983924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.984510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.985049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.134378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:55.145754 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-24e18890-e93e-4887-8e1a-64a37d4958c6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1499 microversion: 2.1 time: 0.357963 Oct 17 13:37:55.146392 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3425/7156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1499 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:55.255363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d480e8e290947c48f0667345ed02cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a92a0d55c5452eab084941b2cd3dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:55.264337 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c17df07-505e-4e32-95c6-f208d6128381 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 200 len: 1672 microversion: 2.1 time: 0.308720 Oct 17 13:37:55.265624 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3732/7157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 1672 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:55.735489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-40e4ebb3-557e-4d00-9115-9962a21c0b06 req-36ea31e9-bc93-46b1-b023-2b68d620bc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986dffb6-db5d-4730-8295-c722685fd840", "name": "network-vif-deleted", "tag": "3db7cccb-e851-4774-889d-eec1f9bf5fd2"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:55.752563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-40e4ebb3-557e-4d00-9115-9962a21c0b06 req-36ea31e9-bc93-46b1-b023-2b68d620bc3a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.753230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-40e4ebb3-557e-4d00-9115-9962a21c0b06 req-36ea31e9-bc93-46b1-b023-2b68d620bc3a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.753780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-40e4ebb3-557e-4d00-9115-9962a21c0b06 req-36ea31e9-bc93-46b1-b023-2b68d620bc3a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.766041 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-40e4ebb3-557e-4d00-9115-9962a21c0b06 req-36ea31e9-bc93-46b1-b023-2b68d620bc3a service nova] Creating event network-vif-deleted:3db7cccb-e851-4774-889d-eec1f9bf5fd2 for instance 986dffb6-db5d-4730-8295-c722685fd840 on n-h2-853316-12 Oct 17 13:37:55.772130 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-40e4ebb3-557e-4d00-9115-9962a21c0b06 req-36ea31e9-bc93-46b1-b023-2b68d620bc3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040608 Oct 17 13:37:55.772887 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3426/7158] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:56.171979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.172662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.182593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.183104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.183545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.184261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.184716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.185143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.294730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.296991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] [instance: 986dffb6-db5d-4730-8295-c722685fd840] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.317223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.317736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.318237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.318970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.319441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.319884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.337197 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] HTTP exception thrown: Instance 986dffb6-db5d-4730-8295-c722685fd840 could not be found. Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Request method failure captured: Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 HTTP/1.1 Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVnOHpH4wIj1OnVxt96kwkNWomqEvEobECv2ibGrL1hstHLXdWGkfoBeordOArEwGqEWkQf3UFgZc5ptq7h5E-OYc18W7vg5aub-te98y_HBP7-IYlXhujWhLxcUkvcgxQmxQ5w4VQzeg2juxlid6Ddjukc1NNFIAij_2VlYVt9YEqc Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 26a92a0d55c5452eab084941b2cd3dfc Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_26a92a0d55c5452eab084941b2cd3dfc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/26a92a0d55c5452eab084941b2cd3dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 26a92a0d55c5452eab084941b2cd3dfc Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkBasicOps-1037615271 Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkBasicOps-1037615271-project Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 6d480e8e290947c48f0667345ed02cc6 Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkBasicOps-1037615271-project Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 986dffb6-db5d-4730-8295-c722685fd840 could not be found. Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '986dffb6-db5d-4730-8295-c722685fd840'} Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986dffb6-db5d-4730-8295-c722685fd840 could not be found. Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986dffb6-db5d-4730-8295-c722685fd840 could not be found. Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:56.339508 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.343067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:56.343067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:56.343067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:56.343067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:56.343067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:56.343067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986dffb6-db5d-4730-8295-c722685fd840 could not be found. Oct 17 13:37:56.343067 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.343419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:56.344628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Returning 404 to user: Instance 986dffb6-db5d-4730-8295-c722685fd840 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:56.345662 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-74b433fb-0abb-4dd1-992d-852981d8d6ab tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840" status: 404 len: 111 microversion: 2.1 time: 0.056392 Oct 17 13:37:56.346341 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3427/7159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:56 2022] GET /compute/v2.1/servers/986dffb6-db5d-4730-8295-c722685fd840 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:37:56.356583 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7fc65c6c-5925-4774-a541-93aa499ca8a3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1502 microversion: 2.1 time: 0.189453 Oct 17 13:37:56.357181 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3733/7160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:56 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:56.385614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:56.386773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.394893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.395446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.396132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.397056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.397498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.398727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.427025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lazy-loading 'flavor' on Instance uuid 34f406b0-2478-4f9b-b001-64abd95aa3b9 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:56.515408 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4660b6d6-4184-4262-a29d-4571ff4bf5f1 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "POST /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9/action" status: 202 len: 0 microversion: 2.1 time: 0.137068 Oct 17 13:37:56.516632 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3428/7161] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:56 2022] POST /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:37:56.527924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.528521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.537479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.538105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.538589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.539288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.539737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.540401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.545386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:56.594673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4d0a6608-d2bb-4491-b0ba-fe1104f5d383 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] Calling method '.version_select at 0x7fa81bbf0f70>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.646796 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4d0a6608-d2bb-4491-b0ba-fe1104f5d383 tempest-TestNetworkBasicOps-1037615271 tempest-TestNetworkBasicOps-1037615271-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1642907045" status: 202 len: 0 microversion: 2.1 time: 0.061047 Oct 17 13:37:56.647388 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3429/7162] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 17 13:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1642907045 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:37:56.741021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:56.751773 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-46f187fd-a86e-4ca2-af44-91886bcd9a7e tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1510 microversion: 2.1 time: 0.227868 Oct 17 13:37:56.757122 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3734/7163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:56 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:57.775929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:57.777000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:57.785455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.786125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.786697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.787452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.787924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.788368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.000807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.010943 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd338e93-8fc5-481e-a8ed-ac21fd50e0ea tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1493 microversion: 2.1 time: 0.239162 Oct 17 13:37:58.011676 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3430/7164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:57 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1493 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:58.036193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:58.037309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.044588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.045073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.045685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.046419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.047021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.047448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.136976 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e1cfdcf-7f96-4256-a6e4-7be4e9049570 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "POST /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9/action" status: 202 len: 0 microversion: 2.1 time: 0.105157 Oct 17 13:37:58.138007 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3735/7165] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:58 2022] POST /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:37:58.146531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.147178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.159351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.160580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.161245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.162210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.162695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.167065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.590610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.608454 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d9483356-484f-4f84-b301-9a3ad0aa14a6 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1499 microversion: 2.1 time: 0.465528 Oct 17 13:37:58.610449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3431/7166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:58 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1499 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:59.634450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:59.635168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:59.666428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.667253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.668276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.668671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.669206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.669697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.928026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:59.936421 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31220113-ad3c-42cf-b0d1-81cf01865365 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1499 microversion: 2.1 time: 0.306342 Oct 17 13:37:59.937266 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3736/7167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:59 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1499 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:00.962382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:00.963960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:00.976362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.977146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.978069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.979170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.980408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.981448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.013714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:01.326340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:01.340906 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ce996ea0-2b4f-4b25-8757-d3383807e5e7 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1502 microversion: 2.1 time: 0.384504 Oct 17 13:38:01.347699 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3432/7168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:00 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:01.368839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:01.369865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:01.378035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.379323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.379939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.381238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.381840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.382659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.413240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:01.506806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3bbd669-5e30-43f0-adaa-29233486930a tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "DELETE /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 204 len: 0 microversion: 2.1 time: 0.141430 Oct 17 13:38:01.507713 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3737/7169] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:01 2022] DELETE /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:01.524658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:01.526336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:01.539534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.540794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.541633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.543191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.544539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.545678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.724573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:01.733806 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1e1c8f4d-eb53-48d5-9006-1f1772896b79 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1508 microversion: 2.1 time: 0.219958 Oct 17 13:38:01.734879 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3433/7170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:01 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:02.762536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:02.763267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:02.772611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.773138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.773742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.774606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.775060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.775633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.961519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:02.970637 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6223167a-4b1d-4628-9194-69a46d33c3f3 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1508 microversion: 2.1 time: 0.213954 Oct 17 13:38:02.971408 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3738/7171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:02 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:03.998595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.001775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.031232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.031804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.032324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.033290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.033768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.034289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.381383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b87c1e3b0743119552d503da247546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba5e8fd93a4b3ba928f3a74a1ed9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:04.399984 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dc136822-6407-4107-be71-6175077f1c60 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 200 len: 1508 microversion: 2.1 time: 0.406664 Oct 17 13:38:04.400875 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3434/7172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:03 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:04.602680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8218fb93-63f2-4ab6-b767-540187611233 req-d5a4ecb4-8a33-4f20-8703-be6bd943a4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f406b0-2478-4f9b-b001-64abd95aa3b9", "name": "network-vif-deleted", "tag": "3076068d-32fc-4fb5-bfd2-01e84de71a94"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:04.615326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8218fb93-63f2-4ab6-b767-540187611233 req-d5a4ecb4-8a33-4f20-8703-be6bd943a4ed service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.616075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8218fb93-63f2-4ab6-b767-540187611233 req-d5a4ecb4-8a33-4f20-8703-be6bd943a4ed service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.616655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8218fb93-63f2-4ab6-b767-540187611233 req-d5a4ecb4-8a33-4f20-8703-be6bd943a4ed service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.630918 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8218fb93-63f2-4ab6-b767-540187611233 req-d5a4ecb4-8a33-4f20-8703-be6bd943a4ed service nova] Creating event network-vif-deleted:3076068d-32fc-4fb5-bfd2-01e84de71a94 for instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 on n-h1-853316-12 Oct 17 13:38:04.636311 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8218fb93-63f2-4ab6-b767-540187611233 req-d5a4ecb4-8a33-4f20-8703-be6bd943a4ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042922 Oct 17 13:38:04.637098 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3739/7173] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:05.430246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:05.431544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] [instance: 34f406b0-2478-4f9b-b001-64abd95aa3b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:05.449870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:05.450671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:05.451134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.451994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:05.452636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:05.453087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.510818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] HTTP exception thrown: Instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 could not be found. Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Request method failure captured: Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 HTTP/1.1 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVqhV_ktrjk9ZjEKvoGGWaDAWC1JNOSo3moKqLEKuEx_nrGA9MKE0fagD2pBoGcFuS0poTSbHnuRmodfFK5dUksEVqnPiiH87ILiKi5vzaagHrxU_5SWsrgFxe37gd5I5F6NI0I5qAxgSGJxV67uicKd2xrr_1YiQdGl552Gz2IYz48 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 94ba5e8fd93a4b3ba928f3a74a1ed9af Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestServerAdvancedOps-1387373223 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_94ba5e8fd93a4b3ba928f3a74a1ed9af", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94ba5e8fd93a4b3ba928f3a74a1ed9af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/94ba5e8fd93a4b3ba928f3a74a1ed9af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94ba5e8fd93a4b3ba928f3a74a1ed9af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestServerAdvancedOps-1387373223 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 94ba5e8fd93a4b3ba928f3a74a1ed9af Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestServerAdvancedOps-1387373223 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestServerAdvancedOps-1387373223-project Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 22b87c1e3b0743119552d503da247546 Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestServerAdvancedOps-1387373223-project Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 could not be found. Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '34f406b0-2478-4f9b-b001-64abd95aa3b9'} Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 could not be found. Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 could not be found. Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:05.512656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 could not be found. Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] Returning 404 to user: Instance 34f406b0-2478-4f9b-b001-64abd95aa3b9 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ef8e414-30e4-4dfc-b1e0-3d9f45bbc1c0 tempest-TestServerAdvancedOps-1387373223 tempest-TestServerAdvancedOps-1387373223-project] 10.222.0.27 "GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9" status: 404 len: 111 microversion: 2.1 time: 0.093574 Oct 17 13:38:05.522507 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3435/7174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:05 2022] GET /compute/v2.1/servers/34f406b0-2478-4f9b-b001-64abd95aa3b9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:54.399591 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:39:54.400854 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 13:39:54.401670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:54.402557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:54.404430 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 13:39:54.406077 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 17 13:39:54.407120 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:39:54.407310 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 17 13:39:54.414046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2080081381", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:54.747295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:55.057275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:55.057697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:55.058221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:55.058632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:55.059048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:55.068859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.069342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.069812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.070594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.071040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.071499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.089251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Getting quotas for project 950c07d8f13b4fceb3038be0b533c300. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:55.096107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Getting quotas for user 48745046b2e54d84ad1122655e6bdd16 and project 950c07d8f13b4fceb3038be0b533c300. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:55.111530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:55.114010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:55.163022 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d05f419-4a8b-43de-a7e5-402d592e29f1 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765344 Oct 17 13:39:55.163687 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3740/7175] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:55.173892 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 13:39:55.175197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:55.176716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=16 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:55.178111 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 13:39:55.183433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc28c1e4-f2cf-4faf-b3c1-e80b431937af tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:55.184201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc28c1e4-f2cf-4faf-b3c1-e80b431937af tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:55.364772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc28c1e4-f2cf-4faf-b3c1-e80b431937af tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:55.372245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc28c1e4-f2cf-4faf-b3c1-e80b431937af tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1215 microversion: 2.1 time: 0.200772 Oct 17 13:39:55.373042 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3436/7176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:55 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:56.401468 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-12e09892-ee38-4fdb-86a2-b9e31a530f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:56.402120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-12e09892-ee38-4fdb-86a2-b9e31a530f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:56.418373 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41272. Oct 17 13:39:56.422639 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41274. Oct 17 13:39:56.483549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-12e09892-ee38-4fdb-86a2-b9e31a530f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:56.490992 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-12e09892-ee38-4fdb-86a2-b9e31a530f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1215 microversion: 2.1 time: 0.095200 Oct 17 13:39:56.491609 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3741/7177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:56 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:57.517179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-847c2209-b5b2-4a6d-90b0-39cc31ccaad5 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:57.518213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-847c2209-b5b2-4a6d-90b0-39cc31ccaad5 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:57.553885 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41286. Oct 17 13:39:57.590581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-847c2209-b5b2-4a6d-90b0-39cc31ccaad5 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:57.599713 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-847c2209-b5b2-4a6d-90b0-39cc31ccaad5 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1215 microversion: 2.1 time: 0.088485 Oct 17 13:39:57.600416 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3437/7178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:57 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:58.629258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-428f6f58-4851-4b6a-988a-cab23bd20157 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:58.631825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-428f6f58-4851-4b6a-988a-cab23bd20157 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:58.706022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-428f6f58-4851-4b6a-988a-cab23bd20157 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.715371 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-428f6f58-4851-4b6a-988a-cab23bd20157 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1215 microversion: 2.1 time: 0.092021 Oct 17 13:39:58.716379 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3742/7179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:58 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:59.750056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:59.750730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:59.757623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:59.758114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:59.758615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:59.759314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:59.759776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:59.760209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:59.841066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:59.850597 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-376328eb-a6af-4d8b-a192-cafe8fbc7c6f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1219 microversion: 2.1 time: 0.105006 Oct 17 13:39:59.851222 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3438/7180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:59 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:00.875469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:00.876153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:00.886011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.886743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.887256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.888182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.888720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.889805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:01.369376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:01.379460 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-26b744a2-aff5-4c0c-a6c0-ce1f9f1d8033 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1273 microversion: 2.1 time: 0.508900 Oct 17 13:40:01.380169 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3743/7181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:00 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1273 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:02.427141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:02.428781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:02.437421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.438046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.438624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.439470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.439959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.440410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.608721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:02.627474 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ef32707f-2fb1-43f6-8099-e5724645549b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1315 microversion: 2.1 time: 0.208172 Oct 17 13:40:02.627474 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3439/7182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:02 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:02.678195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1b617aa7-05e9-4ae4-ace9-d902c60ea6ff req-78a09674-65ef-4f88-b7cd-8742619466c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552ce949-7e0e-4791-bb03-0b6d8ae9ddc7", "tag": "66fbf5b7-f56c-4ab6-9abf-d085ae5c87fd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:02.691244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1b617aa7-05e9-4ae4-ace9-d902c60ea6ff req-78a09674-65ef-4f88-b7cd-8742619466c7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.693026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1b617aa7-05e9-4ae4-ace9-d902c60ea6ff req-78a09674-65ef-4f88-b7cd-8742619466c7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.694591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1b617aa7-05e9-4ae4-ace9-d902c60ea6ff req-78a09674-65ef-4f88-b7cd-8742619466c7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.729225 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1b617aa7-05e9-4ae4-ace9-d902c60ea6ff req-78a09674-65ef-4f88-b7cd-8742619466c7 service nova] Creating event network-changed:66fbf5b7-f56c-4ab6-9abf-d085ae5c87fd for instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 on n-h2-853316-12 Oct 17 13:40:02.739401 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1b617aa7-05e9-4ae4-ace9-d902c60ea6ff req-78a09674-65ef-4f88-b7cd-8742619466c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064969 Oct 17 13:40:02.740895 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3744/7183] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:03.652978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:03.653673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:03.662702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:03.663219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:03.664938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:03.665694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:03.666186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:03.666654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:03.824383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:03.837928 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7e8f0a19-b82a-409b-8bc2-95c6424ef6be tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1315 microversion: 2.1 time: 0.188893 Oct 17 13:40:03.838721 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3440/7184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:03 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:04.863394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:04.864106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:04.870700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:04.871193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:04.871766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:04.872334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:04.873065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:04.873496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:05.015935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:05.024172 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8c2dd6c-64e4-4be0-9a70-d2f31ed1327b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1315 microversion: 2.1 time: 0.166802 Oct 17 13:40:05.024775 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3745/7185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:04 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:06.049755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:06.050389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:06.056616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.057127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.057585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:06.058339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.058812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.059258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:06.221490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:06.230291 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e208dde-89f9-45ae-9fee-7947544acee9 tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1315 microversion: 2.1 time: 0.185380 Oct 17 13:40:06.231031 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3441/7186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:06 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:07.255062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:07.255946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:07.258444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:07.266100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:07.266587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:07.267034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.267750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:07.268615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:07.269207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.432926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:07.441491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e53a8f7f-79be-40af-ac4d-edfe72b7aeec tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1315 microversion: 2.1 time: 0.190356 Oct 17 13:40:07.442367 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3746/7187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:07 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:07.473864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f6f836f9-3b91-4d5a-a7b2-e1030d371470 req-2a4d7522-8124-4220-952e-a9474e207140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552ce949-7e0e-4791-bb03-0b6d8ae9ddc7", "name": "network-vif-plugged", "status": "completed", "tag": "66fbf5b7-f56c-4ab6-9abf-d085ae5c87fd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:07.486015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f6f836f9-3b91-4d5a-a7b2-e1030d371470 req-2a4d7522-8124-4220-952e-a9474e207140 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:07.486760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f6f836f9-3b91-4d5a-a7b2-e1030d371470 req-2a4d7522-8124-4220-952e-a9474e207140 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:07.487326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f6f836f9-3b91-4d5a-a7b2-e1030d371470 req-2a4d7522-8124-4220-952e-a9474e207140 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.501406 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f6f836f9-3b91-4d5a-a7b2-e1030d371470 req-2a4d7522-8124-4220-952e-a9474e207140 service nova] Creating event network-vif-plugged:66fbf5b7-f56c-4ab6-9abf-d085ae5c87fd for instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 on n-h2-853316-12 Oct 17 13:40:07.509452 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f6f836f9-3b91-4d5a-a7b2-e1030d371470 req-2a4d7522-8124-4220-952e-a9474e207140 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040715 Oct 17 13:40:07.510310 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3442/7188] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:08.466196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:08.467744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:08.475042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:08.475526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:08.475961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:08.476668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:08.477118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:08.477541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:08.627962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:08.662026 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c799b2d8-fa93-4f6d-815f-9a32f6ab905b tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1315 microversion: 2.1 time: 0.199877 Oct 17 13:40:08.662753 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3747/7189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:08 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:09.682656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:09.689354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:09.690219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:09.697397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.697784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.698453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.699104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.699403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.699930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.870228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:09.878954 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5a49844-ec79-4c61-b852-6d3bc16d0f2f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1465 microversion: 2.1 time: 0.197460 Oct 17 13:40:09.879568 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3443/7190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:09 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1465 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:09.929928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:09.930531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:09.932540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:09.940132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.940631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.941113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.941820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.942311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.942741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.974015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:10.064024 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7619aefd-aa7c-4aa7-95ff-31406cddde3a tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "DELETE /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 204 len: 0 microversion: 2.1 time: 0.137830 Oct 17 13:40:10.064843 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3748/7191] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:09 2022] DELETE /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:10.074573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:10.075213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:10.081785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:10.082332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:10.082797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.083540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:10.084020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:10.084476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.245000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:10.253897 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc3915a5-2d87-401b-ac6d-87f9db23d7cc tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1471 microversion: 2.1 time: 0.183495 Oct 17 13:40:10.254553 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3444/7192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:10 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:11.278485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:11.280295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:11.288693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:11.289557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:11.289905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:11.290670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:11.291176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:11.291547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:11.615492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48745046b2e54d84ad1122655e6bdd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950c07d8f13b4fceb3038be0b533c300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:11.634797 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ff6c138-a5e0-44bd-b1a7-92758d25389d tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 200 len: 1471 microversion: 2.1 time: 0.360782 Oct 17 13:40:11.635756 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3749/7193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:11 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:12.008827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2104fa43-15cd-49b4-b338-d12efba79e9a req-417c05ab-b197-4d9b-b3a7-4ce0bdb7ee17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552ce949-7e0e-4791-bb03-0b6d8ae9ddc7", "name": "network-vif-deleted", "tag": "66fbf5b7-f56c-4ab6-9abf-d085ae5c87fd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:12.027428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2104fa43-15cd-49b4-b338-d12efba79e9a req-417c05ab-b197-4d9b-b3a7-4ce0bdb7ee17 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.027428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2104fa43-15cd-49b4-b338-d12efba79e9a req-417c05ab-b197-4d9b-b3a7-4ce0bdb7ee17 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.028133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2104fa43-15cd-49b4-b338-d12efba79e9a req-417c05ab-b197-4d9b-b3a7-4ce0bdb7ee17 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.069102 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2104fa43-15cd-49b4-b338-d12efba79e9a req-417c05ab-b197-4d9b-b3a7-4ce0bdb7ee17 service nova] Creating event network-vif-deleted:66fbf5b7-f56c-4ab6-9abf-d085ae5c87fd for instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 on n-h2-853316-12 Oct 17 13:40:12.076364 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2104fa43-15cd-49b4-b338-d12efba79e9a req-417c05ab-b197-4d9b-b3a7-4ce0bdb7ee17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079793 Oct 17 13:40:12.077449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3445/7194] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:12.676917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:12.677536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] [instance: 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:12.684942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.685700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.685989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.686769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.687233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.687671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.711442 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] HTTP exception thrown: Instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 could not be found. Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Request method failure captured: Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 HTTP/1.1 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVso0OlAem5SXUSpb58h2vKHWxh4_L2t27Nd4DC7WOPkn_RHKuH-87KyPNJhGADZiwDhAwWefKRIoqf6pkKwlrL67sOadZz32sa62BHWqGpwVyrRiL7SKPRcG46qGsh8g8KsTLof1MbEB81brRO-gJfmp965-WRsgWzkIY93gt8phpo Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 950c07d8f13b4fceb3038be0b533c300 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-VolumesNegativeTest-1153360492 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_950c07d8f13b4fceb3038be0b533c300", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/950c07d8f13b4fceb3038be0b533c300"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/950c07d8f13b4fceb3038be0b533c300"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/950c07d8f13b4fceb3038be0b533c300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-VolumesNegativeTest-1153360492 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 950c07d8f13b4fceb3038be0b533c300 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-VolumesNegativeTest-1153360492 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-VolumesNegativeTest-1153360492-project Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 48745046b2e54d84ad1122655e6bdd16 Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-VolumesNegativeTest-1153360492-project Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 could not be found. Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '552ce949-7e0e-4791-bb03-0b6d8ae9ddc7'} Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 could not be found. Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 could not be found. Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:12.714449 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 could not be found. Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] Returning 404 to user: Instance 552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2bcd6cf-d605-4832-9f1e-5a20846a3c3f tempest-VolumesNegativeTest-1153360492 tempest-VolumesNegativeTest-1153360492-project] 10.222.0.27 "GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7" status: 404 len: 111 microversion: 2.1 time: 0.043624 Oct 17 13:40:12.719704 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3750/7195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:12 2022] GET /compute/v2.1/servers/552ce949-7e0e-4791-bb03-0b6d8ae9ddc7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:19.838206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6cdba41b-4ff7-45ba-8f09-25292fa3ecf5 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Action: 'create', calling method: .version_select at 0x7fa81bb294c0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-950178015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi2IuTBl4XKSSYnWeYhnzzTnygEKbCLdJS46QB6NC0o67Pek6uAXt6LXBqdXmDI71XkKu5uA4Gint43qgQQq4OAxxbVa8RfqYkrcDUSVcerH+E/0e7COL8zbgO/JVl8Fg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:19.853613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6cdba41b-4ff7-45ba-8f09-25292fa3ecf5 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Getting quotas for project dcce50030a3c46589cb17309f849904c. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:19.858981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6cdba41b-4ff7-45ba-8f09-25292fa3ecf5 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Getting quotas for user 46a3bf417c7b4cc3a07c282ab948b063 and project dcce50030a3c46589cb17309f849904c. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:19.873248 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6cdba41b-4ff7-45ba-8f09-25292fa3ecf5 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [e842b619-549b-4674-b41f-316ff90c7a34] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:40:20.880672 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [None req-6cdba41b-4ff7-45ba-8f09-25292fa3ecf5 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [e842b619-549b-4674-b41f-316ff90c7a34] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41862. Oct 17 13:40:20.897459 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6cdba41b-4ff7-45ba-8f09-25292fa3ecf5 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 1.064533 Oct 17 13:40:20.898064 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3446/7196] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:40:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:21.968042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1434311600", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b559ff4e-def2-4649-8f90-db5b92c01283", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-950178015", "security_groups": [{"name": "tempest-secgroup-smoke-1784093229"}], "networks": [{"uuid": "7fe5d035-2ffc-426c-852f-762725f4ad63"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:22.090405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] validate_networks() for [('7fe5d035-2ffc-426c-852f-762725f4ad63', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:40:22.473035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:40:22.473429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:40:22.473898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:40:22.474421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:40:22.474842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:40:22.484479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.484958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.485391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.486109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.486613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.487036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.504480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Getting quotas for project dcce50030a3c46589cb17309f849904c. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:22.509659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Getting quotas for user 46a3bf417c7b4cc3a07c282ab948b063 and project dcce50030a3c46589cb17309f849904c. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:22.569098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:40:22.571312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b559ff4e-def2-4649-8f90-db5b92c01283',volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:40:22.707337 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b26e6def-f704-4f47-a552-fadc12e43e80 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743314 Oct 17 13:40:22.707985 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3751/7197] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:40:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:40:22.718147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=40 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:22.722531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d79fa3dd-c6d0-4769-b0aa-0e9619c48dff tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:22.723186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d79fa3dd-c6d0-4769-b0aa-0e9619c48dff tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:22.779763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d79fa3dd-c6d0-4769-b0aa-0e9619c48dff tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:22.786728 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d79fa3dd-c6d0-4769-b0aa-0e9619c48dff tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1098 microversion: 2.1 time: 0.071553 Oct 17 13:40:22.787286 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3447/7198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:22 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1098 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:23.809426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-890c65cb-f711-40df-9ee1-d08f8bbdba6b tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:23.810817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-890c65cb-f711-40df-9ee1-d08f8bbdba6b tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:23.866070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-890c65cb-f711-40df-9ee1-d08f8bbdba6b tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:23.873512 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-890c65cb-f711-40df-9ee1-d08f8bbdba6b tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1098 microversion: 2.1 time: 0.068197 Oct 17 13:40:23.874076 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3752/7199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:23 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1098 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:24.897350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc0cd1d2-d3fc-4ef9-8f0a-b953f69be0e2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:24.897980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc0cd1d2-d3fc-4ef9-8f0a-b953f69be0e2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:24.958224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc0cd1d2-d3fc-4ef9-8f0a-b953f69be0e2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:24.965196 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc0cd1d2-d3fc-4ef9-8f0a-b953f69be0e2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1098 microversion: 2.1 time: 0.072024 Oct 17 13:40:24.965813 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3448/7200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:24 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1098 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:25.988797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5de7ca50-6aed-4b3e-b993-716025c42a15 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:25.989434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5de7ca50-6aed-4b3e-b993-716025c42a15 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:25.992863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:26.050433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5de7ca50-6aed-4b3e-b993-716025c42a15 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:26.058085 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5de7ca50-6aed-4b3e-b993-716025c42a15 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1098 microversion: 2.1 time: 0.073090 Oct 17 13:40:26.062367 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3753/7201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:25 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1098 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:27.083590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:27.084122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:27.086812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:27.093534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.094032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.094513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.095230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.095691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.096130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.163865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:27.172008 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f66066b3-bd88-4a1a-9e84-ffab1d07e8b6 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1148 microversion: 2.1 time: 0.092703 Oct 17 13:40:27.172581 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3449/7202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:27 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1148 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:28.196270 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:28.197348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:28.210135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.210879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.211317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.212022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.212473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.213021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.218291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:28.288873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:28.298422 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ccfbed2-3e2e-4af5-aec7-d219c056e119 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1214 microversion: 2.1 time: 0.106399 Oct 17 13:40:28.299451 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3754/7203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:28 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:29.327969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f894acf8-9b51-4022-89ce-01199ed35cb4 req-de4c40b1-24ba-4d18-b8ed-8ae8532f76e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d14430e-22a8-4d4d-8e0e-e7f5a9028c62", "tag": "315e2038-fb8b-4fc7-8452-62cc16ed3121"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:29.331093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.332255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:29.350729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.354932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.355792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.356768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.357263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f894acf8-9b51-4022-89ce-01199ed35cb4 req-de4c40b1-24ba-4d18-b8ed-8ae8532f76e1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.358027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f894acf8-9b51-4022-89ce-01199ed35cb4 req-de4c40b1-24ba-4d18-b8ed-8ae8532f76e1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.359362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.360024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f894acf8-9b51-4022-89ce-01199ed35cb4 req-de4c40b1-24ba-4d18-b8ed-8ae8532f76e1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.360680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.375295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f894acf8-9b51-4022-89ce-01199ed35cb4 req-de4c40b1-24ba-4d18-b8ed-8ae8532f76e1 service nova] Creating event network-changed:315e2038-fb8b-4fc7-8452-62cc16ed3121 for instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 on n-h2-853316-12 Oct 17 13:40:29.380547 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f894acf8-9b51-4022-89ce-01199ed35cb4 req-de4c40b1-24ba-4d18-b8ed-8ae8532f76e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057083 Oct 17 13:40:29.381692 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3755/7204] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:29.528963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:29.537385 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-92a52b04-a28e-4c83-b9b7-027559846859 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1282 microversion: 2.1 time: 0.218515 Oct 17 13:40:29.538381 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3450/7205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:29 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:30.560900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:30.562295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:30.569403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.569882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.570348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.571040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.571488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.571916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.715854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:30.724710 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3c64a84-6d5a-466b-8b6b-e82044720ae9 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1282 microversion: 2.1 time: 0.168116 Oct 17 13:40:30.725309 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3756/7206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:30 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:31.747577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:31.748197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:31.756105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:31.756603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:31.757078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:31.757790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:31.758280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:31.758745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:31.910425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:31.919502 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c7cd58b-55c3-42c0-81d1-1884e7a83ac0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1282 microversion: 2.1 time: 0.175725 Oct 17 13:40:31.920106 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3451/7207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:31 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:32.944150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:32.944768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:32.948360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:32.954364 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.954953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.955615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.956113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.956569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.956998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.130292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:33.138506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-404bdfef-5553-4cd5-97e9-167e7ab6d0a2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1282 microversion: 2.1 time: 0.198798 Oct 17 13:40:33.139136 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3757/7208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:32 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:34.163395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:34.164042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:34.171903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.172400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.172853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.173568 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.174031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.174494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.315635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:34.323663 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7fce823c-6768-4159-bf7d-55d95a931391 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.164232 Oct 17 13:40:34.324246 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3452/7209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:34 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:35.353261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:35.353920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:35.366931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.367441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.367882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.368608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.369066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.369606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.509913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:35.518149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55168b36-b6de-4c1e-8543-8ce76a45c324 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.168909 Oct 17 13:40:35.518770 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3758/7210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:35 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:36.540870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:36.541435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:36.543365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:36.551054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.551550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.551996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.552875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.553372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.553812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.693493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:36.701507 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c133a233-2503-4915-b11b-d24c6043c7ce tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.164673 Oct 17 13:40:36.702731 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3453/7211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:36 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:37.726037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:37.726602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:37.728439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:37.735262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.735750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.736187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.736878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.737330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.737754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.871217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:37.879102 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f36f297d-fe0d-4a18-8c20-dae5e3ebeb3d tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.157062 Oct 17 13:40:37.879674 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3759/7212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:37 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:38.901952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:38.902622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:38.910579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.911122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.911584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.912341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.912820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.913264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.057362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:39.066220 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e19df966-1e70-49fd-aed0-2b628f8a6b1e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.168038 Oct 17 13:40:39.066813 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3454/7213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:38 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:40.090448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:40.091005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:40.098422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.098931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.099375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.100110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.100728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.100989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.249979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:40.257792 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-98d546cb-f19f-43eb-afa2-0e00ec6aaffe tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.171536 Oct 17 13:40:40.258432 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3760/7214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:40 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.282112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.282794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:41.289592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.290102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.290618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.291322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.291783 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.292222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.428636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.437407 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ee23f7d-2427-4119-8cde-0956aa87d50f tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.159891 Oct 17 13:40:41.438000 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3455/7215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:42.461291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.461834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:42.469599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.470088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.470575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.471281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.471740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.472170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.605689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:42.613894 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-170608da-2558-400c-a4b0-c0582b461e83 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.156579 Oct 17 13:40:42.614512 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3761/7216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:43.636807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:43.637444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:43.645033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.645544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.646006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.646782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.647257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.647704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.674618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d9430677-7847-4fad-8a97-21e6ac2571de req-7929e975-8c32-4aba-8246-c8fd53038ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d14430e-22a8-4d4d-8e0e-e7f5a9028c62", "name": "network-vif-plugged", "status": "completed", "tag": "315e2038-fb8b-4fc7-8452-62cc16ed3121"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:43.686530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9430677-7847-4fad-8a97-21e6ac2571de req-7929e975-8c32-4aba-8246-c8fd53038ac0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.687014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9430677-7847-4fad-8a97-21e6ac2571de req-7929e975-8c32-4aba-8246-c8fd53038ac0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.687461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9430677-7847-4fad-8a97-21e6ac2571de req-7929e975-8c32-4aba-8246-c8fd53038ac0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.698904 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d9430677-7847-4fad-8a97-21e6ac2571de req-7929e975-8c32-4aba-8246-c8fd53038ac0 service nova] Creating event network-vif-plugged:315e2038-fb8b-4fc7-8452-62cc16ed3121 for instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 on n-h2-853316-12 Oct 17 13:40:43.705172 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d9430677-7847-4fad-8a97-21e6ac2571de req-7929e975-8c32-4aba-8246-c8fd53038ac0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034700 Oct 17 13:40:43.706030 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3762/7217] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:40:43.809359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:43.817713 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cac12e57-e7bb-49df-8528-425ef233a01e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1270 microversion: 2.1 time: 0.184899 Oct 17 13:40:43.818312 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3456/7218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:43 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:44.843913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:44.844612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:44.850897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.851379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.851907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:44.852504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.852952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.853371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:44.999820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:45.007898 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-77493277-bf03-4235-80f7-ee14e725478c tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1458 microversion: 2.1 time: 0.169518 Oct 17 13:40:45.008495 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3763/7219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:44 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1458 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:45.031494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:45.032217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:45.039935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:45.040483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:45.040970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.041753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:45.042421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:45.042879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.188092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:45.196131 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-570cd6bc-3675-4d73-bd4a-efe2d2b97209 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1458 microversion: 2.1 time: 0.169216 Oct 17 13:40:45.196727 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3457/7220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:45 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1458 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:47.018879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a0521e9c-39f4-4a46-b712-518607b06390 req-d0c274e0-0b19-49ac-bafd-b9034490553e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d14430e-22a8-4d4d-8e0e-e7f5a9028c62", "tag": "315e2038-fb8b-4fc7-8452-62cc16ed3121"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:47.030952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a0521e9c-39f4-4a46-b712-518607b06390 req-d0c274e0-0b19-49ac-bafd-b9034490553e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:47.031818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a0521e9c-39f4-4a46-b712-518607b06390 req-d0c274e0-0b19-49ac-bafd-b9034490553e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:47.032436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a0521e9c-39f4-4a46-b712-518607b06390 req-d0c274e0-0b19-49ac-bafd-b9034490553e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:47.045871 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a0521e9c-39f4-4a46-b712-518607b06390 req-d0c274e0-0b19-49ac-bafd-b9034490553e service nova] Creating event network-changed:315e2038-fb8b-4fc7-8452-62cc16ed3121 for instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 on n-h2-853316-12 Oct 17 13:40:47.051741 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a0521e9c-39f4-4a46-b712-518607b06390 req-d0c274e0-0b19-49ac-bafd-b9034490553e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037392 Oct 17 13:40:47.052825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3764/7221] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:49.070723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-144ffbf2-0ad1-4373-b035-27aaf85811e8 req-855f0d11-e7da-400a-9ec9-e907b6362ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d14430e-22a8-4d4d-8e0e-e7f5a9028c62", "tag": "315e2038-fb8b-4fc7-8452-62cc16ed3121"}, {"name": "network-changed", "server_uuid": "7d14430e-22a8-4d4d-8e0e-e7f5a9028c62", "tag": "315e2038-fb8b-4fc7-8452-62cc16ed3121"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:49.083387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-144ffbf2-0ad1-4373-b035-27aaf85811e8 req-855f0d11-e7da-400a-9ec9-e907b6362ffc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:49.083892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-144ffbf2-0ad1-4373-b035-27aaf85811e8 req-855f0d11-e7da-400a-9ec9-e907b6362ffc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:49.084352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-144ffbf2-0ad1-4373-b035-27aaf85811e8 req-855f0d11-e7da-400a-9ec9-e907b6362ffc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:49.099087 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-144ffbf2-0ad1-4373-b035-27aaf85811e8 req-855f0d11-e7da-400a-9ec9-e907b6362ffc service nova] Creating event network-changed:315e2038-fb8b-4fc7-8452-62cc16ed3121 for instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 on n-h2-853316-12 Oct 17 13:40:49.099716 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-144ffbf2-0ad1-4373-b035-27aaf85811e8 req-855f0d11-e7da-400a-9ec9-e907b6362ffc service nova] Creating event network-changed:315e2038-fb8b-4fc7-8452-62cc16ed3121 for instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 on n-h2-853316-12 Oct 17 13:40:49.105152 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-144ffbf2-0ad1-4373-b035-27aaf85811e8 req-855f0d11-e7da-400a-9ec9-e907b6362ffc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039830 Oct 17 13:40:49.105725 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3458/7222] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:22.440441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=25 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:22.442194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=53 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:22.446816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-25a8cb61-4d0b-4f8a-83c2-98344e4682aa req-48876acc-5698-4b9d-a90a-cc1a250b5556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d14430e-22a8-4d4d-8e0e-e7f5a9028c62", "tag": "315e2038-fb8b-4fc7-8452-62cc16ed3121"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:22.448129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:22.448722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:22.453966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=19 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:22.454955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=56 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:22.457934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.458541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.459457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.460174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.461027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.461538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.463574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-25a8cb61-4d0b-4f8a-83c2-98344e4682aa req-48876acc-5698-4b9d-a90a-cc1a250b5556 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.464240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-25a8cb61-4d0b-4f8a-83c2-98344e4682aa req-48876acc-5698-4b9d-a90a-cc1a250b5556 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.464647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-25a8cb61-4d0b-4f8a-83c2-98344e4682aa req-48876acc-5698-4b9d-a90a-cc1a250b5556 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.477354 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-25a8cb61-4d0b-4f8a-83c2-98344e4682aa req-48876acc-5698-4b9d-a90a-cc1a250b5556 service nova] Creating event network-changed:315e2038-fb8b-4fc7-8452-62cc16ed3121 for instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 on n-h2-853316-12 Oct 17 13:41:22.482591 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-25a8cb61-4d0b-4f8a-83c2-98344e4682aa req-48876acc-5698-4b9d-a90a-cc1a250b5556 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042005 Oct 17 13:41:22.483512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3459/7223] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:22.498045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:22.585354 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c9005dd-3611-4985-ab1d-c6e91527a7c2 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 204 len: 0 microversion: 2.1 time: 0.146822 Oct 17 13:41:22.589493 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3765/7224] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:22 2022] DELETE /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:22.596389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:22.597946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:22.605567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.606422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.607042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.607932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.608588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.609211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.761707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:22.770318 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-37c64ea5-dbba-4298-be7f-701d6526b4b1 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1582 microversion: 2.1 time: 0.179065 Oct 17 13:41:22.771146 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3460/7225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:22 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1582 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:23.797591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:23.798324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:23.806121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.806648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.807078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.808127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.808583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.809141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.974216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:23.982294 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5f4fd110-8cd7-4592-afee-3aec412275de tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1582 microversion: 2.1 time: 0.189050 Oct 17 13:41:23.982876 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3766/7226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:23 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1582 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:24.697037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c6594fae-bd15-4596-9bd3-2269322f6a68 req-55b7d485-5200-4522-b38f-4b18fb2f0226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d14430e-22a8-4d4d-8e0e-e7f5a9028c62", "name": "network-vif-deleted", "tag": "315e2038-fb8b-4fc7-8452-62cc16ed3121"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:24.706967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c6594fae-bd15-4596-9bd3-2269322f6a68 req-55b7d485-5200-4522-b38f-4b18fb2f0226 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:24.707427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c6594fae-bd15-4596-9bd3-2269322f6a68 req-55b7d485-5200-4522-b38f-4b18fb2f0226 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:24.707876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c6594fae-bd15-4596-9bd3-2269322f6a68 req-55b7d485-5200-4522-b38f-4b18fb2f0226 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:24.718953 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c6594fae-bd15-4596-9bd3-2269322f6a68 req-55b7d485-5200-4522-b38f-4b18fb2f0226 service nova] Creating event network-vif-deleted:315e2038-fb8b-4fc7-8452-62cc16ed3121 for instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 on n-h2-853316-12 Oct 17 13:41:24.727699 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c6594fae-bd15-4596-9bd3-2269322f6a68 req-55b7d485-5200-4522-b38f-4b18fb2f0226 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174326 Oct 17 13:41:24.729296 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3461/7227] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:25.006749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:25.007485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:25.014189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.014666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.015101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.015794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.016241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.016664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.084877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:25.092933 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9da49fb8-fb0c-412e-b8a5-b0e89f083294 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1229 microversion: 2.1 time: 0.091837 Oct 17 13:41:25.093504 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3767/7228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:24 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:26.119216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:26.120023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:26.126530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.127036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.127510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.128924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.129404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.129854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.202471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:26.211548 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a79f3b7b-7162-48f0-a13a-6ec7b41b4aa7 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1229 microversion: 2.1 time: 0.097767 Oct 17 13:41:26.212151 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3462/7229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:26 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:27.235776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:27.236365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:27.243944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:27.244256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:27.245471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:27.245471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:27.246689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:27.246689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:27.309733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:27.318142 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0ec926cb-bd2d-4c10-b719-f42704089d67 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1229 microversion: 2.1 time: 0.086529 Oct 17 13:41:27.318747 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3768/7230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:27 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:28.344729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:28.345361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:28.352687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:28.353184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:28.353633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:28.354365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:28.354827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:28.355265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:28.419231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a3bf417c7b4cc3a07c282ab948b063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcce50030a3c46589cb17309f849904c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:28.427676 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf96bb1c-f6fc-4fa4-8a79-27308d4c125e tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 200 len: 1229 microversion: 2.1 time: 0.087116 Oct 17 13:41:28.428254 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3463/7231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:28 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 1229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:29.452111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:29.452767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] [instance: 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:29.461428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:29.462001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:29.462505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:29.463235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:29.463706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:29.464162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:29.483279 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] HTTP exception thrown: Instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 could not be found. Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Request method failure captured: Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 HTTP/1.1 Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVrCOlPzjyn43c-QJXvYxDLbe-p6AoyDaQ6F4LDaVndwFJH1rCqifJNkXbOzqvGjmFcUe1qOSKMFZYxXb6w-DtL1D6Nr1P33jcZIu8-_K-arN-PhEOM2uJwDeChZBg2nfQwGnrvxSe11FXI-0ZbjGDtAB4wWSPlALGK6zCSiM8_nhOk Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dcce50030a3c46589cb17309f849904c Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestVolumeBackupRestore-1494400984 Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dcce50030a3c46589cb17309f849904c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dcce50030a3c46589cb17309f849904c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dcce50030a3c46589cb17309f849904c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dcce50030a3c46589cb17309f849904c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestVolumeBackupRestore-1494400984 Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dcce50030a3c46589cb17309f849904c Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1494400984 Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestVolumeBackupRestore-1494400984-project Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 46a3bf417c7b4cc3a07c282ab948b063 Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestVolumeBackupRestore-1494400984-project Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 could not be found. Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '7d14430e-22a8-4d4d-8e0e-e7f5a9028c62'} Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 could not be found. Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 could not be found. Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:29.485136 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 could not be found. Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Returning 404 to user: Instance 7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-99739d36-f6eb-4ab5-b011-ad9b5626c5e0 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62" status: 404 len: 111 microversion: 2.1 time: 0.038665 Oct 17 13:41:29.490672 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3769/7232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:29 2022] GET /compute/v2.1/servers/7d14430e-22a8-4d4d-8e0e-e7f5a9028c62 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:29.655307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-707f0e93-edce-4646-a7c5-30c92128c522 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] Calling method '.version_select at 0x7fa81bbfaca0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:29.689829 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-707f0e93-edce-4646-a7c5-30c92128c522 tempest-TestVolumeBackupRestore-1494400984 tempest-TestVolumeBackupRestore-1494400984-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-950178015" status: 202 len: 0 microversion: 2.1 time: 0.038532 Oct 17 13:41:29.694383 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3464/7233] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 17 13:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-950178015 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:41:53.026867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:53.027536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:53.139391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-403775196", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:53.193838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] validate_networks() for None {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:41:53.388777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:41:53.389206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:41:53.389679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:41:53.390116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:41:53.390555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:41:53.399600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:53.400086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:53.400526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:53.401256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:53.401713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:53.402141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:53.419176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Getting quotas for project dfd737c6d93b4acebe670650ae65f899. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:53.424402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Getting quotas for user 4dbaa3fce9f74ba5872ce8e9995b26ab and project dfd737c6d93b4acebe670650ae65f899. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:53.437080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:41:53.439400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:41:53.484228 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-53933d3b-8e21-4ec7-89a1-0765040fcbc8 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.463712 Oct 17 13:41:53.484876 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3770/7234] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:41:53.498553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3208c09d-c75c-4ae6-b132-8dad2d40da30 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:53.500286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3208c09d-c75c-4ae6-b132-8dad2d40da30 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:53.505191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=22 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:53.505694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:53.561550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3208c09d-c75c-4ae6-b132-8dad2d40da30 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:53.568794 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3208c09d-c75c-4ae6-b132-8dad2d40da30 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1221 microversion: 2.1 time: 0.074502 Oct 17 13:41:53.569381 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3465/7235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:53 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:54.593391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:54.594137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:54.601723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.602345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.602847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.603660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.604175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.604662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.676618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:54.684562 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8dfcc734-c2ae-496f-b1c5-059fdee500c6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1279 microversion: 2.1 time: 0.095959 Oct 17 13:41:54.685133 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3771/7236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:54 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:55.709497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:55.710150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:55.717031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.717470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.717919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.718648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.719109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.719546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.954871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:55.963301 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-786ae5dc-814f-461a-b665-7c108b0b9cf6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1321 microversion: 2.1 time: 0.258492 Oct 17 13:41:55.963989 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3466/7237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:55 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:56.108951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0dadef7b-f770-4e93-987a-13edf7ba7026 req-3ef194f5-86c8-43e0-bfc8-011e9e66c7fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44aff43-2680-44eb-84b7-ae7bb844cd42", "tag": "9f33fdab-0a21-42b1-ad52-d462afeeda00"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:56.120332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0dadef7b-f770-4e93-987a-13edf7ba7026 req-3ef194f5-86c8-43e0-bfc8-011e9e66c7fe service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.121120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0dadef7b-f770-4e93-987a-13edf7ba7026 req-3ef194f5-86c8-43e0-bfc8-011e9e66c7fe service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.122135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0dadef7b-f770-4e93-987a-13edf7ba7026 req-3ef194f5-86c8-43e0-bfc8-011e9e66c7fe service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.134978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0dadef7b-f770-4e93-987a-13edf7ba7026 req-3ef194f5-86c8-43e0-bfc8-011e9e66c7fe service nova] Creating event network-changed:9f33fdab-0a21-42b1-ad52-d462afeeda00 for instance a44aff43-2680-44eb-84b7-ae7bb844cd42 on n-h2-853316-12 Oct 17 13:41:56.140461 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0dadef7b-f770-4e93-987a-13edf7ba7026 req-3ef194f5-86c8-43e0-bfc8-011e9e66c7fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036280 Oct 17 13:41:56.141137 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3772/7238] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:56.987719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:56.988692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:56.995803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.996301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.996755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.997472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.997939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.998407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.133187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:57.140943 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c86cc10-c16d-4c6d-86e5-30f2cc681f1a tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1321 microversion: 2.1 time: 0.157941 Oct 17 13:41:57.141539 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3467/7239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:56 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:58.165219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:58.165929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:58.172143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:58.172623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:58.173065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.173749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:58.174735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:58.175534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.306272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:58.313905 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29c0d26f-95cb-4baa-9ca2-cae3c4dcfe33 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1321 microversion: 2.1 time: 0.153950 Oct 17 13:41:58.314507 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3773/7240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:58 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:59.337781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:59.338430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:59.345001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.345494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.345941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.347000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.347465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.347904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.476273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:59.484177 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-be137032-654d-4b53-b9ed-feb1bb704edf tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1321 microversion: 2.1 time: 0.150509 Oct 17 13:41:59.484757 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3468/7241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:59 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:00.506874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:00.507480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:00.514348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.514828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.515265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.515951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.516403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.516826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.652438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:00.660892 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56a28f51-1d4e-4a93-a856-e758aaf4335b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1321 microversion: 2.1 time: 0.158082 Oct 17 13:42:00.661454 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3774/7242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:00 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:01.683146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.683765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:01.691630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.692142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.692597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.693344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.693814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.694297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.832305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:01.840234 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c239f08c-d9d1-4342-9eca-80ba89844684 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1321 microversion: 2.1 time: 0.160879 Oct 17 13:42:01.840834 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3469/7243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:01 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:02.051225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5b2dea67-9f7a-42df-b82b-c347a89af2dd req-a9a31e7c-b1d0-41f1-a697-1696c77ed0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44aff43-2680-44eb-84b7-ae7bb844cd42", "name": "network-vif-plugged", "status": "completed", "tag": "9f33fdab-0a21-42b1-ad52-d462afeeda00"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:02.061017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5b2dea67-9f7a-42df-b82b-c347a89af2dd req-a9a31e7c-b1d0-41f1-a697-1696c77ed0c7 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.061492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5b2dea67-9f7a-42df-b82b-c347a89af2dd req-a9a31e7c-b1d0-41f1-a697-1696c77ed0c7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.061918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5b2dea67-9f7a-42df-b82b-c347a89af2dd req-a9a31e7c-b1d0-41f1-a697-1696c77ed0c7 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.073467 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5b2dea67-9f7a-42df-b82b-c347a89af2dd req-a9a31e7c-b1d0-41f1-a697-1696c77ed0c7 service nova] Creating event network-vif-plugged:9f33fdab-0a21-42b1-ad52-d462afeeda00 for instance a44aff43-2680-44eb-84b7-ae7bb844cd42 on n-h2-853316-12 Oct 17 13:42:02.078821 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5b2dea67-9f7a-42df-b82b-c347a89af2dd req-a9a31e7c-b1d0-41f1-a697-1696c77ed0c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097508 Oct 17 13:42:02.079432 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3775/7244] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:02.863388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.864012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:02.871057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.871558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.872007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.872719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.873184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.873627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:03.003136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:03.011800 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cd89b06e-a6d5-4713-8b5b-49bbf78734cd tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1321 microversion: 2.1 time: 0.152570 Oct 17 13:42:03.012382 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3470/7245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:02 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:04.043833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:04.044601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:04.050231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:04.051034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:04.060824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.061323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.061770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.062500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.062991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.063423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.194021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:04.201830 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-367b94bd-083e-40c0-8cba-c438f152fa44 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1471 microversion: 2.1 time: 0.159840 Oct 17 13:42:04.202427 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3776/7246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:04 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:04.226893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:04.282375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ee07f25d-9aed-45ae-ac8e-ee550015fcf1 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Calling method '.version_select at 0x7fa8204673a0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:04.349894 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ee07f25d-9aed-45ae-ac8e-ee550015fcf1 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c2954f8496e44e0c9ed2934b33ec1a4a" status: 200 len: 371 microversion: 2.1 time: 0.127445 Oct 17 13:42:04.350512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3471/7247] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 13:42:04 2022] GET /compute/v2.1/os-quota-sets/c2954f8496e44e0c9ed2934b33ec1a4a => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:04.362891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd594a5e-2555-422f-9aea-5e13ab261c22 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-616774556", "id": 1025544813, "os-flavor-access:is_public": "True"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:04.380841 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd594a5e-2555-422f-9aea-5e13ab261c22 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022198 Oct 17 13:42:04.381581 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3777/7248] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:42:04 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:04.393904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1025544813"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:04.396123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:04.402404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.402899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.403346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.404076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.404540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.404974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.598024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2b64390233754f27abd70e52b6d1e08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2954f8496e44e0c9ed2934b33ec1a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:04.604361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-616774556 {{(pid=127539) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:42:04.610875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.611370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.611815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.612551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.613011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.613442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.637415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Getting quotas for project dfd737c6d93b4acebe670650ae65f899. Resources: {'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:04.642439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Getting quotas for user 4dbaa3fce9f74ba5872ce8e9995b26ab and project dfd737c6d93b4acebe670650ae65f899. Resources: {'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:04.657031 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] ram quota exceeded for c2954f8496e44e0c9ed2934b33ec1a4a, tried to resize instance. Oct 17 13:42:04.657511 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Request method failure captured: Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42/action HTTP/1.1 Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 39 Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVugoj-6DzCke18odyNF8y6SsIoKQyvxAkoNRquoVLUudkF689AfBX3sfWMh_ThxpaIeZ93WUsmfqEFf8zJ68gnyFF2hHUWo-ux4Y9DQWPDpD1qhc0of7oUVOdXrwCnBA_D0zL6o6KRrMnNt_6DS-WfjE3_FeoaZk1V4d-guvakoe3Q Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: c2954f8496e44e0c9ed2934b33ec1a4a Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1863988185 Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member,admin Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member,admin Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2954f8496e44e0c9ed2934b33ec1a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2954f8496e44e0c9ed2934b33ec1a4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2954f8496e44e0c9ed2934b33ec1a4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2954f8496e44e0c9ed2934b33ec1a4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1863988185 Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: c2954f8496e44e0c9ed2934b33ec1a4a Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1863988185 Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersAdminNegativeTestJSON-1863988185-project-admin Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 2b64390233754f27abd70e52b6d1e08c Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1863988185-project-admin Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: {"resize": {"flavorRef": "1025544813"}} Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a44aff43-2680-44eb-84b7-ae7bb844cd42', 'body': {'resize': {'flavorRef': '1025544813'}}} Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:42:04.659752 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1978beb6-885a-44b5-896a-054e08c07e0f tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42/action" status: 403 len: 118 microversion: 2.1 time: 0.271546 Oct 17 13:42:04.664641 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3472/7249] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:04 2022] POST /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42/action => generated 118 bytes in 273 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:04.670003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-570c0091-44d3-4ed1-bc5e-a222b8b5a9ac tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:04.686362 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-570c0091-44d3-4ed1-bc5e-a222b8b5a9ac tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1025544813" status: 202 len: 0 microversion: 2.1 time: 0.019961 Oct 17 13:42:04.686918 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3778/7250] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 17 13:42:04 2022] DELETE /compute/v2.1/flavors/1025544813 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:04.696067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f988e264-50fc-4964-8f4c-9e4f099f5cff tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:04.717238 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f988e264-50fc-4964-8f4c-9e4f099f5cff tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025038 Oct 17 13:42:04.717842 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3473/7251] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:42:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:04.737984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0042078c-5bbb-444b-af2f-af94befe9980 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Calling method '.version_select at 0x7fa81b818040>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:04.813247 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0042078c-5bbb-444b-af2f-af94befe9980 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c2954f8496e44e0c9ed2934b33ec1a4a" status: 200 len: 371 microversion: 2.1 time: 0.078963 Oct 17 13:42:04.813849 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3779/7252] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 17 13:42:04 2022] GET /compute/v2.1/os-quota-sets/c2954f8496e44e0c9ed2934b33ec1a4a => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:04.826659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4153d415-43a2-4252-864b-69e570d8f0ef tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1173216437", "id": 37566416, "os-flavor-access:is_public": "True"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:04.845643 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4153d415-43a2-4252-864b-69e570d8f0ef tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.022679 Oct 17 13:42:04.846310 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3474/7253] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:42:04 2022] POST /compute/v2.1/flavors => generated 431 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:04.858263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "37566416"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:04.860574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:04.867380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.867868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.868308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.868999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.869460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.869886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.026534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2b64390233754f27abd70e52b6d1e08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2954f8496e44e0c9ed2934b33ec1a4a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:05.034231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1173216437 {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:42:05.044947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.045642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.045867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.046635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.047095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.047600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.083917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Getting quotas for project dfd737c6d93b4acebe670650ae65f899. Resources: {'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:05.093005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Getting quotas for user 4dbaa3fce9f74ba5872ce8e9995b26ab and project dfd737c6d93b4acebe670650ae65f899. Resources: {'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:05.112042 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.compute.api [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] cores quota exceeded for c2954f8496e44e0c9ed2934b33ec1a4a, tried to resize instance. Oct 17 13:42:05.112862 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Request method failure captured: Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42/action HTTP/1.1 Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 37 Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVugoj-6DzCke18odyNF8y6SsIoKQyvxAkoNRquoVLUudkF689AfBX3sfWMh_ThxpaIeZ93WUsmfqEFf8zJ68gnyFF2hHUWo-ux4Y9DQWPDpD1qhc0of7oUVOdXrwCnBA_D0zL6o6KRrMnNt_6DS-WfjE3_FeoaZk1V4d-guvakoe3Q Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: c2954f8496e44e0c9ed2934b33ec1a4a Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1863988185 Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member,admin Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member,admin Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2954f8496e44e0c9ed2934b33ec1a4a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2954f8496e44e0c9ed2934b33ec1a4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2954f8496e44e0c9ed2934b33ec1a4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2954f8496e44e0c9ed2934b33ec1a4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1863988185 Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: c2954f8496e44e0c9ed2934b33ec1a4a Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1863988185 Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersAdminNegativeTestJSON-1863988185-project-admin Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 2b64390233754f27abd70e52b6d1e08c Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1863988185-project-admin Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: {"resize": {"flavorRef": "37566416"}} Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a44aff43-2680-44eb-84b7-ae7bb844cd42', 'body': {'resize': {'flavorRef': '37566416'}}} Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:42:05.117838 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:05.122921 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-63cf89b9-dfcc-4601-b94d-1916add0e600 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42/action" status: 403 len: 113 microversion: 2.1 time: 0.267248 Oct 17 13:42:05.127095 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3780/7254] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:04 2022] POST /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42/action => generated 113 bytes in 269 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:05.131016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2458d6c2-b81d-4116-854c-2b767deb8b1b tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:05.148692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2458d6c2-b81d-4116-854c-2b767deb8b1b tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/37566416" status: 202 len: 0 microversion: 2.1 time: 0.021417 Oct 17 13:42:05.149787 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3475/7255] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 13:42:05 2022] DELETE /compute/v2.1/flavors/37566416 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:05.157966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7d7b3e1-f209-4f8a-8224-20f6e31685d1 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:05.178512 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7d7b3e1-f209-4f8a-8224-20f6e31685d1 tempest-ServersAdminNegativeTestJSON-1863988185 tempest-ServersAdminNegativeTestJSON-1863988185-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024877 Oct 17 13:42:05.179091 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3781/7256] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 17 13:42:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:05.199992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:05.200534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:05.207971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.208413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.208875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.209621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.210095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.210601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.238036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:05.315734 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-032efb0f-14ec-4807-974b-33bb2b7a6c75 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 204 len: 0 microversion: 2.1 time: 0.118319 Oct 17 13:42:05.316573 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3476/7257] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:05 2022] DELETE /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:05.324711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:05.325325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:05.332586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.333077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.333517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.334246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.334709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.335136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.470115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:05.478134 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1f3e336a-e28c-4665-9321-68a0cd01d504 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1477 microversion: 2.1 time: 0.157248 Oct 17 13:42:05.478730 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3782/7258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:05 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:06.501624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:06.502500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:06.509262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:06.509755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:06.510232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:06.510933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:06.511425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:06.511863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:06.711315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:06.719199 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-63e5ad4a-1033-42d3-a532-ec6423ed7bb1 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1477 microversion: 2.1 time: 0.221968 Oct 17 13:42:06.735245 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3477/7259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:06 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:07.092559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-156d6e08-4cb8-48e3-8f99-acad1d3faed0 req-70f229b1-b37c-42ef-b426-c333a71c0486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44aff43-2680-44eb-84b7-ae7bb844cd42", "name": "network-vif-deleted", "tag": "9f33fdab-0a21-42b1-ad52-d462afeeda00"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:07.104941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-156d6e08-4cb8-48e3-8f99-acad1d3faed0 req-70f229b1-b37c-42ef-b426-c333a71c0486 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.105614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-156d6e08-4cb8-48e3-8f99-acad1d3faed0 req-70f229b1-b37c-42ef-b426-c333a71c0486 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.106060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-156d6e08-4cb8-48e3-8f99-acad1d3faed0 req-70f229b1-b37c-42ef-b426-c333a71c0486 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.125120 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-156d6e08-4cb8-48e3-8f99-acad1d3faed0 req-70f229b1-b37c-42ef-b426-c333a71c0486 service nova] Creating event network-vif-deleted:9f33fdab-0a21-42b1-ad52-d462afeeda00 for instance a44aff43-2680-44eb-84b7-ae7bb844cd42 on n-h2-853316-12 Oct 17 13:42:07.131367 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-156d6e08-4cb8-48e3-8f99-acad1d3faed0 req-70f229b1-b37c-42ef-b426-c333a71c0486 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041955 Oct 17 13:42:07.131823 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3783/7260] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:07.742322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:07.743047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:07.750930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.750930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.751549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.752032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.752525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.752962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.790385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.790891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.791350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.791813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lazy-loading 'fault' on Instance uuid a44aff43-2680-44eb-84b7-ae7bb844cd42 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:42:07.843489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbaa3fce9f74ba5872ce8e9995b26ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd737c6d93b4acebe670650ae65f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:07.855059 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0e0ad367-e917-497b-8d29-dffd351dc2d6 tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 200 len: 1311 microversion: 2.1 time: 0.116734 Oct 17 13:42:07.855655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3478/7261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:07 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:08.880827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:08.881607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] [instance: a44aff43-2680-44eb-84b7-ae7bb844cd42] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:08.887839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:08.888326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:08.888763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.889460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:08.889912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:08.890363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.903610 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] HTTP exception thrown: Instance a44aff43-2680-44eb-84b7-ae7bb844cd42 could not be found. Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Request method failure captured: Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 HTTP/1.1 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVugbVWIgjAQSoO07G6-CqzNVwrv6TgfKVDP1Y7k7uNyNEohBrom849Pysmu4yovEULEABE0b_6-SiEsGZTYiLnlw31soEDMRrisThdtFTSTcpP3DzAE6fuRwhaGLLttJGNRPgRcQ0OavqACSuoY7ahuP7NixMKcn8vCAnAywsHJI1c Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: dfd737c6d93b4acebe670650ae65f899 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1040420305 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dfd737c6d93b4acebe670650ae65f899", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dfd737c6d93b4acebe670650ae65f899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dfd737c6d93b4acebe670650ae65f899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dfd737c6d93b4acebe670650ae65f899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1040420305 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: dfd737c6d93b4acebe670650ae65f899 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1040420305 Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersAdminNegativeTestJSON-1040420305-project Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 4dbaa3fce9f74ba5872ce8e9995b26ab Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1040420305-project Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance a44aff43-2680-44eb-84b7-ae7bb844cd42 could not be found. Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a44aff43-2680-44eb-84b7-ae7bb844cd42'} Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44aff43-2680-44eb-84b7-ae7bb844cd42 could not be found. Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44aff43-2680-44eb-84b7-ae7bb844cd42 could not be found. Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:08.905204 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44aff43-2680-44eb-84b7-ae7bb844cd42 could not be found. Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] Returning 404 to user: Instance a44aff43-2680-44eb-84b7-ae7bb844cd42 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4fefc97-48ab-4c69-acd7-c4caeeca929b tempest-ServersAdminNegativeTestJSON-1040420305 tempest-ServersAdminNegativeTestJSON-1040420305-project] 10.222.0.27 "GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42" status: 404 len: 111 microversion: 2.1 time: 0.031549 Oct 17 13:42:08.910345 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3784/7262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:08 2022] GET /compute/v2.1/servers/a44aff43-2680-44eb-84b7-ae7bb844cd42 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:15.280767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:15.281635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:15.440529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-398397043", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "dfe124d5-3acd-4291-ac4e-1d70f59edf78"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:15.506207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] validate_networks() for [('dfe124d5-3acd-4291-ac4e-1d70f59edf78', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:42:15.929484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:42:15.929925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:42:15.933071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:42:15.933071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:42:15.933071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:42:15.947778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.948268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.948713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.949475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.950980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.950980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.971558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Getting quotas for project 58ab6dc0f80d49dbb31c98e3de1ce542. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:15.978556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Getting quotas for user 23696f8cb45943d0b951802e9a1b5c3a and project 58ab6dc0f80d49dbb31c98e3de1ce542. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:15.991883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:42:15.994267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:42:16.044982 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [6b06333d-7505-4c7c-a4bd-b2240ccbabb5] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:42:17.052391 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [6b06333d-7505-4c7c-a4bd-b2240ccbabb5] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42692. Oct 17 13:42:17.056301 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fc4d651a-446d-4490-9220-da750191ecdb tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781073 Oct 17 13:42:17.056940 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3479/7263] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:42:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:42:17.068096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e616704b-daed-4563-b613-98f839f943e6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:17.069388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e616704b-daed-4563-b613-98f839f943e6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.076172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:17.077091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:17.132455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e616704b-daed-4563-b613-98f839f943e6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:17.140475 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e616704b-daed-4563-b613-98f839f943e6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1214 microversion: 2.1 time: 0.076226 Oct 17 13:42:17.146565 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3785/7264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:17 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:18.165617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:18.166292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:18.177169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:18.177688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:18.178198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.178955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:18.179429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:18.180071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.280940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:18.296623 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6045eaa6-9081-4ab4-868b-c79bb7bbb675 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1284 microversion: 2.1 time: 0.134451 Oct 17 13:42:18.297958 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3480/7265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:18 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:19.321826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:19.322478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:19.326022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=53 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:19.334342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.334837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.335544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.336380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.337170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.337812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.477462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:19.485251 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fcf85a0f-5be2-4362-babb-46208836ef2e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1314 microversion: 2.1 time: 0.167267 Oct 17 13:42:19.492693 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3786/7266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:19 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:19.571189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-3a0541ec-b89b-4c01-b3bf-1a9f47da12b1 req-84a63f00-cb9b-4bca-8d18-6c00c0de6f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260bbb64-e53b-476d-9ed6-e7f4b1ca0b83", "tag": "4205e132-bf55-4c78-9e1a-992ddf5d02df"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:19.586789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a0541ec-b89b-4c01-b3bf-1a9f47da12b1 req-84a63f00-cb9b-4bca-8d18-6c00c0de6f4d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.587396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a0541ec-b89b-4c01-b3bf-1a9f47da12b1 req-84a63f00-cb9b-4bca-8d18-6c00c0de6f4d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.588488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-3a0541ec-b89b-4c01-b3bf-1a9f47da12b1 req-84a63f00-cb9b-4bca-8d18-6c00c0de6f4d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.602656 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-3a0541ec-b89b-4c01-b3bf-1a9f47da12b1 req-84a63f00-cb9b-4bca-8d18-6c00c0de6f4d service nova] Creating event network-changed:4205e132-bf55-4c78-9e1a-992ddf5d02df for instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 on n-h2-853316-12 Oct 17 13:42:19.608210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-3a0541ec-b89b-4c01-b3bf-1a9f47da12b1 req-84a63f00-cb9b-4bca-8d18-6c00c0de6f4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040728 Oct 17 13:42:19.608905 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3481/7267] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:20.508554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:20.509081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:20.516004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:20.516490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:20.516927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:20.518296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:20.518961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:20.519060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:20.953930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:20.965207 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9206f8fd-e206-4484-9617-284f9d24f2ca tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1314 microversion: 2.1 time: 0.460641 Oct 17 13:42:20.965795 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3787/7268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:20 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:21.989256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:21.990070 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:21.997422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:21.997924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:21.998560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:21.999287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:21.999759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:22.000206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:22.150386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:22.159918 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f4a40b02-967f-4d5b-a1f2-02791b94d2c7 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1314 microversion: 2.1 time: 0.175199 Oct 17 13:42:22.160503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3482/7269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:21 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:23.183263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:23.183853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:23.186462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:23.192898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:23.193353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:23.193787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:23.194496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:23.194946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:23.195392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:23.327342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:23.336143 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-27c77172-7248-4034-9471-4935f5109a5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1314 microversion: 2.1 time: 0.156839 Oct 17 13:42:23.336709 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3788/7270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:23 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:24.084468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d69cb81f-6eff-4c3c-a1a0-1df309fedd27 req-14248222-2ad9-46fb-b8f0-2dbf8db50751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260bbb64-e53b-476d-9ed6-e7f4b1ca0b83", "name": "network-vif-plugged", "status": "completed", "tag": "4205e132-bf55-4c78-9e1a-992ddf5d02df"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:24.090582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:24.098613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d69cb81f-6eff-4c3c-a1a0-1df309fedd27 req-14248222-2ad9-46fb-b8f0-2dbf8db50751 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.099208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d69cb81f-6eff-4c3c-a1a0-1df309fedd27 req-14248222-2ad9-46fb-b8f0-2dbf8db50751 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.099655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d69cb81f-6eff-4c3c-a1a0-1df309fedd27 req-14248222-2ad9-46fb-b8f0-2dbf8db50751 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.104106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:24.113781 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d69cb81f-6eff-4c3c-a1a0-1df309fedd27 req-14248222-2ad9-46fb-b8f0-2dbf8db50751 service nova] Creating event network-vif-plugged:4205e132-bf55-4c78-9e1a-992ddf5d02df for instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 on n-h2-853316-12 Oct 17 13:42:24.118835 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d69cb81f-6eff-4c3c-a1a0-1df309fedd27 req-14248222-2ad9-46fb-b8f0-2dbf8db50751 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038844 Oct 17 13:42:24.119461 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3483/7271] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:24.358185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:24.358706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:24.366368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.366853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.367289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.367981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.368432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.368851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.503864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:24.511595 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1bee4fe2-bb0d-4000-a04c-657b77216757 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1314 microversion: 2.1 time: 0.157483 Oct 17 13:42:24.512158 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3789/7272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:24 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:25.537922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:25.538589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:25.546814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.547007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.547377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.548112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.549078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.550057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.684946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:25.694432 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac6e5e55-32b1-45b3-81f2-dcead9fd276e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1501 microversion: 2.1 time: 0.163473 Oct 17 13:42:25.695000 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3484/7273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:25 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:25.717345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:25.719641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:25.726975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.727460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.727892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.728575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.729024 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.729442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.757594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:25.763037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Old instance type m1.heat2, new instance type m1.heat {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:42:25.770054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:42:25.770492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:42:25.770966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:42:25.771373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:42:25.771779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:42:25.835510 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7d8d4cb2-ab54-45e5-b966-20c1518a89f2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "POST /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83/action" status: 202 len: 0 microversion: 2.1 time: 0.122122 Oct 17 13:42:25.836126 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3790/7274] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:25 2022] POST /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:25.844437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:25.845061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:25.851573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.852065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.852516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.853668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.854141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.854607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.961657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:25.986954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:25.989221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:25.996629 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a63fd097-acb4-493d-b750-416bdbcf3163 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1510 microversion: 2.1 time: 0.156099 Oct 17 13:42:25.997217 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3485/7275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:25 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:27.022022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:27.022687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:27.035464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.036389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.037209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.038539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.039431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.040245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.140529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:27.183392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:27.191486 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6d775360-e4e1-4bdc-938b-6e6233f82d9a tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1510 microversion: 2.1 time: 0.174680 Oct 17 13:42:27.192040 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3791/7276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:27 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:28.214683 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:28.215369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:28.222458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.222953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.223401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.224105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.224569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.225001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.358871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:28.367306 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f823a80-e539-4451-afe1-1dca8c83332e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.156683 Oct 17 13:42:28.367888 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3486/7277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:28 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:29.390918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:29.391531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:29.399803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:29.400299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:29.400739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:29.401469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:29.401946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:29.402401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:29.534020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:29.541887 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fcfe8278-b2ab-4e7b-87c7-dacba79b0951 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.154979 Oct 17 13:42:29.542484 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3792/7278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:29 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:30.565156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:30.565699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:30.572689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:30.573186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:30.573639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:30.574388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:30.574855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:30.575296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:30.717200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:30.726471 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c6009aac-e2e4-488c-b07d-2efe415970bc tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.165172 Oct 17 13:42:30.727063 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3487/7279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:30 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:31.749535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:31.750238 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:31.757456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:31.758015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:31.758426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:31.759700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:31.759700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:31.760042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:31.891303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:31.899821 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d45d372e-c30f-498f-ba8e-1339d6913dc5 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.154227 Oct 17 13:42:31.900416 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3793/7280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:31 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:32.923347 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:32.924069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:32.930897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:32.931393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:32.931847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:32.932546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:32.933015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:32.933454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:33.066604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:33.074341 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-54e01a04-43b2-40cf-8702-aeac3dba5157 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.154954 Oct 17 13:42:33.074912 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3488/7281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:32 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:34.100180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.100714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:34.106702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.107186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.107621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.108309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.108763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.109191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.245152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:34.254273 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a5a30cfe-5ed7-4961-92cf-575dafda0a1f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.159178 Oct 17 13:42:34.254842 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3794/7282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:34 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:35.276888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:35.277507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:35.284450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.284948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.285403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.286109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.286630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.287073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.418450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:35.426301 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de886b23-79d7-43a7-b493-e1e816eb5efa tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.153296 Oct 17 13:42:35.426879 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3489/7283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:35 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:36.449975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:36.450566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:36.458386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:36.458883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:36.459329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:36.460058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:36.460519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:36.460951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:36.592271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:36.600973 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d64b94b3-a563-4423-a681-7a96b171cf53 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.155089 Oct 17 13:42:36.601548 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3795/7284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:36 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:37.624051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:37.624684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:37.632671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:37.633167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:37.633618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:37.634356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:37.634832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:37.635271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:37.768416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:37.776028 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d79e7f6b-03a6-420d-93ba-3534f96458a4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.155878 Oct 17 13:42:37.776600 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3490/7285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:37 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:42:38.799323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:38.799932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:38.806754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:38.807243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:38.807681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:38.808377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:38.808832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:38.809252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:38.945552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:38.953817 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1bc7ff49-91dc-4e55-83c6-173da08fbe13 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.158625 Oct 17 13:42:38.955096 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3796/7286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:38 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:39.976916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:39.977539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:39.984474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:39.984974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:39.985429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:39.986232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:39.986758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:39.987237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:40.131277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:40.139394 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7b0acb03-18a1-4372-b18f-ffcbc93229a8 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.166381 Oct 17 13:42:40.140002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3491/7287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:39 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:41.162647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:41.163263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:41.170233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:41.170729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:41.171176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:41.171886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:41.172347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:41.172776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:41.314400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:41.322406 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7dea95d3-02f7-4612-a28a-82606172fe35 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.163892 Oct 17 13:42:41.322998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3797/7288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:41 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:42.346248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:42.346879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:42.353906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:42.354437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:42.354892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:42.355597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:42.356071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:42.356510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:42.491821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:42.499499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c419b08-dbcc-4d7c-8b09-547d72ac9d4e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.157835 Oct 17 13:42:42.500074 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3492/7289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:42 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:43.524755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:43.525344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:43.532067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:43.532598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:43.533030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:43.533720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:43.534186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:43.534612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:43.667389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:43.676602 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-95600a18-3416-4aa8-92d9-878648f51131 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.156089 Oct 17 13:42:43.677188 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3798/7290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:43 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:44.700423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:44.701043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:44.708898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.709390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.709836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.710571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.711033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.711468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.843798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:44.852097 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a544a48-b572-4ee3-b916-6aa567bcfba6 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.155631 Oct 17 13:42:44.852682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3493/7291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:44 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:45.874981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:45.875587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:45.883539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:45.884026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:45.884463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:45.885162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:45.885612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:45.886034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:46.022667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:46.030623 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d8f54d1-8e6d-4f17-8bed-90b259f638cd tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.159526 Oct 17 13:42:46.031199 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3799/7292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:45 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:47.057790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:47.058868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:47.069291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:47.069802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:47.070291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:47.071018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:47.071486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:47.071927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:47.224514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:47.232526 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-04d8e854-77bb-42e5-9304-51197ef9ecd3 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.181263 Oct 17 13:42:47.233098 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3494/7293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:47 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:48.257396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:48.257968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:48.264855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.265341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.265778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.267010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.267723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.268152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.401679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:48.410245 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-265029d9-8b61-471f-aa63-b2a0e2016728 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.156857 Oct 17 13:42:48.410816 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3800/7294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:48 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:49.432684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:49.433304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:49.440715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:49.441212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:49.441659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:49.442393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:49.442859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:49.443295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:49.574767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:49.582982 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7b401d7c-013a-44aa-a1a3-d43f6d3bdc8b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.154166 Oct 17 13:42:49.583549 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3495/7295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:49 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:50.608864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:50.609422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:50.615543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:50.616036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:50.616482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:50.617187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:50.617651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:50.618085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:50.622006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:50.767229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:50.774987 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5cb707f6-4610-402c-9a9f-26e783c8b4c9 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.172297 Oct 17 13:42:50.775555 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3801/7296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:50 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:51.799080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:51.799796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:51.808373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:51.808907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:51.809365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:51.810848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:51.811505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:51.811960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:51.956319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:51.967873 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6799978-7418-42cc-9865-861cf3488c5c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.173254 Oct 17 13:42:51.968467 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3496/7297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:51 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:52.992378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:52.992959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:53.000497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.001619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.002064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.003619 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.004076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.004622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.139757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:53.148030 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab351cea-b860-4aa4-8ea4-be138fc85dd1 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.159512 Oct 17 13:42:53.148661 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3802/7298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:52 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:54.173282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:54.174012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:54.180888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.181441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.181860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.182597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.183066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.183508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.318530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:54.326553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6dc55995-ef55-435a-a57a-c9b90a0735e2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1515 microversion: 2.1 time: 0.157687 Oct 17 13:42:54.327136 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3497/7299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:54 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:55.350336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:55.350951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:55.353729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=34 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:55.360444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:55.360943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:55.361575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:55.362315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:55.362771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:55.363197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:55.515783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:55.526810 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a32bb54-b09c-45ff-822a-d30561b46f3e tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1514 microversion: 2.1 time: 0.180259 Oct 17 13:42:55.527393 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3803/7300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:55 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:55.737314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c62eab24-2b32-4f46-b734-a139ed57133b req-474f674c-e53e-425a-a9f3-cad9ac625e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260bbb64-e53b-476d-9ed6-e7f4b1ca0b83", "name": "network-vif-unplugged", "status": "completed", "tag": "4205e132-bf55-4c78-9e1a-992ddf5d02df"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:55.744221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=30 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:55.751463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c62eab24-2b32-4f46-b734-a139ed57133b req-474f674c-e53e-425a-a9f3-cad9ac625e3d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:55.751957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c62eab24-2b32-4f46-b734-a139ed57133b req-474f674c-e53e-425a-a9f3-cad9ac625e3d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:55.752409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c62eab24-2b32-4f46-b734-a139ed57133b req-474f674c-e53e-425a-a9f3-cad9ac625e3d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:55.757182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=86 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:55.768645 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c62eab24-2b32-4f46-b734-a139ed57133b req-474f674c-e53e-425a-a9f3-cad9ac625e3d service nova] Creating event network-vif-unplugged:4205e132-bf55-4c78-9e1a-992ddf5d02df for instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 on n-h1-853316-12 Oct 17 13:42:55.775425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-c62eab24-2b32-4f46-b734-a139ed57133b req-474f674c-e53e-425a-a9f3-cad9ac625e3d service nova] Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:42:55.788032 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c62eab24-2b32-4f46-b734-a139ed57133b req-474f674c-e53e-425a-a9f3-cad9ac625e3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057823 Oct 17 13:42:55.788911 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3498/7301] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:56.553964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:56.554598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:56.561097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:56.561854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:56.562427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:56.563928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:56.564782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:56.565225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:56.719746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:56.728479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d5c63c60-3404-4694-8088-ae2fd4df8ded tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1514 microversion: 2.1 time: 0.179608 Oct 17 13:42:56.729068 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3804/7302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:56 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:57.753952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:57.754696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:57.761851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.762380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.762830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.763549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.763996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.764438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.812991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6a019621-3c2e-4e25-9fc4-aa71ed04ea5d req-89fe7861-4113-4213-9a7d-ea4104a6abe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260bbb64-e53b-476d-9ed6-e7f4b1ca0b83", "tag": "4205e132-bf55-4c78-9e1a-992ddf5d02df"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:57.823665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a019621-3c2e-4e25-9fc4-aa71ed04ea5d req-89fe7861-4113-4213-9a7d-ea4104a6abe3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.824448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a019621-3c2e-4e25-9fc4-aa71ed04ea5d req-89fe7861-4113-4213-9a7d-ea4104a6abe3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.824878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6a019621-3c2e-4e25-9fc4-aa71ed04ea5d req-89fe7861-4113-4213-9a7d-ea4104a6abe3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.838527 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6a019621-3c2e-4e25-9fc4-aa71ed04ea5d req-89fe7861-4113-4213-9a7d-ea4104a6abe3 service nova] Creating event network-changed:4205e132-bf55-4c78-9e1a-992ddf5d02df for instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 on n-h1-853316-12 Oct 17 13:42:57.843884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-6a019621-3c2e-4e25-9fc4-aa71ed04ea5d req-89fe7861-4113-4213-9a7d-ea4104a6abe3 service nova] Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:42:57.855992 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6a019621-3c2e-4e25-9fc4-aa71ed04ea5d req-89fe7861-4113-4213-9a7d-ea4104a6abe3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046813 Oct 17 13:42:57.856601 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3805/7303] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:42:57.953672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:57.962772 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f290242d-691e-474f-bc1b-52eb72a61386 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1512 microversion: 2.1 time: 0.213612 Oct 17 13:42:57.963358 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3499/7304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:57 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:58.987361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:58.988095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:58.994495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:58.994985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:58.995424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:58.996127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:58.996580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:58.997004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:59.130325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:59.138083 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b5bc33fc-23be-40de-8333-e85fbadac277 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1512 microversion: 2.1 time: 0.155945 Oct 17 13:42:59.138679 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3806/7305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:58 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:00.161105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:00.161724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.168660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.169152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.169597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.170348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.170810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.171245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.302330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:00.310017 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-afa85c90-1d98-4c7e-8303-8138853e550b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1509 microversion: 2.1 time: 0.152989 Oct 17 13:43:00.310607 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3500/7306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:00 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:00.332690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:00.333263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.340162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.340648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.341089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.341787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.342274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.342701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.369073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:00.420481 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.compute.api [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Found an unconfirmed migration during delete, id: 16, status: finished Oct 17 13:43:01.825407 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-47e5e9bb-f970-42bc-b929-38d8405f5573 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 204 len: 0 microversion: 2.1 time: 1.497375 Oct 17 13:43:01.826844 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3807/7307] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:00 2022] DELETE /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 0 bytes in 1500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:01.836853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:01.837753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:01.846684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.847198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.847661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.848402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.848875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.849325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.980260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:01.988992 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ecc96874-ef51-4f29-ac56-de38a0b721d4 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1501 microversion: 2.1 time: 0.156731 Oct 17 13:43:01.989563 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3501/7308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:01 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:03.013373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:03.014075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:03.021064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.021552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.021992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.022715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.023174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.023600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.167075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23696f8cb45943d0b951802e9a1b5c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58ab6dc0f80d49dbb31c98e3de1ce542', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:03.175699 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3bed02aa-ed50-4d28-9bdb-a9805005803f tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 200 len: 1501 microversion: 2.1 time: 0.166606 Oct 17 13:43:03.176507 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3808/7309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:03 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:03.199798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c7b99af5-fcc7-4564-867b-2a5dbe773c24 req-006e69cd-5cd1-4870-a6df-d9980785b79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260bbb64-e53b-476d-9ed6-e7f4b1ca0b83", "name": "network-vif-plugged", "status": "completed", "tag": "4205e132-bf55-4c78-9e1a-992ddf5d02df"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:03.211722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c7b99af5-fcc7-4564-867b-2a5dbe773c24 req-006e69cd-5cd1-4870-a6df-d9980785b79d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.212234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c7b99af5-fcc7-4564-867b-2a5dbe773c24 req-006e69cd-5cd1-4870-a6df-d9980785b79d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.212706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c7b99af5-fcc7-4564-867b-2a5dbe773c24 req-006e69cd-5cd1-4870-a6df-d9980785b79d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.229475 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c7b99af5-fcc7-4564-867b-2a5dbe773c24 req-006e69cd-5cd1-4870-a6df-d9980785b79d service nova] Creating event network-vif-plugged:4205e132-bf55-4c78-9e1a-992ddf5d02df for instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 on n-h1-853316-12 Oct 17 13:43:03.234793 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c7b99af5-fcc7-4564-867b-2a5dbe773c24 req-006e69cd-5cd1-4870-a6df-d9980785b79d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038615 Oct 17 13:43:03.236457 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3502/7310] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:03.717923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1cb691b9-b076-414c-94bb-f991dcdd232e req-114e237d-eb67-47fd-839c-00fb195ac767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260bbb64-e53b-476d-9ed6-e7f4b1ca0b83", "name": "network-vif-deleted", "tag": "4205e132-bf55-4c78-9e1a-992ddf5d02df"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:03.730974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1cb691b9-b076-414c-94bb-f991dcdd232e req-114e237d-eb67-47fd-839c-00fb195ac767 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.731492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1cb691b9-b076-414c-94bb-f991dcdd232e req-114e237d-eb67-47fd-839c-00fb195ac767 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.731937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1cb691b9-b076-414c-94bb-f991dcdd232e req-114e237d-eb67-47fd-839c-00fb195ac767 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.745711 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1cb691b9-b076-414c-94bb-f991dcdd232e req-114e237d-eb67-47fd-839c-00fb195ac767 service nova] Creating event network-vif-deleted:4205e132-bf55-4c78-9e1a-992ddf5d02df for instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 on n-h1-853316-12 Oct 17 13:43:03.750439 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1cb691b9-b076-414c-94bb-f991dcdd232e req-114e237d-eb67-47fd-839c-00fb195ac767 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038221 Oct 17 13:43:03.751129 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3809/7311] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:04.200237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:04.200966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:04.209269 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:04.209774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:04.210261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.210992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:04.211464 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:04.211912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.226505 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] HTTP exception thrown: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Request method failure captured: Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 HTTP/1.1 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVu3OUJGJnfcMGATYtGDznQZ9Wygj4ReeRoR4JOyJ3ZGgCfcdwvvrgbYHxe4MoNXrSAZPQMVsuftMButAoRjBrOakRLl6tKb-VzOBDA5xmcPZ2jgcPDwFerJGtBuKWfRFKqiVwUIMWapou0-CDBbhRApbnoDEdDRckcQRXW--R5I670 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 58ab6dc0f80d49dbb31c98e3de1ce542 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ab6dc0f80d49dbb31c98e3de1ce542", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 58ab6dc0f80d49dbb31c98e3de1ce542 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersTestJSON-1504818872-project Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 23696f8cb45943d0b951802e9a1b5c3a Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersTestJSON-1504818872-project Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '260bbb64-e53b-476d-9ed6-e7f4b1ca0b83'} Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:04.228181 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Returning 404 to user: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3705a342-cb0c-41c3-bbaf-954c19081d3b tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 404 len: 111 microversion: 2.1 time: 0.033810 Oct 17 13:43:04.233402 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3503/7312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:04 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:04.249869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:04.250590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:04.256938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:04.257426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:04.257868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.258603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:04.259063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:04.259492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.276990 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] HTTP exception thrown: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Request method failure captured: Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 HTTP/1.1 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVu3OUJGJnfcMGATYtGDznQZ9Wygj4ReeRoR4JOyJ3ZGgCfcdwvvrgbYHxe4MoNXrSAZPQMVsuftMButAoRjBrOakRLl6tKb-VzOBDA5xmcPZ2jgcPDwFerJGtBuKWfRFKqiVwUIMWapou0-CDBbhRApbnoDEdDRckcQRXW--R5I670 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 58ab6dc0f80d49dbb31c98e3de1ce542 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ab6dc0f80d49dbb31c98e3de1ce542", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 58ab6dc0f80d49dbb31c98e3de1ce542 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-DeleteServersTestJSON-1504818872-project Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 23696f8cb45943d0b951802e9a1b5c3a Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-DeleteServersTestJSON-1504818872-project Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '260bbb64-e53b-476d-9ed6-e7f4b1ca0b83'} Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:04.278737 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Returning 404 to user: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-196cfdd0-841f-401d-80b3-e80bc4cd884c tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 404 len: 111 microversion: 2.1 time: 0.036551 Oct 17 13:43:04.290673 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3810/7313] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:04 2022] DELETE /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:04.295467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:04.296103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] [instance: 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:04.302260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:04.302760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:04.303208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.303916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:04.304380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:04.304920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.319064 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] HTTP exception thrown: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Request method failure captured: Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 HTTP/1.1 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVu3OUJGJnfcMGATYtGDznQZ9Wygj4ReeRoR4JOyJ3ZGgCfcdwvvrgbYHxe4MoNXrSAZPQMVsuftMButAoRjBrOakRLl6tKb-VzOBDA5xmcPZ2jgcPDwFerJGtBuKWfRFKqiVwUIMWapou0-CDBbhRApbnoDEdDRckcQRXW--R5I670 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 58ab6dc0f80d49dbb31c98e3de1ce542 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58ab6dc0f80d49dbb31c98e3de1ce542", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58ab6dc0f80d49dbb31c98e3de1ce542"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 58ab6dc0f80d49dbb31c98e3de1ce542 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504818872 Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-DeleteServersTestJSON-1504818872-project Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 23696f8cb45943d0b951802e9a1b5c3a Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-DeleteServersTestJSON-1504818872-project Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '260bbb64-e53b-476d-9ed6-e7f4b1ca0b83'} Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:04.320593 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] Returning 404 to user: Instance 260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d0392d74-cfbd-4e76-838c-d1c571e8a2b2 tempest-DeleteServersTestJSON-1504818872 tempest-DeleteServersTestJSON-1504818872-project] 10.222.0.27 "GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83" status: 404 len: 111 microversion: 2.1 time: 0.035226 Oct 17 13:43:04.325191 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3504/7314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:04 2022] GET /compute/v2.1/servers/260bbb64-e53b-476d-9ed6-e7f4b1ca0b83 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:13.600532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1237622214", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "bad6b900-cce0-4e68-8ada-8d36efbefb2a"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:13.657590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] validate_networks() for [('bad6b900-cce0-4e68-8ada-8d36efbefb2a', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:43:14.036673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:14.037121 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:14.037592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:14.038003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:14.038432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:14.047256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.047858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.048451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.049183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.049638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.050058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.067439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Getting quotas for project ea1f283002ce44918989603565f9dab3. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:14.072765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Getting quotas for user 33886d344ba541678b034ecb49334543 and project ea1f283002ce44918989603565f9dab3. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:14.085665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:14.088006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:14.134238 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6c70514-d7f0-4720-ba3c-db88f5d4507a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662505 Oct 17 13:43:14.140339 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3811/7315] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:43:14.147057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c100a3b-d2a8-4da5-8ee9-c62421799cf9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:14.148438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c100a3b-d2a8-4da5-8ee9-c62421799cf9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:14.226888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c100a3b-d2a8-4da5-8ee9-c62421799cf9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.233763 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c100a3b-d2a8-4da5-8ee9-c62421799cf9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1218 microversion: 2.1 time: 0.090787 Oct 17 13:43:14.234345 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3505/7316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:14 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:15.259604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:15.260151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:15.269426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:15.269925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:15.270407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:15.271263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:15.271723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:15.272144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:15.341091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:15.351991 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d24fc214-6cff-4996-9df7-b541ba1bf370 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1278 microversion: 2.1 time: 0.097869 Oct 17 13:43:15.352867 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3812/7317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:15 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:16.373518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=27 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:16.389593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:16.390272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:16.421403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.423164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.424550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.426423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.427363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.428237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.773593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:16.788904 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6d845d9-fb0c-435d-8d1d-4a9d97851c22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1318 microversion: 2.1 time: 0.415315 Oct 17 13:43:16.805982 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3506/7318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:16 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:17.004938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b1c04871-6fae-4727-ba8a-310c9c261a7e req-6e7906a2-0e3d-46e5-8c7b-9024ede23c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2adb23-d0fa-4615-b708-1214ca0f6b05", "tag": "3c63aa54-ad7c-455c-926e-626425e9b7f0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:17.018673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b1c04871-6fae-4727-ba8a-310c9c261a7e req-6e7906a2-0e3d-46e5-8c7b-9024ede23c0c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:17.019393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b1c04871-6fae-4727-ba8a-310c9c261a7e req-6e7906a2-0e3d-46e5-8c7b-9024ede23c0c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:17.019902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b1c04871-6fae-4727-ba8a-310c9c261a7e req-6e7906a2-0e3d-46e5-8c7b-9024ede23c0c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:17.032654 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b1c04871-6fae-4727-ba8a-310c9c261a7e req-6e7906a2-0e3d-46e5-8c7b-9024ede23c0c service nova] Creating event network-changed:3c63aa54-ad7c-455c-926e-626425e9b7f0 for instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 on n-h2-853316-12 Oct 17 13:43:17.038134 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b1c04871-6fae-4727-ba8a-310c9c261a7e req-6e7906a2-0e3d-46e5-8c7b-9024ede23c0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038477 Oct 17 13:43:17.038954 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3813/7319] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:17.813690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:17.815030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:17.822478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:17.823238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:17.823686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:17.824454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:17.824918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:17.825356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:17.959941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:17.967674 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d4b61e33-05da-4051-9557-32a018251848 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1318 microversion: 2.1 time: 0.158538 Oct 17 13:43:17.968244 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3507/7320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:17 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:18.992351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:18.993052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:18.999945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:19.000433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:19.001445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:19.002180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:19.002640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:19.003060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:19.149147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:19.157547 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2b6bc64-c5c1-4945-878c-8bcb5bd96156 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1318 microversion: 2.1 time: 0.169855 Oct 17 13:43:19.158373 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3814/7321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:18 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:20.180177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:20.180875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:20.187805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.189066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.189549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.190297 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.190772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.191216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.330513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:20.339818 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3dc41e27-c094-43b3-98b1-bd7a48403cb7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1318 microversion: 2.1 time: 0.163345 Oct 17 13:43:20.340774 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3508/7322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:20 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:21.377782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:21.378410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:21.385836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.386361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.386906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.387609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.388069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.388498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.391300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:21.522700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:21.530444 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2027ae0-cb5c-498f-8829-65ecfb6ac1c7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1318 microversion: 2.1 time: 0.157229 Oct 17 13:43:21.531013 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3815/7323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:21 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:22.300126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-5d460502-4e8d-4bb9-87e2-d960263bbeff req-38701740-1f6c-4d49-a729-2c28a10e724b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2adb23-d0fa-4615-b708-1214ca0f6b05", "name": "network-vif-plugged", "status": "completed", "tag": "3c63aa54-ad7c-455c-926e-626425e9b7f0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:22.310022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5d460502-4e8d-4bb9-87e2-d960263bbeff req-38701740-1f6c-4d49-a729-2c28a10e724b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.310565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5d460502-4e8d-4bb9-87e2-d960263bbeff req-38701740-1f6c-4d49-a729-2c28a10e724b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.311089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5d460502-4e8d-4bb9-87e2-d960263bbeff req-38701740-1f6c-4d49-a729-2c28a10e724b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:22.324693 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-5d460502-4e8d-4bb9-87e2-d960263bbeff req-38701740-1f6c-4d49-a729-2c28a10e724b service nova] Creating event network-vif-plugged:3c63aa54-ad7c-455c-926e-626425e9b7f0 for instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 on n-h2-853316-12 Oct 17 13:43:22.330233 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-5d460502-4e8d-4bb9-87e2-d960263bbeff req-38701740-1f6c-4d49-a729-2c28a10e724b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035900 Oct 17 13:43:22.331171 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3509/7324] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:22.553585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:22.554215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:22.561139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.561618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.562048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:22.562781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.563251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.564229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:22.697537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:22.706261 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-58bc8151-30b2-4343-934f-c63429efd4da tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1318 microversion: 2.1 time: 0.157294 Oct 17 13:43:22.706904 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3816/7325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:22 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:23.731176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:23.731933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:23.739440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.739938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.740388 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.741094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.741557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.741994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.873686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:23.881788 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b952e2c2-f80c-4dd9-8d45-64a41193bf67 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1507 microversion: 2.1 time: 0.155894 Oct 17 13:43:23.882393 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3510/7326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:23 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:23.904188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:23.904732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:23.912261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.912753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.913196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.913897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.914395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.914828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.049018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.056884 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-678dee2f-dc54-49ee-a3b3-e1cab317f233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1507 microversion: 2.1 time: 0.156702 Oct 17 13:43:24.057480 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3817/7327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:23 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:24.080374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:24.082786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:24.088941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.089443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.089890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.090626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.091096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.091533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.156241 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de77c590-0d26-444f-a07b-d0351e0d4ae9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "PUT /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1079 microversion: 2.1 time: 0.080489 Oct 17 13:43:24.156976 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3511/7328] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 17 13:43:24 2022] PUT /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1079 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:24.177297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:24.178406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:24.180637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:24.181312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:24.187249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.187735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.188287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.189017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.189503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.189929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.334793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.342495 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3dacce00-3bd4-4d7e-9b0e-cb090f6f2367 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1505 microversion: 2.1 time: 0.170274 Oct 17 13:43:24.343058 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3818/7329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:24 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:24.363850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:24.364512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:24.366616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:24.372142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.372648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.373104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.373813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.374312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.374762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.509343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.517820 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-010ac3d0-3df4-40cd-9b07-2f58fdee6ed3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1505 microversion: 2.1 time: 0.157738 Oct 17 13:43:24.518415 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3512/7330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:24 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:24.539508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:24.542312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:24.548987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.549470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.549907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.550711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.551188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.551611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.581641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.587018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Old instance type m1.heat2, new instance type m1.heat {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:43:24.593533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:24.593951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:24.595358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:24.595897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:24.596330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:24.659846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-74929ed7-e374-4933-9749-e0e47dd2b294 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "POST /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05/action" status: 202 len: 0 microversion: 2.1 time: 0.124279 Oct 17 13:43:24.660474 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3819/7331] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:43:24 2022] POST /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:43:24.668525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:24.669208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:24.675411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.675915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.676427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.677146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.677618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.678064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.818841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.833458 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-78ceea4c-91c1-48e8-a0ad-b792e64fb60b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1516 microversion: 2.1 time: 0.168691 Oct 17 13:43:24.834035 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3513/7332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:24 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:25.857407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.858697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:25.861734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:25.868476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.869042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.869480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.870193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.870650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.871073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.007323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:26.015386 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-70536f1e-48c5-49cb-bc52-b64c60433b11 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1516 microversion: 2.1 time: 0.162089 Oct 17 13:43:26.015965 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3820/7333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:25 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:27.039396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:27.040028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:27.042757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=34 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:27.049058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:27.049500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:27.050062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.050704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:27.051176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:27.051621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.185701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:27.194484 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34c859d1-cca2-49b6-bffe-f33bfa14c6e9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.159261 Oct 17 13:43:27.195064 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3514/7334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:27 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:28.218445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:28.219049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:28.226396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.226881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.227317 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.228004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.228453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.228872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.365006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.372810 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-707b0012-ffc9-484a-a98c-b19291508dba tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.158317 Oct 17 13:43:28.373379 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3821/7335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:28 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:29.398681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:29.399506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:29.410006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.410872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.411459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.412561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.413121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.413869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.572811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:29.580905 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9c87ec47-4b66-4bdc-894a-36bed1236e0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.188165 Oct 17 13:43:29.581483 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3515/7336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:29 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:30.605181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:30.605793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:30.613174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.613669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.614130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.614860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.615320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.615749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.747719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.756643 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c99833b9-1a8e-43b1-b174-45a05b3a158c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.155632 Oct 17 13:43:30.757210 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3822/7337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:30 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:31.780999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.781619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:31.788651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.789145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.789642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.790323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.790792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.791227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.928065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:31.935939 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5a971a5c-7118-42c6-9ef0-4642930208f5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.158843 Oct 17 13:43:31.936507 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3516/7338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:32.961027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:32.961645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:32.968596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.969180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.969698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.970479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.970944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.971379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:33.029646 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:43:33.029892 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:43:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 (ip 10.222.0.27) !!! Oct 17 13:43:33.111506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:33.119411 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c91275c3-2f6e-4361-adf0-0c220f1a6be6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.162417 Oct 17 13:43:33.119983 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3823/7339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:32 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:34.143334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:34.144308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:34.152364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.152937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.153402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.154136 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.154630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.155075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.291384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:34.299806 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bf63fcef-cd01-46fd-aa9d-b982901bd98b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.161036 Oct 17 13:43:34.300554 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3517/7340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:34 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:35.322760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:35.323366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:35.331222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.331701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.332164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.332860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.333310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.333735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.467768 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:35.477084 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a5f218cd-5d68-484c-9c9a-580ed037e19c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.158223 Oct 17 13:43:35.477648 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3824/7341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:35 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:36.501515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:36.502233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:36.509202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.509708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.510180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.510899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.511374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.511813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.641871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:36.649639 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2cb5df06-b8f9-4dea-9dc1-b26465ecd4fb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.152733 Oct 17 13:43:36.650223 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3518/7342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:36 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:37.673166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:37.673797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:37.680747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.681170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.681892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:37.682623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.683073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.683494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:37.829108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:37.837156 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a4466a29-f138-421b-8943-95922e010a38 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.168070 Oct 17 13:43:37.837730 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3825/7343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:37 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:38.861446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:38.862068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:38.868927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:38.869416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:38.869862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:38.870603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:38.871068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:38.871504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.001514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:39.009325 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b4ad690-21fe-4405-b361-379694f26958 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.152653 Oct 17 13:43:39.010139 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3519/7344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:38 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:40.033936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:40.034584 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:40.041966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:40.042503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:40.042945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:40.043658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:40.044206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:40.044636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:40.185943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:40.195208 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a00de0c3-417a-41ed-8ce9-4bd4213bce4c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.165353 Oct 17 13:43:40.196005 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3826/7345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:40 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:41.221223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:41.221995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:41.230588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.231182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.231900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.232402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.232876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.233322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.373789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:41.382234 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77acff54-0147-491b-b6cd-12fd882dc7b5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.166615 Oct 17 13:43:41.382752 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3520/7346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:41 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:42.408682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:42.409301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:42.416359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.416857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.417299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.418003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.418485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.418919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.553985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:42.561933 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db551b90-a1a9-4db3-a068-fdd4b2686b2c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.158795 Oct 17 13:43:42.562518 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3827/7347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:42 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:43.585466 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:43.586105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:43.592984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:43.593472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:43.593915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:43.595477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:43.596118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:43.596557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:43.733443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:43.742083 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c8f9b68-0b27-4672-a964-bc6ec35db159 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.160530 Oct 17 13:43:43.742702 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3521/7348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:43 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:44.766728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:44.767347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:44.776353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:44.776854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:44.777294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:44.778007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:44.778501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:44.778933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:44.922062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:44.930856 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fdb8059a-79e5-4209-ab1a-04909a14a199 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.169255 Oct 17 13:43:44.931455 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3828/7349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:44 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:45.954986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:45.955605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:45.962361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:45.962961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:45.963508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.964003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:45.964461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:45.964895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.986960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:46.113276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:46.121296 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d578387-e9c5-4bf1-83aa-74b5c4f8510d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.170506 Oct 17 13:43:46.121873 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3522/7350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:45 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:47.145594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:47.146236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:47.153612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.154097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.154555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.155255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.155706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.156130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.293859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:47.302806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-52796413-2ead-4acd-a8a3-840de94bf89a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.161947 Oct 17 13:43:47.303411 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3829/7351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:47 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:48.324883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:48.325497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:48.333273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:48.333766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:48.334235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:48.334934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:48.335395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:48.335830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:48.464847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:48.472826 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e992fcec-d6f4-4eb1-bee1-8db092e48f23 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.151862 Oct 17 13:43:48.473404 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3523/7352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:48 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:49.495829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:49.496452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:49.504279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:49.504763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:49.505200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:49.505888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:49.506383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:49.506808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:49.522744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:49.642877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.650704 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd73efe7-338b-40bb-a90e-f69c8fb585ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.158751 Oct 17 13:43:49.651270 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3830/7353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:49 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:50.672960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:50.673639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:50.680709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.681212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.681668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.682456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.682925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.683367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.823768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:50.832985 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ac9f2f7-2dbd-4c5b-9752-418feca689cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.163896 Oct 17 13:43:50.833580 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3524/7354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:50 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:51.858283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:51.859058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:51.865654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.866133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.866594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.867284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.867736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.868155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.997405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:52.005725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9403824a-4211-4d77-ac0c-45cd07888f68 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.153172 Oct 17 13:43:52.006329 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3831/7355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:51 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:53.029062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:53.029768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:53.037289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.037797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.038286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.039011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.039486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.039930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.181856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:53.190612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9d1ed549-77db-40c3-86f6-7636186cc98d tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1521 microversion: 2.1 time: 0.165385 Oct 17 13:43:53.191215 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3525/7356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:53 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:53.688473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1561b0b8-a3ba-4825-bde8-b1be20f4e911 req-c15de097-8a9f-467f-9b88-c1e4871e566e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2adb23-d0fa-4615-b708-1214ca0f6b05", "name": "network-vif-unplugged", "status": "completed", "tag": "3c63aa54-ad7c-455c-926e-626425e9b7f0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:53.701930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1561b0b8-a3ba-4825-bde8-b1be20f4e911 req-c15de097-8a9f-467f-9b88-c1e4871e566e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.703025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1561b0b8-a3ba-4825-bde8-b1be20f4e911 req-c15de097-8a9f-467f-9b88-c1e4871e566e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.703638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1561b0b8-a3ba-4825-bde8-b1be20f4e911 req-c15de097-8a9f-467f-9b88-c1e4871e566e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.717190 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1561b0b8-a3ba-4825-bde8-b1be20f4e911 req-c15de097-8a9f-467f-9b88-c1e4871e566e service nova] Creating event network-vif-unplugged:3c63aa54-ad7c-455c-926e-626425e9b7f0 for instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 on n-h1-853316-12 Oct 17 13:43:53.724228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-1561b0b8-a3ba-4825-bde8-b1be20f4e911 req-c15de097-8a9f-467f-9b88-c1e4871e566e service nova] Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:43:53.736499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1561b0b8-a3ba-4825-bde8-b1be20f4e911 req-c15de097-8a9f-467f-9b88-c1e4871e566e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052776 Oct 17 13:43:53.737244 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3832/7357] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:43:54.217043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:54.217585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:54.225493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.225993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.226506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.227230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.227694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.228160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.444627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.455362 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c653318-c9d4-4bc6-ad54-c344ba79356e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1520 microversion: 2.1 time: 0.242491 Oct 17 13:43:54.455958 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3526/7358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:54 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:55.481628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:55.482373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:55.490909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.491916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.491916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.492878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.493021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.493388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.635247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:55.644353 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0c42d3f1-533b-4996-985b-b3129ea778b0 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1518 microversion: 2.1 time: 0.167096 Oct 17 13:43:55.644951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3833/7359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:55 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:55.761098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-bd6e9a12-5400-4ecb-9e34-a64bce8aac5f req-f3aa2048-3f11-47be-9e64-cfc6202d5e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2adb23-d0fa-4615-b708-1214ca0f6b05", "tag": "3c63aa54-ad7c-455c-926e-626425e9b7f0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:55.772234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd6e9a12-5400-4ecb-9e34-a64bce8aac5f req-f3aa2048-3f11-47be-9e64-cfc6202d5e1a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.772727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd6e9a12-5400-4ecb-9e34-a64bce8aac5f req-f3aa2048-3f11-47be-9e64-cfc6202d5e1a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.773171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-bd6e9a12-5400-4ecb-9e34-a64bce8aac5f req-f3aa2048-3f11-47be-9e64-cfc6202d5e1a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.784874 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-bd6e9a12-5400-4ecb-9e34-a64bce8aac5f req-f3aa2048-3f11-47be-9e64-cfc6202d5e1a service nova] Creating event network-changed:3c63aa54-ad7c-455c-926e-626425e9b7f0 for instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 on n-h1-853316-12 Oct 17 13:43:55.790131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-bd6e9a12-5400-4ecb-9e34-a64bce8aac5f req-f3aa2048-3f11-47be-9e64-cfc6202d5e1a service nova] Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:43:55.801425 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-bd6e9a12-5400-4ecb-9e34-a64bce8aac5f req-f3aa2048-3f11-47be-9e64-cfc6202d5e1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044093 Oct 17 13:43:55.802013 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3527/7360] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:56.667718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:56.668407 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:56.670844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=28 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:56.676633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:56.677123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:56.677793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.678970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:56.679426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:56.679866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.822099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:56.831335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f6b00a8d-84e3-4a96-8192-66c9f965cc00 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1518 microversion: 2.1 time: 0.167435 Oct 17 13:43:56.831919 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3834/7361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:56 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:57.856280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:57.857027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:57.858994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=28 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:57.864807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:57.865312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:57.865775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:57.866519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:57.866987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:57.867439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.088247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.099798 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-20858d61-6dcd-4c02-aa06-34482d30ddff tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1515 microversion: 2.1 time: 0.247922 Oct 17 13:43:58.100191 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3528/7362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:57 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:58.124720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:58.125289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:58.136419 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.136890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.137331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.138046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.138712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.139155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.207256 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11470a07-fbd8-48f2-a004-f2ef08884e2b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "POST /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05/action" status: 204 len: 0 microversion: 2.1 time: 0.086390 Oct 17 13:43:58.208083 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3835/7363] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:43:58 2022] POST /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:58.216537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:58.217638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:58.224142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.224908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.225358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.226315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.226899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.227458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.467067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.475078 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-500135c0-e591-4bb5-8988-f14d165471b3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1515 microversion: 2.1 time: 0.262823 Oct 17 13:43:58.475657 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3529/7364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:58 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:59.453800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-213b2ea3-6933-4a7b-b8bb-d06c0feb5af3 req-19aad930-a8c2-47a6-a7e1-e4db5981b904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2adb23-d0fa-4615-b708-1214ca0f6b05", "name": "network-vif-plugged", "status": "completed", "tag": "3c63aa54-ad7c-455c-926e-626425e9b7f0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:59.465560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-213b2ea3-6933-4a7b-b8bb-d06c0feb5af3 req-19aad930-a8c2-47a6-a7e1-e4db5981b904 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.466457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-213b2ea3-6933-4a7b-b8bb-d06c0feb5af3 req-19aad930-a8c2-47a6-a7e1-e4db5981b904 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.466900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-213b2ea3-6933-4a7b-b8bb-d06c0feb5af3 req-19aad930-a8c2-47a6-a7e1-e4db5981b904 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.482465 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-213b2ea3-6933-4a7b-b8bb-d06c0feb5af3 req-19aad930-a8c2-47a6-a7e1-e4db5981b904 service nova] Creating event network-vif-plugged:3c63aa54-ad7c-455c-926e-626425e9b7f0 for instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 on n-h1-853316-12 Oct 17 13:43:59.488717 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-213b2ea3-6933-4a7b-b8bb-d06c0feb5af3 req-19aad930-a8c2-47a6-a7e1-e4db5981b904 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040943 Oct 17 13:43:59.489601 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3836/7365] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:59.500201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:59.501364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:59.509448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.510230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.510883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.511787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.512263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.513300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.658579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.666705 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-760d5648-78ba-49fa-bdc2-8244d8cc6282 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1507 microversion: 2.1 time: 0.171593 Oct 17 13:43:59.678346 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3530/7366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:59 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:59.689621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:59.690345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:59.696580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.697067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.697504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.698240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.698698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.699130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.833084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.840874 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-707bfee9-9e5f-41f9-a00c-46459b9d1e7c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1507 microversion: 2.1 time: 0.155628 Oct 17 13:43:59.841492 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3837/7367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:59 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:59.867150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7274d7fa-d4a7-4dd6-9f8c-75636767c315 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Action: 'create', calling method: .version_select at 0x7fa81baf5160>, body: {"keypair": {"name": "tempest-keypair-450032422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSGOhGVG0ZfyvYJ2s6ZZiHm1WXI+eKnvxXwGTUJF0e3Unlf0v7pwPIqgnr9LV6YU6CcAIugfNdNEJzWEO4uMn5vm56ugBbJ9MLUN3y4SJUJZ6Lrm7o31J4aGNaB9YszKw=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:59.883625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-7274d7fa-d4a7-4dd6-9f8c-75636767c315 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Getting quotas for project ea1f283002ce44918989603565f9dab3. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:59.888805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-7274d7fa-d4a7-4dd6-9f8c-75636767c315 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Getting quotas for user 33886d344ba541678b034ecb49334543 and project ea1f283002ce44918989603565f9dab3. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:59.918013 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7274d7fa-d4a7-4dd6-9f8c-75636767c315 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054555 Oct 17 13:43:59.918665 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3531/7368] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:43:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:01.505467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:01.506086 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:01.512958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.513454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.513893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.514624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.515082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.515518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.647458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:01.655693 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5c3e4de5-1876-42c8-9667-c4c0f65747a6 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 200 len: 1507 microversion: 2.1 time: 0.154645 Oct 17 13:44:01.656191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3838/7369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:01 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:01.678503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:01.679117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:01.685769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.686313 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.686826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.687525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.687987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.688422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.714715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:01.791310 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5440ab78-5466-4454-a9fe-193c3169e9af tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 204 len: 0 microversion: 2.1 time: 0.117680 Oct 17 13:44:01.791897 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3532/7370] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:01 2022] DELETE /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:01.853882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2044682676", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "bad6b900-cce0-4e68-8ada-8d36efbefb2a"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:01.907972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] validate_networks() for [('bad6b900-cce0-4e68-8ada-8d36efbefb2a', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:44:02.288341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:02.288763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:02.289236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:02.289642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:02.290049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:02.298936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.300519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.300960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.301695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.302151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.302600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.320893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Getting quotas for project ea1f283002ce44918989603565f9dab3. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:02.326285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Getting quotas for user 33886d344ba541678b034ecb49334543 and project ea1f283002ce44918989603565f9dab3. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:02.339983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:44:02.342322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:02.388985 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-66d2ad25-c72f-4a21-93c7-43a6b18a12aa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539086 Oct 17 13:44:02.389647 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3839/7371] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:44:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:44:02.402784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43020957-7a43-4509-b12c-872bfc84f627 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:02.403621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43020957-7a43-4509-b12c-872bfc84f627 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:02.460581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43020957-7a43-4509-b12c-872bfc84f627 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:02.467244 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43020957-7a43-4509-b12c-872bfc84f627 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1218 microversion: 2.1 time: 0.068790 Oct 17 13:44:02.467812 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3533/7372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:02 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:03.489725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:03.490309 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:03.498029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:03.498539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:03.498992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:03.499726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:03.500178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:03.500599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:03.567237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:03.576897 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cbc067d3-4abc-400b-9dd3-7585936bb46e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1270 microversion: 2.1 time: 0.091340 Oct 17 13:44:03.577473 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3840/7373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:03 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:04.321449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b4134a0e-0fdf-4f19-80c0-2a215993cb80 req-3cf22206-6e89-48cd-be9a-0b1753ff9fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2adb23-d0fa-4615-b708-1214ca0f6b05", "name": "network-vif-deleted", "tag": "3c63aa54-ad7c-455c-926e-626425e9b7f0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:04.336184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b4134a0e-0fdf-4f19-80c0-2a215993cb80 req-3cf22206-6e89-48cd-be9a-0b1753ff9fb4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:04.336682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b4134a0e-0fdf-4f19-80c0-2a215993cb80 req-3cf22206-6e89-48cd-be9a-0b1753ff9fb4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:04.337135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b4134a0e-0fdf-4f19-80c0-2a215993cb80 req-3cf22206-6e89-48cd-be9a-0b1753ff9fb4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.349539 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b4134a0e-0fdf-4f19-80c0-2a215993cb80 req-3cf22206-6e89-48cd-be9a-0b1753ff9fb4 service nova] Creating event network-vif-deleted:3c63aa54-ad7c-455c-926e-626425e9b7f0 for instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 on n-h1-853316-12 Oct 17 13:44:04.354937 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b4134a0e-0fdf-4f19-80c0-2a215993cb80 req-3cf22206-6e89-48cd-be9a-0b1753ff9fb4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038291 Oct 17 13:44:04.355586 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3534/7374] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:04.601345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:04.603002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:04.611618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:04.612700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:04.613313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.614255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:04.614868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:04.615454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.775878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.785238 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0759f58f-cf64-4d12-812b-b364d755b7a2 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1318 microversion: 2.1 time: 0.187382 Oct 17 13:44:04.785546 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3841/7375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:04 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:05.808864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:05.809577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:05.816699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.817195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.817643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.818385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.818850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.819287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.954252 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:05.962619 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-639a55c5-167e-43b3-a4f0-dee9810866ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1318 microversion: 2.1 time: 0.158769 Oct 17 13:44:05.963598 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3535/7376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:05 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:06.371484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c5601f30-a42a-4fcf-bc35-dc5ae3780674 req-3a69e57f-11e0-401e-adfc-133b02c742d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca7f8ed7-ce82-4349-9dbd-68b73e8b303a", "tag": "16c8706d-5845-4b47-9c22-475c2a58ff2b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:06.382078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c5601f30-a42a-4fcf-bc35-dc5ae3780674 req-3a69e57f-11e0-401e-adfc-133b02c742d6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:06.382649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c5601f30-a42a-4fcf-bc35-dc5ae3780674 req-3a69e57f-11e0-401e-adfc-133b02c742d6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:06.383143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c5601f30-a42a-4fcf-bc35-dc5ae3780674 req-3a69e57f-11e0-401e-adfc-133b02c742d6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:06.395339 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c5601f30-a42a-4fcf-bc35-dc5ae3780674 req-3a69e57f-11e0-401e-adfc-133b02c742d6 service nova] Creating event network-changed:16c8706d-5845-4b47-9c22-475c2a58ff2b for instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a on n-h1-853316-12 Oct 17 13:44:06.400437 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c5601f30-a42a-4fcf-bc35-dc5ae3780674 req-3a69e57f-11e0-401e-adfc-133b02c742d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032710 Oct 17 13:44:06.401036 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3842/7377] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:06.988288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:06.988918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:06.995801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:06.996296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:06.996742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:06.997442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:06.997902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:06.998369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:07.390445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:07.398369 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1f0d314a-f2dc-472f-b63e-861fb4cf63ea tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1318 microversion: 2.1 time: 0.415087 Oct 17 13:44:07.398961 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3536/7378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:06 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:08.422467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:08.423207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:08.430056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:08.430577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:08.431025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:08.431730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:08.432190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:08.432620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:08.568308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:08.576025 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a2c2dd66-d561-46f8-bd87-e9aa0f941e83 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1318 microversion: 2.1 time: 0.158832 Oct 17 13:44:08.576597 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3843/7379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:08 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:09.598948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:09.599586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:09.607288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:09.607791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:09.608307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:09.609069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:09.609541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:09.610016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:09.747036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:09.755680 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1449f989-af5f-44cc-9576-e81e8e3555e7 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1318 microversion: 2.1 time: 0.160241 Oct 17 13:44:09.756386 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3537/7380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:09 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:10.779567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:10.780182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:10.787072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.787557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.788816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.789628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.790091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.790551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.926009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:10.934515 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b40732c-c53a-4497-8b46-eca2638effab tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1318 microversion: 2.1 time: 0.158811 Oct 17 13:44:10.935108 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3844/7381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:10 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:11.641781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-57e0982f-bc12-40d5-84ef-50fac102db6d req-b8a2a83b-fe9c-49e5-9338-c620eec75cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7f8ed7-ce82-4349-9dbd-68b73e8b303a", "name": "network-vif-plugged", "status": "completed", "tag": "16c8706d-5845-4b47-9c22-475c2a58ff2b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:11.652246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-57e0982f-bc12-40d5-84ef-50fac102db6d req-b8a2a83b-fe9c-49e5-9338-c620eec75cd3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:11.652749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-57e0982f-bc12-40d5-84ef-50fac102db6d req-b8a2a83b-fe9c-49e5-9338-c620eec75cd3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:11.653204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-57e0982f-bc12-40d5-84ef-50fac102db6d req-b8a2a83b-fe9c-49e5-9338-c620eec75cd3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:11.665561 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-57e0982f-bc12-40d5-84ef-50fac102db6d req-b8a2a83b-fe9c-49e5-9338-c620eec75cd3 service nova] Creating event network-vif-plugged:16c8706d-5845-4b47-9c22-475c2a58ff2b for instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a on n-h1-853316-12 Oct 17 13:44:11.670858 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-57e0982f-bc12-40d5-84ef-50fac102db6d req-b8a2a83b-fe9c-49e5-9338-c620eec75cd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Oct 17 13:44:11.671619 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3538/7382] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:11.957777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:11.958433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:11.966502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:11.966983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:11.967415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:11.968117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:11.968563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:11.968983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:12.102847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:12.110739 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9d758278-f7f1-41ad-9178-bd3e5e4f42ef tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1318 microversion: 2.1 time: 0.157248 Oct 17 13:44:12.111312 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3845/7383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:11 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:13.130267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:13.135774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:13.136512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:13.143028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:13.143525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:13.143979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:13.144686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:13.145162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:13.145604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:13.280839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.288697 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-43b4bd3e-0e13-4020-896f-93d3ea652018 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1318 microversion: 2.1 time: 0.159506 Oct 17 13:44:13.289820 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3539/7384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:13 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:14.312282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:14.312884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:14.314960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:14.315617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:14.323216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.323905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.324123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.324823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.325269 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.325689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.459327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.467257 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-863eb20c-ce1b-4510-b25c-1d42a60e890a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1508 microversion: 2.1 time: 0.158919 Oct 17 13:44:14.467844 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3846/7385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:14 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:14.488818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:14.489442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:14.496897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.497394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.497849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.498589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.499067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.499508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.632177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.640539 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-749676ca-90ad-4a49-820b-1274fb60a499 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1508 microversion: 2.1 time: 0.155637 Oct 17 13:44:14.641107 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3540/7386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:14 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:14.662534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:14.665403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:14.671443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.671922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.672357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.673041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.673493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.673910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.703773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.709253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Old instance type m1.heat2, new instance type m1.heat {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:44:14.716243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:14.716661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:14.717133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:14.717536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:14.717941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:14.734012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:14.782895 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90a8dcf1-035d-496f-9321-1475dead84ae tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "POST /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a/action" status: 202 len: 0 microversion: 2.1 time: 0.124178 Oct 17 13:44:14.783593 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3847/7387] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:44:14 2022] POST /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:44:14.792060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:14.792688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:14.798788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.799196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.799587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.800299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.800763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.801204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.806126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:14.936599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.944565 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5b73ac3-0cfb-4b08-9841-18e41bce984c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1515 microversion: 2.1 time: 0.156828 Oct 17 13:44:14.945307 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3541/7388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:14 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:15.969820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:15.970542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:15.977578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:15.978323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:15.978771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:15.979647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:15.980108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:15.980540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.123521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:16.131472 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee66bf1c-9e71-47cb-919b-edc41f60b7b4 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1515 microversion: 2.1 time: 0.166453 Oct 17 13:44:16.132049 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3848/7389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:15 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:17.156142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:17.156768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:17.163362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:17.164150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:17.164806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:17.165556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:17.166043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:17.166538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:17.300157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.308141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a556b734-c736-44b8-82ba-200a8d37884a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.156589 Oct 17 13:44:17.308717 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3542/7390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:17 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:18.331868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:18.332479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:18.340030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.340513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.340953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.341678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.342134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.342594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.479329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:18.487186 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-efe7e2a8-5815-45d4-9e7e-1c539353d72a tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.159664 Oct 17 13:44:18.487767 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3849/7391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:18 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:19.510615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:19.511238 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:19.518026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:19.518561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:19.519017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:19.519720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:19.520184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:19.520622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:19.651751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:19.659520 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4bf3cc35-30af-453b-9ee0-2b9bf503f437 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.153485 Oct 17 13:44:19.660085 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3543/7392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:19 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:20.682180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:20.682776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:20.689638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:20.690124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:20.690593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:20.691290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:20.691750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:20.692180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:20.822760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:20.831022 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91d4014e-27ff-43ac-b745-743e490b5520 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.153006 Oct 17 13:44:20.831592 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3850/7393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:20 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:21.856432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:21.857179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:21.864355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:21.864862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:21.865323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:21.866047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:21.866547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:21.866997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:21.997224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.004948 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8e802e36-3055-44d8-8451-389e38edbd22 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.153708 Oct 17 13:44:22.005521 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3544/7394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:21 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:23.029077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:23.030370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:23.037477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:23.037955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:23.038415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:23.039650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:23.040107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:23.040530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:23.175340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:23.183493 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86da2f5f-4484-4645-aa36-c79db5adf4f8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.159067 Oct 17 13:44:23.184071 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3851/7395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:23 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:24.207870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:24.208503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:24.216400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:24.216914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:24.217377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:24.218100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:24.218603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:24.219055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:24.356135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:24.363922 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7eb9e73-cf76-4782-80af-57458b3da63e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.160098 Oct 17 13:44:24.364485 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3545/7396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:24 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:25.387355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:25.388001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:25.395095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.395586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.396025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.396736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.397221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.397644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.531542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.539635 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-35107b9d-931f-49e5-91dd-6472dd8b04cd tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.156771 Oct 17 13:44:25.540235 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3852/7397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:25 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:26.562961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:26.563587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:26.570377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:26.570877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:26.571326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:26.572348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:26.572876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:26.573399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:27.068576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.076498 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1dc26ea2-7669-4c43-be4d-e865006a8baa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.517497 Oct 17 13:44:27.077073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3546/7398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:26 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:28.100399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:28.100967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:28.104051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:28.117305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:28.117808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:28.118287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:28.119187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:28.119650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:28.120087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:28.266205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:28.274023 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-84b5a365-5861-4dbc-8d35-2903af40c948 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.177699 Oct 17 13:44:28.274627 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3853/7399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:28 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:29.297001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:29.297615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:29.300169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:29.305744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:29.306510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:29.306997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:29.307717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:29.308188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:29.308639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:29.439997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:29.448144 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-575b49b2-32a4-48bd-9a90-ad6386ed7567 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.155149 Oct 17 13:44:29.448707 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3547/7400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:29 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:30.471210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:30.471844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:30.479036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.479515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.479949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.480639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.481087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.481510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.613921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:30.622438 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d508a90-d56b-48a3-89e8-48476542b12e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.155159 Oct 17 13:44:30.623002 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3854/7401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:30 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:31.646350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:31.646979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:31.653910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.654440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.654900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.655615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.656086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.656531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.793302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.801040 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-849358b2-c959-4cb1-ab47-2888f93d1cb8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.158742 Oct 17 13:44:31.801611 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3548/7402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:31 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:32.825961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:32.826581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:32.834141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.834654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.835085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.835785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.836232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.836653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.974764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:32.983179 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1f8b72e6-0f6c-4092-87af-a964978a3ad9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.161861 Oct 17 13:44:32.983760 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3855/7403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:32 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:34.007050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:34.007682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:34.014840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.015344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.015809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.016525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.016995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.017440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.150658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:34.169747 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b516d9c5-1940-4304-bb3c-c99060a52044 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.166537 Oct 17 13:44:34.170355 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3549/7404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:34 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:35.192985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:35.193601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:35.201079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.201570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.202017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.202745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.203481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.203896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.342040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:35.349921 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-72ee49f5-07f1-421a-a73c-524a2db0498b tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.160942 Oct 17 13:44:35.350519 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3856/7405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:35 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:36.373087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:36.373748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:36.380820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.381302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.381749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.382481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.382954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.383389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.516749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.524554 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fba4c5f8-25f6-4075-9486-d63db637ac88 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.155471 Oct 17 13:44:36.525204 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3550/7406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:36 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:37.547769 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:37.548386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:37.555536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.556159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.556603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.557305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.557767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.558220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.687858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:37.695690 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31f6be1f-f7cd-4832-89cc-6b0daaee6c87 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.151903 Oct 17 13:44:37.696259 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3857/7407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:37 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:38.719818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:38.720514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:38.728286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:38.728831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:38.729295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:38.730047 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:38.730550 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:38.731025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:38.864461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.872468 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-16feaf04-515f-49b4-81c2-9bc554420774 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.156668 Oct 17 13:44:38.873045 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3551/7408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:38 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:39.895170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:39.895783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:39.903565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.904053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.904501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.905201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.905663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.906096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.042233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:40.049978 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-856ad7d1-e6d5-4dfd-8c5f-1ca9d6475534 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.158728 Oct 17 13:44:40.050578 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3858/7409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:39 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:41.073197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:41.073815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:41.080857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.081358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.081809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.082543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.083011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.083448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.224717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:41.233316 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5654066-b6c0-4583-8c87-51c460f3c287 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.164741 Oct 17 13:44:41.233908 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3552/7410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:41 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:42.256852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:42.257452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:42.264916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:42.265392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:42.265830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:42.266550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:42.267000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:42.267423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:42.406348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:42.416846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8a5feb21-fd34-4d20-855e-d4744433312e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.163975 Oct 17 13:44:42.417622 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3859/7411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:42 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:43.440346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:43.441002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:43.448874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.449374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.449830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.450587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.451066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.451508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.582789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.591245 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c3c313c9-f1a2-4210-99f3-be9405088ecb tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1520 microversion: 2.1 time: 0.154753 Oct 17 13:44:43.591864 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3553/7412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:43 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:44.614997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:44.615707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:44.622673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.623154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.623586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.624278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.624732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.625153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.678509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7527bc0b-1d32-4a68-aca1-9f30e631cb70 req-6ad26fd7-6e3a-4193-906a-6657761d9f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7f8ed7-ce82-4349-9dbd-68b73e8b303a", "name": "network-vif-unplugged", "status": "completed", "tag": "16c8706d-5845-4b47-9c22-475c2a58ff2b"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:44.689698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7527bc0b-1d32-4a68-aca1-9f30e631cb70 req-6ad26fd7-6e3a-4193-906a-6657761d9f2f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.690235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7527bc0b-1d32-4a68-aca1-9f30e631cb70 req-6ad26fd7-6e3a-4193-906a-6657761d9f2f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.690699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7527bc0b-1d32-4a68-aca1-9f30e631cb70 req-6ad26fd7-6e3a-4193-906a-6657761d9f2f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.704200 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7527bc0b-1d32-4a68-aca1-9f30e631cb70 req-6ad26fd7-6e3a-4193-906a-6657761d9f2f service nova] Creating event network-vif-unplugged:16c8706d-5845-4b47-9c22-475c2a58ff2b for instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a on n-h2-853316-12 Oct 17 13:44:44.709954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-7527bc0b-1d32-4a68-aca1-9f30e631cb70 req-6ad26fd7-6e3a-4193-906a-6657761d9f2f service nova] Instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:44:44.728894 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7527bc0b-1d32-4a68-aca1-9f30e631cb70 req-6ad26fd7-6e3a-4193-906a-6657761d9f2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053431 Oct 17 13:44:44.729879 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3554/7413] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:44.770899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.773231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:44.781040 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65478101-ca4a-4486-ae86-800452e95444 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1519 microversion: 2.1 time: 0.169928 Oct 17 13:44:44.781855 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3860/7414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:44 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:45.806532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:45.807244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:45.813428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:45.813926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:45.814403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:45.815277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:45.815744 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:45.816185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:45.818878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=81 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:45.957657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:45.965991 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09e99dd2-0c5b-43eb-b812-5b4484da4807 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1517 microversion: 2.1 time: 0.164897 Oct 17 13:44:45.966623 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3555/7415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:45 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:46.749721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a4ebf911-095a-4c20-bb4e-83e503543381 req-3465f2b4-69ad-4c6d-86c4-e8650929ac42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca7f8ed7-ce82-4349-9dbd-68b73e8b303a", "tag": "16c8706d-5845-4b47-9c22-475c2a58ff2b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:46.761446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a4ebf911-095a-4c20-bb4e-83e503543381 req-3465f2b4-69ad-4c6d-86c4-e8650929ac42 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.761933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a4ebf911-095a-4c20-bb4e-83e503543381 req-3465f2b4-69ad-4c6d-86c4-e8650929ac42 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.762400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a4ebf911-095a-4c20-bb4e-83e503543381 req-3465f2b4-69ad-4c6d-86c4-e8650929ac42 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.774669 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a4ebf911-095a-4c20-bb4e-83e503543381 req-3465f2b4-69ad-4c6d-86c4-e8650929ac42 service nova] Creating event network-changed:16c8706d-5845-4b47-9c22-475c2a58ff2b for instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a on n-h2-853316-12 Oct 17 13:44:46.780033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-a4ebf911-095a-4c20-bb4e-83e503543381 req-3465f2b4-69ad-4c6d-86c4-e8650929ac42 service nova] Instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:44:46.791798 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a4ebf911-095a-4c20-bb4e-83e503543381 req-3465f2b4-69ad-4c6d-86c4-e8650929ac42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046504 Oct 17 13:44:46.792399 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3861/7416] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:46.989853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:46.990460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:46.998435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.998942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.999398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.000143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.000593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.001435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.318921 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:47.330968 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c61cbb1b-bb77-400a-a638-0e9433a548fa tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1517 microversion: 2.1 time: 0.345647 Oct 17 13:44:47.331560 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3556/7417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:46 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:48.361076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:48.361774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:48.368726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.369379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.369734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.370462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.370920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.371350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.518259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.526962 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-acefecae-c39e-4a68-9b03-bdef017ee717 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1514 microversion: 2.1 time: 0.171163 Oct 17 13:44:48.527556 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3862/7418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:48 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:48.550342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:48.550911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:48.558713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.559223 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.559887 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.560632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.561102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.561548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.625524 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0d845512-4d5b-430c-a9e4-110a519f49d8 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "POST /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a/action" status: 204 len: 0 microversion: 2.1 time: 0.078955 Oct 17 13:44:48.626362 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3557/7419] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:44:48 2022] POST /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:48.635322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:48.636107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:48.642719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.643267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.644005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.644770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.645424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.646073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.808130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.817566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8c78d28a-f348-47e8-9182-df9c354a0041 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1514 microversion: 2.1 time: 0.186837 Oct 17 13:44:48.818206 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3863/7420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:48 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:49.843158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:49.843883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:49.850121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.850655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.851117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.851831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.852304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.852756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.992818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:50.001666 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ceeb2e8b-fae9-441c-ab5f-b88f268b45ec tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1514 microversion: 2.1 time: 0.164437 Oct 17 13:44:50.002266 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3558/7421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:49 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:50.715013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-27a97d8e-f89a-455c-9fb8-95f66276f701 req-ed13af15-8cc1-4775-904b-335af3a7759e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7f8ed7-ce82-4349-9dbd-68b73e8b303a", "name": "network-vif-plugged", "status": "completed", "tag": "16c8706d-5845-4b47-9c22-475c2a58ff2b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:50.727794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-27a97d8e-f89a-455c-9fb8-95f66276f701 req-ed13af15-8cc1-4775-904b-335af3a7759e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.728303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-27a97d8e-f89a-455c-9fb8-95f66276f701 req-ed13af15-8cc1-4775-904b-335af3a7759e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.728929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-27a97d8e-f89a-455c-9fb8-95f66276f701 req-ed13af15-8cc1-4775-904b-335af3a7759e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.742539 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-27a97d8e-f89a-455c-9fb8-95f66276f701 req-ed13af15-8cc1-4775-904b-335af3a7759e service nova] Creating event network-vif-plugged:16c8706d-5845-4b47-9c22-475c2a58ff2b for instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a on n-h2-853316-12 Oct 17 13:44:50.748131 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-27a97d8e-f89a-455c-9fb8-95f66276f701 req-ed13af15-8cc1-4775-904b-335af3a7759e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038413 Oct 17 13:44:50.748767 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3864/7422] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:51.025369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.026025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.033894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.034435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.034892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.035615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.036091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.036530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.177329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.191343 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f101efc7-c651-461d-9a26-ed7a341743f3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1506 microversion: 2.1 time: 0.169720 Oct 17 13:44:51.192401 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3559/7423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:51.215882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.216572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.222997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.223506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.223940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.224633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.225078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.225505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.368306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.376707 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b65c6c64-8ad2-4753-8296-ee5008a34c0e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1506 microversion: 2.1 time: 0.165796 Oct 17 13:44:51.377302 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3865/7424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:51.399131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.399762 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.407228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.407729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.408181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.413284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.413284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.413284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.545061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.552824 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a007a05-e9a6-452a-9351-6f19e098c7d3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1506 microversion: 2.1 time: 0.157680 Oct 17 13:44:51.553395 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3560/7425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:51.575865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.576283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.582747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.583225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.583661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.584352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.584800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.585218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.611291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:51.687881 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5bf44f6d-8426-499b-8050-ba8168d3a132 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 204 len: 0 microversion: 2.1 time: 0.116297 Oct 17 13:44:51.688701 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3866/7426] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:51 2022] DELETE /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:51.707291 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.707806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.713868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.714520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.715013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.715721 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.716188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.716626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.745749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:51.793797 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.compute.api [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Instance is already in deleting state, ignoring this request Oct 17 13:44:51.794681 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d20f5308-6fe4-41f8-acb2-f76b1a098fa3 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 204 len: 0 microversion: 2.1 time: 0.091598 Oct 17 13:44:51.795248 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3561/7427] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:51 2022] DELETE /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:51.803925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.804726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.812614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.813140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.813591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.814341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.815042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.815259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.948285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.957621 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5e297cb5-d089-483e-86a3-59385681688f tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1512 microversion: 2.1 time: 0.157953 Oct 17 13:44:51.958217 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3867/7428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:52.981259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.982013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:52.989031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.989528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.989980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.990718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.991185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.991622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.222638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33886d344ba541678b034ecb49334543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1f283002ce44918989603565f9dab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:53.232180 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15c9e80a-d1a3-4630-9d88-126d2e950bb9 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 200 len: 1512 microversion: 2.1 time: 0.255248 Oct 17 13:44:53.232776 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3562/7429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:53.563948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6b76e44c-6da4-42ca-af03-0d7e4da002d8 req-78489baa-9ff6-4f1e-9f53-945427032061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca7f8ed7-ce82-4349-9dbd-68b73e8b303a", "name": "network-vif-deleted", "tag": "16c8706d-5845-4b47-9c22-475c2a58ff2b"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:53.576880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6b76e44c-6da4-42ca-af03-0d7e4da002d8 req-78489baa-9ff6-4f1e-9f53-945427032061 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.577519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6b76e44c-6da4-42ca-af03-0d7e4da002d8 req-78489baa-9ff6-4f1e-9f53-945427032061 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.578029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6b76e44c-6da4-42ca-af03-0d7e4da002d8 req-78489baa-9ff6-4f1e-9f53-945427032061 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.591822 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6b76e44c-6da4-42ca-af03-0d7e4da002d8 req-78489baa-9ff6-4f1e-9f53-945427032061 service nova] Creating event network-vif-deleted:16c8706d-5845-4b47-9c22-475c2a58ff2b for instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a on n-h2-853316-12 Oct 17 13:44:53.597954 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6b76e44c-6da4-42ca-af03-0d7e4da002d8 req-78489baa-9ff6-4f1e-9f53-945427032061 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037654 Oct 17 13:44:53.598901 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3868/7430] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:44:54.255379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:54.255992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: ca7f8ed7-ce82-4349-9dbd-68b73e8b303a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:54.263616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.264125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.264592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.265307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.265781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.266262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.280765 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] HTTP exception thrown: Instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a could not be found. Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Request method failure captured: Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a HTTP/1.1 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVvxT7VR_aJWwFUvG-sZ7uLGFvM1Mf-Ow1ToXh9_YndWgfEToxLqFY3la_qOk3rYDPo7qhPiSX4hO6t3YTTVh1OeupgdjTnQLZd57XWej9JrPgE4HKMnts8ZT960pslbvv7uemylgAjB_jo2FTJH1dEyXskPH7qnsCNte6BPM4t4HB4 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ea1f283002ce44918989603565f9dab3 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ea1f283002ce44918989603565f9dab3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ea1f283002ce44918989603565f9dab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ea1f283002ce44918989603565f9dab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ea1f283002ce44918989603565f9dab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ea1f283002ce44918989603565f9dab3 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerDiskConfigTestJSON-1652458933-project Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 33886d344ba541678b034ecb49334543 Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerDiskConfigTestJSON-1652458933-project Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a could not be found. Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'ca7f8ed7-ce82-4349-9dbd-68b73e8b303a'} Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a could not be found. Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a could not be found. Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:54.282548 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a could not be found. Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Returning 404 to user: Instance ca7f8ed7-ce82-4349-9dbd-68b73e8b303a could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-70ada122-d86b-4cca-b36c-2a45935f443e tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a" status: 404 len: 111 microversion: 2.1 time: 0.032698 Oct 17 13:44:54.290014 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3563/7431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:54 2022] GET /compute/v2.1/servers/ca7f8ed7-ce82-4349-9dbd-68b73e8b303a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:44:54.293664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25c0b7ac-ce34-464f-b14b-5729e1ca10c5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '.version_select at 0x7fa8213f9790>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:54.318309 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25c0b7ac-ce34-464f-b14b-5729e1ca10c5 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450032422" status: 202 len: 0 microversion: 2.1 time: 0.028976 Oct 17 13:44:54.318891 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3869/7432] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 13:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450032422 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:44:54.940192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:54.940712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:54.947992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.947992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.947992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.949213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.949684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.950128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.965047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] HTTP exception thrown: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Request method failure captured: Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 HTTP/1.1 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVvxT7VR_aJWwFUvG-sZ7uLGFvM1Mf-Ow1ToXh9_YndWgfEToxLqFY3la_qOk3rYDPo7qhPiSX4hO6t3YTTVh1OeupgdjTnQLZd57XWej9JrPgE4HKMnts8ZT960pslbvv7uemylgAjB_jo2FTJH1dEyXskPH7qnsCNte6BPM4t4HB4 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: ea1f283002ce44918989603565f9dab3 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ea1f283002ce44918989603565f9dab3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ea1f283002ce44918989603565f9dab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ea1f283002ce44918989603565f9dab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ea1f283002ce44918989603565f9dab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: ea1f283002ce44918989603565f9dab3 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerDiskConfigTestJSON-1652458933-project Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 33886d344ba541678b034ecb49334543 Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerDiskConfigTestJSON-1652458933-project Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '9b2adb23-d0fa-4615-b708-1214ca0f6b05'} Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:54.966656 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Returning 404 to user: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-415cfd86-8ed0-4b4b-894a-d727c7e23233 tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 404 len: 111 microversion: 2.1 time: 0.031969 Oct 17 13:44:54.970500 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3564/7433] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:54 2022] DELETE /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:44:54.978756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:54.979724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] [instance: 9b2adb23-d0fa-4615-b708-1214ca0f6b05] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:54.992997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.993496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.993976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.994695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.995232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.995668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.009766 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] HTTP exception thrown: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Request method failure captured: Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 HTTP/1.1 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVvxT7VR_aJWwFUvG-sZ7uLGFvM1Mf-Ow1ToXh9_YndWgfEToxLqFY3la_qOk3rYDPo7qhPiSX4hO6t3YTTVh1OeupgdjTnQLZd57XWej9JrPgE4HKMnts8ZT960pslbvv7uemylgAjB_jo2FTJH1dEyXskPH7qnsCNte6BPM4t4HB4 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: ea1f283002ce44918989603565f9dab3 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ea1f283002ce44918989603565f9dab3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ea1f283002ce44918989603565f9dab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ea1f283002ce44918989603565f9dab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ea1f283002ce44918989603565f9dab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: ea1f283002ce44918989603565f9dab3 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1652458933 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerDiskConfigTestJSON-1652458933-project Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 33886d344ba541678b034ecb49334543 Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerDiskConfigTestJSON-1652458933-project Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9b2adb23-d0fa-4615-b708-1214ca0f6b05'} Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:55.012001 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] Returning 404 to user: Instance 9b2adb23-d0fa-4615-b708-1214ca0f6b05 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-162822f7-fea0-48a4-bea0-f016b9271a8c tempest-ServerDiskConfigTestJSON-1652458933 tempest-ServerDiskConfigTestJSON-1652458933-project] 10.222.0.27 "GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05" status: 404 len: 111 microversion: 2.1 time: 0.040212 Oct 17 13:44:55.016504 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3870/7434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:54 2022] GET /compute/v2.1/servers/9b2adb23-d0fa-4615-b708-1214ca0f6b05 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:04.551924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d4db96c6-6011-4b06-80c0-1f534a3b1893 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'create', calling method: .version_select at 0x7fa81bbfc5e0>, body: {"keypair": {"name": "tempest-keypair-1889155957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdo78w/CJw90LFTed3BTNNbIeVpobJ5UosnIyZXLZTFlwOxeY0hT5eyVeWUTZnS3PfZk7nbw013Io/uVzqqOWTRYIEaQsDHVNmz/kVFnZHz7qVgGFgn/gEi6FeTJ2ptrg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:04.561363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=36 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:04.571826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d4db96c6-6011-4b06-80c0-1f534a3b1893 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for project 10b6a534a0584ac5a5b1041188f25290. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:04.579111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d4db96c6-6011-4b06-80c0-1f534a3b1893 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for user e9d88c6d47404b2d8ef7eb4325be60d1 and project 10b6a534a0584ac5a5b1041188f25290. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:04.614605 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d4db96c6-6011-4b06-80c0-1f534a3b1893 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.219971 Oct 17 13:45:04.615207 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3565/7435] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:06.044929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1571014183", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac2470be-3750-4f94-8152-7da5178f1b2b"}], "security_groups": [{"name": "tempest-securitygroup--757939450"}], "key_name": "tempest-keypair-1889155957", "user_data": "}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:06.054541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:06.055595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:06.329629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] validate_networks() for [('ac2470be-3750-4f94-8152-7da5178f1b2b', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:06.836433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:06.836974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:06.837539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:06.837956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:06.838420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:06.848249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.848732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.849165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.849894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.850382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.850808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.868120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for project 10b6a534a0584ac5a5b1041188f25290. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:06.874045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for user e9d88c6d47404b2d8ef7eb4325be60d1 and project 10b6a534a0584ac5a5b1041188f25290. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:06.887942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:45:06.890336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:45:06.938836 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d45e31fb-0aae-4029-98b5-b4484e8e664b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.900850 Oct 17 13:45:06.945637 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3871/7436] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:45:06.947569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:06.953454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8a97853-9a63-420b-909e-7913cb9b6f5f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:06.954095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f8a97853-9a63-420b-909e-7913cb9b6f5f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:07.093661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f8a97853-9a63-420b-909e-7913cb9b6f5f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:07.101901 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8a97853-9a63-420b-909e-7913cb9b6f5f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1239 microversion: 2.1 time: 0.154978 Oct 17 13:45:07.111235 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3566/7437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:06 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1239 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:08.126257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:08.127464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:08.136174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:08.137014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:08.137727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:08.144695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:08.145414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:08.145961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:08.221161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:08.230535 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e01ee454-dd1f-4a63-bdf8-c410ce92151d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1309 microversion: 2.1 time: 0.108442 Oct 17 13:45:08.238228 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3872/7438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:08 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:09.253218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:09.253868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:09.265825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.266564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.267037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.267785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.268259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.268927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.794084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:09.802008 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-795be33e-d7d3-4e22-8d1a-a1e9c4973977 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1364 microversion: 2.1 time: 0.552917 Oct 17 13:45:09.802712 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3567/7439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:09 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1364 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:09.943192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e4274aca-2057-4ba0-bfa0-de3ca7c63cda req-67746f2b-7f52-4dd4-b6b6-1898a667a667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba11b20-f74c-4424-8b6b-69d9aab38f12", "tag": "39b4c1c9-bdff-4706-ba31-5c88a2f4e069"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:09.955250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4274aca-2057-4ba0-bfa0-de3ca7c63cda req-67746f2b-7f52-4dd4-b6b6-1898a667a667 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.955733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4274aca-2057-4ba0-bfa0-de3ca7c63cda req-67746f2b-7f52-4dd4-b6b6-1898a667a667 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.956161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e4274aca-2057-4ba0-bfa0-de3ca7c63cda req-67746f2b-7f52-4dd4-b6b6-1898a667a667 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.968021 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e4274aca-2057-4ba0-bfa0-de3ca7c63cda req-67746f2b-7f52-4dd4-b6b6-1898a667a667 service nova] Creating event network-changed:39b4c1c9-bdff-4706-ba31-5c88a2f4e069 for instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 on n-h2-853316-12 Oct 17 13:45:09.973088 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e4274aca-2057-4ba0-bfa0-de3ca7c63cda req-67746f2b-7f52-4dd4-b6b6-1898a667a667 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033767 Oct 17 13:45:09.973881 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3873/7440] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:10.825473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:10.826103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:10.833319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:10.833821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:10.834300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:10.835011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:10.835475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:10.836001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:10.969858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:10.977947 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-deef3ddc-2e4a-43c0-be1f-30d270ed8777 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1364 microversion: 2.1 time: 0.156904 Oct 17 13:45:10.978560 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3568/7441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:10 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:12.002228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:12.002935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:12.009199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:12.009688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:12.010132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:12.011050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:12.011465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:12.011892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:12.146614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:12.155816 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b5e2fd30-1bc5-47a9-9cc5-c7703a3b765e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1364 microversion: 2.1 time: 0.158963 Oct 17 13:45:12.156396 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3874/7442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:11 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:13.178074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:13.178624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:13.186355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.186852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.187301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.188012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.188476 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.188915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.327974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:13.336112 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-91165245-e348-4991-b697-3377f97eb728 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1364 microversion: 2.1 time: 0.162047 Oct 17 13:45:13.336704 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3569/7443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:13 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:14.359990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:14.360642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:14.368433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.368966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.369744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.370214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.370701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.371140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.511781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:14.519894 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e92cc2dc-03c4-44e6-833a-8c0c6bcc45a6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1364 microversion: 2.1 time: 0.163833 Oct 17 13:45:14.520481 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3875/7444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:14 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:14.830760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-43897f69-8f67-42bc-9960-dbc53da658b4 req-c8ed2c67-a21b-40ad-8053-0844bc55f006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba11b20-f74c-4424-8b6b-69d9aab38f12", "name": "network-vif-plugged", "status": "completed", "tag": "39b4c1c9-bdff-4706-ba31-5c88a2f4e069"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:14.843983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-43897f69-8f67-42bc-9960-dbc53da658b4 req-c8ed2c67-a21b-40ad-8053-0844bc55f006 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.844485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-43897f69-8f67-42bc-9960-dbc53da658b4 req-c8ed2c67-a21b-40ad-8053-0844bc55f006 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.844947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-43897f69-8f67-42bc-9960-dbc53da658b4 req-c8ed2c67-a21b-40ad-8053-0844bc55f006 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.856717 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-43897f69-8f67-42bc-9960-dbc53da658b4 req-c8ed2c67-a21b-40ad-8053-0844bc55f006 service nova] Creating event network-vif-plugged:39b4c1c9-bdff-4706-ba31-5c88a2f4e069 for instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 on n-h2-853316-12 Oct 17 13:45:14.861835 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-43897f69-8f67-42bc-9960-dbc53da658b4 req-c8ed2c67-a21b-40ad-8053-0844bc55f006 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035316 Oct 17 13:45:14.862485 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3570/7445] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:15.543745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:15.544350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:15.551351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.551835 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.552280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.552972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.553420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.553841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.686700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:15.694727 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e4c8ee7-8add-4277-8ffc-5a8ad7190f4c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1364 microversion: 2.1 time: 0.155598 Oct 17 13:45:15.695311 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3876/7446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:15 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:16.720582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:16.721317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:16.729194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.729700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.730176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.731021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.731573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.732085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.874707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:16.882641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17c3f7ea-cc55-4cb2-b721-6adf4ede3455 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1551 microversion: 2.1 time: 0.167804 Oct 17 13:45:16.883219 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3571/7447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:16 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:16.906365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:16.906951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:16.909831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:16.910531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:16.916333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.916828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.917267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.917963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.918454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.918880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.999620 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3a2a8714-081a-4582-9f1c-a28195081c70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097979 Oct 17 13:45:17.000265 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3877/7448] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:45:16 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:17.962255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:18.027593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9620d902-433b-41fe-89ca-e1ac8b2ea627 req-9d08a267-3e7c-493e-8baf-b842cb637d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba11b20-f74c-4424-8b6b-69d9aab38f12", "tag": "39b4c1c9-bdff-4706-ba31-5c88a2f4e069"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:18.038135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9620d902-433b-41fe-89ca-e1ac8b2ea627 req-9d08a267-3e7c-493e-8baf-b842cb637d2b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.038661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9620d902-433b-41fe-89ca-e1ac8b2ea627 req-9d08a267-3e7c-493e-8baf-b842cb637d2b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.039108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9620d902-433b-41fe-89ca-e1ac8b2ea627 req-9d08a267-3e7c-493e-8baf-b842cb637d2b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:18.053193 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9620d902-433b-41fe-89ca-e1ac8b2ea627 req-9d08a267-3e7c-493e-8baf-b842cb637d2b service nova] Creating event network-changed:39b4c1c9-bdff-4706-ba31-5c88a2f4e069 for instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 on n-h2-853316-12 Oct 17 13:45:18.058638 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9620d902-433b-41fe-89ca-e1ac8b2ea627 req-9d08a267-3e7c-493e-8baf-b842cb637d2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100904 Oct 17 13:45:18.059255 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3572/7449] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:54.180785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:54.181675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=32 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:54.185982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:54.186621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:54.194348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.194833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.195277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.195972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.196427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.196854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.337657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:54.345925 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dd2d49a3-e0c3-4875-b425-2e029e7ce6d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1669 microversion: 2.1 time: 0.166969 Oct 17 13:45:54.346536 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3878/7450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:54 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:54.366544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:54.367311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=28 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:54.371831 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:54.373072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:54.381826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.382366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.382827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.383554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.384030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.384478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.523854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:54.532362 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-677ec752-d756-4e2e-9445-85e904e31a65 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1669 microversion: 2.1 time: 0.168113 Oct 17 13:45:54.532935 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3573/7451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:54 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:54.554442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:54.555051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:54.562122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.562633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.563067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.563781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.564231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.564654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.699914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:54.709927 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd17eea6-7756-463e-a5f1-13fca345ce57 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1669 microversion: 2.1 time: 0.159344 Oct 17 13:45:54.710544 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3879/7452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:54 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:54.732705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:54.735013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:54.741090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.741599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.742062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.742810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.743286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.743737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.819784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:54.825976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Old instance type m1.heat2, new instance type m1.heat {{(pid=127539) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:45:54.834192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:54.835200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:54.835200 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:54.835503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:54.835938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:54.950075 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3fb32079-90b4-4f1f-ab4e-5786bff6398d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12/action" status: 202 len: 0 microversion: 2.1 time: 0.222121 Oct 17 13:45:54.950915 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3574/7453] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:54 2022] POST /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:45:54.959505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:54.960391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:54.967532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.968028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.968469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.969173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.969629 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.970055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:55.131182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:55.139525 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ebcc9aeb-3057-4a83-97a5-0d971c3c05cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1678 microversion: 2.1 time: 0.183836 Oct 17 13:45:55.139917 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3880/7454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:54 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:56.163428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:56.164043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:56.171837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:56.172334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:56.172787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:56.173496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:56.173961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:56.174424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:56.389700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:56.397692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-137a7404-d732-4d2f-8686-931c046aa8cf tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1678 microversion: 2.1 time: 0.239035 Oct 17 13:45:56.408115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3575/7455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:56 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:57.423550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:57.424288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:57.431888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:57.432542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:57.432986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:57.433721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:57.434206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:57.434644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:57.597531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:57.605475 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac9517b0-3a5d-4ada-89ee-8ff5e64bed7b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.188102 Oct 17 13:45:57.606051 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3881/7456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:57 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:58.634375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:58.634924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:58.642247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:58.642753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:58.643210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:58.643929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:58.644400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:58.644844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:58.795607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:58.803636 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba4f8f0b-98c4-452c-b9ad-c023cb3baa77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.173499 Oct 17 13:45:58.804215 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3576/7457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:58 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:59.827365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:59.827984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:59.835287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.835780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.836219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.836928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.837509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.837819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.976663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:59.985564 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ee8bff92-bd7a-411d-9276-9a4935272372 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.162086 Oct 17 13:45:59.986398 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3882/7458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:59 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:01.010535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:01.011404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:01.020367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:01.021030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:01.021548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:01.022326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:01.022812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:01.023265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:01.159733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:01.169837 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7d49f049-3761-48fc-9d23-71c4eb89a151 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.164506 Oct 17 13:46:01.170637 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3577/7459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:01 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:02.193859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:02.194509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:02.201782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.202307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.202746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.203711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.204162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.204581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.358772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:02.367083 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b36d6af-03ec-4ba6-9ab8-fda147dd3748 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.177223 Oct 17 13:46:02.367689 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3883/7460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:02 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:03.392443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:03.393063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:03.399876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.400372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.400819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.401525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.401987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.402448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.544720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:03.552625 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-23da69e9-d6d0-45ff-96c5-41c024f5cec5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.165031 Oct 17 13:46:03.553211 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3578/7461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:03 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:04.575663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:04.576388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:04.584329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.584813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.585260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.585955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.586439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.586889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.718836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:04.726853 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3aa91587-c2ef-46c7-abf4-f86938d87619 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.155263 Oct 17 13:46:04.727442 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3884/7462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:04 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:05.751623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:05.752255 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:05.759615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.760120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.760570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.761285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.761748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.762203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.907751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:05.915605 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-17bfbb09-1ca2-48a7-a5b0-287126296a70 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.168971 Oct 17 13:46:05.916184 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3579/7463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:05 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:06.940924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:06.941515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:06.948455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:06.948943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:06.949382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:06.950071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:06.950563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:06.950989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.088304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:07.096345 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-61dabd2a-bdb3-4038-ad0f-8615f8d4e833 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.159916 Oct 17 13:46:07.096922 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3885/7464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:06 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:08.120224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:08.120856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:08.128254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:08.128786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:08.129233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:08.129936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:08.130437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:08.130879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:08.261810 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:08.270332 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fadabb57-bcec-4ff6-ac49-ef5e82af8e05 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1683 microversion: 2.1 time: 0.153966 Oct 17 13:46:08.270908 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3580/7465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:08 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:09.224095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b76b9d15-d543-4059-8f8f-d5cf7742d8a8 req-91190c8a-cd92-4b04-bc1a-3765bda7533b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba11b20-f74c-4424-8b6b-69d9aab38f12", "name": "network-vif-unplugged", "status": "completed", "tag": "39b4c1c9-bdff-4706-ba31-5c88a2f4e069"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:09.237850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b76b9d15-d543-4059-8f8f-d5cf7742d8a8 req-91190c8a-cd92-4b04-bc1a-3765bda7533b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:09.238401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b76b9d15-d543-4059-8f8f-d5cf7742d8a8 req-91190c8a-cd92-4b04-bc1a-3765bda7533b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:09.238842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b76b9d15-d543-4059-8f8f-d5cf7742d8a8 req-91190c8a-cd92-4b04-bc1a-3765bda7533b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:09.251082 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b76b9d15-d543-4059-8f8f-d5cf7742d8a8 req-91190c8a-cd92-4b04-bc1a-3765bda7533b service nova] Creating event network-vif-unplugged:39b4c1c9-bdff-4706-ba31-5c88a2f4e069 for instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 on n-h1-853316-12 Oct 17 13:46:09.257321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-b76b9d15-d543-4059-8f8f-d5cf7742d8a8 req-91190c8a-cd92-4b04-bc1a-3765bda7533b service nova] Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:46:09.270277 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b76b9d15-d543-4059-8f8f-d5cf7742d8a8 req-91190c8a-cd92-4b04-bc1a-3765bda7533b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050240 Oct 17 13:46:09.271124 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3886/7466] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:09.293083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:09.293800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:09.302366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:09.302957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:09.303421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:09.304150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:09.304620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:09.305063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:09.574049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:09.583185 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0824f38d-4397-4caf-bba9-463ccb6a5438 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1682 microversion: 2.1 time: 0.294030 Oct 17 13:46:09.583774 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3581/7467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:09 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:10.608688 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:10.609391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:10.617014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.617506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.617973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.618764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.619248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.619729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.753033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:10.760911 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ad542556-0b41-4d70-9a86-a8e85200c4d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1680 microversion: 2.1 time: 0.157140 Oct 17 13:46:10.761485 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3887/7468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:10 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:11.296482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-26b4ec13-9371-45e0-bc67-5dc8254e9c48 req-482f0a3b-b8ef-47f5-be5f-52b263416298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba11b20-f74c-4424-8b6b-69d9aab38f12", "tag": "39b4c1c9-bdff-4706-ba31-5c88a2f4e069"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:11.306809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-26b4ec13-9371-45e0-bc67-5dc8254e9c48 req-482f0a3b-b8ef-47f5-be5f-52b263416298 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:11.307308 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-26b4ec13-9371-45e0-bc67-5dc8254e9c48 req-482f0a3b-b8ef-47f5-be5f-52b263416298 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:11.307761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-26b4ec13-9371-45e0-bc67-5dc8254e9c48 req-482f0a3b-b8ef-47f5-be5f-52b263416298 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:11.319941 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-26b4ec13-9371-45e0-bc67-5dc8254e9c48 req-482f0a3b-b8ef-47f5-be5f-52b263416298 service nova] Creating event network-changed:39b4c1c9-bdff-4706-ba31-5c88a2f4e069 for instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 on n-h1-853316-12 Oct 17 13:46:11.325201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-26b4ec13-9371-45e0-bc67-5dc8254e9c48 req-482f0a3b-b8ef-47f5-be5f-52b263416298 service nova] Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:46:11.336995 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-26b4ec13-9371-45e0-bc67-5dc8254e9c48 req-482f0a3b-b8ef-47f5-be5f-52b263416298 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044743 Oct 17 13:46:11.337595 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3582/7469] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:46:11.784484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:11.785923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:11.794764 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:11.795783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:11.796318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:11.797125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:11.797594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:11.798028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:11.932279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:11.940918 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5475afe7-0921-4bbf-8015-dc417b8df74d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1680 microversion: 2.1 time: 0.160546 Oct 17 13:46:11.941488 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3888/7470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:11 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:12.965133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:12.965840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:12.972403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:12.972898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:12.973349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:12.974055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:12.974545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:12.974986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:13.187863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:13.196359 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b7570b66-d175-4985-a861-e0cc4368c407 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1680 microversion: 2.1 time: 0.236220 Oct 17 13:46:13.196938 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3583/7471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:12 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:14.221282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:14.221927 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:14.228913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.229421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.229853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.230580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.231030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.231455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.364288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:14.374486 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e83a07f5-eef9-4e87-8df4-635d0e6f1d31 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1677 microversion: 2.1 time: 0.158486 Oct 17 13:46:14.375067 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3889/7472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:14 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:14.397800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:14.398396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:14.405378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.405883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.406377 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.407096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.407560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.408028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.465536 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6ec0b907-4fd6-4be3-a6b1-af11a0c50403 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12/action" status: 204 len: 0 microversion: 2.1 time: 0.071566 Oct 17 13:46:14.466276 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3584/7473] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:14 2022] POST /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:46:14.475431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:14.476033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:14.482055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.482601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.483183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.484223 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.485481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.485949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.625700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:14.633981 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9fbb2a49-18ee-47ae-9bca-ceb2fb148fe7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1677 microversion: 2.1 time: 0.163250 Oct 17 13:46:14.642238 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3890/7474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:14 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:15.659058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:15.659775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:15.665770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:15.666483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:15.667191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:15.668035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:15.668354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:15.668798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:15.809144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:15.817788 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a73ae841-4981-43b0-a1c0-777c61d5c00b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1677 microversion: 2.1 time: 0.164694 Oct 17 13:46:15.818402 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3585/7475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:15 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:16.150251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f3c922fb-bb3e-498b-965d-36171a2df730 req-fdbc8238-5674-4df9-bc98-fd192030ca31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba11b20-f74c-4424-8b6b-69d9aab38f12", "name": "network-vif-plugged", "status": "completed", "tag": "39b4c1c9-bdff-4706-ba31-5c88a2f4e069"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:16.161298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f3c922fb-bb3e-498b-965d-36171a2df730 req-fdbc8238-5674-4df9-bc98-fd192030ca31 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:16.161777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f3c922fb-bb3e-498b-965d-36171a2df730 req-fdbc8238-5674-4df9-bc98-fd192030ca31 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:16.162252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f3c922fb-bb3e-498b-965d-36171a2df730 req-fdbc8238-5674-4df9-bc98-fd192030ca31 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:16.174137 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f3c922fb-bb3e-498b-965d-36171a2df730 req-fdbc8238-5674-4df9-bc98-fd192030ca31 service nova] Creating event network-vif-plugged:39b4c1c9-bdff-4706-ba31-5c88a2f4e069 for instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 on n-h1-853316-12 Oct 17 13:46:16.179147 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f3c922fb-bb3e-498b-965d-36171a2df730 req-fdbc8238-5674-4df9-bc98-fd192030ca31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033190 Oct 17 13:46:16.179738 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3891/7476] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:16.843267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:16.843809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:16.850370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:16.850868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:16.851321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:16.852026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:16.852493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:16.852935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:16.986493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:16.994171 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25cc2bda-02ab-4e84-af8f-55533de15315 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1669 microversion: 2.1 time: 0.155942 Oct 17 13:46:16.994744 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3586/7477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:16 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:17.017740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:17.018495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:17.024755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.025259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.025681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.026406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.026862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.027292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.166428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:17.175054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-248a0a87-c080-44e7-bf4a-0aeb7a8f0b29 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1669 microversion: 2.1 time: 0.162139 Oct 17 13:46:17.175637 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3892/7478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:17 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:17.198389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:17.199022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:17.206582 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.207085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.207539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.208286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.208750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.209186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.224407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:17.339641 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:17.347433 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-86aba7e1-0852-4c9f-8232-4030d5e83ea5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1669 microversion: 2.1 time: 0.153074 Oct 17 13:46:17.348001 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3587/7479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:17 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:17.369174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:17.369779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:17.376612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.377093 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.377525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.378239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.378691 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.379111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.405176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:46:17.455475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:17.484708 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-873cd9dd-e64e-4d66-ae78-940f0f295f39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 204 len: 0 microversion: 2.1 time: 0.118862 Oct 17 13:46:17.485401 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3893/7480] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:46:17 2022] DELETE /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:46:17.493773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:17.494430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:17.501343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.501842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.502342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.503056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.503527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.503968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.636628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:17.645396 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-efe2f400-0f0f-467b-8137-743512387515 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1675 microversion: 2.1 time: 0.155490 Oct 17 13:46:17.645960 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3588/7481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:17 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:18.669947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:18.671225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:18.678408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:18.678925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:18.679362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:18.680060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:18.680515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:18.680982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:18.815078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:18.823309 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-731f2229-e4e0-4e3f-afd9-cf9c14817467 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1675 microversion: 2.1 time: 0.157739 Oct 17 13:46:18.823892 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3894/7482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:18 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:19.834428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-fb11739a-ed76-4e22-ae7a-72c1e92ec1b4 req-cf4bf533-97fc-4d93-bb80-26d5382fd5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba11b20-f74c-4424-8b6b-69d9aab38f12", "name": "network-vif-deleted", "tag": "39b4c1c9-bdff-4706-ba31-5c88a2f4e069"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:19.849804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fb11739a-ed76-4e22-ae7a-72c1e92ec1b4 req-cf4bf533-97fc-4d93-bb80-26d5382fd5e9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:19.850751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fb11739a-ed76-4e22-ae7a-72c1e92ec1b4 req-cf4bf533-97fc-4d93-bb80-26d5382fd5e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:19.851444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-fb11739a-ed76-4e22-ae7a-72c1e92ec1b4 req-cf4bf533-97fc-4d93-bb80-26d5382fd5e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:19.855895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:19.856804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:19.864328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:19.864817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:19.865264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:19.865972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:19.866398 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-fb11739a-ed76-4e22-ae7a-72c1e92ec1b4 req-cf4bf533-97fc-4d93-bb80-26d5382fd5e9 service nova] Creating event network-vif-deleted:39b4c1c9-bdff-4706-ba31-5c88a2f4e069 for instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 on n-h1-853316-12 Oct 17 13:46:19.869263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:19.869737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:19.873389 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-fb11739a-ed76-4e22-ae7a-72c1e92ec1b4 req-cf4bf533-97fc-4d93-bb80-26d5382fd5e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047873 Oct 17 13:46:19.874655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3589/7483] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:19.943133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:19.951253 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b4f5d090-8539-4a89-af6e-464a040e970e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 200 len: 1324 microversion: 2.1 time: 0.109263 Oct 17 13:46:19.952583 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3895/7484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:19 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 1324 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:20.975069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:20.975833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:20.983907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:20.984459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:20.984919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:20.985637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:20.986141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:20.986613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:21.000052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 HTTP/1.1 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8ba11b20-f74c-4424-8b6b-69d9aab38f12'} Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:21.001839 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3baf3a0d-bc87-4560-b46d-9171875b0fbe tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 404 len: 111 microversion: 2.1 time: 0.032570 Oct 17 13:46:21.007555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3590/7485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:20 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:21.016246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:21.016860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:21.023689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:21.024176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:21.024617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:21.025318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:21.025774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:21.026241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:21.040590 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 HTTP/1.1 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '8ba11b20-f74c-4424-8b6b-69d9aab38f12'} Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:21.042260 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5c9b1fbd-2cc2-4885-8456-5ae4447cdda4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 404 len: 111 microversion: 2.1 time: 0.031502 Oct 17 13:46:21.047185 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3896/7486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:21 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:21.095207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-377433936", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "ac2470be-3750-4f94-8152-7da5178f1b2b"}], "security_groups": [{"name": "tempest-securitygroup--757939450"}], "key_name": "tempest-keypair-1889155957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:21.204598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] validate_networks() for [('ac2470be-3750-4f94-8152-7da5178f1b2b', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:46:21.588505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:46:21.589030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:46:21.589569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:46:21.590019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:46:21.590481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:46:21.599834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:21.600324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:21.600773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:21.601510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:21.601982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:21.602450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:21.619428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for project 10b6a534a0584ac5a5b1041188f25290. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:21.625477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for user e9d88c6d47404b2d8ef7eb4325be60d1 and project 10b6a534a0584ac5a5b1041188f25290. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:21.637712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:46:21.640302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:46:21.690261 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6927aa50-0311-47f8-94ef-6b402fd70cf7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.599130 Oct 17 13:46:21.691277 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3591/7487] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:46:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:46:21.703032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c8ad2a1-5e68-4c92-9773-b98d074394f4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:21.703974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c8ad2a1-5e68-4c92-9773-b98d074394f4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:21.764588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c8ad2a1-5e68-4c92-9773-b98d074394f4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:21.771915 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c8ad2a1-5e68-4c92-9773-b98d074394f4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1238 microversion: 2.1 time: 0.073024 Oct 17 13:46:21.772493 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3897/7488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:21 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:22.798222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:22.798861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:22.806995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:22.807494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:22.808127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:22.808842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:22.809506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:22.809948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:22.888033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:22.896908 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d4fde63-7f9d-455c-9e1f-71fe42ad2f72 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1296 microversion: 2.1 time: 0.105041 Oct 17 13:46:22.897465 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3592/7489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:22 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:23.924022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:23.924664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:23.932302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.932792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.933244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.933930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.934415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.934846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:24.069709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:24.078995 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56b46c5d-6abe-40f3-978f-3177fe7805db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1363 microversion: 2.1 time: 0.160876 Oct 17 13:46:24.079633 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3898/7490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:23 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:24.206144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-dd4a8cec-f8ba-4cd2-bb85-dc99ea9ae425 req-eae61e78-c9bd-4dda-aab8-9dc80f0eabde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7ddd2a-773f-4d76-bb64-3949c4b55f59", "tag": "ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:24.217485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd4a8cec-f8ba-4cd2-bb85-dc99ea9ae425 req-eae61e78-c9bd-4dda-aab8-9dc80f0eabde service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:24.218595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd4a8cec-f8ba-4cd2-bb85-dc99ea9ae425 req-eae61e78-c9bd-4dda-aab8-9dc80f0eabde service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:24.219046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dd4a8cec-f8ba-4cd2-bb85-dc99ea9ae425 req-eae61e78-c9bd-4dda-aab8-9dc80f0eabde service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:24.230641 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-dd4a8cec-f8ba-4cd2-bb85-dc99ea9ae425 req-eae61e78-c9bd-4dda-aab8-9dc80f0eabde service nova] Creating event network-changed:ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd for instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 on n-h2-853316-12 Oct 17 13:46:24.236338 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-dd4a8cec-f8ba-4cd2-bb85-dc99ea9ae425 req-eae61e78-c9bd-4dda-aab8-9dc80f0eabde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108038 Oct 17 13:46:24.236943 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3593/7491] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:25.103259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:25.103838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:25.106704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:25.112665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:25.113155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:25.113596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:25.114375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:25.114858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:25.115288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:25.245632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:25.255217 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f84512de-6127-49ef-baee-1f2a7325c597 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1363 microversion: 2.1 time: 0.155911 Oct 17 13:46:25.255866 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3899/7492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:25 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:26.279634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:26.280349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:26.283256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:26.288735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:26.289239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:26.289696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:26.290444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:26.290916 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:26.291359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:26.423877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:26.431558 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82852f08-6d19-4722-b986-04d68e9cda62 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1363 microversion: 2.1 time: 0.156340 Oct 17 13:46:26.432136 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3594/7493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:26 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:27.456753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:27.457370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:27.463464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:27.463952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:27.464392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:27.465090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:27.465544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:27.465970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:27.605684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:27.613734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-538a8bdc-d4db-4bb4-99a3-d5e70d5d5e18 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1363 microversion: 2.1 time: 0.161537 Oct 17 13:46:27.614356 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3900/7494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:27 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:28.636159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:28.636794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:28.643778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:28.644215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:28.644667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.645374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:28.645843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:28.646316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.779862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:28.787805 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82900d4e-7dea-42e5-95d9-a9e3378dc243 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1363 microversion: 2.1 time: 0.155543 Oct 17 13:46:28.788375 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3595/7495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:28 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:29.230932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e7a6aa79-79ce-42f7-9d7b-0744e338858f req-587a033b-bb5e-4e0b-ac72-6493cd4072ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7ddd2a-773f-4d76-bb64-3949c4b55f59", "name": "network-vif-plugged", "status": "completed", "tag": "ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:29.244056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7a6aa79-79ce-42f7-9d7b-0744e338858f req-587a033b-bb5e-4e0b-ac72-6493cd4072ea service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:29.244545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7a6aa79-79ce-42f7-9d7b-0744e338858f req-587a033b-bb5e-4e0b-ac72-6493cd4072ea service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:29.245044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e7a6aa79-79ce-42f7-9d7b-0744e338858f req-587a033b-bb5e-4e0b-ac72-6493cd4072ea service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:29.257683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e7a6aa79-79ce-42f7-9d7b-0744e338858f req-587a033b-bb5e-4e0b-ac72-6493cd4072ea service nova] Creating event network-vif-plugged:ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd for instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 on n-h2-853316-12 Oct 17 13:46:29.263279 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e7a6aa79-79ce-42f7-9d7b-0744e338858f req-587a033b-bb5e-4e0b-ac72-6493cd4072ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036370 Oct 17 13:46:29.264758 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3901/7496] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:29.815036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:29.815738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:29.822951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:29.823475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:29.824106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:29.824669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:29.825147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:29.825597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:29.955972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:29.963586 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77490ad3-d58c-4c6c-b488-f45a057ebb60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1363 microversion: 2.1 time: 0.155747 Oct 17 13:46:29.964153 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3596/7497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:29 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:30.988555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:30.989281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:30.995517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:30.996003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:30.996442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:30.997160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:30.997616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:30.998628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:31.130041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:31.137896 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-219cd496-4e55-40b3-b93e-cda40b790a3c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1550 microversion: 2.1 time: 0.154604 Oct 17 13:46:31.138622 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3902/7498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:30 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:31.160636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:31.161172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:31.168140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:31.168914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:31.169080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:31.170629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:31.171218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:31.171861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:31.255294 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c5db44c2-94bd-4fa2-aad8-95b6d3437a39 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098460 Oct 17 13:46:31.255898 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3597/7499] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:46:31 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:32.207405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-9da6e484-d33d-40a9-8e14-39ae269a6310 req-b94d6bdb-afc7-4db6-bc5f-6e6b83b7d831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7ddd2a-773f-4d76-bb64-3949c4b55f59", "tag": "ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:32.212417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:32.220300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9da6e484-d33d-40a9-8e14-39ae269a6310 req-b94d6bdb-afc7-4db6-bc5f-6e6b83b7d831 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:32.220779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9da6e484-d33d-40a9-8e14-39ae269a6310 req-b94d6bdb-afc7-4db6-bc5f-6e6b83b7d831 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:32.221205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-9da6e484-d33d-40a9-8e14-39ae269a6310 req-b94d6bdb-afc7-4db6-bc5f-6e6b83b7d831 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:32.233235 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-9da6e484-d33d-40a9-8e14-39ae269a6310 req-b94d6bdb-afc7-4db6-bc5f-6e6b83b7d831 service nova] Creating event network-changed:ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd for instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 on n-h2-853316-12 Oct 17 13:46:32.238547 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-9da6e484-d33d-40a9-8e14-39ae269a6310 req-b94d6bdb-afc7-4db6-bc5f-6e6b83b7d831 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035101 Oct 17 13:46:32.239487 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3903/7500] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:05.176376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:05.177176 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:05.179548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=7 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:05.180175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=45 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:05.185315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3c566361-144b-4805-b197-e01da12c5953 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:05.193911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c566361-144b-4805-b197-e01da12c5953 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:05.194439 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c566361-144b-4805-b197-e01da12c5953 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:05.194899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3c566361-144b-4805-b197-e01da12c5953 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:05.219378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3c566361-144b-4805-b197-e01da12c5953 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:47:05.262037 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3c566361-144b-4805-b197-e01da12c5953 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/action" status: 202 len: 0 microversion: 2.1 time: 0.085916 Oct 17 13:47:05.262786 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3598/7501] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:05 2022] POST /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:05.272076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:05.272959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:05.276545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=9 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:05.277224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=42 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:05.284140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:05.284644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:05.285069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:05.285776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:05.286259 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:05.286696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:05.617122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:05.624970 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-133a2ede-4909-4354-85fc-1189267fa5e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.357300 Oct 17 13:47:05.625547 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3904/7502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:05 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:06.648528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:06.649244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:06.657128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:06.657506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:06.657958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:06.658710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:06.659175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:06.659614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:06.924791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:06.932882 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8fc45250-459c-445e-9fcb-3a9a1a8d2cca tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.288666 Oct 17 13:47:06.933458 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3599/7503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:06 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:07.956585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:07.957199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:07.964240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:07.964723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:07.965157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:07.965850 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:07.966330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:07.966752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:08.097347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:08.105091 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-358cccf5-c00b-46f3-9fcc-df21e2773bf5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.153214 Oct 17 13:47:08.105659 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3905/7504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:07 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:09.130217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:09.130850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:09.137795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:09.138318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:09.138772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:09.139479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:09.139945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:09.141537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:09.277885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:09.287198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fba8e013-c8d8-4d5d-ae03-77c5d1fb5a60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.160897 Oct 17 13:47:09.288055 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3600/7505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:09 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:10.311995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:10.313252 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:10.320271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:10.320770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:10.321214 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:10.321962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:10.322452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:10.322886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:10.465767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:10.474734 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0a6d2f90-6dfb-46d9-be71-65c47af3d3f0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.166576 Oct 17 13:47:10.475332 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3906/7506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:10 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:11.498634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:11.499265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:11.506587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:11.507089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:11.507544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:11.508250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:11.508718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:11.509159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:11.645160 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:11.653161 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-657ec005-1356-47c1-ad72-79bb0aa6fc99 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.158355 Oct 17 13:47:11.653744 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3601/7507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:11 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:12.676457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:12.676999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:12.683928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:12.684411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:12.684848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:12.685538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:12.685997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:12.686446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:12.818271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:12.826058 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-36f17b26-ea7c-4296-9b69-30e8631b9d40 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.153687 Oct 17 13:47:12.826672 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3907/7508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:12 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:13.849968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:13.850627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:13.857429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:13.857926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:13.858409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:13.860171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:13.860651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:13.861097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:13.993922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:14.002693 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4ae97a80-c01e-4433-b12f-af8a799cda79 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.156634 Oct 17 13:47:14.003281 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3602/7509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:13 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:15.026208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:15.026824 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:15.033653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:15.034137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:15.034638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:15.035301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:15.035755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:15.036183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:15.169724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:15.178341 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-481af62d-60df-4c6a-a731-517483a164a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.156135 Oct 17 13:47:15.178918 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3908/7510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:15 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:16.202371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:16.203121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:16.210491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.211005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.211467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.212205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.212682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.213132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.352243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:16.361193 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1160df0f-9afe-4027-a192-8133027096b6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1655 microversion: 2.1 time: 0.162732 Oct 17 13:47:16.361773 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3603/7511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:16 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:16.384250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:16.386596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:16.396467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.397316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.398113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.399360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.400150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.400893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.434875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:16.441387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Old instance type m1.heat2, new instance type m1.heat {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:47:16.448102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:47:16.448514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:47:16.448979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:47:16.449382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:47:16.449790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:47:16.519335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6f7cb905-7c2a-48cb-a233-c739446549c5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/action" status: 202 len: 0 microversion: 2.1 time: 0.138928 Oct 17 13:47:16.519884 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3909/7512] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:16 2022] POST /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:16.530156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:16.531355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:16.537637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.538147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.538652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.539428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.539866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.540312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.689219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:16.697209 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7b82b3c3-e5f6-4305-8127-b02309928624 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.171390 Oct 17 13:47:16.697790 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3604/7513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:16 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:17.722059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:17.722742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:17.729849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.730393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.730893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.731599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.732058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.732497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.887873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:17.896628 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-238ca999-59a6-44ea-a223-7b5854c6808a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1678 microversion: 2.1 time: 0.179571 Oct 17 13:47:17.897207 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3910/7514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:17 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:18.920501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:18.921146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:18.928797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.929302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.929758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:18.930505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.930979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.931426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:19.066784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:19.074650 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8c04800d-ed71-4325-be75-d5dfe2b10433 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1683 microversion: 2.1 time: 0.158092 Oct 17 13:47:19.075213 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3605/7515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:18 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:20.100804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:20.101367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:20.108194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:20.108684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:20.109660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:20.110497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:20.110961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:20.111425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:20.255551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:20.264543 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dcb6def5-9cf0-4b3a-ba08-7b59749cf45f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1683 microversion: 2.1 time: 0.167814 Oct 17 13:47:20.265135 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3911/7516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:20 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:20.706718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b2393318-4b18-4162-aa14-107ba204f6c8 req-af7b5bae-fa3e-4c2f-a040-793ed07088ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7ddd2a-773f-4d76-bb64-3949c4b55f59", "name": "network-vif-unplugged", "status": "completed", "tag": "ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:20.717872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b2393318-4b18-4162-aa14-107ba204f6c8 req-af7b5bae-fa3e-4c2f-a040-793ed07088ae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:20.719312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b2393318-4b18-4162-aa14-107ba204f6c8 req-af7b5bae-fa3e-4c2f-a040-793ed07088ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:20.719939 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b2393318-4b18-4162-aa14-107ba204f6c8 req-af7b5bae-fa3e-4c2f-a040-793ed07088ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:20.732888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b2393318-4b18-4162-aa14-107ba204f6c8 req-af7b5bae-fa3e-4c2f-a040-793ed07088ae service nova] Creating event network-vif-unplugged:ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd for instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 on n-h1-853316-12 Oct 17 13:47:20.739112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-b2393318-4b18-4162-aa14-107ba204f6c8 req-af7b5bae-fa3e-4c2f-a040-793ed07088ae service nova] Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:47:20.751310 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b2393318-4b18-4162-aa14-107ba204f6c8 req-af7b5bae-fa3e-4c2f-a040-793ed07088ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050006 Oct 17 13:47:20.751934 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3606/7517] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:21.288017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:21.288548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:21.295617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.296095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.297282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.297579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.297938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.298467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.450814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:21.460069 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f4c0cc63-39db-4e32-b90d-2ed8a63eca88 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1682 microversion: 2.1 time: 0.176160 Oct 17 13:47:21.470664 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3912/7518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:21 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:22.486350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:22.487065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:22.493241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:22.493739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:22.494218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:22.494928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:22.495393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:22.495832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:22.649071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:22.657378 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-127e5940-c603-49da-93a0-fade249fbd53 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1680 microversion: 2.1 time: 0.176353 Oct 17 13:47:22.657958 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3607/7519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:22 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:47:22.768287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7d45e0e7-1286-4991-9fb6-6fec22c35949 req-4c85788e-3d59-4c3f-9a1f-542486423eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7ddd2a-773f-4d76-bb64-3949c4b55f59", "tag": "ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:22.778694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7d45e0e7-1286-4991-9fb6-6fec22c35949 req-4c85788e-3d59-4c3f-9a1f-542486423eec service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:22.779176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7d45e0e7-1286-4991-9fb6-6fec22c35949 req-4c85788e-3d59-4c3f-9a1f-542486423eec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:22.779606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7d45e0e7-1286-4991-9fb6-6fec22c35949 req-4c85788e-3d59-4c3f-9a1f-542486423eec service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:22.794430 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7d45e0e7-1286-4991-9fb6-6fec22c35949 req-4c85788e-3d59-4c3f-9a1f-542486423eec service nova] Creating event network-changed:ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd for instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 on n-h1-853316-12 Oct 17 13:47:22.800993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-7d45e0e7-1286-4991-9fb6-6fec22c35949 req-4c85788e-3d59-4c3f-9a1f-542486423eec service nova] Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:47:22.816079 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7d45e0e7-1286-4991-9fb6-6fec22c35949 req-4c85788e-3d59-4c3f-9a1f-542486423eec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052051 Oct 17 13:47:22.816952 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3913/7520] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:23.680526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:23.681140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:23.688822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:23.689316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:23.689761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:23.690500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:23.690970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:23.691409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:23.851960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:23.860172 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a5297698-556a-4196-9b6d-c297f6eb2fb1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1680 microversion: 2.1 time: 0.183572 Oct 17 13:47:23.860884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3608/7521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:23 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:24.885361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:24.886064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:24.893194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:24.893687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:24.894129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:24.894857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:24.895318 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:24.895746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:25.040716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:25.049790 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5826fae5-3476-4f5e-a6bb-328a868dd28b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1676 microversion: 2.1 time: 0.169550 Oct 17 13:47:25.050421 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3914/7522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:24 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:47:25.072937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:25.073495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:25.081632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:25.082307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:25.083054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:25.084033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:25.084712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:25.085263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:25.147690 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-526a3e9b-2b11-42bd-89ac-e8cc6c77a885 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/action" status: 204 len: 0 microversion: 2.1 time: 0.078502 Oct 17 13:47:25.148344 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3609/7523] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:25 2022] POST /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:47:25.159159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:25.160397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:25.168345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:25.168925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:25.169433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:25.170149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:25.171417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:25.171853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:25.317721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:25.327165 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-20a32fd5-6a3e-4f28-b59e-f14898f0d269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1676 microversion: 2.1 time: 0.174540 Oct 17 13:47:25.336132 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3915/7524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:25 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:26.352930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:26.353688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:26.360695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.361206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.361669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.362419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.362900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.363344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.517190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:26.528109 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7adaae3b-c58a-4195-b6fa-f7fc6b7dfd84 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1655 microversion: 2.1 time: 0.179389 Oct 17 13:47:26.528713 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3610/7525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:26 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:26.551539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:26.552483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:26.559647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.560150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.560607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.561328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.561825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.562510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.707582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:26.715868 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b1c6c66-9ba5-4d5a-a0d9-eb2183e711da tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1655 microversion: 2.1 time: 0.168454 Oct 17 13:47:26.716460 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3916/7526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:26 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:26.739534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9fc311e5-3c41-49b4-8fd8-b3b5fdd791dd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:26.745564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fc311e5-3c41-49b4-8fd8-b3b5fdd791dd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.746187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fc311e5-3c41-49b4-8fd8-b3b5fdd791dd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.746671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fc311e5-3c41-49b4-8fd8-b3b5fdd791dd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.773563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9fc311e5-3c41-49b4-8fd8-b3b5fdd791dd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Going to try to start instance {{(pid=127539) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:47:26.814872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:26.824377 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9fc311e5-3c41-49b4-8fd8-b3b5fdd791dd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/action" status: 202 len: 0 microversion: 2.1 time: 0.088469 Oct 17 13:47:26.829156 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3611/7527] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:26 2022] POST /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:26.837230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:26.838411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:26.845756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.846352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.846993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.847931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.848592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.849108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.895255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3d7e7b33-e9ba-4460-a61d-2ab454c3798c req-beb7d7a4-419e-4e9f-8cb4-bbb7ad219ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7ddd2a-773f-4d76-bb64-3949c4b55f59", "name": "network-vif-plugged", "status": "completed", "tag": "ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:26.905453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3d7e7b33-e9ba-4460-a61d-2ab454c3798c req-beb7d7a4-419e-4e9f-8cb4-bbb7ad219ee6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.906139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3d7e7b33-e9ba-4460-a61d-2ab454c3798c req-beb7d7a4-419e-4e9f-8cb4-bbb7ad219ee6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.906759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3d7e7b33-e9ba-4460-a61d-2ab454c3798c req-beb7d7a4-419e-4e9f-8cb4-bbb7ad219ee6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.918694 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3d7e7b33-e9ba-4460-a61d-2ab454c3798c req-beb7d7a4-419e-4e9f-8cb4-bbb7ad219ee6 service nova] Creating event network-vif-plugged:ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd for instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 on n-h1-853316-12 Oct 17 13:47:26.927313 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3d7e7b33-e9ba-4460-a61d-2ab454c3798c req-beb7d7a4-419e-4e9f-8cb4-bbb7ad219ee6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129633 Oct 17 13:47:26.929033 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3917/7528] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:47:27.003720 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:27.011738 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f94332f-994c-4074-b589-126aa95e9f75 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1664 microversion: 2.1 time: 0.180876 Oct 17 13:47:27.012309 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3612/7529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:26 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:47:28.038487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:28.039183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:28.045504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:28.046011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:28.046641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:28.047510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:28.047968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:28.048393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:28.226361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:28.234901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d66b469e-06c6-4a04-92f7-0ea38c4ca24c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1664 microversion: 2.1 time: 0.201591 Oct 17 13:47:28.235487 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3918/7530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:28 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:29.258677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:29.259331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:29.266927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.268735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.268735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.268735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.269682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.269682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.416540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:29.424987 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db2c63fa-0231-4f00-8441-3962a6672a77 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1668 microversion: 2.1 time: 0.170206 Oct 17 13:47:29.425572 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3613/7531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:29 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:29.447865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:29.448480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:29.456057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.456544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.456984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.457684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.458137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.458590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.485651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:47:29.499787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:29.564062 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e9adb75c-2720-4f25-ae3e-710c80eccf58 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 204 len: 0 microversion: 2.1 time: 0.119748 Oct 17 13:47:29.564858 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3919/7532] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:29 2022] DELETE /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:47:29.573636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:29.574333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:29.581595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.582114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.582615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.583346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.583825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.584275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.719009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:29.730145 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82eeaf94-1edf-483e-be7f-e5e9151bc020 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1674 microversion: 2.1 time: 0.160824 Oct 17 13:47:29.730781 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3614/7533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:29 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:30.755360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:30.755983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:30.762917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.763405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.763847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.764538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.765778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.766241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.903492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:30.911523 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd8c6301-2130-4ecd-83eb-1dca5513c76b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1674 microversion: 2.1 time: 0.160511 Oct 17 13:47:30.912107 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3920/7534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:30 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:31.939496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:31.940640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:31.948872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:31.949394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:31.949849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:31.950611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:31.951086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:31.951541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:32.055861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:32.068869 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ab3b1e8-f603-492f-bf40-0968ed806610 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 200 len: 1607 microversion: 2.1 time: 0.137397 Oct 17 13:47:32.069788 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3615/7535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:31 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 1607 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:47:32.213541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e11f10ad-c055-40e5-a8dc-c058a4fffe5e req-26e6fe45-4a59-42d5-a86d-bcbf5fae11a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7ddd2a-773f-4d76-bb64-3949c4b55f59", "name": "network-vif-deleted", "tag": "ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:32.235060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e11f10ad-c055-40e5-a8dc-c058a4fffe5e req-26e6fe45-4a59-42d5-a86d-bcbf5fae11a3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:32.236225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e11f10ad-c055-40e5-a8dc-c058a4fffe5e req-26e6fe45-4a59-42d5-a86d-bcbf5fae11a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:32.236937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e11f10ad-c055-40e5-a8dc-c058a4fffe5e req-26e6fe45-4a59-42d5-a86d-bcbf5fae11a3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:32.259439 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e11f10ad-c055-40e5-a8dc-c058a4fffe5e req-26e6fe45-4a59-42d5-a86d-bcbf5fae11a3 service nova] Creating event network-vif-deleted:ac99eb68-cf4d-4433-b8b8-ad5c6caf82bd for instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 on n-h1-853316-12 Oct 17 13:47:32.268300 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e11f10ad-c055-40e5-a8dc-c058a4fffe5e req-26e6fe45-4a59-42d5-a86d-bcbf5fae11a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156273 Oct 17 13:47:32.269311 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3921/7536] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:33.092280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:33.092978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:33.100612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.101105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.101553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.102282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.102748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.103184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.117607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 HTTP/1.1 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'fe7ddd2a-773f-4d76-bb64-3949c4b55f59'} Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:33.119326 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79d735d7-a83a-4a74-9483-c3f95e30cc4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 404 len: 111 microversion: 2.1 time: 0.032432 Oct 17 13:47:33.125698 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3616/7537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:33 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:33.139671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:33.141014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:33.147393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.147883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.148329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.149036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.149499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.149931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.163545 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 HTTP/1.1 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'fe7ddd2a-773f-4d76-bb64-3949c4b55f59'} Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:33.165219 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a5f02b2-3759-4f6d-81ab-315d753f51e1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 404 len: 111 microversion: 2.1 time: 0.032231 Oct 17 13:47:33.169888 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3922/7538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:33 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:33.216951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1397701171", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "ac2470be-3750-4f94-8152-7da5178f1b2b"}], "security_groups": [{"name": "tempest-securitygroup--757939450"}], "key_name": "tempest-keypair-1889155957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:33.335416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] validate_networks() for [('ac2470be-3750-4f94-8152-7da5178f1b2b', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:47:33.788552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:47:33.788994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:47:33.789519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:47:33.789946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:47:33.790397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:47:33.800481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.800983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.801431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.802195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.802669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.803106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.820527 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for project 10b6a534a0584ac5a5b1041188f25290. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:33.825846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for user e9d88c6d47404b2d8ef7eb4325be60d1 and project 10b6a534a0584ac5a5b1041188f25290. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:33.838881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:47:33.841140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:47:33.888268 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8a0d026f-234d-4a44-976f-74f0d1b79446 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.675172 Oct 17 13:47:33.888815 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3617/7539] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:47:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:47:33.900257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-db8d26e7-614c-4a64-bae2-06323adb89c2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:33.900869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-db8d26e7-614c-4a64-bae2-06323adb89c2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:33.955987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-db8d26e7-614c-4a64-bae2-06323adb89c2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:33.962984 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-db8d26e7-614c-4a64-bae2-06323adb89c2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1239 microversion: 2.1 time: 0.066608 Oct 17 13:47:33.963566 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3923/7540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:33 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:34.990137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:34.991685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:35.002242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.002802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.003273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.004553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.005127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.005848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.380081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:35.388347 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-30592005-4900-4889-94ca-a471805f45db tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1309 microversion: 2.1 time: 0.403309 Oct 17 13:47:35.388930 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3618/7541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:34 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:36.412817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:36.413465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:36.418515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:36.425081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:36.425800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:36.426279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:36.427026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:36.427474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:36.427904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:36.608648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:36.617480 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ccb5827-aed9-4e42-8afd-0f55c81a7875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1364 microversion: 2.1 time: 0.208456 Oct 17 13:47:36.618070 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3924/7542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:36 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:36.896410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-f4e9a843-756d-484c-b354-23b899b7cbed req-9a20a03a-ce74-4086-b312-997303d59ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:36.904698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:36.911562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4e9a843-756d-484c-b354-23b899b7cbed req-9a20a03a-ce74-4086-b312-997303d59ef8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:36.912074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4e9a843-756d-484c-b354-23b899b7cbed req-9a20a03a-ce74-4086-b312-997303d59ef8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:36.912601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-f4e9a843-756d-484c-b354-23b899b7cbed req-9a20a03a-ce74-4086-b312-997303d59ef8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:36.926060 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-f4e9a843-756d-484c-b354-23b899b7cbed req-9a20a03a-ce74-4086-b312-997303d59ef8 service nova] Creating event network-changed:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h2-853316-12 Oct 17 13:47:36.932080 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-f4e9a843-756d-484c-b354-23b899b7cbed req-9a20a03a-ce74-4086-b312-997303d59ef8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039290 Oct 17 13:47:36.932867 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3619/7543] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:37.650969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:37.651583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:37.658647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:37.659137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:37.659579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:37.660281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:37.660738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:37.661165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:37.795377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:37.803749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-317987ad-dae0-4d3d-8b60-997118a84410 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1364 microversion: 2.1 time: 0.156787 Oct 17 13:47:37.804339 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3925/7544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:37 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:38.831053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:38.831772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:38.837983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:38.838505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:38.838959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:38.839666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:38.840141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:38.840572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:38.977237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:38.987317 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-53a423f8-7569-496a-9f13-499bc0998b4d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1364 microversion: 2.1 time: 0.162388 Oct 17 13:47:38.987909 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3620/7545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:38 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:40.010855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:40.011508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:40.019051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:40.019542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:40.019990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:40.020689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:40.021153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:40.021580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:40.161694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:40.171574 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e628dd1-5244-4843-ad4e-c20a5f42743f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1364 microversion: 2.1 time: 0.164219 Oct 17 13:47:40.172332 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3926/7546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:40 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:41.196120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:41.196950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:41.204622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:41.205127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:41.205566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:41.206366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:41.206840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:41.207280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:41.361113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:41.369306 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e39f30c8-9dfb-48f6-b5b2-8a0f72cbc628 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1364 microversion: 2.1 time: 0.178184 Oct 17 13:47:41.370327 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3621/7547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:41 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:41.531131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-7ecb5268-4e23-47a3-9c2b-d65d95545da1 req-37c43414-4641-4119-9265-24f1a17215a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "name": "network-vif-plugged", "status": "completed", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:41.550087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7ecb5268-4e23-47a3-9c2b-d65d95545da1 req-37c43414-4641-4119-9265-24f1a17215a2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:41.550782 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7ecb5268-4e23-47a3-9c2b-d65d95545da1 req-37c43414-4641-4119-9265-24f1a17215a2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:41.551357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-7ecb5268-4e23-47a3-9c2b-d65d95545da1 req-37c43414-4641-4119-9265-24f1a17215a2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:41.565121 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-7ecb5268-4e23-47a3-9c2b-d65d95545da1 req-37c43414-4641-4119-9265-24f1a17215a2 service nova] Creating event network-vif-plugged:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h2-853316-12 Oct 17 13:47:41.570588 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-7ecb5268-4e23-47a3-9c2b-d65d95545da1 req-37c43414-4641-4119-9265-24f1a17215a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044351 Oct 17 13:47:41.571762 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3927/7548] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:47:42.394426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.395233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.402645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.403172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.403638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.404384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.404864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.405358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.538248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:42.547057 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-90b866a7-1d5e-4d95-b3c4-3b8fe2369367 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1364 microversion: 2.1 time: 0.157194 Oct 17 13:47:42.547647 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3622/7549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:42 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:43.571411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:43.572102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:43.578905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:43.579397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:43.579831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:43.580521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:43.580976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:43.581394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:43.721147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:43.729080 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b890d711-0d40-4e78-91e3-6f27ca9f800c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1551 microversion: 2.1 time: 0.162824 Oct 17 13:47:43.729650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3928/7550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:43 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:43.754941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:43.755477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:43.763427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:43.763969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:43.765774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:43.767482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:43.768004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:43.768506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:43.811190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:43.833349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:43.858227 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-80079e47-2f82-4173-9777-1e99de6d057e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107775 Oct 17 13:47:43.858873 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3623/7551] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:47:43 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:47:44.844964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0535ab2a-fb3c-4b8d-bf9f-19063fe6ecac req-90fc5657-2a6a-4a10-99d2-dd57999e1781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:44.850106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:44.856892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0535ab2a-fb3c-4b8d-bf9f-19063fe6ecac req-90fc5657-2a6a-4a10-99d2-dd57999e1781 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:44.857473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0535ab2a-fb3c-4b8d-bf9f-19063fe6ecac req-90fc5657-2a6a-4a10-99d2-dd57999e1781 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:44.857969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0535ab2a-fb3c-4b8d-bf9f-19063fe6ecac req-90fc5657-2a6a-4a10-99d2-dd57999e1781 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:44.873633 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0535ab2a-fb3c-4b8d-bf9f-19063fe6ecac req-90fc5657-2a6a-4a10-99d2-dd57999e1781 service nova] Creating event network-changed:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h2-853316-12 Oct 17 13:47:44.880125 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0535ab2a-fb3c-4b8d-bf9f-19063fe6ecac req-90fc5657-2a6a-4a10-99d2-dd57999e1781 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040284 Oct 17 13:47:44.880754 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3929/7552] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:15.101609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=9 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:15.102324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=58 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:15.106899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:15.109395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:15.116592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.117161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.117611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.118416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.118888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.119325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.152842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.158642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Old instance type m1.heat2, new instance type m1.heat {{(pid=127539) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:48:15.165215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:15.165646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:15.166130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:15.166575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:15.166996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:15.235721 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-26d40857-cf31-46cc-9371-d09db3e9eb0d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8/action" status: 202 len: 0 microversion: 2.1 time: 0.136166 Oct 17 13:48:15.236764 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3624/7553] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:15 2022] POST /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:15.243323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=11 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:15.244136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:15.249913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:15.250744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:15.263131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.263879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.264522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.266147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.266639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.267084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.446823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.455577 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69b35477-dd22-442f-bfbd-e0660f96f6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1678 microversion: 2.1 time: 0.214800 Oct 17 13:48:15.456137 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3930/7554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:15 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:16.479918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:16.480555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:16.487894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.488402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.489057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.489781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.490280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.490729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.631105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.638959 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9800ee3-be19-4c98-ba37-789869a4dcc2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1678 microversion: 2.1 time: 0.163842 Oct 17 13:48:16.639448 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3625/7555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:16 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:17.663157 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:17.663896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:17.671003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.672579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.673027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.673753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.674224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.674651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.813425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:17.821267 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-47824e32-55b7-4695-ae4d-3134d0b9f5d4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1678 microversion: 2.1 time: 0.162071 Oct 17 13:48:17.828034 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3931/7556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:17 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:18.845868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:18.846529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:18.853340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.853843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.854332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.855046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.855517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.855961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.986560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:18.994289 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-710ed700-5ca4-4ce6-a611-39327c4dac4e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.153103 Oct 17 13:48:18.994856 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3626/7557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:18 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:20.020375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:20.020980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:20.027940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.028424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.028858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.029546 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.029995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.031543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.164892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.172879 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44520a7b-ec32-4ed6-8a3d-d104955937c0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.156469 Oct 17 13:48:20.173451 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3932/7558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:20 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:21.196459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:21.197079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:21.205360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.205867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.206348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.207068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.207537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.207974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.359000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.367359 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5b726aa-8635-495c-a4c3-22ed9286137f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.175149 Oct 17 13:48:21.368045 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3627/7559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:21 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:22.391643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:22.392254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:22.399213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.399697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.400132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.400826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.401277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.401695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.531701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.539590 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-25b2fb81-39a1-42c3-84b9-40a0691fb048 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.153152 Oct 17 13:48:22.540157 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3933/7560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:22 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:23.562790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:23.563342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:23.570459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.570963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.571412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.572147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.572617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.573207 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.704450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:23.712205 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19a1947e-3907-45f6-a167-b09b15f7bc9d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.153497 Oct 17 13:48:23.712772 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3628/7561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:23 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:24.736796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:24.737370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:24.744438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:24.744929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:24.745373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:24.746078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:24.746569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:24.747000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.221166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:25.229223 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9190c596-43cd-4331-a370-baec6812e9a7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.497297 Oct 17 13:48:25.229921 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3934/7562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:24 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:26.253129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:26.253782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:26.260755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:26.261248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:26.261698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:26.262442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:26.262908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:26.263345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:26.399186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:26.406929 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-72caf8c1-ec8e-47a0-b174-e31831b5a2d0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.158081 Oct 17 13:48:26.407483 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3629/7563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:26 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:27.430429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:27.431047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:27.437778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:27.438371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:27.438815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:27.439573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:27.440677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:27.441170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:27.592197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:27.600914 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c5d831a-c4d2-420b-89c1-ccf434575ba6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.174425 Oct 17 13:48:27.601510 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3935/7564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:27 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:28.624485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:28.625117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:28.632226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:28.632727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:28.633190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:28.633895 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:28.634396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:28.634886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:28.765427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:28.773828 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-61776f33-78b7-492e-8c3b-1df185787d01 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1683 microversion: 2.1 time: 0.153528 Oct 17 13:48:28.774435 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3630/7565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:28 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:29.799358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:29.800017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:29.808728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.809216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.809894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.810630 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.811081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.811525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.953993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:29.962840 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1ad25bc1-aaad-443f-8670-30f2ab79d5f1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1682 microversion: 2.1 time: 0.168577 Oct 17 13:48:29.963500 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3936/7566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:29 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:30.279941 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e53a4dcf-6598-4b06-86ff-b1f50c488532 req-7568e4da-0ca0-4723-bda8-6f207f5f34e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:30.291181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e53a4dcf-6598-4b06-86ff-b1f50c488532 req-7568e4da-0ca0-4723-bda8-6f207f5f34e9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.291686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e53a4dcf-6598-4b06-86ff-b1f50c488532 req-7568e4da-0ca0-4723-bda8-6f207f5f34e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.292137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e53a4dcf-6598-4b06-86ff-b1f50c488532 req-7568e4da-0ca0-4723-bda8-6f207f5f34e9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.304902 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e53a4dcf-6598-4b06-86ff-b1f50c488532 req-7568e4da-0ca0-4723-bda8-6f207f5f34e9 service nova] Creating event network-vif-unplugged:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h1-853316-12 Oct 17 13:48:30.310858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-e53a4dcf-6598-4b06-86ff-b1f50c488532 req-7568e4da-0ca0-4723-bda8-6f207f5f34e9 service nova] Instance f276304c-8f24-4803-879e-d374aaac5cf8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:48:30.322387 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e53a4dcf-6598-4b06-86ff-b1f50c488532 req-7568e4da-0ca0-4723-bda8-6f207f5f34e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046094 Oct 17 13:48:30.323111 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3631/7567] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:30.986770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:30.987380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:30.995507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.995995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.996441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.997149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.997604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.998033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.141216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:31.149858 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b2fc48c0-e92f-42ee-bd1e-e952899b3792 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1682 microversion: 2.1 time: 0.166728 Oct 17 13:48:31.150327 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3937/7568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:30 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:32.176646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:32.177511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:32.183737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.184235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.184690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.185399 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.185870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.186634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.321489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:32.329622 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fc711f09-fd02-4422-8f31-188b7d59eaf2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1680 microversion: 2.1 time: 0.158765 Oct 17 13:48:32.330212 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3632/7569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:32 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:32.363160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-049e5483-5f69-4405-bb4e-3efa42de8dbd req-e3c01072-6001-4084-bbc5-416e2963de4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:32.374101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-049e5483-5f69-4405-bb4e-3efa42de8dbd req-e3c01072-6001-4084-bbc5-416e2963de4e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.374624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-049e5483-5f69-4405-bb4e-3efa42de8dbd req-e3c01072-6001-4084-bbc5-416e2963de4e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.375057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-049e5483-5f69-4405-bb4e-3efa42de8dbd req-e3c01072-6001-4084-bbc5-416e2963de4e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.386971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-049e5483-5f69-4405-bb4e-3efa42de8dbd req-e3c01072-6001-4084-bbc5-416e2963de4e service nova] Creating event network-changed:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h1-853316-12 Oct 17 13:48:32.392278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-049e5483-5f69-4405-bb4e-3efa42de8dbd req-e3c01072-6001-4084-bbc5-416e2963de4e service nova] Instance f276304c-8f24-4803-879e-d374aaac5cf8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:48:32.404216 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-049e5483-5f69-4405-bb4e-3efa42de8dbd req-e3c01072-6001-4084-bbc5-416e2963de4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044757 Oct 17 13:48:32.404810 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3938/7570] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:33.353526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:33.354208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:33.363309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:33.363892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:33.364270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:33.364981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:33.365451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:33.365891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:33.495142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:33.503117 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-840f45e0-499f-4492-a654-d6725fe03334 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1680 microversion: 2.1 time: 0.153550 Oct 17 13:48:33.503687 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3633/7571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:33 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:34.527187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:34.527882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:34.535006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:34.537010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:34.537567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:34.538294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:34.538754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:34.539178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:34.679868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:34.687696 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f5491e9-7f2e-40d0-a992-d231a80b6102 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1680 microversion: 2.1 time: 0.164798 Oct 17 13:48:34.688268 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3939/7572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:34 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:35.711454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:35.712079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:35.721265 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.721765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.722239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.723642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.724276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.724798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.864135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:35.872194 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e32248cc-0658-4035-9ea2-386058d10987 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1677 microversion: 2.1 time: 0.165434 Oct 17 13:48:35.872792 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3634/7573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:35 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:35.896351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:35.896945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:35.906240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.906738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.907183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.907897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.908354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.908789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.950441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.950928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.951371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.952109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.952566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.952995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.976832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for project 10b6a534a0584ac5a5b1041188f25290. Resources: {'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:35.984704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for user e9d88c6d47404b2d8ef7eb4325be60d1 and project 10b6a534a0584ac5a5b1041188f25290. Resources: {'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:36.106038 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-68d64153-58ac-47f7-8ad3-da8bfd9e5285 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8/action" status: 202 len: 0 microversion: 2.1 time: 0.214308 Oct 17 13:48:36.106695 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3940/7574] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:35 2022] POST /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:36.115753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:36.116480 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:36.122598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.123114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.123572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.124303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.124777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.125222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.350061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:36.358047 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc731c85-3d95-4017-97e9-7952e389eedb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1676 microversion: 2.1 time: 0.246859 Oct 17 13:48:36.358664 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3635/7575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:36 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:37.070088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5f10d1a5-75e9-487b-8373-68353b9660c0 req-5e0196c4-ed72-46e8-b885-dd059bbc84e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "name": "network-vif-plugged", "status": "completed", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:37.083501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5f10d1a5-75e9-487b-8373-68353b9660c0 req-5e0196c4-ed72-46e8-b885-dd059bbc84e3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.083999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5f10d1a5-75e9-487b-8373-68353b9660c0 req-5e0196c4-ed72-46e8-b885-dd059bbc84e3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.084438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5f10d1a5-75e9-487b-8373-68353b9660c0 req-5e0196c4-ed72-46e8-b885-dd059bbc84e3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.096489 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5f10d1a5-75e9-487b-8373-68353b9660c0 req-5e0196c4-ed72-46e8-b885-dd059bbc84e3 service nova] Creating event network-vif-plugged:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h1-853316-12 Oct 17 13:48:37.102783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-5f10d1a5-75e9-487b-8373-68353b9660c0 req-5e0196c4-ed72-46e8-b885-dd059bbc84e3 service nova] Instance f276304c-8f24-4803-879e-d374aaac5cf8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:48:37.113809 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5f10d1a5-75e9-487b-8373-68353b9660c0 req-5e0196c4-ed72-46e8-b885-dd059bbc84e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048090 Oct 17 13:48:37.114452 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3941/7576] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:37.382607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:37.383235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:37.390230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.390733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.391216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.391925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.392391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.392830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.522942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:37.530771 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9f0422b5-95c6-479d-a98d-9cd058da5e7f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1676 microversion: 2.1 time: 0.152681 Oct 17 13:48:37.531342 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3636/7577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:37 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:38.555215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:38.555979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:38.563403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.563890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.564357 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.565054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.565510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.565935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.705954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:38.714263 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5fdd37ab-0823-4dce-8b32-15d8589775f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1676 microversion: 2.1 time: 0.163795 Oct 17 13:48:38.714853 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3942/7578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:38 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:39.517586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-282be378-7fa7-4071-9100-ca0df372460b req-96410d6d-306d-4c4a-ad35-0fc41dff5cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:39.529890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-282be378-7fa7-4071-9100-ca0df372460b req-96410d6d-306d-4c4a-ad35-0fc41dff5cc5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.530539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-282be378-7fa7-4071-9100-ca0df372460b req-96410d6d-306d-4c4a-ad35-0fc41dff5cc5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.531143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-282be378-7fa7-4071-9100-ca0df372460b req-96410d6d-306d-4c4a-ad35-0fc41dff5cc5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.545579 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-282be378-7fa7-4071-9100-ca0df372460b req-96410d6d-306d-4c4a-ad35-0fc41dff5cc5 service nova] Creating event network-vif-unplugged:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h2-853316-12 Oct 17 13:48:39.552174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-282be378-7fa7-4071-9100-ca0df372460b req-96410d6d-306d-4c4a-ad35-0fc41dff5cc5 service nova] Instance f276304c-8f24-4803-879e-d374aaac5cf8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:48:39.564380 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-282be378-7fa7-4071-9100-ca0df372460b req-96410d6d-306d-4c4a-ad35-0fc41dff5cc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050186 Oct 17 13:48:39.565139 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3637/7579] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:39.737147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:39.737756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:39.744832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.745471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.745772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.746528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.747041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.747471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.884924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:39.893070 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-858b60db-0e8a-4b1e-851f-9bb6e91714a4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1676 microversion: 2.1 time: 0.159814 Oct 17 13:48:39.893682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3943/7580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:39 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:40.917536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:40.918273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:40.925202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:40.925699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:40.926151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:40.927022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:40.927487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:40.927924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.061079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:41.069326 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e5989560-f201-4ace-89bf-effb7e5ec58e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1676 microversion: 2.1 time: 0.156176 Oct 17 13:48:41.069895 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3638/7581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:40 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:41.601271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-77e0279a-043e-49e7-80f4-003043cdcc08 req-b4273c42-f883-4915-a52b-e9eeb3a72cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:41.611647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-77e0279a-043e-49e7-80f4-003043cdcc08 req-b4273c42-f883-4915-a52b-e9eeb3a72cba service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.612123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-77e0279a-043e-49e7-80f4-003043cdcc08 req-b4273c42-f883-4915-a52b-e9eeb3a72cba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.612554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-77e0279a-043e-49e7-80f4-003043cdcc08 req-b4273c42-f883-4915-a52b-e9eeb3a72cba service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.616507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:41.624998 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-77e0279a-043e-49e7-80f4-003043cdcc08 req-b4273c42-f883-4915-a52b-e9eeb3a72cba service nova] Creating event network-changed:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h2-853316-12 Oct 17 13:48:41.631351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-77e0279a-043e-49e7-80f4-003043cdcc08 req-b4273c42-f883-4915-a52b-e9eeb3a72cba service nova] Instance f276304c-8f24-4803-879e-d374aaac5cf8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:48:41.642890 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-77e0279a-043e-49e7-80f4-003043cdcc08 req-b4273c42-f883-4915-a52b-e9eeb3a72cba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045868 Oct 17 13:48:41.643861 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3944/7582] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:42.099294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:42.101091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:42.108500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.109091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.109802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.110619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.111155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.111669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.420119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:42.426966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:42.441491 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62e37257-6826-4ea1-b719-9274866a3f64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1669 microversion: 2.1 time: 0.350803 Oct 17 13:48:42.442203 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3639/7583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:42 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1669 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:42.466690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:42.467485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:42.474892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.475480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.475988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.476774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.477307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.477807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.624205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:42.636402 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d8c0ab23-35bd-4c95-960a-bdf68fb2f8af tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1669 microversion: 2.1 time: 0.174597 Oct 17 13:48:42.637177 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3945/7584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:42 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:42.661435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:42.662194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:42.669995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.670535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.671054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.671847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.672386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.672929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.114962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:43.123183 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-613f4089-7d82-49d6-86f7-4f484dca0170 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1669 microversion: 2.1 time: 0.466373 Oct 17 13:48:43.123967 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3640/7585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:42 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:43.145709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:43.146494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:43.152528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.153096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.153545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.154273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.154739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.155171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.187571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:48:43.281508 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-640bc439-369d-4296-98ce-f5b396d73e9a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 204 len: 0 microversion: 2.1 time: 0.140018 Oct 17 13:48:43.282631 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3946/7586] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:48:43 2022] DELETE /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:48:43.291952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:43.292581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:43.298661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.299158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.299611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.300310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.301488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.302001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.439301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:43.447812 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dd422244-a6c5-4b70-8c9a-39a89f6feb64 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1675 microversion: 2.1 time: 0.159967 Oct 17 13:48:43.448391 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3641/7587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:43 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:43.837986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-4d0828dc-33f6-4ece-b487-934911d8773d req-b4e0109e-7df8-4ce0-8805-3135929b789d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "name": "network-vif-plugged", "status": "completed", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:43.851799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4d0828dc-33f6-4ece-b487-934911d8773d req-b4e0109e-7df8-4ce0-8805-3135929b789d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.852278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4d0828dc-33f6-4ece-b487-934911d8773d req-b4e0109e-7df8-4ce0-8805-3135929b789d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.852701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-4d0828dc-33f6-4ece-b487-934911d8773d req-b4e0109e-7df8-4ce0-8805-3135929b789d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.867714 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-4d0828dc-33f6-4ece-b487-934911d8773d req-b4e0109e-7df8-4ce0-8805-3135929b789d service nova] Creating event network-vif-plugged:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h2-853316-12 Oct 17 13:48:43.873089 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-4d0828dc-33f6-4ece-b487-934911d8773d req-b4e0109e-7df8-4ce0-8805-3135929b789d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039322 Oct 17 13:48:43.873682 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3947/7588] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:44.471771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:44.472398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:44.479870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:44.480371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:44.480829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.481545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:44.482015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:44.482491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.684899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:44.693660 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b1da1051-2655-4eb2-8c2f-3ed7dba76839 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1675 microversion: 2.1 time: 0.225803 Oct 17 13:48:44.694271 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3642/7589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:44 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:45.466300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-81541abb-f541-4b68-84ac-cb01f3d8b19a req-5386f856-9306-4a37-b5d0-60db51581ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f276304c-8f24-4803-879e-d374aaac5cf8", "name": "network-vif-deleted", "tag": "2351db5a-7eb9-4136-a404-bae0111ed092"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:45.474579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:45.481767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-81541abb-f541-4b68-84ac-cb01f3d8b19a req-5386f856-9306-4a37-b5d0-60db51581ad0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.482278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-81541abb-f541-4b68-84ac-cb01f3d8b19a req-5386f856-9306-4a37-b5d0-60db51581ad0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.482714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-81541abb-f541-4b68-84ac-cb01f3d8b19a req-5386f856-9306-4a37-b5d0-60db51581ad0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.494836 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-81541abb-f541-4b68-84ac-cb01f3d8b19a req-5386f856-9306-4a37-b5d0-60db51581ad0 service nova] Creating event network-vif-deleted:2351db5a-7eb9-4136-a404-bae0111ed092 for instance f276304c-8f24-4803-879e-d374aaac5cf8 on n-h2-853316-12 Oct 17 13:48:45.500200 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-81541abb-f541-4b68-84ac-cb01f3d8b19a req-5386f856-9306-4a37-b5d0-60db51581ad0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037894 Oct 17 13:48:45.501044 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3948/7590] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:48:45.719222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:45.719971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:45.727640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=43 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:45.730309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.730900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.731360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.732095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.732600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.733046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.766654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.767178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.767639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.768111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lazy-loading 'fault' on Instance uuid f276304c-8f24-4803-879e-d374aaac5cf8 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:48:45.814934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:45.823054 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a86a3e24-3d48-4789-b1b7-ad124973527d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 200 len: 1329 microversion: 2.1 time: 0.107945 Oct 17 13:48:45.823769 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3643/7591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:45 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:46.843492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:46.849915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:46.850723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:46.857182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.857661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.858102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.858829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.859262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.859685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.876222 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 HTTP/1.1 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'f276304c-8f24-4803-879e-d374aaac5cf8'} Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:46.877851 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3b16576b-d998-491f-8689-0ffff45b8b0b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 404 len: 111 microversion: 2.1 time: 0.036835 Oct 17 13:48:46.882611 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3949/7592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:46 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:46.897454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:46.898112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:46.905602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.906111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.906604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.907394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.907871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.908319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.922877 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 HTTP/1.1 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'f276304c-8f24-4803-879e-d374aaac5cf8'} Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:46.924549 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3f9d1649-571f-4fde-8258-0b06fa27e4c7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 404 len: 111 microversion: 2.1 time: 0.033307 Oct 17 13:48:46.928932 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3644/7593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:46 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:46.976268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1859497761", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "ac2470be-3750-4f94-8152-7da5178f1b2b"}], "security_groups": [{"name": "tempest-securitygroup--757939450"}], "key_name": "tempest-keypair-1889155957", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:47.088579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] validate_networks() for [('ac2470be-3750-4f94-8152-7da5178f1b2b', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:48:47.565807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:47.566260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:47.567953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:47.568360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:47.568806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:47.580683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:47.581161 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:47.581592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:47.582997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:47.583462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:47.583909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:47.601458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for project 10b6a534a0584ac5a5b1041188f25290. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:47.606609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for user e9d88c6d47404b2d8ef7eb4325be60d1 and project 10b6a534a0584ac5a5b1041188f25290. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:47.619958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:48:47.622301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:48:47.671762 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c421772-7091-44c4-a6bf-39a98e25830f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.700042 Oct 17 13:48:47.672420 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3950/7594] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:48:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:48:47.685168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52851da3-e852-44e0-bfcf-8c3db919c6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:47.685903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52851da3-e852-44e0-bfcf-8c3db919c6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:47.752413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-52851da3-e852-44e0-bfcf-8c3db919c6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:47.763535 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52851da3-e852-44e0-bfcf-8c3db919c6d2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1239 microversion: 2.1 time: 0.083048 Oct 17 13:48:47.764131 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3645/7595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:47 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:48.788420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.789099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:48.796054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.796632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.797142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.797912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.798464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.798956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.876597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:48.885664 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d8117b6d-b4d4-476b-acfb-19a6f59c4a26 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1309 microversion: 2.1 time: 0.103047 Oct 17 13:48:48.886466 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3951/7596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:49.909165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:49.909789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:49.918071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.918632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.919100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:49.919837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.920346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.920797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:50.135936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:50.144032 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6fe5dae4-a2d7-4aad-b9f7-42908718b954 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1364 microversion: 2.1 time: 0.238911 Oct 17 13:48:50.145683 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3646/7597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:49 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:50.279710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-872de232-98b7-439c-aceb-2d9f4086fe90 req-ffd9465e-584c-462b-910e-d7c167cae50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:50.293597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-872de232-98b7-439c-aceb-2d9f4086fe90 req-ffd9465e-584c-462b-910e-d7c167cae50b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:50.294084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-872de232-98b7-439c-aceb-2d9f4086fe90 req-ffd9465e-584c-462b-910e-d7c167cae50b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:50.294550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-872de232-98b7-439c-aceb-2d9f4086fe90 req-ffd9465e-584c-462b-910e-d7c167cae50b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:50.307676 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-872de232-98b7-439c-aceb-2d9f4086fe90 req-ffd9465e-584c-462b-910e-d7c167cae50b service nova] Creating event network-changed:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h2-853316-12 Oct 17 13:48:50.312520 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-872de232-98b7-439c-aceb-2d9f4086fe90 req-ffd9465e-584c-462b-910e-d7c167cae50b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036570 Oct 17 13:48:50.313123 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3952/7598] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:51.167861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:51.168486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:51.176335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:51.176841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:51.177309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:51.178010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:51.178507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:51.178949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:51.314037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:51.322958 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3336b6b0-959f-4bb8-a7e5-55f9547dbaa8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1364 microversion: 2.1 time: 0.159011 Oct 17 13:48:51.323522 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3647/7599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:51 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:52.349439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:52.350051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:52.357122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.357622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.358076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:52.358916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.359379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.359810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:52.507196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:52.515164 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d00d6da9-82d0-48e8-a0f5-ba86882f9939 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1364 microversion: 2.1 time: 0.171545 Oct 17 13:48:52.515747 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3953/7600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:52 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:53.539760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:53.540426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:53.547495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:53.548005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:53.548468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:53.549190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:53.549669 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:53.550133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:53.686754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:53.694932 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bfcaa828-583a-4d8e-989c-1a797496581f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1364 microversion: 2.1 time: 0.159749 Oct 17 13:48:53.695512 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3648/7601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:53 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:54.718925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:54.719503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:54.726898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:54.727381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:54.727821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.728510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:54.728967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:54.729389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.859754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:54.868154 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ac3ab560-cd9c-4d5b-abdc-fd1aee332534 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1364 microversion: 2.1 time: 0.153293 Oct 17 13:48:54.868715 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3954/7602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:54 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:55.892481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:55.893275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:55.901414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.901924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.902420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.903343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.903648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.904103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.913253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e913b5cc-80a2-4f61-9d67-7cae2847eee3 req-589bda95-bf44-4796-b683-6290991d4ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "name": "network-vif-plugged", "status": "completed", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:55.926547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e913b5cc-80a2-4f61-9d67-7cae2847eee3 req-589bda95-bf44-4796-b683-6290991d4ec5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.927053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e913b5cc-80a2-4f61-9d67-7cae2847eee3 req-589bda95-bf44-4796-b683-6290991d4ec5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.927516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e913b5cc-80a2-4f61-9d67-7cae2847eee3 req-589bda95-bf44-4796-b683-6290991d4ec5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.940277 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e913b5cc-80a2-4f61-9d67-7cae2847eee3 req-589bda95-bf44-4796-b683-6290991d4ec5 service nova] Creating event network-vif-plugged:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h2-853316-12 Oct 17 13:48:55.947820 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e913b5cc-80a2-4f61-9d67-7cae2847eee3 req-589bda95-bf44-4796-b683-6290991d4ec5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039520 Oct 17 13:48:55.948509 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3955/7603] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:56.130659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:56.139154 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-12328316-d985-46b4-bb3b-ebff80433875 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1364 microversion: 2.1 time: 0.251790 Oct 17 13:48:56.140065 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3649/7604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:55 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:57.165610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:57.166316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:57.175246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.176128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.177085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.178644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.179314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.180359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.347083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:57.357459 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-605f0e8c-3921-4c95-ba2f-40cbe2d3a5f2 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1551 microversion: 2.1 time: 0.197047 Oct 17 13:48:57.358099 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3956/7605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:57 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1551 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:57.383134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:57.383757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:57.390899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.391409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.391867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.392595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.393073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.393516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.477912 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9ea3942-f750-4a26-8d54-dbd61f0dbc74 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099375 Oct 17 13:48:57.478704 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3650/7606] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:48:57 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:58.973206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f6dfceb7-f181-4791-9e67-adb4d88b5165 req-b425247f-81a8-46da-b2de-72c300b80af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:58.978866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:58.979641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:58.991237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f6dfceb7-f181-4791-9e67-adb4d88b5165 req-b425247f-81a8-46da-b2de-72c300b80af1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.991842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f6dfceb7-f181-4791-9e67-adb4d88b5165 req-b425247f-81a8-46da-b2de-72c300b80af1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.992377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f6dfceb7-f181-4791-9e67-adb4d88b5165 req-b425247f-81a8-46da-b2de-72c300b80af1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:59.010885 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f6dfceb7-f181-4791-9e67-adb4d88b5165 req-b425247f-81a8-46da-b2de-72c300b80af1 service nova] Creating event network-changed:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h2-853316-12 Oct 17 13:48:59.017153 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f6dfceb7-f181-4791-9e67-adb4d88b5165 req-b425247f-81a8-46da-b2de-72c300b80af1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047492 Oct 17 13:48:59.018025 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3957/7607] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:49:30.774133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:30.776340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=19 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:30.777016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=56 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:30.781497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:30.782228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:30.789414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.789922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.790411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.791132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.791610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.792092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.922534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:30.930758 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5e3a104-3ba3-4951-9659-c87bb0264605 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1669 microversion: 2.1 time: 0.157389 Oct 17 13:49:30.931330 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3651/7608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:30 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:30.951646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:30.952510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:30.957560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da5a76e8-7c40-4bd6-8dee-3d352420c1a4"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:30.960150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:30.969053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.969536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.969973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.970692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.971147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.971574 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:31.225382 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-aa7c7007-bf2b-4e97-94c9-d30e807c866f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275136 Oct 17 13:49:31.230211 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3958/7609] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:49:30 2022] POST /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:49:41.957121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:41.960092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:41.962954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:41.963616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:41.969349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.969795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.970317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.970994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.971462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.971900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.002618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:42.009189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=127539) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:49:42.016219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:49:42.016671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:49:42.017154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:49:42.017571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:49:42.018014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:49:42.086410 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-14ef031a-83c8-4729-b3f5-02eff5c5719b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.133489 Oct 17 13:49:42.087646 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3652/7610] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:41 2022] POST /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:49:42.096115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:42.097659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:42.109516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:42.110440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:42.112359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.112983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.113643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.115578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.116199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.116896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.282321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:42.293311 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1fc15348-d9ca-4459-bc19-e73305e3c325 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1724 microversion: 2.1 time: 0.201596 Oct 17 13:49:42.293890 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3959/7611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:42 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:43.318017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:43.318701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:43.326773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:43.327524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:43.327996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:43.329206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:43.330059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:43.330311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:43.566506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:43.576069 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d76aecc4-8521-4066-936e-0f85cb7c7fa7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1724 microversion: 2.1 time: 0.262940 Oct 17 13:49:43.576872 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3653/7612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:43 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:44.599866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:44.600534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:44.608020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:44.608505 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:44.608946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:44.609644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:44.610098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:44.610557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:44.742791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:44.751148 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-af709a89-dd38-4faa-8cca-1a4546e1cdf1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.155268 Oct 17 13:49:44.751715 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3960/7613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:44 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:45.775569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:45.776178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:45.790333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.790844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.791323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.792051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.792517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.792956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.926712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:45.935673 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-588e6056-bd7b-4832-bd9f-1c4618fbf63f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.164691 Oct 17 13:49:45.936243 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3654/7614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:45 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:46.959805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:46.960417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:46.968076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.968561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.968999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.969692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.970144 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.970591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:47.102718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:47.111117 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a6655475-3005-47dd-86e5-673e78adbe04 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.155413 Oct 17 13:49:47.111800 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3961/7615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:46 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:48.135486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:48.136107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:48.142885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.143381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.143830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.144535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.145000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.145440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.281271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:48.289540 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-19c27c4b-3eec-4cab-990b-6529b16ae155 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.159007 Oct 17 13:49:48.290113 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3655/7616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:48 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:49.314749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:49.315358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:49.322693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:49.323178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:49.323612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:49.324333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:49.324781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:49.325202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:49.459640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:49.468513 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c9eeada-30ba-4901-9bfc-1c6a348326c3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.157703 Oct 17 13:49:49.469333 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3962/7617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:49 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:50.494495 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:50.495137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:50.502020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:50.502569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:50.503032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:50.503754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:50.504233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:50.504684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:50.634700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:50.642942 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09555bb3-ba38-497f-bf9f-a4829bbb4bb9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.153129 Oct 17 13:49:50.643511 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3656/7618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:50 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:51.666578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:51.667196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:51.674246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.674728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.675159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.675845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.676292 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.676712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.814286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:51.823999 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c89f0497-ee33-40db-8550-1a668283b964 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.161357 Oct 17 13:49:51.824592 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3963/7619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:51 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:52.848975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:52.849600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:52.856740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:52.857236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:52.857685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:52.858420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:52.858890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:52.859325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:52.994128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:53.003497 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-484556e0-eba7-4ebe-9fce-aa92487d119a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.157637 Oct 17 13:49:53.004003 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3657/7620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:52 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:54.027933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:54.028550 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:54.035662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.036162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.036609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.037326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.037794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.038248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.178669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:54.187506 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-62a16736-9f66-4aa8-a352-6fddfbba893d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.163656 Oct 17 13:49:54.188081 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3964/7621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:54 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:55.211984 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:55.213186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:55.220841 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:55.221312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:55.221867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:55.222889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:55.223412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:55.223836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:55.358674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:55.367148 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b679cce-a61b-44c2-bfee-57cdc9d7593d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.160026 Oct 17 13:49:55.368293 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3658/7622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:55 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:56.391860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:56.392475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:56.400011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:56.400496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:56.400941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:56.401636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:56.402091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:56.402547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:56.533559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:56.542691 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91ee687e-13eb-4cd3-bdc4-a25064787cfc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.154816 Oct 17 13:49:56.543286 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3965/7623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:56 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:57.566081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:57.566733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:57.574569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:57.575059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:57.575514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:57.576216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:57.576681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:57.577119 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:57.711681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:57.720048 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-541f7a6f-0706-4071-8c98-940d702d615f tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.158369 Oct 17 13:49:57.720620 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3659/7624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:57 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:58.743295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:58.743902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:58.750755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:58.751178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:58.751611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:58.752293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:58.752741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:58.753163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:58.887663 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:58.895982 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f10a247-dea8-4219-98c6-04c5bb592173 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.156891 Oct 17 13:49:58.896550 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3966/7625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:58 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:59.920435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:59.921040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:59.927918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:59.928410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:59.928856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:59.929559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:59.930024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:59.931121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:00.072563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:00.081275 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a562f7a2-36fd-4e3e-87e0-769a01ea84ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.165386 Oct 17 13:50:00.081799 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3660/7626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:59 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:01.106904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:01.107531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:01.114698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:01.115200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:01.115636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:01.116347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:01.117070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:01.117499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:01.285021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:01.296019 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31d8b6ce-468a-4bc6-b83b-d8fed133ab8d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.194233 Oct 17 13:50:01.296759 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3967/7627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:01 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:02.322323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:02.323140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:02.331268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:02.331268 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:02.331719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:02.332496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:02.333022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:02.333471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:02.481699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:02.490739 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ea670626-85c4-4caa-a85f-9e7634ba2167 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1729 microversion: 2.1 time: 0.172630 Oct 17 13:50:02.491334 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3661/7628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:02 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:03.515110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:03.515832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:03.522545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.523078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.523659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.524578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.525040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.525651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.571139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-5ea431c2-c5d8-4a7d-8fab-66947535e772 req-4d9efcfd-f0f3-400c-b31a-89b7e44e2d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "name": "network-vif-unplugged", "status": "completed", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:03.582435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ea431c2-c5d8-4a7d-8fab-66947535e772 req-4d9efcfd-f0f3-400c-b31a-89b7e44e2d31 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.582929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ea431c2-c5d8-4a7d-8fab-66947535e772 req-4d9efcfd-f0f3-400c-b31a-89b7e44e2d31 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.583358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ea431c2-c5d8-4a7d-8fab-66947535e772 req-4d9efcfd-f0f3-400c-b31a-89b7e44e2d31 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.595899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-5ea431c2-c5d8-4a7d-8fab-66947535e772 req-4d9efcfd-f0f3-400c-b31a-89b7e44e2d31 service nova] Creating event network-vif-unplugged:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h1-853316-12 Oct 17 13:50:03.601734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-5ea431c2-c5d8-4a7d-8fab-66947535e772 req-4d9efcfd-f0f3-400c-b31a-89b7e44e2d31 service nova] Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:03.615920 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-5ea431c2-c5d8-4a7d-8fab-66947535e772 req-4d9efcfd-f0f3-400c-b31a-89b7e44e2d31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048475 Oct 17 13:50:03.616724 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3662/7629] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:03.669128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:03.678623 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a30fbe00-c9e5-48e9-a222-352f6d6953d1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1728 microversion: 2.1 time: 0.167311 Oct 17 13:50:03.679643 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3968/7630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:03 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:04.761441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:04.761970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:04.769292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:04.769861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:04.770420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.771235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:04.771781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:04.772285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.911922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:04.920187 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-201f41f5-8b21-4613-86da-ae35330ab90c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.219895 Oct 17 13:50:04.920759 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3663/7631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:04 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:05.654044 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-08bd91e1-e223-43e7-aa2b-3e1c049c33ec req-bf714c1d-fc18-4d65-acb4-42efe7fa26b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:05.664991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-08bd91e1-e223-43e7-aa2b-3e1c049c33ec req-bf714c1d-fc18-4d65-acb4-42efe7fa26b8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.665514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-08bd91e1-e223-43e7-aa2b-3e1c049c33ec req-bf714c1d-fc18-4d65-acb4-42efe7fa26b8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.665987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-08bd91e1-e223-43e7-aa2b-3e1c049c33ec req-bf714c1d-fc18-4d65-acb4-42efe7fa26b8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.678542 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-08bd91e1-e223-43e7-aa2b-3e1c049c33ec req-bf714c1d-fc18-4d65-acb4-42efe7fa26b8 service nova] Creating event network-changed:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h1-853316-12 Oct 17 13:50:05.684552 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-08bd91e1-e223-43e7-aa2b-3e1c049c33ec req-bf714c1d-fc18-4d65-acb4-42efe7fa26b8 service nova] Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:05.696038 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-08bd91e1-e223-43e7-aa2b-3e1c049c33ec req-bf714c1d-fc18-4d65-acb4-42efe7fa26b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046413 Oct 17 13:50:05.696654 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3969/7632] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:05.943746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:05.945066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:05.955055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.955931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.956400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.957148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.957627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.958125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:06.283881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:06.293799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5e7664ea-3971-48c9-a0fa-82d0d1611863 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.353972 Oct 17 13:50:06.294737 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3664/7633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:05 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:07.318405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:07.319119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:07.326047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.326575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.327022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.327811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.328268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.328697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.475719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:07.485337 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a7bba0a7-87d9-46ed-8611-00da5842c47e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.172139 Oct 17 13:50:07.486089 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3970/7634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:07 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:08.508898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:08.509562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:08.517381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:08.517883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:08.518371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:08.519088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:08.519553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:08.519993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:08.671354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:08.680013 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48603414-d5ab-4157-9523-406ec4826da1 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.174935 Oct 17 13:50:08.680615 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3665/7635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:08 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:09.704241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:09.704862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:09.712736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.713102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.713626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.714321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.714995 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.715579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.852321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:09.861261 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7dd9e4e9-ec7d-4355-bac6-f249d97fcc28 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.161239 Oct 17 13:50:09.861824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3971/7636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:09 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:10.885711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:10.886537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:10.893281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.893774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.894316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.895021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.895487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.895925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:11.023048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:11.032111 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-56b6aaa4-16ef-4b5f-b321-ec30068c12ee tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.150887 Oct 17 13:50:11.032695 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3666/7637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:10 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:12.055436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:12.056037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:12.063335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:12.063820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:12.064258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:12.064952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:12.065403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:12.065827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:12.199709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:12.202029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=81 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:12.209660 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c167fcf4-74d9-43e5-aa2d-2fc6c7618478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.158323 Oct 17 13:50:12.210249 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3972/7638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:12 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:13.233131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:13.233780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:13.236701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=35 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:13.241914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.242446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.242902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.243618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.244093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.244538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.247702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:13.382908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:13.391731 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f6fc1e7f-b10a-4686-ada2-60016bc5b202 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.162694 Oct 17 13:50:13.392317 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3667/7639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:13 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:14.414760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:14.415367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:14.418840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=29 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:14.424231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:14.424720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:14.425163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:14.425863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:14.426350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:14.426786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:14.556910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:14.565425 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-166c629b-b07b-4df9-af8c-7dc7fcc7d3e3 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.154549 Oct 17 13:50:14.566002 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3973/7640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:14 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:15.590734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:15.591479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:15.598584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.599082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.599795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.600547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.601013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.601454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.733812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:15.742042 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f783d4fb-3d7a-4ca9-82aa-3d8a4ff60b63 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.156796 Oct 17 13:50:15.742641 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3668/7641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:15 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:16.766667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:16.767211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:16.774386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:16.774904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:16.775346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:16.776109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:16.776594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:16.777017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:16.914792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:16.924133 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c45c573f-9666-4a43-b455-203e189d2be9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.161574 Oct 17 13:50:16.924721 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3974/7642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:16 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:17.948565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:17.950003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:17.957705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:17.961312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:17.961312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:17.961312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:17.961312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:17.961312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:18.099038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:18.112024 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a327a16-16b1-4b87-a048-2d22adf074ce tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1726 microversion: 2.1 time: 0.167215 Oct 17 13:50:18.112916 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3669/7643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:17 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:19.137583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:19.138248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:19.145169 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.145657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.146101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.146892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.147346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.147776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.287050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:19.296731 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e24a3426-b40d-41d1-8018-48dcfb194945 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1723 microversion: 2.1 time: 0.163205 Oct 17 13:50:19.297320 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3975/7644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:19 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:19.320797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:19.321371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:19.328920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.329690 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.330151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.330911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.331386 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.331832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.371957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.372640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.372901 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.373651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.374122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.374590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.404138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for project 10b6a534a0584ac5a5b1041188f25290. Resources: {'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:50:19.409956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Getting quotas for user e9d88c6d47404b2d8ef7eb4325be60d1 and project 10b6a534a0584ac5a5b1041188f25290. Resources: {'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:50:19.539105 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de419f6f-dfa2-4d2b-a535-21ba14a68556 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "POST /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.221364 Oct 17 13:50:19.540149 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3670/7645] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:50:19 2022] POST /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:19.560420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:19.561590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:19.569867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.570674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.571342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.572217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.572831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.573433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.725412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:19.735489 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a29737c6-ce64-400a-a7e7-da7258c0595c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.188436 Oct 17 13:50:19.735489 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3976/7646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:19 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:20.759565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:20.760234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:20.769092 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:20.769657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:20.770145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:20.770879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:20.771348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:20.771790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:20.906275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:20.914695 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c97236df-490e-4d88-98bf-7e0769b95248 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.159562 Oct 17 13:50:20.915263 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3671/7647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:20 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:21.563058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-e606d978-7e59-4762-8382-4c748e199e16 req-3354b2b2-c69d-4599-b88f-805c198676fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "name": "network-vif-plugged", "status": "completed", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:21.574440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e606d978-7e59-4762-8382-4c748e199e16 req-3354b2b2-c69d-4599-b88f-805c198676fb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:21.575056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e606d978-7e59-4762-8382-4c748e199e16 req-3354b2b2-c69d-4599-b88f-805c198676fb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:21.575362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-e606d978-7e59-4762-8382-4c748e199e16 req-3354b2b2-c69d-4599-b88f-805c198676fb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:21.588196 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-e606d978-7e59-4762-8382-4c748e199e16 req-3354b2b2-c69d-4599-b88f-805c198676fb service nova] Creating event network-vif-plugged:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h1-853316-12 Oct 17 13:50:21.593998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-e606d978-7e59-4762-8382-4c748e199e16 req-3354b2b2-c69d-4599-b88f-805c198676fb service nova] Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:21.605927 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-e606d978-7e59-4762-8382-4c748e199e16 req-3354b2b2-c69d-4599-b88f-805c198676fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046880 Oct 17 13:50:21.606958 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3977/7648] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:21.938454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:21.939089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:21.946728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:21.947285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:21.947859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:21.948628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:21.949113 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:21.949587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:22.093576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:22.104736 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dda6de0e-427e-434d-a5b6-89db9a496c48 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.170263 Oct 17 13:50:22.105514 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3672/7649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:21 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:23.129587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:23.130642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:23.137307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.137815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.138280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.138983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.139444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.139867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.278807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:23.287347 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8e2db989-b2ff-4173-989c-85956c2282cd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.162858 Oct 17 13:50:23.306910 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3978/7650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:23 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:24.331336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:24.331965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:24.340647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:24.341165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:24.341632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:24.342412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:24.342889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:24.343339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:24.480201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:24.489152 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de9d82f4-42d8-461d-b744-2466bbf0d0ad tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.162001 Oct 17 13:50:24.489840 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3673/7651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:24 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:24.919979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-62dc2347-28f5-4976-8a5f-4ca977b993d4 req-45cee649-9955-4ac0-91e3-3c2d8599968d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "name": "network-vif-unplugged", "status": "completed", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:24.931582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-62dc2347-28f5-4976-8a5f-4ca977b993d4 req-45cee649-9955-4ac0-91e3-3c2d8599968d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:24.932237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-62dc2347-28f5-4976-8a5f-4ca977b993d4 req-45cee649-9955-4ac0-91e3-3c2d8599968d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:24.932859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-62dc2347-28f5-4976-8a5f-4ca977b993d4 req-45cee649-9955-4ac0-91e3-3c2d8599968d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:24.945743 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-62dc2347-28f5-4976-8a5f-4ca977b993d4 req-45cee649-9955-4ac0-91e3-3c2d8599968d service nova] Creating event network-vif-unplugged:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h2-853316-12 Oct 17 13:50:24.952353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-62dc2347-28f5-4976-8a5f-4ca977b993d4 req-45cee649-9955-4ac0-91e3-3c2d8599968d service nova] Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:24.964644 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-62dc2347-28f5-4976-8a5f-4ca977b993d4 req-45cee649-9955-4ac0-91e3-3c2d8599968d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049035 Oct 17 13:50:24.966743 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3979/7652] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:25.517250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:25.517876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:25.524978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:25.525479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:25.525934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:25.526692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:25.527159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:25.527709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:25.730667 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:50:25.730911 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 13:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 (ip 10.222.0.27) !!! Oct 17 13:50:25.744241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:25.753933 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-61009386-e68c-4859-bf1a-3ad594292be0 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.241774 Oct 17 13:50:25.754551 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3674/7653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:25 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:26.779644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:26.780275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:26.783085 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:50:26.783344 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 (ip 10.222.0.27) !!! Oct 17 13:50:26.794191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.794675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.795107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.795803 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.796255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.796678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.935633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:26.944023 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3a3c723-c1ee-4d19-924a-b4d8a78cd0e6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.170075 Oct 17 13:50:26.944599 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3980/7654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:26 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:27.005187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-11870d80-4e1a-4994-a184-a41783013863 req-298181a4-b7e6-4731-a96c-cbc8e450f560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:27.016322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-11870d80-4e1a-4994-a184-a41783013863 req-298181a4-b7e6-4731-a96c-cbc8e450f560 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:27.016814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-11870d80-4e1a-4994-a184-a41783013863 req-298181a4-b7e6-4731-a96c-cbc8e450f560 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:27.017261 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-11870d80-4e1a-4994-a184-a41783013863 req-298181a4-b7e6-4731-a96c-cbc8e450f560 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:27.029211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-11870d80-4e1a-4994-a184-a41783013863 req-298181a4-b7e6-4731-a96c-cbc8e450f560 service nova] Creating event network-changed:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h2-853316-12 Oct 17 13:50:27.034492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-11870d80-4e1a-4994-a184-a41783013863 req-298181a4-b7e6-4731-a96c-cbc8e450f560 service nova] Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:27.045993 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-11870d80-4e1a-4994-a184-a41783013863 req-298181a4-b7e6-4731-a96c-cbc8e450f560 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044520 Oct 17 13:50:27.046862 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3675/7655] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:27.969421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:27.970027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:27.976896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:27.977374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:27.977807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:27.978530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:27.978977 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:27.979398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:28.117423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:28.126311 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b15851d6-4ae6-467b-8bc6-58b10908ddc8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.161425 Oct 17 13:50:28.126897 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3981/7656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:27 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:29.150779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:29.151491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:29.159520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:29.160025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:29.160816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.161181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:29.161645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:29.162083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.303964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:29.312874 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-94687cb6-7256-428f-903b-ca33080177d7 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.166446 Oct 17 13:50:29.313441 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3676/7657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:29 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:30.336374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:30.337017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:30.344072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.344563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.345002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.345731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.346197 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.346655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.489533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:30.498476 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-163bb37b-f640-4abe-8f25-4ce4cbe4431e tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.166165 Oct 17 13:50:30.499062 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3982/7658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:30 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:31.522986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:31.523600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:31.525566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:31.531979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:31.532481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:31.532932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:31.533642 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:31.534106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:31.534580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:31.670936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:31.679211 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b259f8f9-08ec-4903-9546-1517bd7e17c6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.160092 Oct 17 13:50:31.679797 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3677/7659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:31 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:32.702558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:32.703174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:32.710501 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.710993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.711431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.712132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.712591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.713022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.850353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:32.858714 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-02b7a892-f4ea-490d-a963-35732bb3585b tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.160647 Oct 17 13:50:32.859301 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3983/7660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:32 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:33.881167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:33.881870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:33.888950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:33.889447 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:33.889896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:33.890640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:33.891106 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:33.891547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:34.026356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:34.036348 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de84c232-e789-424c-ab16-36368794867a tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.158949 Oct 17 13:50:34.036973 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3678/7661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:33 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:35.059466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:35.060080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:35.066947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:35.067428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:35.067866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:35.068562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:35.069015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:35.069442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:35.207908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:35.216332 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-121d4fd8-2eda-4daa-b04c-beddf384c4ea tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.161021 Oct 17 13:50:35.216903 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3984/7662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:35 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:36.240195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:36.240827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:36.256761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:36.257260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:36.257714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:36.258470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:36.258946 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:36.259396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:36.392428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:36.400892 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bd79bc8f-009c-473e-8fb8-d2ecb084c8cb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.164608 Oct 17 13:50:36.401489 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3679/7663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:36 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:37.425841 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:37.426480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:37.433609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:37.434111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:37.434662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:37.435289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:37.435751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:37.436178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:37.578392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:37.588835 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-84137097-3caf-4e91-a1e3-e203dc434478 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1722 microversion: 2.1 time: 0.168037 Oct 17 13:50:37.589442 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3985/7664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:37 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:38.615518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:38.616168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:38.623139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.623649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.624104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.624825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.625305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.625751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.757385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:38.765630 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-05ad091b-8471-48b0-a601-50e972564eb5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1715 microversion: 2.1 time: 0.155653 Oct 17 13:50:38.766231 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3680/7665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:38 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:38.788918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:38.789531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:38.796588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.797075 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.797519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.799142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.799653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.800087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.936404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:38.944804 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a723168b-b823-41e7-9930-a177a09737b4 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1715 microversion: 2.1 time: 0.159854 Oct 17 13:50:38.945384 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3986/7666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:38 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:39.022913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:39.023724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:39.030084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.030620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.031080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.031800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.033004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.033288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.036199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:39.176250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:39.184838 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c5e7e85f-29cc-4148-a900-0cec9b084587 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1715 microversion: 2.1 time: 0.165916 Oct 17 13:50:39.185417 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3681/7667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:39 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:39.207754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:39.208247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:39.214513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.214994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.215466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.216158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.216603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.217026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.243545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:50:39.321342 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-53164c71-346f-43ad-953b-c984406b357d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 204 len: 0 microversion: 2.1 time: 0.117892 Oct 17 13:50:39.325429 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3987/7668] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:39 2022] DELETE /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:50:39.331042 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:39.331672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:39.337659 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.338180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.338646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.339362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.339829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.340274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.472611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:39.480910 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7d47c9d-bd09-4357-814e-6f7bce53db60 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1721 microversion: 2.1 time: 0.154344 Oct 17 13:50:39.481488 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3682/7669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:39 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:40.307349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-6e698fb9-0894-4698-8949-c32b5ecda2e2 req-041c8451-3fa2-452f-8208-8d0820f9edcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "name": "network-vif-plugged", "status": "completed", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:40.321386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6e698fb9-0894-4698-8949-c32b5ecda2e2 req-041c8451-3fa2-452f-8208-8d0820f9edcf service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:40.321940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6e698fb9-0894-4698-8949-c32b5ecda2e2 req-041c8451-3fa2-452f-8208-8d0820f9edcf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:40.322398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-6e698fb9-0894-4698-8949-c32b5ecda2e2 req-041c8451-3fa2-452f-8208-8d0820f9edcf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:40.334071 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-6e698fb9-0894-4698-8949-c32b5ecda2e2 req-041c8451-3fa2-452f-8208-8d0820f9edcf service nova] Creating event network-vif-plugged:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h2-853316-12 Oct 17 13:50:40.339214 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-6e698fb9-0894-4698-8949-c32b5ecda2e2 req-041c8451-3fa2-452f-8208-8d0820f9edcf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036313 Oct 17 13:50:40.339815 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3988/7670] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:40.505345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:40.505915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:40.513210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:40.513705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:40.514199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:40.514876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:40.515371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:40.515811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:40.651390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:40.659816 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e315327e-3bd6-4ad5-a0ae-2c545dd574ba tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1721 microversion: 2.1 time: 0.158982 Oct 17 13:50:40.660392 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3683/7671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:40 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:41.684366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:41.684985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:41.692921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:41.693743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:41.693863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:41.694592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:41.695048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:41.695471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:41.737033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:41.765601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-07094518-c443-455f-bf06-20feb72d40c4 req-fe0064f6-3032-47b0-9e6e-8cb1ec50ed14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00b2dbf-810a-4427-9840-fdebb24dd8b0", "name": "network-vif-deleted", "tag": "8a85ab4d-587f-43a0-8011-168fd3f93e52"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:41.781519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-07094518-c443-455f-bf06-20feb72d40c4 req-fe0064f6-3032-47b0-9e6e-8cb1ec50ed14 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:41.782051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-07094518-c443-455f-bf06-20feb72d40c4 req-fe0064f6-3032-47b0-9e6e-8cb1ec50ed14 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:41.782860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-07094518-c443-455f-bf06-20feb72d40c4 req-fe0064f6-3032-47b0-9e6e-8cb1ec50ed14 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:41.798369 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-07094518-c443-455f-bf06-20feb72d40c4 req-fe0064f6-3032-47b0-9e6e-8cb1ec50ed14 service nova] Creating event network-vif-deleted:8a85ab4d-587f-43a0-8011-168fd3f93e52 for instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 on n-h2-853316-12 Oct 17 13:50:41.799414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:41.808295 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-07094518-c443-455f-bf06-20feb72d40c4 req-fe0064f6-3032-47b0-9e6e-8cb1ec50ed14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046121 Oct 17 13:50:41.810276 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3677a1ba-e952-4d6a-9602-835c0c4a9ccd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1654 microversion: 2.1 time: 0.130181 Oct 17 13:50:41.810695 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3684/7672] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:41.811443 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3989/7673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:41 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1654 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:42.841652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:42.842423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:42.850180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.850703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.851335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.852073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.852552 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.853003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.946960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:42.956454 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6280b77f-2c75-4e33-a894-43edb052c5bb tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1370 microversion: 2.1 time: 0.120752 Oct 17 13:50:42.957375 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3685/7674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:42 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1370 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:43.980921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:43.981513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:43.989539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:43.990026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:43.990489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:43.991272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:43.991727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:43.992147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:44.057960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:44.066408 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3eef268f-823f-4531-83a8-b7662068900c tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1370 microversion: 2.1 time: 0.089358 Oct 17 13:50:44.066979 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3990/7675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:43 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:45.088611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:45.089170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:45.092052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:45.099026 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:45.099538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:45.099994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:45.100859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:45.101306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:45.101776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:45.172189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d88c6d47404b2d8ef7eb4325be60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b6a534a0584ac5a5b1041188f25290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:45.181656 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f719e8b5-cf63-451d-9514-0792b477b3a5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 200 len: 1370 microversion: 2.1 time: 0.097069 Oct 17 13:50:45.182265 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3686/7676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:45 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:46.204992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:46.205624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:46.208726 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:46.213634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:46.214123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:46.214593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:46.215299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:46.215758 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:46.216232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:46.231180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 HTTP/1.1 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a00b2dbf-810a-4427-9840-fdebb24dd8b0'} Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:46.232869 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3adccc9-8a8c-4f1a-9a6e-ee6bb82a98fd tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 404 len: 111 microversion: 2.1 time: 0.033748 Oct 17 13:50:46.238004 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3991/7677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:46 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:46.298396 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:46.300613 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:46.307256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:46.307758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:46.308213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:46.308931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:46.309402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:46.309845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:46.322663 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/os-volume_attachments HTTP/1.1 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': 'a00b2dbf-810a-4427-9840-fdebb24dd8b0'} Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:46.324362 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-647b4333-0a3c-47e1-a78b-90804e0bc16d tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032232 Oct 17 13:50:46.328515 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3687/7678] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:46 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:49.695060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.695555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.702579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.703057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.703498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.705461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.705923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.706380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.723271 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 HTTP/1.1 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'a00b2dbf-810a-4427-9840-fdebb24dd8b0'} Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:49.725195 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a8f7d0e4-4b02-4018-893b-c31c94d030f5 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 404 len: 111 microversion: 2.1 time: 0.035548 Oct 17 13:50:49.729645 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3992/7679] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:49 2022] DELETE /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:49.736306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.736985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: a00b2dbf-810a-4427-9840-fdebb24dd8b0] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.743893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.744398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.744859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.745576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.746050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.746528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.761288 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 HTTP/1.1 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a00b2dbf-810a-4427-9840-fdebb24dd8b0'} Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.762879 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance a00b2dbf-810a-4427-9840-fdebb24dd8b0 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-498265e8-d699-4f54-9430-a7d8151e6269 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0" status: 404 len: 111 microversion: 2.1 time: 0.032507 Oct 17 13:50:49.767579 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3688/7680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:49 2022] GET /compute/v2.1/servers/a00b2dbf-810a-4427-9840-fdebb24dd8b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:49.773483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.774000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.780332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.780846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.781306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.782135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.782684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.783116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.798733 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 HTTP/1.1 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'f276304c-8f24-4803-879e-d374aaac5cf8'} Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:49.800330 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:49.805008 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f49449fc-3cf6-44f0-83db-4443dcc800f9 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 404 len: 111 microversion: 2.1 time: 0.032463 Oct 17 13:50:49.810194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3993/7681] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:49 2022] DELETE /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:49.811870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.812512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: f276304c-8f24-4803-879e-d374aaac5cf8] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.819849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.820360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.820855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.821593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.822065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.822536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.838064 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 HTTP/1.1 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'f276304c-8f24-4803-879e-d374aaac5cf8'} Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.839692 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance f276304c-8f24-4803-879e-d374aaac5cf8 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-40aa83c8-7354-474f-9298-dd1e2a8f3ea6 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8" status: 404 len: 111 microversion: 2.1 time: 0.033699 Oct 17 13:50:49.847741 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3689/7682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:49 2022] GET /compute/v2.1/servers/f276304c-8f24-4803-879e-d374aaac5cf8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:49.850567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.851066 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.857299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.857784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.858245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.859047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.859459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.859881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.874730 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 HTTP/1.1 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'fe7ddd2a-773f-4d76-bb64-3949c4b55f59'} Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:49.877261 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-eb29e66b-b81e-4bf3-9270-2bec75d47618 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 404 len: 111 microversion: 2.1 time: 0.032057 Oct 17 13:50:49.881889 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3994/7683] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:49 2022] DELETE /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:49.887479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.888105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: fe7ddd2a-773f-4d76-bb64-3949c4b55f59] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.894774 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.895278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.895732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.896449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.896917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.897359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.914747 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 HTTP/1.1 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'fe7ddd2a-773f-4d76-bb64-3949c4b55f59'} Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.916312 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance fe7ddd2a-773f-4d76-bb64-3949c4b55f59 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-91eaa90f-0199-482f-8b3c-ec987f8545d8 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59" status: 404 len: 111 microversion: 2.1 time: 0.034179 Oct 17 13:50:49.926477 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3690/7684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:49 2022] GET /compute/v2.1/servers/fe7ddd2a-773f-4d76-bb64-3949c4b55f59 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:49.930445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.930950 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.939280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.939775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.940215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.940918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.941370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.941856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.956705 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 HTTP/1.1 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '8ba11b20-f74c-4424-8b6b-69d9aab38f12'} Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:49.958308 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4e15330e-b64c-43c7-90cd-0ebc66da0035 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 404 len: 111 microversion: 2.1 time: 0.033953 Oct 17 13:50:49.963440 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3995/7685] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:49 2022] DELETE /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:49.968429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.969061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] [instance: 8ba11b20-f74c-4424-8b6b-69d9aab38f12] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.975389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.975906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.976376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.977949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.977949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.978369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.993811 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] HTTP exception thrown: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Request method failure captured: Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 HTTP/1.1 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTVxgjL_gu1akISD5iZOULfCHtkKLKEchOwXFR_X2ZEoEOc9_BwCi6yXwFrvPc8nSoRQQhvjUKi1bdLC3jjyRvHekDbd9yxc05onZxm8pBwkE0Q5gYy2bYqCtf7I9cv2QYkvZT0al-6L_ksZCfKyysfcW-AU4AQOcwJ-ikyLKFvn7jUI Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10b6a534a0584ac5a5b1041188f25290", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10b6a534a0584ac5a5b1041188f25290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 10b6a534a0584ac5a5b1041188f25290 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServerActionsTestJSON-1859251212 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: e9d88c6d47404b2d8ef7eb4325be60d1 Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServerActionsTestJSON-1859251212-project Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '8ba11b20-f74c-4424-8b6b-69d9aab38f12'} Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:49.995412 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Returning 404 to user: Instance 8ba11b20-f74c-4424-8b6b-69d9aab38f12 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6a45274e-2baf-4c8f-ba9e-e8d5952605bc tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12" status: 404 len: 111 microversion: 2.1 time: 0.032272 Oct 17 13:50:50.000612 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3691/7686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:49 2022] GET /compute/v2.1/servers/8ba11b20-f74c-4424-8b6b-69d9aab38f12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:50:50.006482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e7d0c58-8875-4d8c-a559-7c1b2c992491 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] Calling method '.version_select at 0x7fa8212abf70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:50.037186 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e7d0c58-8875-4d8c-a559-7c1b2c992491 tempest-ServerActionsTestJSON-1859251212 tempest-ServerActionsTestJSON-1859251212-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889155957" status: 202 len: 0 microversion: 2.1 time: 0.034443 Oct 17 13:50:50.037980 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3996/7687] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 13:50:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889155957 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:59.636815 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-552030520", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "583d0309-e3de-4127-a60c-9515334e0008"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:59.695531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] validate_networks() for [('583d0309-e3de-4127-a60c-9515334e0008', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:50:59.983732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=41 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:00.076055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:51:00.076605 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:51:00.077103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:51:00.077537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:51:00.077970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:51:00.087533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.088037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.088496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.089262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.089742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.090205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.109436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Getting quotas for project de03167a84594fff8493eb5a18c3ffa9. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:51:00.115490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Getting quotas for user 09f0c5f6388f4b679d6e6ce119a46f3e and project de03167a84594fff8493eb5a18c3ffa9. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:51:00.128162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:51:00.130538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:51:00.179304 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-59776123-ca19-4b51-909c-b9889780253d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682507 Oct 17 13:51:00.180256 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3692/7688] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:51:00.191752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-009bd939-daac-4c5b-8356-c5a75d1f1d0b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:00.192380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-009bd939-daac-4c5b-8356-c5a75d1f1d0b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:00.197848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=21 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:00.198537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:00.255779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-009bd939-daac-4c5b-8356-c5a75d1f1d0b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:00.264327 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-009bd939-daac-4c5b-8356-c5a75d1f1d0b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1216 microversion: 2.1 time: 0.076804 Oct 17 13:51:00.264895 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3997/7689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:00 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:01.288481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:01.289095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:01.296152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.296951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.298385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:01.299407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.300068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.300674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:01.407829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:01.425223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-953295b6-6a9d-4f8b-9aeb-8c4aad7abf2b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1276 microversion: 2.1 time: 0.141834 Oct 17 13:51:01.426519 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3693/7690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:01 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:02.456591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:02.457221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:02.466300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:02.467557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:02.468627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:02.471069 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:02.472222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:02.473753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:02.667778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:02.682234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-041f164b-734a-4826-a71c-67d483edabc5 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1316 microversion: 2.1 time: 0.233585 Oct 17 13:51:02.684995 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3998/7691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:02 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:03.046393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b602970b-15e8-4c7f-aa61-b40e29ea396c req-b0c80c31-0e52-4129-a081-9152dd7cbe92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5", "tag": "3d024403-5365-4d31-aadb-c7eaa9218345"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:03.065419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b602970b-15e8-4c7f-aa61-b40e29ea396c req-b0c80c31-0e52-4129-a081-9152dd7cbe92 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.066432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b602970b-15e8-4c7f-aa61-b40e29ea396c req-b0c80c31-0e52-4129-a081-9152dd7cbe92 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.067215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b602970b-15e8-4c7f-aa61-b40e29ea396c req-b0c80c31-0e52-4129-a081-9152dd7cbe92 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.092401 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b602970b-15e8-4c7f-aa61-b40e29ea396c req-b0c80c31-0e52-4129-a081-9152dd7cbe92 service nova] Creating event network-changed:3d024403-5365-4d31-aadb-c7eaa9218345 for instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 on n-h1-853316-12 Oct 17 13:51:03.100941 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b602970b-15e8-4c7f-aa61-b40e29ea396c req-b0c80c31-0e52-4129-a081-9152dd7cbe92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080490 Oct 17 13:51:03.101573 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3694/7692] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:03.715510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:03.716124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:03.724284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.724870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.725353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.726246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.726795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.727246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.872008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:03.880062 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7813507b-3e75-4bc6-83c1-a3c38f09621d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1316 microversion: 2.1 time: 0.168499 Oct 17 13:51:03.880583 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 3999/7693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:03 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:04.903955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:04.904685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:04.912122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.912626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.913083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.913805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.914304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.914752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:05.050726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:05.058413 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0dc3abf8-30c8-482a-8037-cda8f0f8f291 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1316 microversion: 2.1 time: 0.158799 Oct 17 13:51:05.058996 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3695/7694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:04 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:06.081628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:06.082400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:06.089177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.089660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.090095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.090814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.091264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.091689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.230088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:06.241621 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b9de21b5-d711-4b87-ad71-375539db4229 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1316 microversion: 2.1 time: 0.164581 Oct 17 13:51:06.254787 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4000/7695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:06 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:07.267575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:07.268202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:07.275007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.275510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.275961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.276699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.277163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.277603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.406710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:07.414609 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-52d94e7d-45b4-4ae4-98b7-86d8a705e300 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1316 microversion: 2.1 time: 0.151616 Oct 17 13:51:07.415199 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3696/7696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:07 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:07.832811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-114c0fa6-5dc4-4419-b48f-a79b951df79d req-2f61d7a6-1d9b-4717-a2b1-eebb8e038aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5", "name": "network-vif-plugged", "status": "completed", "tag": "3d024403-5365-4d31-aadb-c7eaa9218345"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:07.845189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-114c0fa6-5dc4-4419-b48f-a79b951df79d req-2f61d7a6-1d9b-4717-a2b1-eebb8e038aaa service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.845685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-114c0fa6-5dc4-4419-b48f-a79b951df79d req-2f61d7a6-1d9b-4717-a2b1-eebb8e038aaa service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.846114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-114c0fa6-5dc4-4419-b48f-a79b951df79d req-2f61d7a6-1d9b-4717-a2b1-eebb8e038aaa service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.857700 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-114c0fa6-5dc4-4419-b48f-a79b951df79d req-2f61d7a6-1d9b-4717-a2b1-eebb8e038aaa service nova] Creating event network-vif-plugged:3d024403-5365-4d31-aadb-c7eaa9218345 for instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 on n-h1-853316-12 Oct 17 13:51:07.863238 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-114c0fa6-5dc4-4419-b48f-a79b951df79d req-2f61d7a6-1d9b-4717-a2b1-eebb8e038aaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034433 Oct 17 13:51:07.863829 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4001/7697] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:08.437131 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:08.437764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:08.444828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.445330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.445784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.446522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.446993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.447441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.578180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:08.587022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-943b3bcc-3484-4193-a936-d5b54ac7615e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1316 microversion: 2.1 time: 0.153795 Oct 17 13:51:08.587615 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3697/7698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:08 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:09.612741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:09.613443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:09.619693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.620174 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.620607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.621285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.621738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.622170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.759146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:09.767011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8419e716-d0ab-4227-b7e9-506b21a834bf tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1506 microversion: 2.1 time: 0.160074 Oct 17 13:51:09.767633 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4002/7699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:09 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:09.829520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-115522741", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "583d0309-e3de-4127-a60c-9515334e0008"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:09.886600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] validate_networks() for [('583d0309-e3de-4127-a60c-9515334e0008', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:51:10.099645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:10.122454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:10.249089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:51:10.249534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:51:10.250052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:51:10.250505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:51:10.250940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:51:10.260771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:10.261264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:10.261711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:10.262620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:10.263029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:10.263469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:10.280670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Getting quotas for project de03167a84594fff8493eb5a18c3ffa9. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:51:10.286450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Getting quotas for user 09f0c5f6388f4b679d6e6ce119a46f3e and project de03167a84594fff8493eb5a18c3ffa9. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:51:10.299199 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:51:10.301541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:51:10.348395 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7751340-1656-478a-a5d8-351091089433 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522940 Oct 17 13:51:10.349057 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3698/7700] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:51:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:51:10.360140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1790e31d-c9e0-4bcb-a498-0fb3e344948e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:10.360935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1790e31d-c9e0-4bcb-a498-0fb3e344948e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:10.363112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:10.417307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1790e31d-c9e0-4bcb-a498-0fb3e344948e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:10.424861 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1790e31d-c9e0-4bcb-a498-0fb3e344948e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1216 microversion: 2.1 time: 0.068651 Oct 17 13:51:10.425445 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4003/7701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:10 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:11.448919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:11.449565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:11.458444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.459080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.459811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.460694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.461275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.461794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.543644 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:11.552251 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-acd85bd0-7245-43f6-bc7b-6901d4e72fc9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1274 microversion: 2.1 time: 0.108301 Oct 17 13:51:11.552836 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3699/7702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:11 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:12.575443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:12.575957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:12.585067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.585384 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.585885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:12.586857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.587319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.587760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:12.728635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:12.736401 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3a438ff-0c5e-4fa5-8b3e-4a5beba07a9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1316 microversion: 2.1 time: 0.164922 Oct 17 13:51:12.736946 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4004/7703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:12 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:13.077097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-418f199e-e93f-4007-a3a8-4027eb9ab3c8 req-661f6839-f94c-4f7d-b524-0c4ce3516580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a48101-6ea9-465f-946f-d01d406462dd", "tag": "84c9357a-e36b-4cad-9965-1677ce6c733a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:13.091302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-418f199e-e93f-4007-a3a8-4027eb9ab3c8 req-661f6839-f94c-4f7d-b524-0c4ce3516580 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.091797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-418f199e-e93f-4007-a3a8-4027eb9ab3c8 req-661f6839-f94c-4f7d-b524-0c4ce3516580 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.092244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-418f199e-e93f-4007-a3a8-4027eb9ab3c8 req-661f6839-f94c-4f7d-b524-0c4ce3516580 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.104605 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-418f199e-e93f-4007-a3a8-4027eb9ab3c8 req-661f6839-f94c-4f7d-b524-0c4ce3516580 service nova] Creating event network-changed:84c9357a-e36b-4cad-9965-1677ce6c733a for instance e3a48101-6ea9-465f-946f-d01d406462dd on n-h2-853316-12 Oct 17 13:51:13.110952 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-418f199e-e93f-4007-a3a8-4027eb9ab3c8 req-661f6839-f94c-4f7d-b524-0c4ce3516580 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038675 Oct 17 13:51:13.111671 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3700/7704] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:13.759542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:13.760160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:13.767530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.768020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.768461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.769163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.769618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.770048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.905175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:13.913654 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2348b66-e5ac-47cb-9f84-7cb42ac94b31 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1316 microversion: 2.1 time: 0.158123 Oct 17 13:51:13.914262 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4005/7705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:13 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:14.936588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:14.937227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:14.946457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.946965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.947428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:14.948141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.948610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.949052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:15.083455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:15.091185 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e0e9ec06-b04f-4885-9427-85365815c900 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1316 microversion: 2.1 time: 0.158979 Oct 17 13:51:15.091763 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3701/7706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:14 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:16.115077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:16.115640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:16.122530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:16.123015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:16.123452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:16.124146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:16.124600 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:16.125027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:16.255892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:16.263630 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-919d4d86-4d0c-467e-9de3-a8b9e3fe0f5e tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1316 microversion: 2.1 time: 0.152545 Oct 17 13:51:16.264193 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4006/7707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:16 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:17.287705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:17.288340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:17.291051 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:17.296477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:17.296982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:17.297434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:17.298792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:17.299266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:17.299808 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:17.433991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:17.442119 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67104bd3-3dca-42f9-be57-9fe7a80bcfcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1316 microversion: 2.1 time: 0.158526 Oct 17 13:51:17.442862 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3702/7708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:17 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:18.465133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:18.465738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:18.473432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.473918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.474388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.475087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.475534 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.475956 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.501286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-32604630-dd00-4a6c-9675-f57300b44d25 req-ae99f26f-abfd-494a-826b-0f64bb9650f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a48101-6ea9-465f-946f-d01d406462dd", "name": "network-vif-plugged", "status": "completed", "tag": "84c9357a-e36b-4cad-9965-1677ce6c733a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:18.514869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32604630-dd00-4a6c-9675-f57300b44d25 req-ae99f26f-abfd-494a-826b-0f64bb9650f8 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.515455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32604630-dd00-4a6c-9675-f57300b44d25 req-ae99f26f-abfd-494a-826b-0f64bb9650f8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.515983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-32604630-dd00-4a6c-9675-f57300b44d25 req-ae99f26f-abfd-494a-826b-0f64bb9650f8 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.528486 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-32604630-dd00-4a6c-9675-f57300b44d25 req-ae99f26f-abfd-494a-826b-0f64bb9650f8 service nova] Creating event network-vif-plugged:84c9357a-e36b-4cad-9965-1677ce6c733a for instance e3a48101-6ea9-465f-946f-d01d406462dd on n-h2-853316-12 Oct 17 13:51:18.534583 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-32604630-dd00-4a6c-9675-f57300b44d25 req-ae99f26f-abfd-494a-826b-0f64bb9650f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037143 Oct 17 13:51:18.535210 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3703/7709] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:18.633773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:18.641585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c27e4bf2-2576-4183-98a9-0f63d602f874 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1316 microversion: 2.1 time: 0.180438 Oct 17 13:51:18.642191 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4007/7710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:18 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:19.664577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:19.665316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:19.672218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.672717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.673164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.673868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.675105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.675481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.817226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:19.825264 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-549d22fe-9359-44ca-84b3-50f3d2ba2dce tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1505 microversion: 2.1 time: 0.165034 Oct 17 13:51:19.825884 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3704/7711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:19 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:19.848115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:19.848624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:19.855567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.856340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.856788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.857487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.857947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.858406 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.884922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:51:19.961611 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c7d22cd9-ed08-45bf-923a-3bacc83b0413 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 204 len: 0 microversion: 2.1 time: 0.117060 Oct 17 13:51:19.962138 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4008/7712] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:19 2022] DELETE /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:51:19.970296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:19.971000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:19.977240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.977736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.978231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.978944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.979415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.979852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.108995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:20.117530 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb061a48-52b6-4857-a712-d0f4c6b390c2 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1511 microversion: 2.1 time: 0.151186 Oct 17 13:51:20.118117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3705/7713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:19 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:21.141690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:21.142439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:21.144483 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:21.150969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.151465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.151906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:21.152606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.153071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.153498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:21.295334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:21.304212 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c492e7a-c8ef-4897-a550-2a6227a08ec9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1511 microversion: 2.1 time: 0.166827 Oct 17 13:51:21.304799 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4009/7714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:21 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:21.985289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-81d4386a-7948-4b31-80bc-f3453f498ca9 req-1e477615-8b53-4149-9793-93a4b75c9de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a48101-6ea9-465f-946f-d01d406462dd", "name": "network-vif-deleted", "tag": "84c9357a-e36b-4cad-9965-1677ce6c733a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:21.999833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:22.000942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:22.004730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-81d4386a-7948-4b31-80bc-f3453f498ca9 req-1e477615-8b53-4149-9793-93a4b75c9de4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:22.005229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-81d4386a-7948-4b31-80bc-f3453f498ca9 req-1e477615-8b53-4149-9793-93a4b75c9de4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:22.005696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-81d4386a-7948-4b31-80bc-f3453f498ca9 req-1e477615-8b53-4149-9793-93a4b75c9de4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.026772 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-81d4386a-7948-4b31-80bc-f3453f498ca9 req-1e477615-8b53-4149-9793-93a4b75c9de4 service nova] Creating event network-vif-deleted:84c9357a-e36b-4cad-9965-1677ce6c733a for instance e3a48101-6ea9-465f-946f-d01d406462dd on n-h2-853316-12 Oct 17 13:51:22.031877 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-81d4386a-7948-4b31-80bc-f3453f498ca9 req-1e477615-8b53-4149-9793-93a4b75c9de4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050252 Oct 17 13:51:22.032593 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3706/7715] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:22.327698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:22.328273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:22.336060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:22.336563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:22.337008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.337725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:22.338199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:22.338635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.373051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:22.373540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:22.373993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.374465 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lazy-loading 'fault' on Instance uuid e3a48101-6ea9-465f-946f-d01d406462dd {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:22.417091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:22.427601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2d2ca94e-56e7-4dad-b2be-2045e844bd72 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 200 len: 1306 microversion: 2.1 time: 0.103912 Oct 17 13:51:22.428422 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4010/7716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:22 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:23.451652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.452363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.459626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.460128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.460576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.461380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.461842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.462309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.475819 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] HTTP exception thrown: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Request method failure captured: Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd HTTP/1.1 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTV3Dul1vslzK6E3P2Ut_U7zHKzv_iz2Kl_2RmjNlkIjy0TQpT013GO6idfWv4S36Quk3HLEuSx0N1NFGcwLQ3wsRlCA--B4bsc38RTX4Rl1-MgTwt4H2o8Zv3FQyiWy9_gP18j3GWLwdxVk-ynHhiRESdq7KSv9SZs3ILeXVX23J2cw Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de03167a84594fff8493eb5a18c3ffa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 09f0c5f6388f4b679d6e6ce119a46f3e Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e3a48101-6ea9-465f-946f-d01d406462dd'} Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:23.477463 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Returning 404 to user: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e0f37f19-f7b8-401b-a44a-02ec9a82da9b tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 404 len: 111 microversion: 2.1 time: 0.032627 Oct 17 13:51:23.482521 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3707/7717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:23 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:23.488609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.489220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.496432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.496913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.497346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.498356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.498809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.499232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.631982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:23.639715 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0cc144b7-aa4c-4667-b4b0-e464ee72fe98 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1506 microversion: 2.1 time: 0.155651 Oct 17 13:51:23.640284 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4011/7718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:23 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:23.662196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dec52f1c-9dad-48cd-acc5-083d903b7bcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:23.664534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dec52f1c-9dad-48cd-acc5-083d903b7bcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 9b20d2e9-32d9-4530-82ef-6d1ddc767082] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.669992 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-dec52f1c-9dad-48cd-acc5-083d903b7bcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] HTTP exception thrown: Instance 9b20d2e9-32d9-4530-82ef-6d1ddc767082 could not be found. Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dec52f1c-9dad-48cd-acc5-083d903b7bcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Request method failure captured: Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/9b20d2e9-32d9-4530-82ef-6d1ddc767082/action HTTP/1.1 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 32 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTV3Dul1vslzK6E3P2Ut_U7zHKzv_iz2Kl_2RmjNlkIjy0TQpT013GO6idfWv4S36Quk3HLEuSx0N1NFGcwLQ3wsRlCA--B4bsc38RTX4Rl1-MgTwt4H2o8Zv3FQyiWy9_gP18j3GWLwdxVk-ynHhiRESdq7KSv9SZs3ILeXVX23J2cw Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de03167a84594fff8493eb5a18c3ffa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 09f0c5f6388f4b679d6e6ce119a46f3e Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: {"resize": {"flavorRef": "452"}} Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 9b20d2e9-32d9-4530-82ef-6d1ddc767082 could not be found. Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '9b20d2e9-32d9-4530-82ef-6d1ddc767082', 'body': {'resize': {'flavorRef': '452'}}} Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b20d2e9-32d9-4530-82ef-6d1ddc767082 could not be found. Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:23.671663 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b20d2e9-32d9-4530-82ef-6d1ddc767082 could not be found. Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b20d2e9-32d9-4530-82ef-6d1ddc767082 could not be found. Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dec52f1c-9dad-48cd-acc5-083d903b7bcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Returning 404 to user: Instance 9b20d2e9-32d9-4530-82ef-6d1ddc767082 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dec52f1c-9dad-48cd-acc5-083d903b7bcc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "POST /compute/v2.1/servers/9b20d2e9-32d9-4530-82ef-6d1ddc767082/action" status: 404 len: 111 microversion: 2.1 time: 0.015025 Oct 17 13:51:23.678391 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3708/7719] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:51:23 2022] POST /compute/v2.1/servers/9b20d2e9-32d9-4530-82ef-6d1ddc767082/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:23.682246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.682858 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.688647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.689127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.689573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.691106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.691430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.691854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.825472 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:23.833980 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-859b2a2d-06a3-4876-a989-b58fea53d8a0 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1506 microversion: 2.1 time: 0.155505 Oct 17 13:51:23.834588 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4012/7720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:23 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:23.857415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.858035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.865790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.866312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.866766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.867469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.867932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.868371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.998071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.006710 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f1bfba44-c7cc-4b69-acff-812513cfb6bc tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1506 microversion: 2.1 time: 0.153339 Oct 17 13:51:24.007276 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3709/7721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:23 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:24.029736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d83288ab-be67-4ffa-ab9e-b31c4fa2f132"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:24.031992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.038968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.039375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.039819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.040515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.040974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.041403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.070132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.075250 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] HTTP exception thrown: Flavor d83288ab-be67-4ffa-ab9e-b31c4fa2f132 could not be found. Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Request method failure captured: Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: request: POST /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5/action HTTP/1.1 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 65 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV3Dul1vslzK6E3P2Ut_U7zHKzv_iz2Kl_2RmjNlkIjy0TQpT013GO6idfWv4S36Quk3HLEuSx0N1NFGcwLQ3wsRlCA--B4bsc38RTX4Rl1-MgTwt4H2o8Zv3FQyiWy9_gP18j3GWLwdxVk-ynHhiRESdq7KSv9SZs3ILeXVX23J2cw Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de03167a84594fff8493eb5a18c3ffa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 09f0c5f6388f4b679d6e6ce119a46f3e Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: {"resize": {"flavorRef": "d83288ab-be67-4ffa-ab9e-b31c4fa2f132"}} Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: exception: Flavor d83288ab-be67-4ffa-ab9e-b31c4fa2f132 could not be found. Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5', 'body': {'resize': {'flavorRef': 'd83288ab-be67-4ffa-ab9e-b31c4fa2f132'}}} Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:24.077127 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d83288ab-be67-4ffa-ab9e-b31c4fa2f132 could not be found. Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d83288ab-be67-4ffa-ab9e-b31c4fa2f132 could not be found. Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d83288ab-be67-4ffa-ab9e-b31c4fa2f132 could not be found. Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Returning 400 to user: Flavor d83288ab-be67-4ffa-ab9e-b31c4fa2f132 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fe6b1905-8b49-4b3d-a027-e2ff6a046fab tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "POST /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5/action" status: 400 len: 107 microversion: 2.1 time: 0.052812 Oct 17 13:51:24.082594 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4013/7722] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:51:24 2022] POST /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:51:24.088460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.089085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.095043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.095543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.096661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.097562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.098030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.098498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.232244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.240474 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a5ee0dc-332b-45b1-8ab5-da80ec21b074 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1506 microversion: 2.1 time: 0.155961 Oct 17 13:51:24.241051 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3710/7723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:24 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:24.263563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.264184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.271020 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.271512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.271957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.272659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.273120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.273549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.293187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:24.412794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.420708 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-42282f42-b3bc-4521-828e-9d9ffbadf1b8 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1506 microversion: 2.1 time: 0.161308 Oct 17 13:51:24.421275 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4014/7724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:24 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:24.443290 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9fdd4b3-4648-4754-aa33-6225ce1a5f78 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9fdd4b3-4648-4754-aa33-6225ce1a5f78 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Request method failure captured: Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: request: POST /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5/action HTTP/1.1 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 29 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTV3Dul1vslzK6E3P2Ut_U7zHKzv_iz2Kl_2RmjNlkIjy0TQpT013GO6idfWv4S36Quk3HLEuSx0N1NFGcwLQ3wsRlCA--B4bsc38RTX4Rl1-MgTwt4H2o8Zv3FQyiWy9_gP18j3GWLwdxVk-ynHhiRESdq7KSv9SZs3ILeXVX23J2cw Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de03167a84594fff8493eb5a18c3ffa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 09f0c5f6388f4b679d6e6ce119a46f3e Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: {"resize": {"flavorRef": ""}} Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5', 'body': {'resize': {'flavorRef': ''}}} Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi '' Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.446943 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d9fdd4b3-4648-4754-aa33-6225ce1a5f78 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d9fdd4b3-4648-4754-aa33-6225ce1a5f78 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "POST /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5/action" status: 400 len: 113 microversion: 2.1 time: 0.009777 Oct 17 13:51:24.452281 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3711/7725] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:51:24 2022] POST /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:51:24.457774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.458375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.464674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.465171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.465610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.466343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.466826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.467281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.600342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.608222 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ab38ae8c-802d-4b84-8f82-5db7795ffbd3 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1506 microversion: 2.1 time: 0.155300 Oct 17 13:51:24.608800 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4015/7726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:24 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:24.635226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.635734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.643443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.644107 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.644540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.645242 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.645708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.646147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.658896 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] HTTP exception thrown: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Request method failure captured: Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd HTTP/1.1 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTV3Dul1vslzK6E3P2Ut_U7zHKzv_iz2Kl_2RmjNlkIjy0TQpT013GO6idfWv4S36Quk3HLEuSx0N1NFGcwLQ3wsRlCA--B4bsc38RTX4Rl1-MgTwt4H2o8Zv3FQyiWy9_gP18j3GWLwdxVk-ynHhiRESdq7KSv9SZs3ILeXVX23J2cw Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de03167a84594fff8493eb5a18c3ffa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 09f0c5f6388f4b679d6e6ce119a46f3e Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e3a48101-6ea9-465f-946f-d01d406462dd'} Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:24.660472 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Returning 404 to user: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de2ad3c8-22ac-48bc-ae04-88411c1ce8d9 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 404 len: 111 microversion: 2.1 time: 0.031468 Oct 17 13:51:24.665133 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3712/7727] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:24 2022] DELETE /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:24.670288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.670899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: e3a48101-6ea9-465f-946f-d01d406462dd] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.677033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.677512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.677946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.678655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.679106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.679527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.693445 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] HTTP exception thrown: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Request method failure captured: Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd HTTP/1.1 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV3Dul1vslzK6E3P2Ut_U7zHKzv_iz2Kl_2RmjNlkIjy0TQpT013GO6idfWv4S36Quk3HLEuSx0N1NFGcwLQ3wsRlCA--B4bsc38RTX4Rl1-MgTwt4H2o8Zv3FQyiWy9_gP18j3GWLwdxVk-ynHhiRESdq7KSv9SZs3ILeXVX23J2cw Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de03167a84594fff8493eb5a18c3ffa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 09f0c5f6388f4b679d6e6ce119a46f3e Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e3a48101-6ea9-465f-946f-d01d406462dd'} Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:24.694974 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Returning 404 to user: Instance e3a48101-6ea9-465f-946f-d01d406462dd could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d7bcbe01-cd09-481c-8730-f6a87627ea47 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd" status: 404 len: 111 microversion: 2.1 time: 0.029921 Oct 17 13:51:24.699801 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4016/7728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:24 2022] GET /compute/v2.1/servers/e3a48101-6ea9-465f-946f-d01d406462dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:24.705039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.706789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.712766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.713196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.713645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.714373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.714839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.715276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.743016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:51:24.826226 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62637160-3f9f-4168-97d9-b11148d2bfee tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "DELETE /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 204 len: 0 microversion: 2.1 time: 0.124756 Oct 17 13:51:24.826877 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3713/7729] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:24 2022] DELETE /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:51:24.836243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.836863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.842888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.843376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.843817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.844515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.844973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.845404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.975498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.983248 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9791bd76-254f-4c00-adf9-e1d650959506 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1512 microversion: 2.1 time: 0.150903 Oct 17 13:51:24.983806 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4017/7730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:24 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:26.008024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:26.008739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:26.015491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.015992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.016442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.017172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.017650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.018805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.022897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:26.154501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:26.162549 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3d335e24-b2c9-49f3-a6a7-2d4a68724f0d tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1512 microversion: 2.1 time: 0.158666 Oct 17 13:51:26.163132 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3714/7731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:26 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:26.878558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2e13d40d-12e0-4b2c-b148-a4af69968d19 req-71b9bbf5-db52-4743-8ad9-6c3045a1d8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5", "name": "network-vif-deleted", "tag": "3d024403-5365-4d31-aadb-c7eaa9218345"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:26.891989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2e13d40d-12e0-4b2c-b148-a4af69968d19 req-71b9bbf5-db52-4743-8ad9-6c3045a1d8bf service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.892474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2e13d40d-12e0-4b2c-b148-a4af69968d19 req-71b9bbf5-db52-4743-8ad9-6c3045a1d8bf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.893861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2e13d40d-12e0-4b2c-b148-a4af69968d19 req-71b9bbf5-db52-4743-8ad9-6c3045a1d8bf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.906930 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2e13d40d-12e0-4b2c-b148-a4af69968d19 req-71b9bbf5-db52-4743-8ad9-6c3045a1d8bf service nova] Creating event network-vif-deleted:3d024403-5365-4d31-aadb-c7eaa9218345 for instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 on n-h1-853316-12 Oct 17 13:51:26.913002 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2e13d40d-12e0-4b2c-b148-a4af69968d19 req-71b9bbf5-db52-4743-8ad9-6c3045a1d8bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039332 Oct 17 13:51:26.913645 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4018/7732] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:27.184967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:27.185587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:27.192876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:27.193450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:27.194247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:27.195503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:27.196354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:27.197148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:27.234888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:27.235391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:27.235865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:27.236429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lazy-loading 'fault' on Instance uuid 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:27.280075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0c5f6388f4b679d6e6ce119a46f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de03167a84594fff8493eb5a18c3ffa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:27.288901 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e96fe823-e1c3-4cdd-a7b1-44f43f203bf7 tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 200 len: 1306 microversion: 2.1 time: 0.107903 Oct 17 13:51:27.289472 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3715/7733] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:27 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:28.313677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:28.314455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] [instance: 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:28.320759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:28.321243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:28.321681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:28.322397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:28.322853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:28.323286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:28.336825 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] HTTP exception thrown: Instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 could not be found. Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Request method failure captured: Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 HTTP/1.1 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV3Dul1vslzK6E3P2Ut_U7zHKzv_iz2Kl_2RmjNlkIjy0TQpT013GO6idfWv4S36Quk3HLEuSx0N1NFGcwLQ3wsRlCA--B4bsc38RTX4Rl1-MgTwt4H2o8Zv3FQyiWy9_gP18j3GWLwdxVk-ynHhiRESdq7KSv9SZs3ILeXVX23J2cw Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de03167a84594fff8493eb5a18c3ffa9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de03167a84594fff8493eb5a18c3ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: de03167a84594fff8493eb5a18c3ffa9 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1241281841 Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 09f0c5f6388f4b679d6e6ce119a46f3e Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-ServersNegativeTestJSON-1241281841-project Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 could not be found. Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5'} Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 could not be found. Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 could not be found. Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:28.338487 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 could not be found. Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] Returning 404 to user: Instance 449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f1950bb8-2fa8-43a5-87a3-0205f8f8c5df tempest-ServersNegativeTestJSON-1241281841 tempest-ServersNegativeTestJSON-1241281841-project] 10.222.0.27 "GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5" status: 404 len: 111 microversion: 2.1 time: 0.031393 Oct 17 13:51:28.343030 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4019/7734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:28 2022] GET /compute/v2.1/servers/449ae5f1-eed3-45fd-a7c8-e13dc43aeeb5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:52:00.373874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:00.375205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:00.553674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-af66ac9b-be58-4308-8055-c9be35ef5f5f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: .version_select at 0x7fa820452ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-70108914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCuR7O1TLcjNlTZZbCMauDpj9m1kITR+GssAGgj7of3F8UHCbteT4QeLH/NORwGVV4/GcY9eI0NTM2pNXKkmJ4Go5Dc8ALpwzwq2Wr4kiZzn1MxeFUo1bEYOvHF9agoVQ=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:00.569982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-af66ac9b-be58-4308-8055-c9be35ef5f5f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for project e4feb3e35a774a7d96ceed4547903de3. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:00.575498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-af66ac9b-be58-4308-8055-c9be35ef5f5f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for user ac2553f6be79486abbb14987bee7af25 and project e4feb3e35a774a7d96ceed4547903de3. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:00.619610 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-af66ac9b-be58-4308-8055-c9be35ef5f5f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.250963 Oct 17 13:52:00.620470 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3716/7735] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:52:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:00.674693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-431655910", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-70108914", "networks": [{"uuid": "67cab846-0b14-41e4-9e59-abe98f99cdf1"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:00.685767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:00.686706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=20 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:00.739644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] validate_networks() for [('67cab846-0b14-41e4-9e59-abe98f99cdf1', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:52:01.214313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:52:01.214780 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:52:01.215266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:52:01.215685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:52:01.216104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:52:01.227356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:01.227855 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:01.228300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:01.229045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:01.229509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:01.230158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:01.256428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for project e4feb3e35a774a7d96ceed4547903de3. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:01.263051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for user ac2553f6be79486abbb14987bee7af25 and project e4feb3e35a774a7d96ceed4547903de3. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:01.279961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:52:01.282971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:52:01.332631 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [ea64873f-0855-4521-8e24-2c7f045884cf] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:52:02.339447 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [ea64873f-0855-4521-8e24-2c7f045884cf] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44658. Oct 17 13:52:02.343535 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6ac52f9-d5b1-4808-a247-4f264fd842ce tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673763 Oct 17 13:52:02.344185 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4020/7736] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:52:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:52:02.357098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a3c36017-af4b-451c-9344-d0c38d575351 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:02.357731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a3c36017-af4b-451c-9344-d0c38d575351 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:02.415359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a3c36017-af4b-451c-9344-d0c38d575351 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:02.423553 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a3c36017-af4b-451c-9344-d0c38d575351 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1260 microversion: 2.1 time: 0.071413 Oct 17 13:52:02.424159 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3717/7737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:02 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1260 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:03.448124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:03.449328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:03.462706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:03.465881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:03.466745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:03.468347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:03.468903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:03.469358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:03.581638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:03.593627 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-524a57a1-1c27-43b1-8090-24e9c32da92f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1320 microversion: 2.1 time: 0.150002 Oct 17 13:52:03.595701 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4021/7738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:03 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:04.627135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:04.629885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:04.644634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:04.645708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:04.646686 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:04.648674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:04.650448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:04.651465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:05.029985 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:05.043724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a9574ac6-fb67-4a7e-a398-c9ca75d867bf tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1360 microversion: 2.1 time: 0.424731 Oct 17 13:52:05.045145 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3718/7739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:04 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1360 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:05.269193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-af0f8dea-6ef8-450c-ae7f-85847430cb19 req-f466a832-c80e-41f1-ac77-a1e87c7b8d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42277f0-f8bd-42a3-b98f-e3a4ccb85907", "tag": "b7638370-5762-4655-acc4-4d31153ff063"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:05.288563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-af0f8dea-6ef8-450c-ae7f-85847430cb19 req-f466a832-c80e-41f1-ac77-a1e87c7b8d0a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:05.289430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-af0f8dea-6ef8-450c-ae7f-85847430cb19 req-f466a832-c80e-41f1-ac77-a1e87c7b8d0a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:05.290327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-af0f8dea-6ef8-450c-ae7f-85847430cb19 req-f466a832-c80e-41f1-ac77-a1e87c7b8d0a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:05.303792 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-af0f8dea-6ef8-450c-ae7f-85847430cb19 req-f466a832-c80e-41f1-ac77-a1e87c7b8d0a service nova] Creating event network-changed:b7638370-5762-4655-acc4-4d31153ff063 for instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 on n-h2-853316-12 Oct 17 13:52:05.309154 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-af0f8dea-6ef8-450c-ae7f-85847430cb19 req-f466a832-c80e-41f1-ac77-a1e87c7b8d0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046212 Oct 17 13:52:05.309908 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4022/7740] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:06.069424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:06.070364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:06.078888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:06.079382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:06.080118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:06.081687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:06.082059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:06.082543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:06.705419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:06.715697 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-813bc927-e631-45a8-bbba-4fbe6a5fc839 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1360 microversion: 2.1 time: 0.650572 Oct 17 13:52:06.716583 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3719/7741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:06 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1360 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:07.743869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:07.745124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:07.751912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:07.752416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:07.753439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:07.754445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:07.755262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:07.755703 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:07.960008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:07.968683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-416a0aaf-c97a-431c-9389-4414c61563e9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1360 microversion: 2.1 time: 0.231373 Oct 17 13:52:07.969366 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4023/7742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:07 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:08.993960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:08.994742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:09.001682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:09.002206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:09.002782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:09.003501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:09.004011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:09.004563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:09.153075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:09.163140 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cff268b3-5c88-45a8-9ad4-91985a638268 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1360 microversion: 2.1 time: 0.173103 Oct 17 13:52:09.163755 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3720/7743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:08 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:10.185972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:10.187332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:10.195085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:10.195609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:10.196053 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:10.196761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:10.197216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:10.197671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:10.334846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:10.342692 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ec4f5fda-9c68-4e0f-ae33-1a94b3ec1a5b tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1360 microversion: 2.1 time: 0.160665 Oct 17 13:52:10.343281 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4024/7744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:10 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:10.767792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7d77586f-5cc8-482d-8917-31ff51be4cea req-df7aebe2-b037-4875-aefb-a09d608ef056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42277f0-f8bd-42a3-b98f-e3a4ccb85907", "name": "network-vif-plugged", "status": "completed", "tag": "b7638370-5762-4655-acc4-4d31153ff063"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:10.780934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d77586f-5cc8-482d-8917-31ff51be4cea req-df7aebe2-b037-4875-aefb-a09d608ef056 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:10.781601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d77586f-5cc8-482d-8917-31ff51be4cea req-df7aebe2-b037-4875-aefb-a09d608ef056 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:10.782071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7d77586f-5cc8-482d-8917-31ff51be4cea req-df7aebe2-b037-4875-aefb-a09d608ef056 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:10.794600 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7d77586f-5cc8-482d-8917-31ff51be4cea req-df7aebe2-b037-4875-aefb-a09d608ef056 service nova] Creating event network-vif-plugged:b7638370-5762-4655-acc4-4d31153ff063 for instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 on n-h2-853316-12 Oct 17 13:52:10.800120 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7d77586f-5cc8-482d-8917-31ff51be4cea req-df7aebe2-b037-4875-aefb-a09d608ef056 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036293 Oct 17 13:52:10.802136 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3721/7745] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:11.365315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:11.365922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:11.368807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:11.369492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:11.375655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:11.376156 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:11.376598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:11.377315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:11.377772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:11.378230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:11.513103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:11.521765 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b0973a4c-fcc5-4508-946b-32b9d6bd4e44 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1360 microversion: 2.1 time: 0.160386 Oct 17 13:52:11.522381 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4025/7746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:11 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:12.545662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:12.546352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:12.549082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:12.555953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.556760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.557225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.557928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.558432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.558869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.692067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:12.700091 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-26fa67b2-6d11-4794-a763-0bc831161855 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1552 microversion: 2.1 time: 0.158823 Oct 17 13:52:12.700675 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3722/7747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:12 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:12.722412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:12.723878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:12.730418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.730902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.731337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.732026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.732476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.732896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.881725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:12.889824 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f602f0bc-b51b-4b25-aa87-2a4025328575 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1552 microversion: 2.1 time: 0.171233 Oct 17 13:52:12.890433 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4026/7748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:12 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:14.537535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16172ad6-d5be-4c99-aad1-abb89bd41c50"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:14.539917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:14.547058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:14.547561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:14.548011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:14.548724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:14.549186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:14.549622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:14.797813 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a873a3de-179e-465a-a028-0af4dfa4b308 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265079 Oct 17 13:52:14.798486 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3723/7749] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:52:14 2022] POST /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:25.534436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:25.534935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:25.538524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:25.539191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=34 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:25.545420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:25.545908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:25.546381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:25.547082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:25.547542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:25.547980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:25.631237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lazy-loading 'services' on Instance uuid a42277f0-f8bd-42a3-b98f-e3a4ccb85907 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:52:25.708251 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ebebef1-a5dc-47e7-a3c3-ac45285039aa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments/16172ad6-d5be-4c99-aad1-abb89bd41c50" status: 202 len: 0 microversion: 2.1 time: 0.177068 Oct 17 13:52:25.709082 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4027/7750] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:52:25 2022] DELETE /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments/16172ad6-d5be-4c99-aad1-abb89bd41c50 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:52:25.715650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:25.716449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:25.721818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:25.725184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:25.734196 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:25.734872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:25.735333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:25.736055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:25.736524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:25.736970 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:25.769566 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-544a080e-f8fe-47de-be54-7dc141a1ca19 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055834 Oct 17 13:52:25.770133 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3724/7751] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:25 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:26.784340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:26.787276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:26.793910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:26.794432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:26.794874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:26.795568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:26.796022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:26.796449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:26.828159 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-70c656d3-0259-46b1-ab6e-38adb58ab7a2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049009 Oct 17 13:52:26.828884 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4028/7752] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:26 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:27.841174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:27.843444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:27.850446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:27.850956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:27.851419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:27.852145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:27.852617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:27.853064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:27.884310 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8b1e2188-70f3-4f42-bf98-9c1a6e9206df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047452 Oct 17 13:52:27.884888 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3725/7753] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:27 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:28.897486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:28.899766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:28.906734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:28.907242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:28.907677 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:28.908369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:28.908818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:28.909244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:28.939599 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7e62ddf4-33bc-4566-9089-66b57ab34bfe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Oct 17 13:52:28.940175 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4029/7754] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:28 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:29.952764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:29.955248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:29.963469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.963976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.964430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.965152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.965620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.966065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.997104 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b727d6a5-9ff1-4aa8-9853-9150411b727a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048346 Oct 17 13:52:29.997677 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3726/7755] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:29 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:31.009840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:31.012037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:31.018794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.019273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.019709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.020394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.020843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.021425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.050075 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-df00e659-2fd1-44d9-bbcf-bc889e7da89e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044948 Oct 17 13:52:31.050686 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4030/7756] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:31 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:52:31.062054 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:31.062622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:31.070288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.070796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.071260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.071974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.072449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.072903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.152021 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] HTTP exception thrown: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 is not attached to volume 16172ad6-d5be-4c99-aad1-abb89bd41c50 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Request method failure captured: Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments/16172ad6-d5be-4c99-aad1-abb89bd41c50 HTTP/1.1 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTV37v-LrIbhvWliABMiHi13yrWViihi_R3S-rQ0O5lgCHAkI6VhpdFL7DxNMa7sQJgKwh73HvB4It1T_pa5LIMhOdooJ_eho6mk-mZkNjEcDs3NLjhCMOWG2NRk-JJkbvBEC_7z3N7RTP2yCTL10RZsa-cLWZ4Rlwc_ntr2cjBPsv4A Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e4feb3e35a774a7d96ceed4547903de3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ac2553f6be79486abbb14987bee7af25 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 is not attached to volume 16172ad6-d5be-4c99-aad1-abb89bd41c50 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': 'a42277f0-f8bd-42a3-b98f-e3a4ccb85907', 'id': '16172ad6-d5be-4c99-aad1-abb89bd41c50'} Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16172ad6-d5be-4c99-aad1-abb89bd41c50. Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 is not attached to volume 16172ad6-d5be-4c99-aad1-abb89bd41c50 Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:31.164518 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:31.169193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:31.169193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:31.169193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 is not attached to volume 16172ad6-d5be-4c99-aad1-abb89bd41c50 Oct 17 13:52:31.169193 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:31.169193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Returning 404 to user: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 is not attached to volume 16172ad6-d5be-4c99-aad1-abb89bd41c50 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:31.169193 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-71cc4bb3-cb4f-4a4c-ad0b-b98ba7d1a121 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments/16172ad6-d5be-4c99-aad1-abb89bd41c50" status: 404 len: 154 microversion: 2.1 time: 0.108124 Oct 17 13:52:31.169193 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3727/7757] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:52:31 2022] DELETE /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907/os-volume_attachments/16172ad6-d5be-4c99-aad1-abb89bd41c50 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:52:34.517763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:34.518423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:34.525831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:34.526365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:34.526807 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:34.527514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:34.527972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:34.528397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:34.556088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:52:34.637891 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e02dcc15-60e3-4ea2-b2a6-e406664c2d1e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 204 len: 0 microversion: 2.1 time: 0.123853 Oct 17 13:52:34.638590 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4031/7758] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:52:34 2022] DELETE /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:52:34.648421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:34.649299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:34.656853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:34.657350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:34.657799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:34.658538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:34.659002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:34.659440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:34.797038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:34.806001 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-faa90b68-b0f6-42d2-a042-6e9ae7a0c69e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1558 microversion: 2.1 time: 0.162318 Oct 17 13:52:34.806961 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3728/7759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:34 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:35.830560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:35.831257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:35.840124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.840608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.841043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.841731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.842205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.842635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.979596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:35.987425 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29fe63a5-ec59-42f8-a49f-fe196929112e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1558 microversion: 2.1 time: 0.161440 Oct 17 13:52:35.987993 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4032/7760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:35 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:36.725937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-dfb74779-d9ff-4afb-9ccd-b25cd9156193 req-1bd8e559-313c-4b8b-8e09-e1ae983ce49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42277f0-f8bd-42a3-b98f-e3a4ccb85907", "name": "network-vif-deleted", "tag": "b7638370-5762-4655-acc4-4d31153ff063"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:36.736204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dfb74779-d9ff-4afb-9ccd-b25cd9156193 req-1bd8e559-313c-4b8b-8e09-e1ae983ce49f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.736707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dfb74779-d9ff-4afb-9ccd-b25cd9156193 req-1bd8e559-313c-4b8b-8e09-e1ae983ce49f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.737165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dfb74779-d9ff-4afb-9ccd-b25cd9156193 req-1bd8e559-313c-4b8b-8e09-e1ae983ce49f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.750510 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-dfb74779-d9ff-4afb-9ccd-b25cd9156193 req-1bd8e559-313c-4b8b-8e09-e1ae983ce49f service nova] Creating event network-vif-deleted:b7638370-5762-4655-acc4-4d31153ff063 for instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 on n-h2-853316-12 Oct 17 13:52:36.759366 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-dfb74779-d9ff-4afb-9ccd-b25cd9156193 req-1bd8e559-313c-4b8b-8e09-e1ae983ce49f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118289 Oct 17 13:52:36.760683 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3729/7761] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:37.011616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:37.012229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:37.019114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.019606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.020045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.020751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.021701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.022264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.056122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.056610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.057045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.057511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lazy-loading 'fault' on Instance uuid a42277f0-f8bd-42a3-b98f-e3a4ccb85907 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:52:37.102610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:37.110789 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-399afc73-e2f0-4b4e-a55a-beffb9af9a70 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 200 len: 1350 microversion: 2.1 time: 0.103055 Oct 17 13:52:37.111394 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4033/7762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:37 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:38.134414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:38.135146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: a42277f0-f8bd-42a3-b98f-e3a4ccb85907] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:38.141343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.141842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.142356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.143074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.143547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.143992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.157052 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] HTTP exception thrown: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 could not be found. Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Request method failure captured: Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 HTTP/1.1 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTV37v-LrIbhvWliABMiHi13yrWViihi_R3S-rQ0O5lgCHAkI6VhpdFL7DxNMa7sQJgKwh73HvB4It1T_pa5LIMhOdooJ_eho6mk-mZkNjEcDs3NLjhCMOWG2NRk-JJkbvBEC_7z3N7RTP2yCTL10RZsa-cLWZ4Rlwc_ntr2cjBPsv4A Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e4feb3e35a774a7d96ceed4547903de3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: ac2553f6be79486abbb14987bee7af25 Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 could not be found. Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'a42277f0-f8bd-42a3-b98f-e3a4ccb85907'} Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 could not be found. Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 could not be found. Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:38.158718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 could not be found. Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Returning 404 to user: Instance a42277f0-f8bd-42a3-b98f-e3a4ccb85907 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-62fc35a8-64db-4e86-a4a6-07fb443e7da8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907" status: 404 len: 111 microversion: 2.1 time: 0.030978 Oct 17 13:52:38.164084 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3730/7763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:38 2022] GET /compute/v2.1/servers/a42277f0-f8bd-42a3-b98f-e3a4ccb85907 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:52:38.169608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-83d534a6-ca02-4b9d-8c6b-a617a92604d3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '.version_select at 0x7fa8213490d0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:38.190443 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-83d534a6-ca02-4b9d-8c6b-a617a92604d3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-70108914" status: 202 len: 0 microversion: 2.1 time: 0.024675 Oct 17 13:52:38.191012 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4034/7764] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:52:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-70108914 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:52:38.207988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b2400c0a-2aa6-4ba9-8c92-6dcc9150b9c9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: .version_select at 0x7fa820452ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-213836688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdgxC/a0JsFInrpX9NS3GmUm5X5cUwXhuKNp/0jhJMG8iS6xf01Zo92dFMkz+Oe/NbBFiyPJ+HLOuQhu85KAeoi1U0RZQtBPcTLBRoDRHC3Rl8XQYq7m8ybc7fDrmZ8gw=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:38.225617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b2400c0a-2aa6-4ba9-8c92-6dcc9150b9c9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for project e4feb3e35a774a7d96ceed4547903de3. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:38.230822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-b2400c0a-2aa6-4ba9-8c92-6dcc9150b9c9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for user ac2553f6be79486abbb14987bee7af25 and project e4feb3e35a774a7d96ceed4547903de3. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:38.253164 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b2400c0a-2aa6-4ba9-8c92-6dcc9150b9c9 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049253 Oct 17 13:52:38.253758 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3731/7765] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:52:38 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:38.305325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-890328218", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-213836688", "networks": [{"uuid": "67cab846-0b14-41e4-9e59-abe98f99cdf1"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:38.359669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] validate_networks() for [('67cab846-0b14-41e4-9e59-abe98f99cdf1', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:52:38.735842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:52:38.736263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:52:38.736734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:52:38.737140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:52:38.737547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:52:38.746816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.747293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.747727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.748449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.748896 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.749322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.767005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for project e4feb3e35a774a7d96ceed4547903de3. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:38.773087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for user ac2553f6be79486abbb14987bee7af25 and project e4feb3e35a774a7d96ceed4547903de3. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:38.785145 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:52:38.787569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:52:38.835572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a0f0a601-e071-4517-b150-99f78adca0f7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534230 Oct 17 13:52:38.836231 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4035/7766] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:52:38.847371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-819547a8-678d-42ff-8000-67a3eea94a37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:38.848275 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-819547a8-678d-42ff-8000-67a3eea94a37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:38.905607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-819547a8-678d-42ff-8000-67a3eea94a37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:38.913680 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-819547a8-678d-42ff-8000-67a3eea94a37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1261 microversion: 2.1 time: 0.070170 Oct 17 13:52:38.914279 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3732/7767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:38 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:39.937262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:39.937882 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:39.945274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.946139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.946866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.947808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.948489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.949162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:40.012893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:40.021540 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-06719c6d-70ab-4ec5-ac36-38eb0a857a3f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1319 microversion: 2.1 time: 0.088563 Oct 17 13:52:40.022618 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4036/7768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:39 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:41.044869 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:41.045502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:41.053100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:41.053490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:41.053943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.054691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:41.055155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:41.055595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.263991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-72641872-8d8c-4141-b588-c93a52c4ffe5 req-ebf777e7-49a8-4aea-84ca-43794f238e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7271d0-bf96-4d13-89a4-f723304f586a", "tag": "1b6ad37b-dd85-4f4d-818c-c1526d2cdd60"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:41.282253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:41.283058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-72641872-8d8c-4141-b588-c93a52c4ffe5 req-ebf777e7-49a8-4aea-84ca-43794f238e6b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:41.284018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-72641872-8d8c-4141-b588-c93a52c4ffe5 req-ebf777e7-49a8-4aea-84ca-43794f238e6b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:41.284624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-72641872-8d8c-4141-b588-c93a52c4ffe5 req-ebf777e7-49a8-4aea-84ca-43794f238e6b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.294478 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2d67a7b1-3aeb-4044-ae50-e7957616ff88 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1361 microversion: 2.1 time: 0.252444 Oct 17 13:52:41.297890 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3733/7769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:41 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:41.305818 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-72641872-8d8c-4141-b588-c93a52c4ffe5 req-ebf777e7-49a8-4aea-84ca-43794f238e6b service nova] Creating event network-changed:1b6ad37b-dd85-4f4d-818c-c1526d2cdd60 for instance 9e7271d0-bf96-4d13-89a4-f723304f586a on n-h2-853316-12 Oct 17 13:52:41.314662 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-72641872-8d8c-4141-b588-c93a52c4ffe5 req-ebf777e7-49a8-4aea-84ca-43794f238e6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055419 Oct 17 13:52:41.315435 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4037/7770] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:42.318152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:42.319259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:42.326180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.326676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.327121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.327825 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.328287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.328726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.468111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:42.476613 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-410080e5-8334-4da9-b38f-dda218e1a772 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1361 microversion: 2.1 time: 0.162791 Oct 17 13:52:42.477251 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3734/7771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:42 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:43.500590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:43.501289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:43.509517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:43.509998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:43.510461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:43.511155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:43.511612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:43.512033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:43.648641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:43.656299 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4626d44a-01dc-44b5-a4a4-5e7edeec1724 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1361 microversion: 2.1 time: 0.159985 Oct 17 13:52:43.656857 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4038/7772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:43 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:44.679322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:44.679948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:44.687442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.687881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.688332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.689034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.689497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.689935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.828202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:44.836973 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b9c0562b-14a2-4cdc-ac5c-2f4cfa8a1510 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1361 microversion: 2.1 time: 0.161520 Oct 17 13:52:44.837568 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3735/7773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:44 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:44.953752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-8d864011-52ef-48b5-8a21-42004048edea req-9e2afead-9ec5-4c69-a11c-94056989093e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7271d0-bf96-4d13-89a4-f723304f586a", "name": "network-vif-plugged", "status": "completed", "tag": "1b6ad37b-dd85-4f4d-818c-c1526d2cdd60"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:44.963533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8d864011-52ef-48b5-8a21-42004048edea req-9e2afead-9ec5-4c69-a11c-94056989093e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.964015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8d864011-52ef-48b5-8a21-42004048edea req-9e2afead-9ec5-4c69-a11c-94056989093e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.964448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-8d864011-52ef-48b5-8a21-42004048edea req-9e2afead-9ec5-4c69-a11c-94056989093e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.975296 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-8d864011-52ef-48b5-8a21-42004048edea req-9e2afead-9ec5-4c69-a11c-94056989093e service nova] Creating event network-vif-plugged:1b6ad37b-dd85-4f4d-818c-c1526d2cdd60 for instance 9e7271d0-bf96-4d13-89a4-f723304f586a on n-h2-853316-12 Oct 17 13:52:44.980051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-8d864011-52ef-48b5-8a21-42004048edea req-9e2afead-9ec5-4c69-a11c-94056989093e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093562 Oct 17 13:52:44.980652 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4039/7774] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:45.859700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:45.860329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:45.867195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.867688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.868148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:45.868854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.869327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.869768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.000043 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:46.007817 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e8196b70-4a56-4220-b185-d9896af4b5c6 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1361 microversion: 2.1 time: 0.152052 Oct 17 13:52:46.008387 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3736/7775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:45 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:47.033575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:47.034382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:47.041704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.042315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.042786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.043479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.044011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.044510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.183724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:47.191583 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91860d48-3af6-4322-a7f0-28b6e35072b8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1552 microversion: 2.1 time: 0.163674 Oct 17 13:52:47.192172 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4040/7776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:47 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:47.214666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:47.215288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:47.222099 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.222632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.223108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.223775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.224243 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.224681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.357050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:47.364724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7b2676a0-e87f-49ee-be91-efd148e9d370 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1552 microversion: 2.1 time: 0.154648 Oct 17 13:52:47.365294 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3737/7777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:47 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:48.887652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b312d309-268f-4477-9557-5fa8c2b63ab5"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:48.890046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:48.892853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:48.893515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:48.899158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:48.899634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:48.900072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:48.900761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:48.901213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:48.901634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.138826 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a8509b2-86ec-45e6-a70f-2c08dca300c0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255576 Oct 17 13:52:49.139352 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4041/7778] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:52:48 2022] POST /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:59.875330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:59.875839 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:59.878540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:59.879341 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:59.880186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=64 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:59.888098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:59.888688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:59.889144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:59.889846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:59.890348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:59.890793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:59.971211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lazy-loading 'services' on Instance uuid 9e7271d0-bf96-4d13-89a4-f723304f586a {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:00.041235 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-67cb7a9a-8bb1-4d21-8e2b-69261e962b15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments/b312d309-268f-4477-9557-5fa8c2b63ab5" status: 202 len: 0 microversion: 2.1 time: 0.169598 Oct 17 13:53:00.041826 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3738/7779] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:52:59 2022] DELETE /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments/b312d309-268f-4477-9557-5fa8c2b63ab5 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:53:00.048489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:00.049421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:00.055150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:00.058111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:00.066902 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.067494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.068046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.069856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.070401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.070979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.111295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ea8abb72-0bb0-4285-9712-162e93b148d2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064822 Oct 17 13:53:00.116249 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4042/7780] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:00 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:01.125732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:01.128140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:01.135483 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:01.135980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:01.136438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:01.137154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:01.137621 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:01.138062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:01.168733 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cb069abe-7ec1-43c6-8425-677bdb9d62a3 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048200 Oct 17 13:53:01.169495 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3739/7781] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:01 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:02.181736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:02.183947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:02.190967 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:02.191444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:02.191890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:02.192589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:02.193126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:02.193597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:02.225752 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dff31988-17c7-46ee-b5bb-ff3637c011fe tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048622 Oct 17 13:53:02.230661 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4043/7782] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:02 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:03.238715 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:03.241017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:03.248309 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:03.248809 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:03.249266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:03.249983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:03.250478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:03.250922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:03.282559 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-018e576b-3e7c-4eec-9696-aa5f66161255 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047839 Oct 17 13:53:03.283138 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3740/7783] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:03 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:04.295544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:04.297647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:04.304721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.305205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.305743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.306459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.306939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.307362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.339262 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-148c6980-92c2-43bb-ac9b-88f920ed4219 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047957 Oct 17 13:53:04.339831 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4044/7784] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:04 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:53:05.351992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:05.354990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:05.362116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:05.362647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:05.363104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.364076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:05.364296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:05.364745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.401769 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15ae4d81-6d60-46b2-9c28-c42a37ff9ca5 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053945 Oct 17 13:53:05.402546 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3741/7785] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:05 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:53:05.413182 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:05.413749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:05.421184 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:05.421715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:05.422201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.422878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:05.423334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:05.423759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.517982 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] HTTP exception thrown: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a is not attached to volume b312d309-268f-4477-9557-5fa8c2b63ab5 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Request method failure captured: Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments/b312d309-268f-4477-9557-5fa8c2b63ab5 HTTP/1.1 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV37v-LrIbhvWliABMiHi13yrWViihi_R3S-rQ0O5lgCHAkI6VhpdFL7DxNMa7sQJgKwh73HvB4It1T_pa5LIMhOdooJ_eho6mk-mZkNjEcDs3NLjhCMOWG2NRk-JJkbvBEC_7z3N7RTP2yCTL10RZsa-cLWZ4Rlwc_ntr2cjBPsv4A Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e4feb3e35a774a7d96ceed4547903de3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ac2553f6be79486abbb14987bee7af25 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a is not attached to volume b312d309-268f-4477-9557-5fa8c2b63ab5 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'server_id': '9e7271d0-bf96-4d13-89a4-f723304f586a', 'id': 'b312d309-268f-4477-9557-5fa8c2b63ab5'} Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b312d309-268f-4477-9557-5fa8c2b63ab5. Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a is not attached to volume b312d309-268f-4477-9557-5fa8c2b63ab5 Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:05.519941 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:05.527180 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:05.527180 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:05.527180 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a is not attached to volume b312d309-268f-4477-9557-5fa8c2b63ab5 Oct 17 13:53:05.527180 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:05.527180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Returning 404 to user: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a is not attached to volume b312d309-268f-4477-9557-5fa8c2b63ab5 {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:05.527180 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c9f73da6-e7c0-40de-8ee8-85958298bd68 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments/b312d309-268f-4477-9557-5fa8c2b63ab5" status: 404 len: 154 microversion: 2.1 time: 0.112285 Oct 17 13:53:05.527180 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4045/7786] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:53:05 2022] DELETE /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a/os-volume_attachments/b312d309-268f-4477-9557-5fa8c2b63ab5 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:53:08.880005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:08.880532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:08.888521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:08.889030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:08.889503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:08.890248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:08.890724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:08.891165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:08.916714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:53:09.012474 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2b04991-d39d-4e53-8089-49483924ccb0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 204 len: 0 microversion: 2.1 time: 0.136274 Oct 17 13:53:09.013293 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3742/7787] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:53:08 2022] DELETE /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:53:09.022110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:09.022940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:09.034730 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:09.035340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:09.035999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:09.036833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:09.037178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:09.037612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:09.188926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:09.198733 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c6f61002-b07a-4c54-acf4-b2d889943dfc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1558 microversion: 2.1 time: 0.180632 Oct 17 13:53:09.199338 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4046/7788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:09 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:10.223924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:10.224633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:10.233171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:10.233668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:10.234123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:10.234855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:10.235333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:10.235777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:10.372104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:10.379782 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e77699f5-a76e-4984-abd4-b765e9a3dd7a tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1558 microversion: 2.1 time: 0.160143 Oct 17 13:53:10.380346 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3743/7789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:10 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:10.959367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-96058bf3-a6b5-4be1-8424-d01aa54e21c1 req-623df75f-bde7-4461-a223-4bc1af25b66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7271d0-bf96-4d13-89a4-f723304f586a", "name": "network-vif-deleted", "tag": "1b6ad37b-dd85-4f4d-818c-c1526d2cdd60"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:10.971461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-96058bf3-a6b5-4be1-8424-d01aa54e21c1 req-623df75f-bde7-4461-a223-4bc1af25b66d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:10.971940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-96058bf3-a6b5-4be1-8424-d01aa54e21c1 req-623df75f-bde7-4461-a223-4bc1af25b66d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:10.972366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-96058bf3-a6b5-4be1-8424-d01aa54e21c1 req-623df75f-bde7-4461-a223-4bc1af25b66d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:10.984656 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-96058bf3-a6b5-4be1-8424-d01aa54e21c1 req-623df75f-bde7-4461-a223-4bc1af25b66d service nova] Creating event network-vif-deleted:1b6ad37b-dd85-4f4d-818c-c1526d2cdd60 for instance 9e7271d0-bf96-4d13-89a4-f723304f586a on n-h2-853316-12 Oct 17 13:53:10.990003 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-96058bf3-a6b5-4be1-8424-d01aa54e21c1 req-623df75f-bde7-4461-a223-4bc1af25b66d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034661 Oct 17 13:53:10.990811 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4047/7790] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:11.404226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:11.404853 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:11.411707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:11.412205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:11.412652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:11.413359 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:11.413823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:11.414293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:11.453531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:11.454768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:11.455523 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:11.456029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lazy-loading 'fault' on Instance uuid 9e7271d0-bf96-4d13-89a4-f723304f586a {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:11.503868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:11.511212 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-68d01fb0-54ad-44bc-b965-84885fd4a3ba tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 200 len: 1351 microversion: 2.1 time: 0.111632 Oct 17 13:53:11.511783 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3744/7791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:11 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:12.535055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:12.535783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 9e7271d0-bf96-4d13-89a4-f723304f586a] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:12.542935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:12.543413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:12.543846 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:12.544538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:12.545000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:12.545405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:12.559964 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] HTTP exception thrown: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a could not be found. Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Request method failure captured: Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a HTTP/1.1 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV37v-LrIbhvWliABMiHi13yrWViihi_R3S-rQ0O5lgCHAkI6VhpdFL7DxNMa7sQJgKwh73HvB4It1T_pa5LIMhOdooJ_eho6mk-mZkNjEcDs3NLjhCMOWG2NRk-JJkbvBEC_7z3N7RTP2yCTL10RZsa-cLWZ4Rlwc_ntr2cjBPsv4A Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e4feb3e35a774a7d96ceed4547903de3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ac2553f6be79486abbb14987bee7af25 Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a could not be found. Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '9e7271d0-bf96-4d13-89a4-f723304f586a'} Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a could not be found. Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a could not be found. Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:12.561608 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a could not be found. Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Returning 404 to user: Instance 9e7271d0-bf96-4d13-89a4-f723304f586a could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-144a1957-cf18-417f-9bd3-200d68cace48 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a" status: 404 len: 111 microversion: 2.1 time: 0.033322 Oct 17 13:53:12.566565 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4048/7792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:12 2022] GET /compute/v2.1/servers/9e7271d0-bf96-4d13-89a4-f723304f586a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:53:12.572958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0dbbf70-0d93-4949-9927-09a0e6373b8d tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '.version_select at 0x7fa8250cd160>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:12.594821 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f0dbbf70-0d93-4949-9927-09a0e6373b8d tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-213836688" status: 202 len: 0 microversion: 2.1 time: 0.026136 Oct 17 13:53:12.595449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3745/7793] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 13:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-213836688 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:53:12.612657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cf78d34f-66cb-4187-aac4-74dd94bd6390 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: .version_select at 0x7fa820d46430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1172101629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4xGYcrgXdnt6NtHakUoG4/on2Kiami08DzG32Ussc5dBxP3/tKo8/ao9rQsWtyVxXilh7QlkJTonL5DLWiT1vIJi+Q3k3EqDc87e4TE44NVUeXcYXagHBlNoHB2Q18IQ=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:12.630153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-cf78d34f-66cb-4187-aac4-74dd94bd6390 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for project e4feb3e35a774a7d96ceed4547903de3. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:53:12.635718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-cf78d34f-66cb-4187-aac4-74dd94bd6390 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for user ac2553f6be79486abbb14987bee7af25 and project e4feb3e35a774a7d96ceed4547903de3. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:53:12.661572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cf78d34f-66cb-4187-aac4-74dd94bd6390 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052822 Oct 17 13:53:12.662202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4049/7794] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:53:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:12.713726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-488260647", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1172101629", "networks": [{"uuid": "67cab846-0b14-41e4-9e59-abe98f99cdf1"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:12.773363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] validate_networks() for [('67cab846-0b14-41e4-9e59-abe98f99cdf1', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:53:13.227103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:53:13.227662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:53:13.228444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:53:13.228872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:53:13.229300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:53:13.238629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:13.239120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:13.239571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:13.240322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:13.240793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:13.241235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:13.260700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for project e4feb3e35a774a7d96ceed4547903de3. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:53:13.266826 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Getting quotas for user ac2553f6be79486abbb14987bee7af25 and project e4feb3e35a774a7d96ceed4547903de3. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:53:13.280573 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:53:13.282971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:53:13.342379 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-062e6d38-d665-4a52-a563-3b29ec3efaa2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633174 Oct 17 13:53:13.343200 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3746/7795] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:53:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:53:13.355047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-455fc180-8f6d-490b-b520-b141c6f123e1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:13.355657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-455fc180-8f6d-490b-b520-b141c6f123e1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:13.413170 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-455fc180-8f6d-490b-b520-b141c6f123e1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:13.421710 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-455fc180-8f6d-490b-b520-b141c6f123e1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1262 microversion: 2.1 time: 0.070968 Oct 17 13:53:13.422449 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4050/7796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:13 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:14.448693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:14.450362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:14.457442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:14.457938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:14.458610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:14.459332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:14.459797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:14.460233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:14.529634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:14.537361 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ef38628f-53c2-4604-8fff-22bf67f4cfab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1320 microversion: 2.1 time: 0.095957 Oct 17 13:53:14.537938 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3747/7797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:14 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1320 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:15.560759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:15.561387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:15.568257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:15.568746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:15.569191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:15.569893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:15.570381 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:15.570814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:15.696681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-c4332920-251f-4112-8f1c-07a2881e65d9 req-3e430a65-50c4-4a73-b209-c127ddffe30f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8640f41d-79b6-4a51-a984-4500285a435e", "tag": "2d989b97-6dc7-4398-bcb8-d382726eec25"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:15.709648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:15.718464 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b3fd874-fce0-45b8-acc5-6b4c8bc6250c tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1362 microversion: 2.1 time: 0.161597 Oct 17 13:53:15.719302 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4051/7798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:15 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:15.733752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c4332920-251f-4112-8f1c-07a2881e65d9 req-3e430a65-50c4-4a73-b209-c127ddffe30f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:15.734368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c4332920-251f-4112-8f1c-07a2881e65d9 req-3e430a65-50c4-4a73-b209-c127ddffe30f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:15.734822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-c4332920-251f-4112-8f1c-07a2881e65d9 req-3e430a65-50c4-4a73-b209-c127ddffe30f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:15.753440 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-c4332920-251f-4112-8f1c-07a2881e65d9 req-3e430a65-50c4-4a73-b209-c127ddffe30f service nova] Creating event network-changed:2d989b97-6dc7-4398-bcb8-d382726eec25 for instance 8640f41d-79b6-4a51-a984-4500285a435e on n-h2-853316-12 Oct 17 13:53:15.758805 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-c4332920-251f-4112-8f1c-07a2881e65d9 req-3e430a65-50c4-4a73-b209-c127ddffe30f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070233 Oct 17 13:53:15.760310 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3748/7799] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:16.746410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:16.746942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:16.753774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:16.754296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:16.754735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:16.755424 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:16.755877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:16.756306 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:16.888007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:16.896076 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-203a125e-9483-4bf4-8d41-de3499a8c0ff tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1362 microversion: 2.1 time: 0.154458 Oct 17 13:53:16.896642 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4052/7800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:16 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:17.922788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:17.923453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:17.929766 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:17.930293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:17.930752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:17.931491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:17.931961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:17.932944 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:18.063441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:18.071114 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-46d70681-d4ff-44b6-a1af-ad39d9dc74a1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1362 microversion: 2.1 time: 0.154483 Oct 17 13:53:18.071684 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3749/7801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:17 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:19.094458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:19.095167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:19.102100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:19.102620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:19.103059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:19.103761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:19.104710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:19.105386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:19.243125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:19.251887 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-878ec8bc-6bf3-4cb2-980a-772238730213 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1362 microversion: 2.1 time: 0.161605 Oct 17 13:53:19.252510 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4053/7802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:19 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:20.274284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:20.274957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:20.282373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:20.282865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:20.283315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:20.284011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:20.284468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:20.284903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:20.416168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:20.424336 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9aaa6452-4413-479a-945c-f53d00339f15 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1362 microversion: 2.1 time: 0.153982 Oct 17 13:53:20.424909 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3750/7803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:20 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:21.065781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-cbf720a4-c589-43d9-84f7-ad3fd5f424d6 req-29391776-9d41-4b18-8105-b0e6bf78c0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8640f41d-79b6-4a51-a984-4500285a435e", "name": "network-vif-plugged", "status": "completed", "tag": "2d989b97-6dc7-4398-bcb8-d382726eec25"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:21.077393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cbf720a4-c589-43d9-84f7-ad3fd5f424d6 req-29391776-9d41-4b18-8105-b0e6bf78c0d5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:21.077960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cbf720a4-c589-43d9-84f7-ad3fd5f424d6 req-29391776-9d41-4b18-8105-b0e6bf78c0d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:21.078416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cbf720a4-c589-43d9-84f7-ad3fd5f424d6 req-29391776-9d41-4b18-8105-b0e6bf78c0d5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:21.090338 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-cbf720a4-c589-43d9-84f7-ad3fd5f424d6 req-29391776-9d41-4b18-8105-b0e6bf78c0d5 service nova] Creating event network-vif-plugged:2d989b97-6dc7-4398-bcb8-d382726eec25 for instance 8640f41d-79b6-4a51-a984-4500285a435e on n-h2-853316-12 Oct 17 13:53:21.095233 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-cbf720a4-c589-43d9-84f7-ad3fd5f424d6 req-29391776-9d41-4b18-8105-b0e6bf78c0d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033228 Oct 17 13:53:21.096118 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4054/7804] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:21.447805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:21.448660 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:21.455740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:21.456229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:21.456726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:21.457486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:21.458150 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:21.458684 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:21.587902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:21.596293 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c4ac1a8c-98b0-4656-8ab2-684ef12a6356 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1362 microversion: 2.1 time: 0.152401 Oct 17 13:53:21.596875 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3751/7805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:21 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:22.621506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:22.622216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:22.628528 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:22.629014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:22.629447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:22.630198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:22.630601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:22.631065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:22.767947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:22.775827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1925eb49-ea31-4b31-8f6e-3103d2c215f1 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1554 microversion: 2.1 time: 0.159809 Oct 17 13:53:22.777069 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4055/7806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:22 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:22.799097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:22.799722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:22.806561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:22.807059 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:22.807572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:22.808488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:22.808958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:22.809400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:22.942041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:22.950568 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c346ee4a-e7d9-43b3-8077-c7c7c83822fa tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1554 microversion: 2.1 time: 0.155371 Oct 17 13:53:22.951145 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3752/7807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:22 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:24.472348 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16770519-6fe6-4ad8-9cec-de0be67a3d4c"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:24.474744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:24.476722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:24.483204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:24.483710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:24.484143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:24.484827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:24.485286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:24.485706 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:24.731836 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-14b4f9d1-4071-4734-87a3-86dd54e749cd tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "POST /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263309 Oct 17 13:53:24.732479 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4056/7808] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:53:24 2022] POST /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:35.465899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:35.466494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:35.468525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:35.469204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:35.470556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:35.471334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:35.478299 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:35.478794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:35.479728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:35.480513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:35.480978 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:35.481415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:35.567538 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lazy-loading 'services' on Instance uuid 8640f41d-79b6-4a51-a984-4500285a435e {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:35.638522 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7579159d-c535-400d-8e1f-2675df287c9e tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments/16770519-6fe6-4ad8-9cec-de0be67a3d4c" status: 202 len: 0 microversion: 2.1 time: 0.176375 Oct 17 13:53:35.639157 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3753/7809] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:53:35 2022] DELETE /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments/16770519-6fe6-4ad8-9cec-de0be67a3d4c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:53:35.645675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:35.646582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:35.651508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:35.653873 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:35.663017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:35.663581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:35.664026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:35.664731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:35.665190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:35.665618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:35.699374 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-482ac7fe-4858-4819-94fe-913da71ad3ab tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055603 Oct 17 13:53:35.700148 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4057/7810] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:35 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:36.712949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:36.715418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:36.721930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:36.722473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:36.722927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:36.723649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:36.724115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:36.724558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:36.759025 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a648bff3-0245-4bc8-b50f-91d8ec78d352 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051171 Oct 17 13:53:36.759506 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3754/7811] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:36 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:37.772853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:37.775581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:37.784063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:37.784565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:37.785010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:37.786816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:37.786816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:37.786816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:37.820418 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c1df29c2-0dc4-463a-9120-a08b059db5b0 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051699 Oct 17 13:53:37.822294 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4058/7812] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:37 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:38.833438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:38.835761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:38.843802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:38.844296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:38.844743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:38.845448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:38.845909 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:38.846375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:38.878239 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3e78ac6f-6453-4b06-a826-c801555a5598 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049083 Oct 17 13:53:38.878858 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3755/7813] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:38 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:39.890532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:39.892842 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:39.900301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:39.901789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:39.902255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:39.902980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:39.903438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:39.903865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:39.938510 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a87d74bf-684d-4e77-90c3-c932286fdbd7 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051993 Oct 17 13:53:39.939098 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4059/7814] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:39 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:40.951325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:40.953437 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:40.960764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:40.961263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:40.961718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:40.962463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:40.962937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:40.963406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:40.995170 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a4dd55e6-3fbb-4dda-8c89-3a26362651a4 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047442 Oct 17 13:53:40.995812 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3756/7815] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:40 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:53:41.009213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:41.009772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:41.016747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:41.017242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:41.017683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:41.018425 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:41.018885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:41.019324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:41.100574 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] HTTP exception thrown: Instance 8640f41d-79b6-4a51-a984-4500285a435e is not attached to volume 16770519-6fe6-4ad8-9cec-de0be67a3d4c Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Request method failure captured: Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments/16770519-6fe6-4ad8-9cec-de0be67a3d4c HTTP/1.1 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV37v-LrIbhvWliABMiHi13yrWViihi_R3S-rQ0O5lgCHAkI6VhpdFL7DxNMa7sQJgKwh73HvB4It1T_pa5LIMhOdooJ_eho6mk-mZkNjEcDs3NLjhCMOWG2NRk-JJkbvBEC_7z3N7RTP2yCTL10RZsa-cLWZ4Rlwc_ntr2cjBPsv4A Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e4feb3e35a774a7d96ceed4547903de3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ac2553f6be79486abbb14987bee7af25 Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 8640f41d-79b6-4a51-a984-4500285a435e is not attached to volume 16770519-6fe6-4ad8-9cec-de0be67a3d4c Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'server_id': '8640f41d-79b6-4a51-a984-4500285a435e', 'id': '16770519-6fe6-4ad8-9cec-de0be67a3d4c'} Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16770519-6fe6-4ad8-9cec-de0be67a3d4c. Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8640f41d-79b6-4a51-a984-4500285a435e is not attached to volume 16770519-6fe6-4ad8-9cec-de0be67a3d4c Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:41.102186 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:41.107673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:41.107673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:41.107673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8640f41d-79b6-4a51-a984-4500285a435e is not attached to volume 16770519-6fe6-4ad8-9cec-de0be67a3d4c Oct 17 13:53:41.107673 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:41.107673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Returning 404 to user: Instance 8640f41d-79b6-4a51-a984-4500285a435e is not attached to volume 16770519-6fe6-4ad8-9cec-de0be67a3d4c {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:41.107673 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a4e6d6db-ae6b-4c3f-9678-02bd603df8df tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments/16770519-6fe6-4ad8-9cec-de0be67a3d4c" status: 404 len: 154 microversion: 2.1 time: 0.098604 Oct 17 13:53:41.107673 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4060/7816] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:53:41 2022] DELETE /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e/os-volume_attachments/16770519-6fe6-4ad8-9cec-de0be67a3d4c => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:53:44.463146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:44.464257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:44.470661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:44.471244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:44.471698 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:44.472433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:44.472905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:44.473348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:44.501814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:53:44.584782 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7f0b6d3e-a320-4ec5-9a80-fa7d5ef695dc tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 204 len: 0 microversion: 2.1 time: 0.125167 Oct 17 13:53:44.585640 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3757/7817] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:53:44 2022] DELETE /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:53:44.594123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:44.594717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:44.605461 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:44.605952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:44.606436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:44.607139 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:44.607602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:44.608035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:44.745081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:44.753162 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-957b7c91-32ad-483f-906d-8e81bdc58ef2 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1560 microversion: 2.1 time: 0.163123 Oct 17 13:53:44.753739 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4061/7818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:44 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:45.777406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:45.778114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:45.784776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:45.785277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:45.785730 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:45.786472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:45.786938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:45.787380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:45.922049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:45.929809 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-15e0a793-a75d-4de3-85ff-856d27b2f042 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1560 microversion: 2.1 time: 0.156884 Oct 17 13:53:45.930412 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3758/7819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:45 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:46.578193 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-58321c50-89b1-4b3d-a89f-9450fe4996c5 req-38eccf92-996d-4e91-94cf-a5e67e7b588d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8640f41d-79b6-4a51-a984-4500285a435e", "name": "network-vif-deleted", "tag": "2d989b97-6dc7-4398-bcb8-d382726eec25"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:46.592482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-58321c50-89b1-4b3d-a89f-9450fe4996c5 req-38eccf92-996d-4e91-94cf-a5e67e7b588d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:46.593010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-58321c50-89b1-4b3d-a89f-9450fe4996c5 req-38eccf92-996d-4e91-94cf-a5e67e7b588d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:46.593646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-58321c50-89b1-4b3d-a89f-9450fe4996c5 req-38eccf92-996d-4e91-94cf-a5e67e7b588d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:46.608984 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-58321c50-89b1-4b3d-a89f-9450fe4996c5 req-38eccf92-996d-4e91-94cf-a5e67e7b588d service nova] Creating event network-vif-deleted:2d989b97-6dc7-4398-bcb8-d382726eec25 for instance 8640f41d-79b6-4a51-a984-4500285a435e on n-h2-853316-12 Oct 17 13:53:46.615174 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-58321c50-89b1-4b3d-a89f-9450fe4996c5 req-38eccf92-996d-4e91-94cf-a5e67e7b588d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040752 Oct 17 13:53:46.616875 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4062/7820] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:46.954257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:46.955101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:46.962724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:46.963301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:46.964034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:46.964743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:46.965209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:46.965726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:46.999392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:46.999861 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:47.000259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:47.000718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lazy-loading 'fault' on Instance uuid 8640f41d-79b6-4a51-a984-4500285a435e {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:47.054935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2553f6be79486abbb14987bee7af25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4feb3e35a774a7d96ceed4547903de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:47.064151 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1a4b94c6-05f5-41af-8aa4-3ee8e72bca37 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 200 len: 1352 microversion: 2.1 time: 0.114782 Oct 17 13:53:47.065233 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3759/7821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:46 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:48.089037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:48.089654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] [instance: 8640f41d-79b6-4a51-a984-4500285a435e] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:48.097515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:48.098001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:48.098476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:48.099206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:48.099661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:48.100091 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:48.114092 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] HTTP exception thrown: Instance 8640f41d-79b6-4a51-a984-4500285a435e could not be found. Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Request method failure captured: Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e HTTP/1.1 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV37v-LrIbhvWliABMiHi13yrWViihi_R3S-rQ0O5lgCHAkI6VhpdFL7DxNMa7sQJgKwh73HvB4It1T_pa5LIMhOdooJ_eho6mk-mZkNjEcDs3NLjhCMOWG2NRk-JJkbvBEC_7z3N7RTP2yCTL10RZsa-cLWZ4Rlwc_ntr2cjBPsv4A Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e4feb3e35a774a7d96ceed4547903de3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4feb3e35a774a7d96ceed4547903de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: e4feb3e35a774a7d96ceed4547903de3 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-475271318 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: ac2553f6be79486abbb14987bee7af25 Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestEncryptedCinderVolumes-475271318-project Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 8640f41d-79b6-4a51-a984-4500285a435e could not be found. Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '8640f41d-79b6-4a51-a984-4500285a435e'} Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8640f41d-79b6-4a51-a984-4500285a435e could not be found. Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8640f41d-79b6-4a51-a984-4500285a435e could not be found. Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:48.115760 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8640f41d-79b6-4a51-a984-4500285a435e could not be found. Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Returning 404 to user: Instance 8640f41d-79b6-4a51-a984-4500285a435e could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-07a9f216-62e7-49d9-9e0d-2fe45516f75f tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e" status: 404 len: 111 microversion: 2.1 time: 0.033045 Oct 17 13:53:48.121579 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4063/7822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:48 2022] GET /compute/v2.1/servers/8640f41d-79b6-4a51-a984-4500285a435e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:53:48.127304 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a4cd9e26-a1cd-4afb-903a-86cafa6bc5e8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] Calling method '.version_select at 0x7fa81bcd3310>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:48.149113 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a4cd9e26-a1cd-4afb-903a-86cafa6bc5e8 tempest-TestEncryptedCinderVolumes-475271318 tempest-TestEncryptedCinderVolumes-475271318-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1172101629" status: 202 len: 0 microversion: 2.1 time: 0.026194 Oct 17 13:53:48.149689 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3760/7823] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 17 13:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1172101629 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:54:16.305906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c19d1f46-0a1d-4894-85ae-c8795effc41d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'create', calling method: .version_select at 0x7fa82165aee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1307583509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZOat+oxVIx0HT/OghafGtfwkqbZkWvojLSqmPy0gzJumJpL1bMPuQy8C4C23I+mEOmcCgUMGdEqsaG/NAN6P/2ame7mC90bO6O1VG7Rtcp1GTI5DHdLswAVIEICZhSsg=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:16.312389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=14 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.313034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=34 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.324752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c19d1f46-0a1d-4894-85ae-c8795effc41d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Getting quotas for project 17a6971ea4804cae8a33a6d613608f6f. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:54:16.330080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c19d1f46-0a1d-4894-85ae-c8795effc41d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Getting quotas for user 28b247c7524845ceb0187897c7eae5d4 and project 17a6971ea4804cae8a33a6d613608f6f. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:54:16.354586 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c19d1f46-0a1d-4894-85ae-c8795effc41d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052669 Oct 17 13:54:16.355173 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4064/7824] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:54:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:16.404220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.405069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.409420 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1902119907", "imageRef": "2a5b4cc7-4fea-48b8-b2a5-0e23893c50e0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1307583509", "networks": [{"uuid": "88639476-9582-4707-b95e-6f505a25ca24"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:16.467753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] validate_networks() for [('88639476-9582-4707-b95e-6f505a25ca24', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:54:16.849410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:54:16.849844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:54:16.850361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:54:16.850781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:54:16.851203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:54:16.860081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.860571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.861171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.861910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.862410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.862850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.880474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Getting quotas for project 17a6971ea4804cae8a33a6d613608f6f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:54:16.886264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Getting quotas for user 28b247c7524845ceb0187897c7eae5d4 and project 17a6971ea4804cae8a33a6d613608f6f. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:54:16.898333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:54:16.901164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2a5b4cc7-4fea-48b8-b2a5-0e23893c50e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:54:16.949006 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-18369546-7a9f-44b7-8716-b82bbd298196 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546238 Oct 17 13:54:16.949682 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3761/7825] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:54:16.960745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b367e5e-1e6e-4bc6-9b30-2e568ea2f522 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.961354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b367e5e-1e6e-4bc6-9b30-2e568ea2f522 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:17.019620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b367e5e-1e6e-4bc6-9b30-2e568ea2f522 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.029032 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b367e5e-1e6e-4bc6-9b30-2e568ea2f522 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1259 microversion: 2.1 time: 0.072110 Oct 17 13:54:17.036845 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4065/7826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:18.052502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:18.053900 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:18.063778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.064392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.064864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.065587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.066057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.066551 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.179433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.188799 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-564ee06e-4e73-4a73-9658-2419ab616356 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1319 microversion: 2.1 time: 0.140918 Oct 17 13:54:18.198832 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3762/7827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:18 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:19.212489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:19.215329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:19.232071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:19.232812 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:19.233685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:19.234678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:19.235244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:19.235776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:19.385499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:19.393769 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-444fbefa-2849-4ce8-b99e-ee19c2f2f03a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.185372 Oct 17 13:54:19.394654 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4066/7828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:19 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:20.418184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:20.418814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:20.426073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.426847 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.427052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.427993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.428468 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.428911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.582749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:20.592775 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c54ad302-86e5-4d26-9852-5ccc3a2ff845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.179337 Oct 17 13:54:20.594248 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3763/7829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:20 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:21.618026 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:21.620215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:21.627445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:21.628302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:21.628937 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:21.630102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:21.630903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:21.631556 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:21.777181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:21.785425 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-165313b4-8ce3-4897-936e-ac16d3a07b38 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.172598 Oct 17 13:54:21.786006 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4067/7830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:21 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:22.809452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:22.811280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:22.818979 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.819940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.820780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.822053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.823379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.824405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.969590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.977432 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f108b7a5-6943-4796-ac9b-c68ef6ec6bde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.172469 Oct 17 13:54:22.978245 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3764/7831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:22 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:24.000907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:24.001689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:24.009165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.009670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.010738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.011418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.012002 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.012436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.177586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.187318 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e6db359d-9c2d-47ae-b180-ef3771c25cb0 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.190151 Oct 17 13:54:24.188125 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4068/7832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:23 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:25.212381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:25.213146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:25.220652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.221159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.221610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.222418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.222885 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.223325 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.385937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:25.394622 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4a99c6ee-b94d-4116-b53c-f420ba3475b1 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.186418 Oct 17 13:54:25.395209 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3765/7833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:25 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:26.416941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:26.418806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:26.427062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.427716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.428470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.429190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.429651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.430463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.578680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.587110 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4780bdd6-7905-4f77-9b08-3bffac5e5f75 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.174107 Oct 17 13:54:26.587703 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4069/7834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:26 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:26.754228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-547fac64-622c-4982-ba2b-424e04c380f1 req-0f1c2fac-eaff-49c6-bed4-e061ece3e37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e219-d034-452d-a327-22fdedb35022", "tag": "ade4978f-bee7-4282-9cfa-1f1dc1a0bac5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:26.767602 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-547fac64-622c-4982-ba2b-424e04c380f1 req-0f1c2fac-eaff-49c6-bed4-e061ece3e37f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.768088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-547fac64-622c-4982-ba2b-424e04c380f1 req-0f1c2fac-eaff-49c6-bed4-e061ece3e37f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.768531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-547fac64-622c-4982-ba2b-424e04c380f1 req-0f1c2fac-eaff-49c6-bed4-e061ece3e37f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.780463 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-547fac64-622c-4982-ba2b-424e04c380f1 req-0f1c2fac-eaff-49c6-bed4-e061ece3e37f service nova] Creating event network-changed:ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 for instance 89b5e219-d034-452d-a327-22fdedb35022 on n-h2-853316-12 Oct 17 13:54:26.785638 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-547fac64-622c-4982-ba2b-424e04c380f1 req-0f1c2fac-eaff-49c6-bed4-e061ece3e37f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035504 Oct 17 13:54:26.786281 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3766/7835] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:27.610674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.611298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.613159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:27.619294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.619786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.620225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.621707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.622194 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.622618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.754971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.763906 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5813a302-dca2-44a4-8005-2ae5f7917951 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.157134 Oct 17 13:54:27.764472 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4070/7836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:27 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:28.783270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:28.784155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:28.789735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:28.790467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:28.798100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.798627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.799072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.799775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.800236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.800673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.937365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.945172 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-26d70489-5a83-44fd-8009-93ad461caa98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.162877 Oct 17 13:54:28.945751 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3767/7837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:28 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:29.971946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:29.972561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:29.979443 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:29.979921 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:29.980351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:29.981190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:29.981791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:29.982235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.116650 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.125739 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cb9550a9-9b60-4c1c-a64b-8f3e35b19c15 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.157658 Oct 17 13:54:30.126532 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4071/7838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:29 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:31.149333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:31.149333 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:31.156346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.156846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.157305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.158015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.158509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.158951 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.289206 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:31.297800 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d7eea2fa-8f6a-49b2-aa82-69ff2159a53c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.153025 Oct 17 13:54:31.298407 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3768/7839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:31 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:32.320974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:32.321578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:32.329242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.329721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.330155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.331117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.331564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.331989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.462720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.470561 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55a1e01f-0071-4b05-88a2-fb76512c9d33 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.153665 Oct 17 13:54:32.471116 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4072/7840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:32 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:33.330209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-e26565bf-2173-4617-ba6c-9490c35c4d8c req-dec57275-628c-4db7-94c2-c8960855d8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b5e219-d034-452d-a327-22fdedb35022", "name": "network-vif-plugged", "status": "completed", "tag": "ade4978f-bee7-4282-9cfa-1f1dc1a0bac5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:33.341667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e26565bf-2173-4617-ba6c-9490c35c4d8c req-dec57275-628c-4db7-94c2-c8960855d8ae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.342187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e26565bf-2173-4617-ba6c-9490c35c4d8c req-dec57275-628c-4db7-94c2-c8960855d8ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.342636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-e26565bf-2173-4617-ba6c-9490c35c4d8c req-dec57275-628c-4db7-94c2-c8960855d8ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.354393 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-e26565bf-2173-4617-ba6c-9490c35c4d8c req-dec57275-628c-4db7-94c2-c8960855d8ae service nova] Creating event network-vif-plugged:ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 for instance 89b5e219-d034-452d-a327-22fdedb35022 on n-h2-853316-12 Oct 17 13:54:33.359607 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-e26565bf-2173-4617-ba6c-9490c35c4d8c req-dec57275-628c-4db7-94c2-c8960855d8ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033320 Oct 17 13:54:33.360218 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3769/7841] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:33.493172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.493786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:33.501283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.501773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.502236 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.502942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.503404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.503834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.638469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.646139 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7f3bd604-04ef-479e-8732-b817b2916a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1359 microversion: 2.1 time: 0.157118 Oct 17 13:54:33.646734 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4073/7842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:33 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:34.670910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:34.671570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:34.677728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.678253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.678704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.679405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.679867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.680305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.808788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:34.816702 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-76c55325-98fa-4ab2-9f57-f401d4bb2f3e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1549 microversion: 2.1 time: 0.151603 Oct 17 13:54:34.817286 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3770/7843] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:34 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:34.840790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:34.841587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:34.848585 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.849068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.849498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.850222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.850676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.851099 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.978729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:34.987170 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d6b6b85b-d0dd-4f7b-87fd-f21ee5977943 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1549 microversion: 2.1 time: 0.151151 Oct 17 13:54:34.987735 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4074/7844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:34 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:35.009225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:35.014989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.015760 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Searching by: {'deleted': False, 'project_id': '17a6971ea4804cae8a33a6d613608f6f'} {{(pid=127539) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:54:35.021019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.021511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.021973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.022745 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.023211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.023646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.046837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.multi_cell_list [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:54:35.073783 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-24939cee-fa28-4cfc-b634-d5d21a9ee64a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068313 Oct 17 13:54:35.074449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3771/7845] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 13:54:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:35.086827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:35.087441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:35.093275 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.093754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.094215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.094898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.095346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.095770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.233513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.241505 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-10ccac86-a600-404a-b5b7-d1eeb3371cf6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1549 microversion: 2.1 time: 0.158608 Oct 17 13:54:35.242086 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4075/7846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:35 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:36.793436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b5ef6c5-3437-4ce6-b44a-29480d567159"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:36.795838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:36.802662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.803158 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.803612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.804322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.804792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.805235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.054964 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fc191fd1-4397-4fa0-b010-871908fc9406 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265115 Oct 17 13:54:37.055583 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3772/7847] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:54:36 2022] POST /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:50.101900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:50.102561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:50.105409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:50.106079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=60 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:50.112953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:50.113438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:50.113874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:50.114590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:50.115046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:50.115469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:50.246753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:50.255689 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5ca8e6e7-4e28-4a06-91d1-75f242a5b1f6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1595 microversion: 2.1 time: 0.157619 Oct 17 13:54:50.256196 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4076/7848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:50 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:52.292514 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a931378f-5e70-465a-bff9-a804d1731765 req-e16c18c9-e68b-421c-9860-c27a30c30ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e219-d034-452d-a327-22fdedb35022", "tag": "ade4978f-bee7-4282-9cfa-1f1dc1a0bac5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:52.300001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:52.301030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:52.302090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:52.310367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a931378f-5e70-465a-bff9-a804d1731765 req-e16c18c9-e68b-421c-9860-c27a30c30ae6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:52.311214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a931378f-5e70-465a-bff9-a804d1731765 req-e16c18c9-e68b-421c-9860-c27a30c30ae6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:52.311626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a931378f-5e70-465a-bff9-a804d1731765 req-e16c18c9-e68b-421c-9860-c27a30c30ae6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:52.325521 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a931378f-5e70-465a-bff9-a804d1731765 req-e16c18c9-e68b-421c-9860-c27a30c30ae6 service nova] Creating event network-changed:ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 for instance 89b5e219-d034-452d-a327-22fdedb35022 on n-h2-853316-12 Oct 17 13:54:52.331314 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a931378f-5e70-465a-bff9-a804d1731765 req-e16c18c9-e68b-421c-9860-c27a30c30ae6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042873 Oct 17 13:54:52.332096 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3773/7849] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:53.322001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1624781634"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:53.322593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:53.331133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.331875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:53.332484 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.333375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.333996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:53.334609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.470956 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.network.security_group_api [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Adding security group 650224f2-1f9b-46ff-a890-037273d5e6a5 to port ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 Oct 17 13:54:53.785507 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-16679cbc-8914-4b7f-8799-de09bfe96e69 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/action" status: 202 len: 0 microversion: 2.1 time: 0.468008 Oct 17 13:54:53.786417 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4077/7850] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:54:53 2022] POST /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:54:53.798067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:53.798998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:53.814777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.815454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:53.816014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.816854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.817524 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:53.818094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.987154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1faabca0-b16a-4183-bdaf-6ad0cdba8d9e req-d6c8e969-0597-44e6-8a45-bf090da1dac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e219-d034-452d-a327-22fdedb35022", "tag": "ade4978f-bee7-4282-9cfa-1f1dc1a0bac5"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:53.999457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1faabca0-b16a-4183-bdaf-6ad0cdba8d9e req-d6c8e969-0597-44e6-8a45-bf090da1dac3 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.999941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1faabca0-b16a-4183-bdaf-6ad0cdba8d9e req-d6c8e969-0597-44e6-8a45-bf090da1dac3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:54.000370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1faabca0-b16a-4183-bdaf-6ad0cdba8d9e req-d6c8e969-0597-44e6-8a45-bf090da1dac3 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:54.001343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:54.011606 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75bec20d-2d60-4e2d-9d77-2aca3197df98 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1760 microversion: 2.1 time: 0.220381 Oct 17 13:54:54.012953 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3774/7851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:53 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1760 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:54.013790 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1faabca0-b16a-4183-bdaf-6ad0cdba8d9e req-d6c8e969-0597-44e6-8a45-bf090da1dac3 service nova] Creating event network-changed:ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 for instance 89b5e219-d034-452d-a327-22fdedb35022 on n-h2-853316-12 Oct 17 13:54:54.019795 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1faabca0-b16a-4183-bdaf-6ad0cdba8d9e req-d6c8e969-0597-44e6-8a45-bf090da1dac3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103345 Oct 17 13:54:54.020854 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4078/7852] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:56:31.292742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:31.293520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:31.295085 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 13:56:31.295238 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 13:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/action (ip 10.222.0.27) !!! Oct 17 13:56:31.296473 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 13:56:31.296593 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 13:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/action (ip 10.222.0.27) !!! Oct 17 13:56:31.300775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:31.303018 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:31.314981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:31.315482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:31.315933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:31.316672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:31.317149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:31.317593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:31.392075 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41640aa2-a5eb-4c23-a9f4-c00694d692d7 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/action" status: 202 len: 0 microversion: 2.1 time: 0.101027 Oct 17 13:56:31.392716 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3775/7853] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:31 2022] POST /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:56:31.399314 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 13:56:31.400238 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 13:56:31.400793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:31.401531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=12 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:31.402558 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:56:31.402699 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 (ip 10.222.0.27) !!! Oct 17 13:56:31.403959 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 13:56:31.404177 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 13:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 (ip 10.222.0.27) !!! Oct 17 13:56:31.412077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:31.412828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:31.422933 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:31.423431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:31.423870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:31.424570 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:31.425025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:31.425454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:31.582607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:31.591643 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4a6f7d47-15f3-4296-aaa3-2d25fec4e3e9 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1762 microversion: 2.1 time: 0.193679 Oct 17 13:56:31.592245 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4079/7854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:31 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1762 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:32.618292 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:32.619129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:32.625422 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:32.625918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:32.626406 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:32.627116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:32.627584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:32.628028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:32.811705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:32.820464 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-47c9f021-31a1-495f-9af7-2bd73b543827 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1760 microversion: 2.1 time: 0.207534 Oct 17 13:56:32.821054 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3776/7855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:32 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1760 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:46.753857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:46.754670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:46.759430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1624781634"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:46.759966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:46.769983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.770497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.771034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.771611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.772065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.772490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.778490 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45500. Oct 17 13:57:46.779286 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45502. Oct 17 13:57:46.999844 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.network.security_group_api [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Removing security group 650224f2-1f9b-46ff-a890-037273d5e6a5 from port ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 Oct 17 13:57:47.304755 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1551e25c-b210-4b8e-a372-4f8f4fca81cc tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/action" status: 202 len: 0 microversion: 2.1 time: 0.553529 Oct 17 13:57:47.304755 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4080/7856] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:57:46 2022] POST /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:57:47.317800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7c1cd76c-691c-47a5-aa2e-0d6935855e12 req-c2b8668a-78dd-42a9-be0e-9f0a26f1a0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e219-d034-452d-a327-22fdedb35022", "tag": "ade4978f-bee7-4282-9cfa-1f1dc1a0bac5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:47.323062 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:47.339174 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:47.345475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7c1cd76c-691c-47a5-aa2e-0d6935855e12 req-c2b8668a-78dd-42a9-be0e-9f0a26f1a0e1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:47.345969 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7c1cd76c-691c-47a5-aa2e-0d6935855e12 req-c2b8668a-78dd-42a9-be0e-9f0a26f1a0e1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:47.346850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7c1cd76c-691c-47a5-aa2e-0d6935855e12 req-c2b8668a-78dd-42a9-be0e-9f0a26f1a0e1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:47.367443 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7c1cd76c-691c-47a5-aa2e-0d6935855e12 req-c2b8668a-78dd-42a9-be0e-9f0a26f1a0e1 service nova] Creating event network-changed:ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 for instance 89b5e219-d034-452d-a327-22fdedb35022 on n-h2-853316-12 Oct 17 13:57:47.376466 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7c1cd76c-691c-47a5-aa2e-0d6935855e12 req-c2b8668a-78dd-42a9-be0e-9f0a26f1a0e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063512 Oct 17 13:57:47.377259 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3777/7857] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:48.515504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:48.516233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:48.522459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.522943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.523378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.524062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.524511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.524930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.610851 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lazy-loading 'services' on Instance uuid 89b5e219-d034-452d-a327-22fdedb35022 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:57:48.682539 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [2868f413-6273-4eb9-990e-e3d25cf8489f] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:57:49.401976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a701b993-0363-4dfc-8133-decc5326d96f req-2e6f63f6-c7dd-473c-a915-1be6ba260bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e219-d034-452d-a327-22fdedb35022", "tag": "ade4978f-bee7-4282-9cfa-1f1dc1a0bac5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:49.412867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a701b993-0363-4dfc-8133-decc5326d96f req-2e6f63f6-c7dd-473c-a915-1be6ba260bd2 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.413354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a701b993-0363-4dfc-8133-decc5326d96f req-2e6f63f6-c7dd-473c-a915-1be6ba260bd2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.413801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a701b993-0363-4dfc-8133-decc5326d96f req-2e6f63f6-c7dd-473c-a915-1be6ba260bd2 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.426358 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a701b993-0363-4dfc-8133-decc5326d96f req-2e6f63f6-c7dd-473c-a915-1be6ba260bd2 service nova] Creating event network-changed:ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 for instance 89b5e219-d034-452d-a327-22fdedb35022 on n-h2-853316-12 Oct 17 13:57:49.431516 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a701b993-0363-4dfc-8133-decc5326d96f req-2e6f63f6-c7dd-473c-a915-1be6ba260bd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034693 Oct 17 13:57:49.432299 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3778/7858] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:57:49.691305 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [2868f413-6273-4eb9-990e-e3d25cf8489f] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45532. Oct 17 13:57:49.695280 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d5824b31-c8ba-4fba-837e-9fc76ead7617 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments/3b5ef6c5-3437-4ce6-b44a-29480d567159" status: 202 len: 0 microversion: 2.1 time: 1.184588 Oct 17 13:57:49.696256 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4081/7859] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:57:48 2022] DELETE /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments/3b5ef6c5-3437-4ce6-b44a-29480d567159 => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:57:49.706691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:49.709425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:49.716972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.718520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.719143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.721066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.721736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.723014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.758865 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-23cfbff4-5d68-45b8-bce3-220fb7d3ab2f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056362 Oct 17 13:57:49.759449 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3779/7860] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:57:49 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:50.775359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:50.777705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:50.784795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.785283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.785719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.786440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.786894 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.787342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.817778 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d25734d8-0073-482f-9a84-855cbfe1186f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049173 Oct 17 13:57:50.818379 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4082/7861] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:57:50 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:51.831860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:51.834384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:51.841332 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.841910 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.842411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.843121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.843587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.844027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.878806 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-48f42b1f-8755-4e59-a882-39b5d021d4a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051584 Oct 17 13:57:51.879613 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3780/7862] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:57:51 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:52.893723 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:52.896055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:52.903118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:52.903603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:52.904039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:52.904740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:52.905192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:52.905618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:52.937872 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e7ae8976-a84d-481c-8b42-a96682975cde tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048417 Oct 17 13:57:52.938474 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4083/7863] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:57:52 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:53.950046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:53.952319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:53.960287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:53.960789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:53.961246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:53.961962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:53.962513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:53.962959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:53.996499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-475e264a-9dde-41a5-9379-4b098799acac tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050444 Oct 17 13:57:53.997055 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3781/7864] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:57:53 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:55.010132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:55.012372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:55.019497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.019993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.020441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.021205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.021607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.022037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.052019 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f9a55bd3-19a9-437b-b253-b131fe693589 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045939 Oct 17 13:57:55.052586 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4084/7865] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 13:57:55 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:57:55.063209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:55.063738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:55.070445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.070938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.071389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.072122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.072590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.073063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.247116 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] HTTP exception thrown: Instance 89b5e219-d034-452d-a327-22fdedb35022 is not attached to volume 3b5ef6c5-3437-4ce6-b44a-29480d567159 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Request method failure captured: Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: request: DELETE /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments/3b5ef6c5-3437-4ce6-b44a-29480d567159 HTTP/1.1 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTV54JjXdVN6pmwK3vybD79EHvlXU2z66DUoE0BtOcqJ5M4QiKmpB-cEFCcXLRW1T-utCFMe0UwJ9SVb5SsbaOYUVkhP9kbAUXzefCfwN50EjXY5NpSiFJfA1HhJKw4e6ptv5hyL0V7631lmdQ22IoY2Ca4LwWk5jpHz3kkBYg4hkkok Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 17a6971ea4804cae8a33a6d613608f6f Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestMinimumBasicScenario-1446425373 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_17a6971ea4804cae8a33a6d613608f6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestMinimumBasicScenario-1446425373 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 17a6971ea4804cae8a33a6d613608f6f Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1446425373 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestMinimumBasicScenario-1446425373-project Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 28b247c7524845ceb0187897c7eae5d4 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestMinimumBasicScenario-1446425373-project Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 89b5e219-d034-452d-a327-22fdedb35022 is not attached to volume 3b5ef6c5-3437-4ce6-b44a-29480d567159 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'server_id': '89b5e219-d034-452d-a327-22fdedb35022', 'id': '3b5ef6c5-3437-4ce6-b44a-29480d567159'} Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3b5ef6c5-3437-4ce6-b44a-29480d567159. Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b5e219-d034-452d-a327-22fdedb35022 is not attached to volume 3b5ef6c5-3437-4ce6-b44a-29480d567159 Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:55.248735 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:55.253734 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:55.253734 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:55.253734 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b5e219-d034-452d-a327-22fdedb35022 is not attached to volume 3b5ef6c5-3437-4ce6-b44a-29480d567159 Oct 17 13:57:55.253734 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:57:55.253734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Returning 404 to user: Instance 89b5e219-d034-452d-a327-22fdedb35022 is not attached to volume 3b5ef6c5-3437-4ce6-b44a-29480d567159 {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:55.253734 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82a72699-c6fb-4d4a-b74a-28801a22133c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments/3b5ef6c5-3437-4ce6-b44a-29480d567159" status: 404 len: 154 microversion: 2.1 time: 0.191067 Oct 17 13:57:55.253734 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3782/7866] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 13:57:55 2022] DELETE /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022/os-volume_attachments/3b5ef6c5-3437-4ce6-b44a-29480d567159 => generated 154 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:57:58.510368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:58.510864 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:58.518251 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.518742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.519177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.519917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.520375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.520836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.546314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:57:58.628914 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d43014e9-d42a-4e4c-9731-1d50460ba165 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 204 len: 0 microversion: 2.1 time: 0.122104 Oct 17 13:57:58.632886 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4085/7867] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 13:57:58 2022] DELETE /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:57:58.638323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:58.639096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:58.647086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.647595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.648040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.648757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.649250 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.649687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.786742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:58.794745 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c121184d-12dc-41cc-98d5-79d0ec7c4bab tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1555 microversion: 2.1 time: 0.160422 Oct 17 13:57:58.795422 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3783/7868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:58 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:59.820018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:59.820718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:59.827646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:59.828379 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:59.828643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:59.829325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:59.829779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:59.830224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:59.965438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:59.974107 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6cfb960a-5f25-4843-8f29-3d817b3ce4d6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1555 microversion: 2.1 time: 0.158787 Oct 17 13:57:59.974746 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4086/7869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:59 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:00.693569 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-487b3d81-5ee1-4561-aaf8-a1ebdce161c1 req-dcd28469-5260-4d4f-8e6c-e9aa97fc63d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b5e219-d034-452d-a327-22fdedb35022", "name": "network-vif-deleted", "tag": "ade4978f-bee7-4282-9cfa-1f1dc1a0bac5"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:00.703620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-487b3d81-5ee1-4561-aaf8-a1ebdce161c1 req-dcd28469-5260-4d4f-8e6c-e9aa97fc63d4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:00.704135 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-487b3d81-5ee1-4561-aaf8-a1ebdce161c1 req-dcd28469-5260-4d4f-8e6c-e9aa97fc63d4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:00.704752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-487b3d81-5ee1-4561-aaf8-a1ebdce161c1 req-dcd28469-5260-4d4f-8e6c-e9aa97fc63d4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:00.716900 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-487b3d81-5ee1-4561-aaf8-a1ebdce161c1 req-dcd28469-5260-4d4f-8e6c-e9aa97fc63d4 service nova] Creating event network-vif-deleted:ade4978f-bee7-4282-9cfa-1f1dc1a0bac5 for instance 89b5e219-d034-452d-a327-22fdedb35022 on n-h2-853316-12 Oct 17 13:58:00.722073 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-487b3d81-5ee1-4561-aaf8-a1ebdce161c1 req-dcd28469-5260-4d4f-8e6c-e9aa97fc63d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100093 Oct 17 13:58:00.722707 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3784/7870] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:00.997319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:00.998729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:01.007123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.007710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.008347 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:01.009228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.009861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.010326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:01.045667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.046435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.047112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:01.048261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lazy-loading 'fault' on Instance uuid 89b5e219-d034-452d-a327-22fdedb35022 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:58:01.093664 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:01.103233 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1b2ccf7d-3827-4b87-bf92-4c10c855d018 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 200 len: 1349 microversion: 2.1 time: 0.110162 Oct 17 13:58:01.104024 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4087/7871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:00 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:02.129071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:02.129789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 89b5e219-d034-452d-a327-22fdedb35022] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:02.135980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.136473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.136922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.137623 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.138086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.138549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.152845 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] HTTP exception thrown: Instance 89b5e219-d034-452d-a327-22fdedb35022 could not be found. Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Request method failure captured: Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 HTTP/1.1 Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTV54JjXdVN6pmwK3vybD79EHvlXU2z66DUoE0BtOcqJ5M4QiKmpB-cEFCcXLRW1T-utCFMe0UwJ9SVb5SsbaOYUVkhP9kbAUXzefCfwN50EjXY5NpSiFJfA1HhJKw4e6ptv5hyL0V7631lmdQ22IoY2Ca4LwWk5jpHz3kkBYg4hkkok Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 17a6971ea4804cae8a33a6d613608f6f Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestMinimumBasicScenario-1446425373 Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_17a6971ea4804cae8a33a6d613608f6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestMinimumBasicScenario-1446425373 Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 17a6971ea4804cae8a33a6d613608f6f Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1446425373 Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestMinimumBasicScenario-1446425373-project Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 28b247c7524845ceb0187897c7eae5d4 Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestMinimumBasicScenario-1446425373-project Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 89b5e219-d034-452d-a327-22fdedb35022 could not be found. Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '89b5e219-d034-452d-a327-22fdedb35022'} Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b5e219-d034-452d-a327-22fdedb35022 could not be found. Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b5e219-d034-452d-a327-22fdedb35022 could not be found. Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:02.154585 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b5e219-d034-452d-a327-22fdedb35022 could not be found. Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Returning 404 to user: Instance 89b5e219-d034-452d-a327-22fdedb35022 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c87ed670-f4ef-4715-a6ac-996634fd3b58 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022" status: 404 len: 111 microversion: 2.1 time: 0.032838 Oct 17 13:58:02.159764 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3785/7872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:02 2022] GET /compute/v2.1/servers/89b5e219-d034-452d-a327-22fdedb35022 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:02.166133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1c61d501-c5d3-48d1-bb28-7510ade42080 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '.version_select at 0x7fa81bdcb940>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:02.191678 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1c61d501-c5d3-48d1-bb28-7510ade42080 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1307583509" status: 202 len: 0 microversion: 2.1 time: 0.029444 Oct 17 13:58:02.192276 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4088/7873] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 13:58:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1307583509 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:58:11.488009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4af8b933-d345-43b2-ad7b-c12e3af4ba51 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'create', calling method: .version_select at 0x7fa821b45b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-819899845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWmVqXM90E+iuKC+kmqI1uUt4gseoR1SgBELxqPexS3A/Cl5qcjeFNd7EbQgZ9mAMekLnXhz12A/cwi9LX75FicQxlnRqAPOgYwG7kwfvlSa9808vvS3JH6PD2b2y8vJQ=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:11.506100 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-4af8b933-d345-43b2-ad7b-c12e3af4ba51 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Getting quotas for project 17a6971ea4804cae8a33a6d613608f6f. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:58:11.511273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-4af8b933-d345-43b2-ad7b-c12e3af4ba51 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Getting quotas for user 28b247c7524845ceb0187897c7eae5d4 and project 17a6971ea4804cae8a33a6d613608f6f. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:58:11.538286 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4af8b933-d345-43b2-ad7b-c12e3af4ba51 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054200 Oct 17 13:58:11.538888 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3786/7874] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 13:58:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:11.590988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:11.597176 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1668881121", "imageRef": "12e7d258-a61a-4140-80e8-848f15c23a21", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-819899845", "networks": [{"uuid": "88639476-9582-4707-b95e-6f505a25ca24"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:11.654191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] validate_networks() for [('88639476-9582-4707-b95e-6f505a25ca24', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:58:12.096398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:58:12.096879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:58:12.097335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:58:12.097751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:58:12.098415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:58:12.108541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.109022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.109988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.110815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.111316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.111733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.129872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Getting quotas for project 17a6971ea4804cae8a33a6d613608f6f. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:58:12.135577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Getting quotas for user 28b247c7524845ceb0187897c7eae5d4 and project 17a6971ea4804cae8a33a6d613608f6f. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:58:12.150037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:58:12.152349 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12e7d258-a61a-4140-80e8-848f15c23a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:58:12.209805 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b1688640-6824-49fb-a5f8-bbb09167e040 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620578 Oct 17 13:58:12.210416 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4089/7875] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 13:58:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:58:12.219002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=38 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:12.224302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4f2244ab-e520-46ed-a554-c680172f262b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:12.225038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4f2244ab-e520-46ed-a554-c680172f262b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:12.290616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4f2244ab-e520-46ed-a554-c680172f262b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:12.300380 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4f2244ab-e520-46ed-a554-c680172f262b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1258 microversion: 2.1 time: 0.082103 Oct 17 13:58:12.301020 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3787/7876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:12 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:13.325715 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:13.326368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:13.338787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.339287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.339736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.340454 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.340966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.341400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.431564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:13.441409 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cd563718-4437-4b08-9327-d6956a7de44e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1318 microversion: 2.1 time: 0.121660 Oct 17 13:58:13.442365 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4090/7877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:13 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1318 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:14.467770 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:14.468340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:14.477959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.479340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.480079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.481195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.482041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.482789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.648286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:14.658154 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ed7e46dd-00f5-48e2-9457-bf4547fc69be tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.193929 Oct 17 13:58:14.658773 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3788/7878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:14 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:15.685005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:15.687222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:15.699639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:15.700371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:15.700907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.701729 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:15.702295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:15.702844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.867105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:15.884143 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7dac8888-2652-4831-a474-754b39f3f73e tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.205274 Oct 17 13:58:15.885026 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4091/7879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:15 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:16.908655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:16.909280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:16.916611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:16.917125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:16.917577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:16.918697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:16.919169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:16.919619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:17.060776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:17.070700 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ca088dea-ba60-4971-9160-6de0365ab3bb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.166026 Oct 17 13:58:17.082202 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3789/7880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:16 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:18.095377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:18.096185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:18.098011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:18.104117 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:18.104607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:18.105047 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:18.105745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:18.106217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:18.106643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:18.264312 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:18.274451 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-630057d2-94da-474c-a444-65b5bfd56d1f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.183815 Oct 17 13:58:18.275589 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4092/7881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:18 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:19.297750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:19.298585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:19.301276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:19.306855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:19.307373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:19.307805 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:19.308555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:19.309023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:19.309461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:19.463159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:19.473252 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-888feed5-e7f2-47ec-84b9-9524f3a55f9d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.179498 Oct 17 13:58:19.474230 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3790/7882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:19 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:20.497124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:20.497756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:20.505895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:20.506409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:20.506844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:20.507535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:20.507988 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:20.508404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:20.659970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:20.668200 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-797cd7fe-0434-47a5-bbc7-c088aba60776 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.175168 Oct 17 13:58:20.669108 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4093/7883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:20 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:21.692864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:21.693490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:21.700615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:21.701121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:21.701574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:21.702344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:21.702813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:21.703256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:21.835038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:21.843128 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9b288607-793b-432b-bb1d-b753c26bb42f tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.154190 Oct 17 13:58:21.843799 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3791/7884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:21 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:22.865054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:22.865672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:22.868389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:22.869112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:22.875356 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:22.875929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:22.876369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:22.877064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:22.877517 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:22.877939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:23.007031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:23.015011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-383e1586-a91c-4e10-bc73-021df598529d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.153848 Oct 17 13:58:23.016877 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4094/7885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:22 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:24.039955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:24.040583 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:24.042486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:24.050009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:24.050555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:24.051017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:24.051765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:24.052237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:24.052691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:24.185546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:24.194640 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6e70e9c0-8892-4cac-8490-24c3b7b04270 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.158463 Oct 17 13:58:24.195559 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3792/7886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:24 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:24.965432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-58f10477-bd11-41d9-a5e5-2f08093a706d req-9c80a8ee-9fe9-4000-9976-bb45f0c47d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4241d9-b701-4de4-b9ad-557927f416d9", "tag": "363d3a5f-b717-4c28-99ec-742db46d219a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:24.978612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-58f10477-bd11-41d9-a5e5-2f08093a706d req-9c80a8ee-9fe9-4000-9976-bb45f0c47d94 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:24.979187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-58f10477-bd11-41d9-a5e5-2f08093a706d req-9c80a8ee-9fe9-4000-9976-bb45f0c47d94 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:24.979694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-58f10477-bd11-41d9-a5e5-2f08093a706d req-9c80a8ee-9fe9-4000-9976-bb45f0c47d94 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:24.992039 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-58f10477-bd11-41d9-a5e5-2f08093a706d req-9c80a8ee-9fe9-4000-9976-bb45f0c47d94 service nova] Creating event network-changed:363d3a5f-b717-4c28-99ec-742db46d219a for instance 5f4241d9-b701-4de4-b9ad-557927f416d9 on n-h1-853316-12 Oct 17 13:58:24.997654 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-58f10477-bd11-41d9-a5e5-2f08093a706d req-9c80a8ee-9fe9-4000-9976-bb45f0c47d94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036153 Oct 17 13:58:24.998536 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4095/7887] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:25.218871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:25.219980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:25.227142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:25.227650 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:25.228143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:25.229105 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:25.229719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:25.230624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:25.447876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:25.455879 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c76a5829-ac69-4fe6-9c75-1d5c920dc488 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.240898 Oct 17 13:58:25.456461 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3793/7888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:25 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:26.481104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:26.481802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:26.488344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:26.488832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:26.489276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:26.489969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:26.490458 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:26.490890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:26.619866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:26.628806 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e20ce32b-f666-4b0b-b21d-38b372e00d28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.152797 Oct 17 13:58:26.629380 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4096/7889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:26 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:27.652734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:27.653373 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:27.660954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:27.661461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:27.661913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:27.662652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:27.663117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:27.663549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:27.880498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:27.888422 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-856099ef-7d3a-44de-aea8-5a53ce0b620a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.239699 Oct 17 13:58:27.889105 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3794/7890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:27 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:28.912853 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:28.913610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:28.920345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:28.920830 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:28.921267 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:28.921962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:28.923127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:28.923554 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:29.059368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:29.067233 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2ed8eb40-8fdb-4413-bbac-d4d8061f0615 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.158421 Oct 17 13:58:29.067816 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4097/7891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:28 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:30.091310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:30.092281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:30.101219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:30.101879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:30.102485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:30.103351 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:30.103908 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:30.104665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:30.249381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:30.257869 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-94dccf11-6462-4556-8463-6b790bc9efa5 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.171764 Oct 17 13:58:30.258513 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3795/7892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:30 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:31.279680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:31.280294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:31.287205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:31.287690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:31.288129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:31.288822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:31.289278 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:31.289701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:31.425978 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:31.433725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-146788b4-55db-4014-8be3-77663d10ae43 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.158096 Oct 17 13:58:31.434321 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4098/7893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:31 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:32.114140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-ad82413a-e1fe-4b7f-a852-a9ce90924431 req-e3724903-b33b-43f0-8f89-82b98fe0e774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4241d9-b701-4de4-b9ad-557927f416d9", "name": "network-vif-plugged", "status": "completed", "tag": "363d3a5f-b717-4c28-99ec-742db46d219a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:32.126556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ad82413a-e1fe-4b7f-a852-a9ce90924431 req-e3724903-b33b-43f0-8f89-82b98fe0e774 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:32.127055 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ad82413a-e1fe-4b7f-a852-a9ce90924431 req-e3724903-b33b-43f0-8f89-82b98fe0e774 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:32.127500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-ad82413a-e1fe-4b7f-a852-a9ce90924431 req-e3724903-b33b-43f0-8f89-82b98fe0e774 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:32.138996 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-ad82413a-e1fe-4b7f-a852-a9ce90924431 req-e3724903-b33b-43f0-8f89-82b98fe0e774 service nova] Creating event network-vif-plugged:363d3a5f-b717-4c28-99ec-742db46d219a for instance 5f4241d9-b701-4de4-b9ad-557927f416d9 on n-h1-853316-12 Oct 17 13:58:32.145215 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-ad82413a-e1fe-4b7f-a852-a9ce90924431 req-e3724903-b33b-43f0-8f89-82b98fe0e774 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106054 Oct 17 13:58:32.146255 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3796/7894] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:58:32.457596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:32.458931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:32.466085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:32.468202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:32.468648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:32.470295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:32.470772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:32.471206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:32.611692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:32.622067 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32b43982-80ec-4fe6-b9c4-1a7d725a604a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.168972 Oct 17 13:58:32.622949 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4099/7895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:32 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:33.651374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:33.652134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:33.659456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:33.659961 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:33.660419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:33.661142 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:33.661615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:33.662060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:33.802768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:33.810732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b9b57e18-7ff0-4a5c-a179-8e8285434a41 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1358 microversion: 2.1 time: 0.163620 Oct 17 13:58:33.811337 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3797/7896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:33 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:34.835696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:34.836300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:34.843403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:34.843944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:34.845085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:34.845790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:34.846304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:34.846728 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:34.979504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:34.987989 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b02dae8-d9dc-4589-888f-2ddb04a0558a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1547 microversion: 2.1 time: 0.156336 Oct 17 13:58:34.988581 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4100/7897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:34 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:35.011662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:35.012286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:35.020324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:35.020823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:35.021279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:35.021996 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:35.022611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:35.023127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:35.160186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:35.168070 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f8155ea9-6ea9-4fef-aa0b-1c230bcb2139 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1547 microversion: 2.1 time: 0.160264 Oct 17 13:58:35.168657 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3798/7898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:35 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:35.191043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:35.195941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:35.196705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Searching by: {'deleted': False, 'project_id': '17a6971ea4804cae8a33a6d613608f6f'} {{(pid=127540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:58:35.202087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:35.202615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:35.203051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:35.203962 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:35.204414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:35.204865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:35.229204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.multi_cell_list [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:58:35.257908 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2673f0e1-1501-4293-b68f-2f42da7af2cb tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071345 Oct 17 13:58:35.258526 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4101/7899] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 13:58:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:35.270452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:35.271083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:35.277201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:35.277699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:35.278156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:35.278894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:35.279361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:35.279801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:35.426080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:35.434314 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-57303665-063c-4a12-bac1-5e36ae8a452d tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1547 microversion: 2.1 time: 0.167775 Oct 17 13:58:35.434908 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3799/7900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:35 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:36.982442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "247ed9ca-b5f5-4d52-b63c-e6f511f63b5d"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:36.984932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:36.991801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:36.992279 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:36.992710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:36.993394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:36.993839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:36.994289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:37.257881 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9672dd35-6f7a-4ab6-8ee5-c0513bfd8c28 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278858 Oct 17 13:58:37.258536 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4102/7901] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 13:58:36 2022] POST /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:58:49.155027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:49.155640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:49.158798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=19 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:49.159478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=68 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:49.165007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:49.165508 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:49.165964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.166709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:49.167215 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:49.167662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.307905 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:49.316383 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff148650-803a-4599-bc2b-668eec151620 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1593 microversion: 2.1 time: 0.165309 Oct 17 13:58:49.316876 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3800/7902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:49 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1593 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:51.317513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-14a6e307-6a19-48b0-b931-93f97de2e9e6 req-79d6f071-ee63-43e5-b320-a4696a6832e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4241d9-b701-4de4-b9ad-557927f416d9", "tag": "363d3a5f-b717-4c28-99ec-742db46d219a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:51.328361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:51.329558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=21 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:51.330500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:51.332795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-14a6e307-6a19-48b0-b931-93f97de2e9e6 req-79d6f071-ee63-43e5-b320-a4696a6832e1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:51.333913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-14a6e307-6a19-48b0-b931-93f97de2e9e6 req-79d6f071-ee63-43e5-b320-a4696a6832e1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:51.334625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-14a6e307-6a19-48b0-b931-93f97de2e9e6 req-79d6f071-ee63-43e5-b320-a4696a6832e1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:51.352798 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-14a6e307-6a19-48b0-b931-93f97de2e9e6 req-79d6f071-ee63-43e5-b320-a4696a6832e1 service nova] Creating event network-changed:363d3a5f-b717-4c28-99ec-742db46d219a for instance 5f4241d9-b701-4de4-b9ad-557927f416d9 on n-h1-853316-12 Oct 17 13:58:51.359063 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-14a6e307-6a19-48b0-b931-93f97de2e9e6 req-79d6f071-ee63-43e5-b320-a4696a6832e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046395 Oct 17 13:58:51.360553 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4103/7903] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:52.435374 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-753498355"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:52.436019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:52.443786 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.444305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.444790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.445516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.445990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.446462 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.589398 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.network.security_group_api [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Adding security group 8f0bfdca-06ab-4da7-be11-16855ae6b08b to port 363d3a5f-b717-4c28-99ec-742db46d219a Oct 17 13:58:52.921510 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2a6b95a4-e155-4611-af95-5121d3483a07 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/action" status: 202 len: 0 microversion: 2.1 time: 0.491330 Oct 17 13:58:52.922245 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3801/7904] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:58:52 2022] POST /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:58:52.936112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:52.936814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:52.942346 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-203854c3-643f-432b-abe1-f2975382a111 req-f96fcee0-1867-4992-a84b-980a07de115e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4241d9-b701-4de4-b9ad-557927f416d9", "tag": "363d3a5f-b717-4c28-99ec-742db46d219a"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:52.954301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.954817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.959019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-203854c3-643f-432b-abe1-f2975382a111 req-f96fcee0-1867-4992-a84b-980a07de115e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.959516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-203854c3-643f-432b-abe1-f2975382a111 req-f96fcee0-1867-4992-a84b-980a07de115e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.959963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-203854c3-643f-432b-abe1-f2975382a111 req-f96fcee0-1867-4992-a84b-980a07de115e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.960631 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.961351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.961811 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.962265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.989888 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-203854c3-643f-432b-abe1-f2975382a111 req-f96fcee0-1867-4992-a84b-980a07de115e service nova] Creating event network-changed:363d3a5f-b717-4c28-99ec-742db46d219a for instance 5f4241d9-b701-4de4-b9ad-557927f416d9 on n-h1-853316-12 Oct 17 13:58:52.996287 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-203854c3-643f-432b-abe1-f2975382a111 req-f96fcee0-1867-4992-a84b-980a07de115e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064561 Oct 17 13:58:52.998689 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3802/7905] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:53.127366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:53.136572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a747fc10-3403-47c1-bc09-f9b627d8ab24 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1758 microversion: 2.1 time: 0.209703 Oct 17 13:58:53.137149 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4104/7906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:52 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1758 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:50.781531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:50.782398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:50.834945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:50.837364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:50.843612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:50.844116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:50.844565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:50.845271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:50.845733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:50.846184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:50.918493 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e3a099e5-0765-41ac-80cb-5fa20b0d645c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/action" status: 202 len: 0 microversion: 2.1 time: 0.138583 Oct 17 13:59:50.918979 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3803/7907] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 13:59:50 2022] POST /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:59:50.927566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:50.928519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:50.930487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:50.931134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=8 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:50.936972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:50.937456 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:50.937889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:50.938777 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:50.939228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:50.939651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:51.086888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:51.096271 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3e18b642-8554-4f44-9bc7-faa59aec61b6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1750 microversion: 2.1 time: 0.173009 Oct 17 13:59:51.096857 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4105/7908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:50 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:52.117052 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:59:52.117654 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 13:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 (ip 10.222.0.27) !!! Oct 17 13:59:52.122790 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:52.123316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:52.132356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:52.132759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:52.133205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:52.133923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:52.134419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:52.134862 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:52.289140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:52.297416 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0cc17316-9b62-40d3-aff9-d1a6e9f95e35 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.182284 Oct 17 13:59:52.297987 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3804/7909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:52 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:53.323720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:53.324396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:53.332340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:53.332821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:53.333253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:53.335073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:53.335537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:53.335958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:53.484354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:53.492683 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-50c4ba4b-6c2c-437f-8093-bed4a45f3760 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.173245 Oct 17 13:59:53.493258 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4106/7910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:53 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:54.514975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:54.515535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:54.523293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:54.523784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:54.524239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:54.524949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:54.525409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:54.525845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:54.672604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:54.681517 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d1d439a-6a52-4e82-9c85-13e1fb4e3462 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.170513 Oct 17 13:59:54.682093 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3805/7911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:54 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:55.704450 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:55.705033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:55.712268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.712746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.713185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.713871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.714351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.714770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.865671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:55.874182 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ef83c21d-8a0d-48bf-a99e-73e2f63437c3 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.173636 Oct 17 13:59:55.874772 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4107/7912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:55 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:56.898473 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:56.899102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:56.905959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:56.906492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:56.906947 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:56.907664 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:56.908134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:56.908576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:57.061521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:57.069991 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4324ef67-75ab-47a9-90ab-366a7ad63bbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.175660 Oct 17 13:59:57.070604 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3806/7913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:56 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:58.096738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:58.097311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:58.104955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:58.105436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:58.105872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:58.106595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:58.107051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:58.107475 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:58.257202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:58.265933 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3f075021-f0cb-4de4-b285-a8bfc5b6b758 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.173293 Oct 17 13:59:58.266567 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4108/7914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:58 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:59.289077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:59.289716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:59.296217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:59.296710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:59.297162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:59.297868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:59.298371 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:59.298814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:59.448880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:59.457050 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab3ec8ae-4185-47f9-ad37-2bced42c7ba6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.172166 Oct 17 13:59:59.457608 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3807/7915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:59 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:00.481321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:00.481909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:00.488752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:00.489233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:00.489667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:00.491562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:00.492033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:00.492460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:00.638908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:00.647335 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6876582d-6b19-463c-935a-4f6a82f7c558 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.169932 Oct 17 14:00:00.647907 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4109/7916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:00 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:01.670460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:01.671088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:01.678548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:01.679049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:01.679500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:01.680209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:01.680677 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:01.681122 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:01.825487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:01.835501 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a49e8dd4-0993-494f-bcb9-fa644e0bae7c tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1755 microversion: 2.1 time: 0.168945 Oct 17 14:00:01.836062 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3808/7917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:01 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:02.859342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:02.859984 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:02.868103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:02.868592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:02.869030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:02.869732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:02.870209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:02.870641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:03.042280 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:03.050916 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-45787843-eacf-4da5-85be-29a6ede5f3ea tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1758 microversion: 2.1 time: 0.195400 Oct 17 14:00:03.051521 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4110/7918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:02 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:06.473896 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:01:06.474966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:06.475738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:06.480334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-753498355"}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:06.480888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:06.488067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:06.488594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:06.489044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.489771 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:06.490503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:06.490897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.626394 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.network.security_group_api [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Removing security group 8f0bfdca-06ab-4da7-be11-16855ae6b08b from port 363d3a5f-b717-4c28-99ec-742db46d219a Oct 17 14:01:06.944496 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d533e06-4b57-470a-9d1f-1aaa9e21675b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "POST /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/action" status: 202 len: 0 microversion: 2.1 time: 0.471612 Oct 17 14:01:06.945133 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3809/7919] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:01:06 2022] POST /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:01:06.951913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=12 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:06.952700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=36 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:06.959653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3f6fd837-2055-4d48-bb44-b1403c7b1d8c req-ab20a65b-80cd-42aa-9081-520ea1756ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4241d9-b701-4de4-b9ad-557927f416d9", "tag": "363d3a5f-b717-4c28-99ec-742db46d219a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:06.970976 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3f6fd837-2055-4d48-bb44-b1403c7b1d8c req-ab20a65b-80cd-42aa-9081-520ea1756ad9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:06.971467 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3f6fd837-2055-4d48-bb44-b1403c7b1d8c req-ab20a65b-80cd-42aa-9081-520ea1756ad9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:06.971914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3f6fd837-2055-4d48-bb44-b1403c7b1d8c req-ab20a65b-80cd-42aa-9081-520ea1756ad9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.983785 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3f6fd837-2055-4d48-bb44-b1403c7b1d8c req-ab20a65b-80cd-42aa-9081-520ea1756ad9 service nova] Creating event network-changed:363d3a5f-b717-4c28-99ec-742db46d219a for instance 5f4241d9-b701-4de4-b9ad-557927f416d9 on n-h1-853316-12 Oct 17 14:01:06.991032 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3f6fd837-2055-4d48-bb44-b1403c7b1d8c req-ab20a65b-80cd-42aa-9081-520ea1756ad9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039691 Oct 17 14:01:06.992007 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4111/7920] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:01:08.233033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:08.233655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:08.243676 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.244364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.244824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.245658 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.246317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.246959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.264593 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45942. Oct 17 14:01:08.291805 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-fd38fd64-af90-42b3-bf93-d2e0e3d2e802 req-bd435a6f-bfff-4c2d-a2a3-822f3bbcea4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4241d9-b701-4de4-b9ad-557927f416d9", "tag": "363d3a5f-b717-4c28-99ec-742db46d219a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:08.305792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fd38fd64-af90-42b3-bf93-d2e0e3d2e802 req-bd435a6f-bfff-4c2d-a2a3-822f3bbcea4a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.306308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fd38fd64-af90-42b3-bf93-d2e0e3d2e802 req-bd435a6f-bfff-4c2d-a2a3-822f3bbcea4a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.307085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fd38fd64-af90-42b3-bf93-d2e0e3d2e802 req-bd435a6f-bfff-4c2d-a2a3-822f3bbcea4a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.319259 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-fd38fd64-af90-42b3-bf93-d2e0e3d2e802 req-bd435a6f-bfff-4c2d-a2a3-822f3bbcea4a service nova] Creating event network-changed:363d3a5f-b717-4c28-99ec-742db46d219a for instance 5f4241d9-b701-4de4-b9ad-557927f416d9 on n-h1-853316-12 Oct 17 14:01:08.324696 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-fd38fd64-af90-42b3-bf93-d2e0e3d2e802 req-bd435a6f-bfff-4c2d-a2a3-822f3bbcea4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099882 Oct 17 14:01:08.325310 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4112/7921] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:08.345111 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lazy-loading 'services' on Instance uuid 5f4241d9-b701-4de4-b9ad-557927f416d9 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:01:08.435109 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6938cf49-bb82-4733-8674-eb756780f385 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments/247ed9ca-b5f5-4d52-b63c-e6f511f63b5d" status: 202 len: 0 microversion: 2.1 time: 0.213627 Oct 17 14:01:08.436236 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3810/7922] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 14:01:08 2022] DELETE /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments/247ed9ca-b5f5-4d52-b63c-e6f511f63b5d => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:01:08.455644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:08.461776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:08.468899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.469834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.471141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.472334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.472905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.473428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.509143 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2772f5d3-7fe7-42b4-bc4b-a22108a05e85 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062619 Oct 17 14:01:08.509543 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4113/7923] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 14:01:08 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:09.523591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:09.526442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:09.533833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:09.534482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:09.535034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:09.535830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:09.536411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:09.537467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:09.570882 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7eed6f69-aad7-4b34-8995-80773c68b79b tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052976 Oct 17 14:01:09.571481 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3811/7924] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 14:01:09 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:10.584240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:10.587064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:10.594389 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:10.594922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:10.595371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:10.596090 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:10.596551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:10.596985 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:10.630869 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-18243565-f03d-4950-9820-dbd8ec075625 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050938 Oct 17 14:01:10.631774 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4114/7925] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 14:01:10 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:11.643797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:11.645988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:11.653802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:11.654338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:11.654792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:11.655499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:11.655962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:11.656402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:11.688689 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-55153b17-90be-4400-bac1-8562cdd793a4 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048833 Oct 17 14:01:11.689452 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3812/7926] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 14:01:11 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:12.702085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:12.704326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:12.714711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:12.714711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:12.715039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:12.715699 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:12.716154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:12.716578 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:12.758447 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5efdc215-4933-4ef6-a648-d38204d3b09a tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060600 Oct 17 14:01:12.759046 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4115/7927] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 14:01:12 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:13.771971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:13.775067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:13.782666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:13.783167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:13.783649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:13.784368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:13.785019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:13.785465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:13.817825 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8cf6d6e4-f83a-46f8-988c-aa34bf116272 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050217 Oct 17 14:01:13.818431 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3813/7928] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 14:01:13 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:01:13.831153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:13.831821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:13.839928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:13.840404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:13.840833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:13.841525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:13.841982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:13.842497 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:13.931566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] HTTP exception thrown: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 is not attached to volume 247ed9ca-b5f5-4d52-b63c-e6f511f63b5d Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Request method failure captured: Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: request: DELETE /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments/247ed9ca-b5f5-4d52-b63c-e6f511f63b5d HTTP/1.1 Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV54JjXdVN6pmwK3vybD79EHvlXU2z66DUoE0BtOcqJ5M4QiKmpB-cEFCcXLRW1T-utCFMe0UwJ9SVb5SsbaOYUVkhP9kbAUXzefCfwN50EjXY5NpSiFJfA1HhJKw4e6ptv5hyL0V7631lmdQ22IoY2Ca4LwWk5jpHz3kkBYg4hkkok Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 17a6971ea4804cae8a33a6d613608f6f Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestMinimumBasicScenario-1446425373 Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_17a6971ea4804cae8a33a6d613608f6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestMinimumBasicScenario-1446425373 Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 17a6971ea4804cae8a33a6d613608f6f Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1446425373 Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestMinimumBasicScenario-1446425373-project Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 28b247c7524845ceb0187897c7eae5d4 Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestMinimumBasicScenario-1446425373-project Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 is not attached to volume 247ed9ca-b5f5-4d52-b63c-e6f511f63b5d Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'server_id': '5f4241d9-b701-4de4-b9ad-557927f416d9', 'id': '247ed9ca-b5f5-4d52-b63c-e6f511f63b5d'} Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 247ed9ca-b5f5-4d52-b63c-e6f511f63b5d. Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 is not attached to volume 247ed9ca-b5f5-4d52-b63c-e6f511f63b5d Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:13.933198 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:13.937581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:01:13.937581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:01:13.937581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 is not attached to volume 247ed9ca-b5f5-4d52-b63c-e6f511f63b5d Oct 17 14:01:13.937581 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:13.937581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Returning 404 to user: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 is not attached to volume 247ed9ca-b5f5-4d52-b63c-e6f511f63b5d {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:01:13.937581 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-87a2fd0c-7aaf-4946-9500-d119d2bdb257 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments/247ed9ca-b5f5-4d52-b63c-e6f511f63b5d" status: 404 len: 154 microversion: 2.1 time: 0.107650 Oct 17 14:01:13.937581 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4116/7929] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 14:01:13 2022] DELETE /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9/os-volume_attachments/247ed9ca-b5f5-4d52-b63c-e6f511f63b5d => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:01:17.207636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:17.208169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:17.215418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:17.215929 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:17.216385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:17.217109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:17.217578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:17.218024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:17.244954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:01:17.332922 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6f65845-e00a-42c4-bcd5-9811abe9b548 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 204 len: 0 microversion: 2.1 time: 0.128986 Oct 17 14:01:17.333525 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3814/7930] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:01:17 2022] DELETE /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:01:17.343303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:17.343898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:17.352299 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:17.352793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:17.353232 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:17.353969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:17.354628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:17.355224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:17.529000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:17.538843 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4bdc7fb8-89bd-4677-bb72-975e55c5e845 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1553 microversion: 2.1 time: 0.197981 Oct 17 14:01:17.538843 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4117/7931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:17 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:18.562505 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:18.563137 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:18.572607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:18.573571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:18.574041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:18.574801 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:18.575306 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:18.575751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:18.719492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:18.727563 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cdd3b22e-880a-493d-8437-6b97f8351390 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1553 microversion: 2.1 time: 0.169449 Oct 17 14:01:18.728155 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3815/7932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:18 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:19.679067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-2b24c9b7-c331-4ecd-9aa8-e22d607690e6 req-537016b0-7fe3-4e5d-9c06-b550cd0a0169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4241d9-b701-4de4-b9ad-557927f416d9", "name": "network-vif-deleted", "tag": "363d3a5f-b717-4c28-99ec-742db46d219a"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:19.693059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2b24c9b7-c331-4ecd-9aa8-e22d607690e6 req-537016b0-7fe3-4e5d-9c06-b550cd0a0169 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.693666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2b24c9b7-c331-4ecd-9aa8-e22d607690e6 req-537016b0-7fe3-4e5d-9c06-b550cd0a0169 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.694261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-2b24c9b7-c331-4ecd-9aa8-e22d607690e6 req-537016b0-7fe3-4e5d-9c06-b550cd0a0169 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:19.707329 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-2b24c9b7-c331-4ecd-9aa8-e22d607690e6 req-537016b0-7fe3-4e5d-9c06-b550cd0a0169 service nova] Creating event network-vif-deleted:363d3a5f-b717-4c28-99ec-742db46d219a for instance 5f4241d9-b701-4de4-b9ad-557927f416d9 on n-h1-853316-12 Oct 17 14:01:19.712753 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-2b24c9b7-c331-4ecd-9aa8-e22d607690e6 req-537016b0-7fe3-4e5d-9c06-b550cd0a0169 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041061 Oct 17 14:01:19.713354 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4118/7933] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:19.752455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:19.753128 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:19.760906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.761352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.761884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:19.762649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.763256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.763758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:19.799358 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.799857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.800307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:19.801229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lazy-loading 'fault' on Instance uuid 5f4241d9-b701-4de4-b9ad-557927f416d9 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:01:19.850919 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b247c7524845ceb0187897c7eae5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a6971ea4804cae8a33a6d613608f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:19.859730 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-75d88862-689d-4d7d-9b1f-5f714605c847 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 200 len: 1348 microversion: 2.1 time: 0.111870 Oct 17 14:01:19.860326 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3816/7934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:19 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:20.890301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:20.891052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [instance: 5f4241d9-b701-4de4-b9ad-557927f416d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:20.897339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:20.897817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:20.899736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:20.900438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:20.900893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:20.901324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:20.915861 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] HTTP exception thrown: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 could not be found. Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Request method failure captured: Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 HTTP/1.1 Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTV54JjXdVN6pmwK3vybD79EHvlXU2z66DUoE0BtOcqJ5M4QiKmpB-cEFCcXLRW1T-utCFMe0UwJ9SVb5SsbaOYUVkhP9kbAUXzefCfwN50EjXY5NpSiFJfA1HhJKw4e6ptv5hyL0V7631lmdQ22IoY2Ca4LwWk5jpHz3kkBYg4hkkok Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 17a6971ea4804cae8a33a6d613608f6f Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestMinimumBasicScenario-1446425373 Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_17a6971ea4804cae8a33a6d613608f6f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17a6971ea4804cae8a33a6d613608f6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestMinimumBasicScenario-1446425373 Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 17a6971ea4804cae8a33a6d613608f6f Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1446425373 Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestMinimumBasicScenario-1446425373-project Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 28b247c7524845ceb0187897c7eae5d4 Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestMinimumBasicScenario-1446425373-project Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 could not be found. Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': '5f4241d9-b701-4de4-b9ad-557927f416d9'} Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 could not be found. Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 could not be found. Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:20.917499 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 could not be found. Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Returning 404 to user: Instance 5f4241d9-b701-4de4-b9ad-557927f416d9 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-91229080-4f26-49e7-8859-52f3eb6fecbd tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9" status: 404 len: 111 microversion: 2.1 time: 0.038216 Oct 17 14:01:20.922445 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4119/7935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:20 2022] GET /compute/v2.1/servers/5f4241d9-b701-4de4-b9ad-557927f416d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:01:20.927672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4d35e862-8381-4d70-a467-69f29da00df6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] Calling method '.version_select at 0x7fa820412b80>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:20.932832 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d35e862-8381-4d70-a467-69f29da00df6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [e842b619-549b-4674-b41f-316ff90c7a34] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:01:21.947854 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d35e862-8381-4d70-a467-69f29da00df6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] [e842b619-549b-4674-b41f-316ff90c7a34] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45996. Oct 17 14:01:21.969676 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4d35e862-8381-4d70-a467-69f29da00df6 tempest-TestMinimumBasicScenario-1446425373 tempest-TestMinimumBasicScenario-1446425373-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-819899845" status: 202 len: 0 microversion: 2.1 time: 1.045703 Oct 17 14:01:21.970547 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3817/7936] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 17 14:01:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-819899845 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:01:31.819529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=18 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:31.820653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=38 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:31.998503 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc7b22a7-45aa-417c-94e4-ef8f7e4aa8bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: .version_select at 0x7fa81b8da940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-38902284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHbGswilVcnjz7N/gcisy4UHcu77CHatqYgO2p6decZ3SslWIVUg09yGFMBtRelZH/fSz4g5gtwmqgjwuV6CVqG1paPiSYPakl3m11VIXWHuWI6tbPJygkoXuYPkBvLnA=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:32.017221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-dc7b22a7-45aa-417c-94e4-ef8f7e4aa8bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:01:32.022344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-dc7b22a7-45aa-417c-94e4-ef8f7e4aa8bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:01:32.048600 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc7b22a7-45aa-417c-94e4-ef8f7e4aa8bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.234658 Oct 17 14:01:32.049224 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4120/7937] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 14:01:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:38.034379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-155195509", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "f66867ca-351a-4611-9f47-9d06e9e3cc56"}], "key_name": "tempest-TestNetworkAdvancedServerOps-38902284", "security_groups": [{"name": "tempest-secgroup-smoke-509372398"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:38.046025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:38.047171 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:38.185857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] validate_networks() for [('f66867ca-351a-4611-9f47-9d06e9e3cc56', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:01:38.706818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:01:38.707571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:01:38.708071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:01:38.708503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:01:38.708935 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:01:38.725840 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:38.726739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:38.727360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:38.728750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:38.729546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:38.730370 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:38.753293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:01:38.760041 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:01:38.776494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:01:38.780459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:01:38.842761 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-49f9c5a9-a18d-43ec-88c0-bbbd3fcd2ba7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.814352 Oct 17 14:01:38.843505 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3818/7938] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:01:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:01:38.855779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d3b49ea9-4a43-425b-891f-524bcc643750 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:38.856612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d3b49ea9-4a43-425b-891f-524bcc643750 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:38.863900 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:01:38.864192 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 14:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 (ip 10.222.0.27) !!! Oct 17 14:01:38.927446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d3b49ea9-4a43-425b-891f-524bcc643750 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:38.938051 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d3b49ea9-4a43-425b-891f-524bcc643750 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1264 microversion: 2.1 time: 0.086772 Oct 17 14:01:38.938654 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4121/7939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:38 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1264 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:39.962435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:39.963073 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:39.969267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:39.970742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:39.971863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:39.973004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:39.973635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:39.973747 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:40.060662 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:40.069089 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41844f76-f62d-436d-9950-44435b13b970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1316 microversion: 2.1 time: 0.112027 Oct 17 14:01:40.070569 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3819/7940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:39 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:41.096096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:41.096727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:41.106217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:41.106727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:41.109215 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:41.109969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:41.110476 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:41.110907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:41.310983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:41.320491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-adee7550-6c17-4629-a4f0-ecc4fcbd443d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1389 microversion: 2.1 time: 0.228253 Oct 17 14:01:41.322362 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4122/7941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:41 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1389 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:41.884214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a3076542-dd89-456b-b9b6-ae566482b205 req-b9e44517-5d13-4d79-b4bc-845346ecaf0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79200e59-7f96-4bda-b583-8b5bdb77d0b9", "tag": "0da1fb9e-84f9-470b-ab45-b0defc36d1ac"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:41.908254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a3076542-dd89-456b-b9b6-ae566482b205 req-b9e44517-5d13-4d79-b4bc-845346ecaf0c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:41.909193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a3076542-dd89-456b-b9b6-ae566482b205 req-b9e44517-5d13-4d79-b4bc-845346ecaf0c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:41.910521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a3076542-dd89-456b-b9b6-ae566482b205 req-b9e44517-5d13-4d79-b4bc-845346ecaf0c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:41.933297 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a3076542-dd89-456b-b9b6-ae566482b205 req-b9e44517-5d13-4d79-b4bc-845346ecaf0c service nova] Creating event network-changed:0da1fb9e-84f9-470b-ab45-b0defc36d1ac for instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 on n-h2-853316-12 Oct 17 14:01:41.938732 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a3076542-dd89-456b-b9b6-ae566482b205 req-b9e44517-5d13-4d79-b4bc-845346ecaf0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069744 Oct 17 14:01:41.940673 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3820/7942] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:42.348572 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:42.349177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:42.357172 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:42.357836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:42.358371 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:42.359073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:42.359525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:42.359951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:42.506361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:42.514846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7ff8f114-24b8-4bdf-9e88-a1b298d4534b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1389 microversion: 2.1 time: 0.170519 Oct 17 14:01:42.515550 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4123/7943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:42 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:43.538570 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:43.539982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:43.546438 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:43.546948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:43.547412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:43.548138 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:43.548612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:43.549064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:43.699382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:43.707488 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1cc964f9-c65c-4ba6-a92d-26de8de13651 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1389 microversion: 2.1 time: 0.174082 Oct 17 14:01:43.708073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3821/7944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:43 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1389 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:44.731592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:44.732258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:44.739304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:44.739787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:44.740222 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:44.740916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:44.741375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:44.742555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:44.876261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:44.884817 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c2b2a9f9-baac-41f2-8c06-9990cac4a7ef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1389 microversion: 2.1 time: 0.157469 Oct 17 14:01:44.885394 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4124/7945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:44 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:45.907830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:45.908485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:45.915056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:45.915557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:45.916010 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:45.916718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:45.917186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:45.917628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:46.055906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:46.063684 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4c4fc5ee-5b88-485e-8dbf-2a50e4cd10fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1389 microversion: 2.1 time: 0.159973 Oct 17 14:01:46.064258 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3822/7946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:45 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:47.088120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:47.088759 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:47.094904 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:47.095383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:47.095825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:47.096520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:47.096969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:47.097387 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:47.195315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cb2e78b8-264b-4ff4-98d3-6b8dbb48340d req-c14710fe-bf09-4cc7-a6ab-63d8590ba955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79200e59-7f96-4bda-b583-8b5bdb77d0b9", "name": "network-vif-plugged", "status": "completed", "tag": "0da1fb9e-84f9-470b-ab45-b0defc36d1ac"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:47.205880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cb2e78b8-264b-4ff4-98d3-6b8dbb48340d req-c14710fe-bf09-4cc7-a6ab-63d8590ba955 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:47.206732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cb2e78b8-264b-4ff4-98d3-6b8dbb48340d req-c14710fe-bf09-4cc7-a6ab-63d8590ba955 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:47.207352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cb2e78b8-264b-4ff4-98d3-6b8dbb48340d req-c14710fe-bf09-4cc7-a6ab-63d8590ba955 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:47.222075 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cb2e78b8-264b-4ff4-98d3-6b8dbb48340d req-c14710fe-bf09-4cc7-a6ab-63d8590ba955 service nova] Creating event network-vif-plugged:0da1fb9e-84f9-470b-ab45-b0defc36d1ac for instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 on n-h2-853316-12 Oct 17 14:01:47.228614 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cb2e78b8-264b-4ff4-98d3-6b8dbb48340d req-c14710fe-bf09-4cc7-a6ab-63d8590ba955 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038820 Oct 17 14:01:47.229463 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3823/7947] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:01:47.251786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:47.265413 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-65f74571-f7a9-4626-a245-f46e5e7c12f8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1389 microversion: 2.1 time: 0.182258 Oct 17 14:01:47.266027 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4125/7948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:47 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1389 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:48.292823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:48.293540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:48.300032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:48.300536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:48.300998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:48.301710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:48.302201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:48.302651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:48.446271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:48.454364 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b54ed28c-66b2-483a-9549-6f0c0b7ff84e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1389 microversion: 2.1 time: 0.167624 Oct 17 14:01:48.454954 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3824/7949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:48 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:49.478022 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:49.478673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:49.481486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:49.487081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:49.487566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:49.488005 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:49.488734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:49.489189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:49.489912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:49.627056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:49.635875 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9ca0b2fa-73bf-4fc5-91cb-9958dc22b904 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1559 microversion: 2.1 time: 0.162433 Oct 17 14:01:49.636462 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4126/7950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:49 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:49.658343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:49.658994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:49.660949 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:49.661615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:49.669749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:49.670284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:49.670737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:49.671458 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:49.671922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:49.672363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:49.817109 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:49.825390 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-207caa86-1a94-4db5-b0ed-67591c8a1970 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1559 microversion: 2.1 time: 0.170859 Oct 17 14:01:49.826035 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3825/7951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:49 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:01:51.814385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7cb8651f-7fc2-44ba-8042-61f9b707f28e req-2fd4d7bb-5b12-4862-a1fb-4ebe80c240fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79200e59-7f96-4bda-b583-8b5bdb77d0b9", "tag": "0da1fb9e-84f9-470b-ab45-b0defc36d1ac"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:51.816363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:51.817446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:51.826112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7cb8651f-7fc2-44ba-8042-61f9b707f28e req-2fd4d7bb-5b12-4862-a1fb-4ebe80c240fb service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:51.827012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7cb8651f-7fc2-44ba-8042-61f9b707f28e req-2fd4d7bb-5b12-4862-a1fb-4ebe80c240fb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:51.827671 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7cb8651f-7fc2-44ba-8042-61f9b707f28e req-2fd4d7bb-5b12-4862-a1fb-4ebe80c240fb service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:51.829834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:51.830701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:51.830934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:51.831709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:51.832429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:51.832862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:51.841632 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7cb8651f-7fc2-44ba-8042-61f9b707f28e req-2fd4d7bb-5b12-4862-a1fb-4ebe80c240fb service nova] Creating event network-changed:0da1fb9e-84f9-470b-ab45-b0defc36d1ac for instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 on n-h2-853316-12 Oct 17 14:01:51.846772 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7cb8651f-7fc2-44ba-8042-61f9b707f28e req-2fd4d7bb-5b12-4862-a1fb-4ebe80c240fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036306 Oct 17 14:01:51.847383 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3826/7952] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:52.010849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:52.021170 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69edcdd4-20df-4df4-b500-6778d63fbfd8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1559 microversion: 2.1 time: 0.210688 Oct 17 14:01:52.022281 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4127/7953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:51 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:13.277729 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:13.278521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=38 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:13.283452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:13.285741 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:13.293560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:13.294069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:13.294557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:13.295272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:13.295746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:13.296192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:13.349198 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1784c8a4-ab03-4b63-9032-edd1e28786d5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action" status: 200 len: 24564 microversion: 2.1 time: 0.073520 Oct 17 14:02:13.349861 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3827/7954] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:02:13 2022] POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action => generated 24564 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:02:19.677999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:19.678638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:19.680636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:19.681526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=36 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:19.688918 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:19.689417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:19.690179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:19.690906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:19.691369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:19.691804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:19.765053 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d0ea9dfc-992a-4cc5-bdb4-97bd67d77220 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action" status: 202 len: 0 microversion: 2.1 time: 0.091138 Oct 17 14:02:19.766054 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4128/7955] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:02:19 2022] POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:02:19.775017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:19.776467 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:19.784590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:19.785191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:19.785654 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:19.786534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:19.787063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:19.787541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:19.933863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:19.942513 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aead51f2-b619-4cff-b73d-bfc1d3212120 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1683 microversion: 2.1 time: 0.171761 Oct 17 14:02:19.943089 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3828/7956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:19 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:20.969500 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:20.970247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:20.977925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.978436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.978886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.979596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.980050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.981034 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:21.122521 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:21.130428 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c5d53bb6-3f74-48ab-b5fc-1506ab7dd4fc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1663 microversion: 2.1 time: 0.165165 Oct 17 14:02:21.130999 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4129/7957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:20 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:22.231350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:22.233537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:22.241221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:22.241724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:22.242284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:22.242937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:22.243410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:22.243859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:22.294932 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77cb11f4-51e0-4004-83c0-55553d516b40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action" status: 200 len: 32636 microversion: 2.1 time: 0.067300 Oct 17 14:02:22.295624 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3829/7958] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:02:22 2022] POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action => generated 32636 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:02:22.307334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:22.308563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:22.315399 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:22.315885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:22.316324 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:22.317018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:22.317471 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:22.317898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:22.388010 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-75b4d7de-95cf-47aa-9ef4-f8992134792d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action" status: 202 len: 0 microversion: 2.1 time: 0.084356 Oct 17 14:02:22.388686 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4130/7959] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:02:22 2022] POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:02:22.397656 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:22.398519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:22.407193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:22.407696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:22.408151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:22.408872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:22.409478 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:22.410077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:22.559865 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:22.568310 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d747fe2-6c0f-4d35-a85c-343be0ac4f50 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1670 microversion: 2.1 time: 0.174704 Oct 17 14:02:22.568697 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3830/7960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:22 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:23.595008 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:23.595704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:23.601915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:23.602439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:23.602880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:23.603569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:23.604027 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:23.604527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:23.749738 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:23.757735 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-15de2f87-6195-4aac-9256-fa08fb9b3c0d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1678 microversion: 2.1 time: 0.167847 Oct 17 14:02:23.758692 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4131/7961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:23 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:23.856672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:23.858833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:23.866563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:23.867066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:23.867521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:23.868230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:23.868703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:23.869149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:23.919511 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e70ad511-76fc-4975-9383-ca699bb839a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action" status: 200 len: 35315 microversion: 2.1 time: 0.066831 Oct 17 14:02:23.920157 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3831/7962] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:02:23 2022] POST /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9/action => generated 35315 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:02:24.971844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6c74e978-9870-4a7d-81ee-125ca84cebe1 req-aa7f509c-98f6-4def-b21a-f55367d9e739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79200e59-7f96-4bda-b583-8b5bdb77d0b9", "tag": "0da1fb9e-84f9-470b-ab45-b0defc36d1ac"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:24.973698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:24.974242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:24.982820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:24.983323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:24.983775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:24.983912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6c74e978-9870-4a7d-81ee-125ca84cebe1 req-aa7f509c-98f6-4def-b21a-f55367d9e739 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:24.984349 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6c74e978-9870-4a7d-81ee-125ca84cebe1 req-aa7f509c-98f6-4def-b21a-f55367d9e739 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:24.984490 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:24.984917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6c74e978-9870-4a7d-81ee-125ca84cebe1 req-aa7f509c-98f6-4def-b21a-f55367d9e739 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:24.985362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:24.986128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:24.997790 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6c74e978-9870-4a7d-81ee-125ca84cebe1 req-aa7f509c-98f6-4def-b21a-f55367d9e739 service nova] Creating event network-changed:0da1fb9e-84f9-470b-ab45-b0defc36d1ac for instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 on n-h2-853316-12 Oct 17 14:02:25.002864 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6c74e978-9870-4a7d-81ee-125ca84cebe1 req-aa7f509c-98f6-4def-b21a-f55367d9e739 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034961 Oct 17 14:02:25.004114 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3832/7963] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:25.016300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:02:25.098960 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1eab37da-6c8c-4230-a07f-a7b9198fc1ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 204 len: 0 microversion: 2.1 time: 0.135085 Oct 17 14:02:25.103197 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4132/7964] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:02:24 2022] DELETE /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:02:25.110989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:25.111864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:25.118578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:25.119204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:25.119731 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:25.121244 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:25.121784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:25.122324 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:25.282894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:25.290961 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-18fa0f70-3b1e-48a7-ae30-de2b5d5d156b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1684 microversion: 2.1 time: 0.185007 Oct 17 14:02:25.291548 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3833/7965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:25 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:02:26.315470 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:26.316105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:26.325452 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:26.325949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:26.326429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:26.327140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:26.327591 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:26.328015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:26.475826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:26.484615 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3d739b4e-7839-48f5-974c-2ced191e4e87 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1684 microversion: 2.1 time: 0.173362 Oct 17 14:02:26.485529 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4133/7966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:26 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:27.279403 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-9d15b7aa-5a2a-48e9-a49d-8f551647570a req-b166e3bd-eed4-472d-8dab-28464a74a6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79200e59-7f96-4bda-b583-8b5bdb77d0b9", "name": "network-vif-deleted", "tag": "0da1fb9e-84f9-470b-ab45-b0defc36d1ac"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:27.299218 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9d15b7aa-5a2a-48e9-a49d-8f551647570a req-b166e3bd-eed4-472d-8dab-28464a74a6c0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:27.300102 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9d15b7aa-5a2a-48e9-a49d-8f551647570a req-b166e3bd-eed4-472d-8dab-28464a74a6c0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:27.300838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-9d15b7aa-5a2a-48e9-a49d-8f551647570a req-b166e3bd-eed4-472d-8dab-28464a74a6c0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:27.315311 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-9d15b7aa-5a2a-48e9-a49d-8f551647570a req-b166e3bd-eed4-472d-8dab-28464a74a6c0 service nova] Creating event network-vif-deleted:0da1fb9e-84f9-470b-ab45-b0defc36d1ac for instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 on n-h2-853316-12 Oct 17 14:02:27.320397 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-9d15b7aa-5a2a-48e9-a49d-8f551647570a req-b166e3bd-eed4-472d-8dab-28464a74a6c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048853 Oct 17 14:02:27.320991 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3834/7967] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:27.508553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:27.509096 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:27.516693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:27.517173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:27.517607 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:27.518338 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:27.518788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:27.519210 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:27.552634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:27.553113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:27.553545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:27.553989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lazy-loading 'fault' on Instance uuid 79200e59-7f96-4bda-b583-8b5bdb77d0b9 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:02:27.599355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:27.608201 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1016090-fda0-4be7-b163-8644cec5bf17 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 200 len: 1354 microversion: 2.1 time: 0.103490 Oct 17 14:02:27.608786 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4134/7968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:27 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 1354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:28.632596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:28.633312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 79200e59-7f96-4bda-b583-8b5bdb77d0b9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:28.641033 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:28.641534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:28.641991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:28.642738 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:28.643208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:28.643687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:28.657814 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] HTTP exception thrown: Instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 could not be found. Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Request method failure captured: Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 HTTP/1.1 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTWA7Iq30_ND7tSixL49OZ-6OVwEYrkH-KnArTMgX1Rml56KPmgBx6NXY8oHq9SY8pLkLLTM5u5MmRbS4QizO58DHjkNqbRMsnJb-wQEqFgkMNUEZm5qFcyorglemcrQ1itySDI27ZSvcaWi5fSQafEjdfCh0-OOnbSw2BoJQ6RGoaPU Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a1ad203407d497c985ec78825882b22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a1ad203407d497c985ec78825882b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 14d7820516264dd4adf769a5257e6524 Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 could not be found. Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '79200e59-7f96-4bda-b583-8b5bdb77d0b9'} Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 could not be found. Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 could not be found. Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:02:28.659485 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 could not be found. Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Returning 404 to user: Instance 79200e59-7f96-4bda-b583-8b5bdb77d0b9 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-51e1071f-64b5-4cf8-909d-33fdcb5a5a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9" status: 404 len: 111 microversion: 2.1 time: 0.032598 Oct 17 14:02:28.665088 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3835/7969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:28 2022] GET /compute/v2.1/servers/79200e59-7f96-4bda-b583-8b5bdb77d0b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:02:32.059757 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b239224-c9fa-42ab-a7d1-94fead012469 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '.version_select at 0x7fa820d48b80>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:32.080566 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b239224-c9fa-42ab-a7d1-94fead012469 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38902284" status: 202 len: 0 microversion: 2.1 time: 0.025004 Oct 17 14:02:32.081379 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4135/7970] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 17 14:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38902284 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:02:32.107412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-655bd613-89b2-4af7-9406-d734f8cb9f86 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: .version_select at 0x7fa81bdab430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-812919778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOnkc8bMq4jXWkVQJyVo70yKnUjos6RdeSf7C6Kf0rVNeZ1lMZZHxA/OxVrMoyk2NVkPRHgc7un+YnltfCyDhAOwfZeIicERWHOBSMrbAQQ8vBKE8wDiAX3Uf789eP5Aw=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:32.131017 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-655bd613-89b2-4af7-9406-d734f8cb9f86 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:02:32.138024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-655bd613-89b2-4af7-9406-d734f8cb9f86 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:02:32.164282 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-655bd613-89b2-4af7-9406-d734f8cb9f86 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062006 Oct 17 14:02:32.164960 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3836/7971] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 14:02:32 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:38.095693 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:38.100604 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1977254716", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "9a0f7a21-2f5b-4744-9538-cd25d9d49978"}], "key_name": "tempest-TestNetworkAdvancedServerOps-812919778", "security_groups": [{"name": "tempest-secgroup-smoke-1485170507"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:38.243839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] validate_networks() for [('9a0f7a21-2f5b-4744-9538-cd25d9d49978', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:02:38.692565 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:02:38.693134 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:02:38.693808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:02:38.694240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:02:38.694725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:02:38.704196 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:38.704966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:38.705582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:38.706355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:38.707001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:38.707441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:38.726860 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:02:38.733849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:02:38.749147 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:02:38.751785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:02:38.807661 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc355e10-0b5a-4389-8356-058ed9f9e647 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712946 Oct 17 14:02:38.809587 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4136/7972] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:02:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:02:38.819165 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=36 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:38.828032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5053baae-01b2-4396-93e0-8260c66ffafe tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:38.829120 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5053baae-01b2-4396-93e0-8260c66ffafe tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:38.907475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5053baae-01b2-4396-93e0-8260c66ffafe tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:38.915175 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5053baae-01b2-4396-93e0-8260c66ffafe tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1266 microversion: 2.1 time: 0.098850 Oct 17 14:02:38.915761 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3837/7973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:38 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:02:39.946332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:39.946925 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:39.958940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:39.959463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:39.959926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:39.960916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:39.961380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:39.962017 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:40.044863 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:40.054889 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4af86a0f-7432-42d9-8454-bdccfa3fb587 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1336 microversion: 2.1 time: 0.118870 Oct 17 14:02:40.055480 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4137/7974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:39 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:41.079024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:41.080296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:41.090294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:41.091184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:41.092162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:41.093241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:41.093884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:41.094531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:41.439932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:41.448980 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e8ed567f-e555-46a5-91a4-8de3ae181b0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1392 microversion: 2.1 time: 0.373806 Oct 17 14:02:41.454874 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3838/7975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:41 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1392 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:41.629237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-11695584-de15-450a-b697-fb3bb20cb811 req-1584d050-f533-4994-8056-2594b94b8e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542cc995-4db4-4f71-8b8a-5e1ebb247be9", "tag": "9e589fce-f7b5-421f-9b10-bbd1e801d6e0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:41.659992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-11695584-de15-450a-b697-fb3bb20cb811 req-1584d050-f533-4994-8056-2594b94b8e12 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:41.662734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-11695584-de15-450a-b697-fb3bb20cb811 req-1584d050-f533-4994-8056-2594b94b8e12 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:41.663412 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-11695584-de15-450a-b697-fb3bb20cb811 req-1584d050-f533-4994-8056-2594b94b8e12 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:41.685441 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-11695584-de15-450a-b697-fb3bb20cb811 req-1584d050-f533-4994-8056-2594b94b8e12 service nova] Creating event network-changed:9e589fce-f7b5-421f-9b10-bbd1e801d6e0 for instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 on n-h2-853316-12 Oct 17 14:02:41.691879 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-11695584-de15-450a-b697-fb3bb20cb811 req-1584d050-f533-4994-8056-2594b94b8e12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069362 Oct 17 14:02:41.693072 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4138/7976] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:42.473212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:42.473850 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:42.482972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:42.483479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:42.483931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:42.484689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:42.485154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:42.485593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:42.626231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:42.634156 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e9b49418-ad97-4998-bb79-b93cd609a106 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1392 microversion: 2.1 time: 0.164936 Oct 17 14:02:42.634779 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3839/7977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:42 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:43.658949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:43.659543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:43.666150 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:43.666671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:43.667107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:43.667960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:43.668420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:43.668843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:43.808217 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:43.817295 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29f7dc6f-6d83-4955-b03a-6f35be07b7d2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1392 microversion: 2.1 time: 0.163574 Oct 17 14:02:43.817872 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4139/7978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:43 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:44.842224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:44.842892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:44.845689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:44.852085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:44.852585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:44.853114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:44.853845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:44.855115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:44.855666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:44.992945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:45.001977 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d3a4ecd5-5be6-4e4b-84e2-c245deb0c38c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1392 microversion: 2.1 time: 0.164774 Oct 17 14:02:45.002596 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3840/7979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:44 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:46.024875 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:46.025506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:46.034466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:46.034970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:46.035422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:46.036151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:46.036610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:46.037041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:46.182255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:46.190665 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b877c1ab-a7ef-40c3-994b-31f47e00229e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1392 microversion: 2.1 time: 0.169708 Oct 17 14:02:46.191243 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4140/7980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:46 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:47.215331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:47.215958 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:47.223089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:47.223600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:47.224058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:47.224785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:47.225258 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:47.225704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:47.369879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:47.379131 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d8304939-8e91-4c1f-a9f4-dfc5a117817d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1392 microversion: 2.1 time: 0.168650 Oct 17 14:02:47.379760 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3841/7981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:47 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:47.392098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-85e7487d-7f31-4400-b3d2-65ca7b2bf8c9 req-2a4f248e-341b-4391-9e79-84ab391faf29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542cc995-4db4-4f71-8b8a-5e1ebb247be9", "name": "network-vif-plugged", "status": "completed", "tag": "9e589fce-f7b5-421f-9b10-bbd1e801d6e0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:47.404289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-85e7487d-7f31-4400-b3d2-65ca7b2bf8c9 req-2a4f248e-341b-4391-9e79-84ab391faf29 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:47.404783 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-85e7487d-7f31-4400-b3d2-65ca7b2bf8c9 req-2a4f248e-341b-4391-9e79-84ab391faf29 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:47.405221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-85e7487d-7f31-4400-b3d2-65ca7b2bf8c9 req-2a4f248e-341b-4391-9e79-84ab391faf29 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:47.416788 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-85e7487d-7f31-4400-b3d2-65ca7b2bf8c9 req-2a4f248e-341b-4391-9e79-84ab391faf29 service nova] Creating event network-vif-plugged:9e589fce-f7b5-421f-9b10-bbd1e801d6e0 for instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 on n-h2-853316-12 Oct 17 14:02:47.422288 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-85e7487d-7f31-4400-b3d2-65ca7b2bf8c9 req-2a4f248e-341b-4391-9e79-84ab391faf29 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034174 Oct 17 14:02:47.422932 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4141/7982] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:48.404012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:48.404563 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:48.411475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:48.411973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:48.412421 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:48.413125 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:48.413593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:48.414029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:48.561772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:48.570489 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1acb506b-3789-41d4-a646-fda0121fc619 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1392 microversion: 2.1 time: 0.170969 Oct 17 14:02:48.571242 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3842/7983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:48 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:49.669353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:49.670120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:49.674874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:49.675587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:49.682847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:49.683315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:49.683788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:49.684488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:49.684941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:49.685367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:49.883652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:49.895684 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0592fb5-c836-4aeb-9858-6946667324d4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1564 microversion: 2.1 time: 0.226279 Oct 17 14:02:49.895684 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4142/7984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:49 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1564 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:49.918360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:49.918992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:49.921022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:49.927316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:49.927820 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:49.928276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:49.929079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:49.929546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:49.930009 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:50.072193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:50.080895 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f56332d5-ac50-4093-ab20-f7966417b303 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1564 microversion: 2.1 time: 0.167824 Oct 17 14:02:50.081392 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3843/7985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:49 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:51.717768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-d3f0a1f6-2a0b-4024-a94b-a5b86d76ad72 req-00433a1d-a688-470b-b4e9-4676250d7209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542cc995-4db4-4f71-8b8a-5e1ebb247be9", "tag": "9e589fce-f7b5-421f-9b10-bbd1e801d6e0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:51.722226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:51.722226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:51.728446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d3f0a1f6-2a0b-4024-a94b-a5b86d76ad72 req-00433a1d-a688-470b-b4e9-4676250d7209 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:51.730381 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d3f0a1f6-2a0b-4024-a94b-a5b86d76ad72 req-00433a1d-a688-470b-b4e9-4676250d7209 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:51.731083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-d3f0a1f6-2a0b-4024-a94b-a5b86d76ad72 req-00433a1d-a688-470b-b4e9-4676250d7209 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:51.732433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:51.737225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:51.737998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:51.739286 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:51.740298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:51.740939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:51.741597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:51.744430 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-d3f0a1f6-2a0b-4024-a94b-a5b86d76ad72 req-00433a1d-a688-470b-b4e9-4676250d7209 service nova] Creating event network-changed:9e589fce-f7b5-421f-9b10-bbd1e801d6e0 for instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 on n-h2-853316-12 Oct 17 14:02:51.752930 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-d3f0a1f6-2a0b-4024-a94b-a5b86d76ad72 req-00433a1d-a688-470b-b4e9-4676250d7209 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039110 Oct 17 14:02:51.752930 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3844/7986] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:02:51.899887 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:51.910643 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-778795ba-aa12-4102-80e0-3fc923dbef12 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1564 microversion: 2.1 time: 0.197469 Oct 17 14:02:51.911350 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4143/7987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:51 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:13.217666 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=9 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:13.219097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=38 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:13.223674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:13.226034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:13.233183 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:13.233678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:13.235020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:13.235537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:13.236003 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:13.236444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:13.291585 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-23dcd4e7-70a0-4843-8376-75c7d73767de tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9/action" status: 200 len: 24565 microversion: 2.1 time: 0.075573 Oct 17 14:03:13.292234 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3845/7988] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:03:13 2022] POST /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9/action => generated 24565 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:03:24.373004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:24.375301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:24.377451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:24.378653 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=36 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:24.386201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.386686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.387124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.387814 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.388271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.388692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.466032 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4fa66706-de5f-4ea5-a482-2447a51fbbde tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9/action" status: 202 len: 0 microversion: 2.1 time: 0.096905 Oct 17 14:03:24.466728 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4144/7989] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:03:24 2022] POST /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:03:24.475796 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:24.476528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:24.480326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:24.481015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:24.490703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.491221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.491680 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.492404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.492876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.493321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.774599 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:24.782374 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41943eb0-3619-46e3-a459-8a019781f397 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1673 microversion: 2.1 time: 0.310884 Oct 17 14:03:24.798621 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3846/7990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:24 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1673 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:25.808590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:25.809284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:25.815628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:25.816802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:25.817247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:25.817941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:25.818545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:25.818930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:25.950928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:25.959033 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a366a735-134e-4bfc-a03f-31ea4a46490e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.155772 Oct 17 14:03:25.959617 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4145/7991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:25 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:26.983442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:26.984065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:26.992418 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:26.992915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:26.993364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:26.994066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:26.994559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:26.994998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:27.129477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:27.137280 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-21a5e0e4-e2f9-4dab-8f46-366c8fe82e64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.157758 Oct 17 14:03:27.137853 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3847/7992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:26 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:28.161616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:28.162291 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:28.169115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.169605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.170045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.170770 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.171226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.171654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.318361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:28.326142 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-64b59493-4761-47e4-8d3a-f103894fdbab tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.169160 Oct 17 14:03:28.326730 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4146/7993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:28 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:29.353394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:29.354063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:29.360987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.361502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.361942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.363221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.363693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.364133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.500902 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:29.508687 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-608be150-86cf-40bb-8ae3-905f17bdcc0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.159208 Oct 17 14:03:29.509268 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3848/7994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:29 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:30.533004 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:30.533642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:30.540775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.541253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.542006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.542717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.543168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.543590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.674392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:30.682931 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11055144-608c-4236-b42f-c6a7779d932d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.153867 Oct 17 14:03:30.683453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4147/7995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:30 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:31.707510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:31.708140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:31.715172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.715667 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.716115 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.716818 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.717281 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.717718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.853647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:31.861379 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e023aebf-8012-4c04-9e7f-8bf1e81bdec5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.158367 Oct 17 14:03:31.861943 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3849/7996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:31 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:32.893118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:32.893724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:32.900725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:32.901206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:32.901641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:32.902375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:32.902831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:32.903257 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:33.037792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:33.045640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ffc3a51-2275-4cbc-b23d-e8596ce49a4a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.156444 Oct 17 14:03:33.046229 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4148/7997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:32 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:34.069127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:34.069754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:34.076746 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:34.077293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:34.077694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:34.078430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:34.078898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:34.079337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:34.208016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:34.216290 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-77d6c7e0-c8d7-4301-93fa-db64658bd3c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.151216 Oct 17 14:03:34.217043 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3850/7998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:34 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:35.240180 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:35.240749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:35.247754 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.248235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.248675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:35.249365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.249821 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.250277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:35.385391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:35.393224 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9035694b-f02a-4cdf-8b40-d2287d49036d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.157512 Oct 17 14:03:35.393796 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4149/7999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:35 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:36.416734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:36.417375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:36.424330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:36.424829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:36.425279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:36.425977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:36.426718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:36.427161 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:36.562083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:36.571069 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1ff108c6-16ad-46c0-98e4-cae1806be3f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.158311 Oct 17 14:03:36.571642 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3851/8000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:36 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:37.594076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:37.594731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:37.603107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.603527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.603959 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.604651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.605101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.605525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.741802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:37.749516 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-60211224-e94d-4895-950e-702f1f21cec4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.159387 Oct 17 14:03:37.750080 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4150/8001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:37 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:38.773726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:38.774387 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:38.781064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:38.781558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:38.782007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:38.782732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:38.783195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:38.783635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:38.925075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:38.933131 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6d20fbdb-b6a7-4aa1-9d16-8a6d85aed27e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.164160 Oct 17 14:03:38.933707 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3852/8002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:38 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:39.956627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:39.957224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:39.964856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:39.965363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:39.965800 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:39.966527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:39.967009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:39.967430 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:40.102987 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:40.111054 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-89ca927b-28cb-48f2-aba8-6dc63ff3ad85 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1678 microversion: 2.1 time: 0.158379 Oct 17 14:03:40.111622 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4151/8003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:39 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:41.135705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:41.136093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:41.143139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:41.143648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:41.144146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:41.144868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:41.145337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:41.145779 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:41.280247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:41.288603 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0081b358-d2c3-4430-a8c7-2d3de4f4fbd1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1681 microversion: 2.1 time: 0.157937 Oct 17 14:03:41.289189 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3853/8004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:41 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:05.482405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:05.484583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:05.487045 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=16 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:05.487701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:05.494874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:05.495359 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:05.495799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:05.496493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:05.496946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:05.497369 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:05.553930 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9307ee18-744c-4c46-8948-38d9d661f679 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9/action" status: 200 len: 68902 microversion: 2.1 time: 0.075935 Oct 17 14:04:05.554611 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4152/8005] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:05 2022] POST /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9/action => generated 68902 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:04:12.813240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:12.813986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:12.816614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=16 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:12.817543 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=48 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:12.825519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.826188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.826753 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.827580 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.828153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.828846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.860748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:04:12.882970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-fcb98136-c6bb-409a-a8f8-e2bc85deb1ac req-272a98e7-e393-4239-9fb7-bb7270d9d2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542cc995-4db4-4f71-8b8a-5e1ebb247be9", "tag": "9e589fce-f7b5-421f-9b10-bbd1e801d6e0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:12.898919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fcb98136-c6bb-409a-a8f8-e2bc85deb1ac req-272a98e7-e393-4239-9fb7-bb7270d9d2b1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.899433 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fcb98136-c6bb-409a-a8f8-e2bc85deb1ac req-272a98e7-e393-4239-9fb7-bb7270d9d2b1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.900720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-fcb98136-c6bb-409a-a8f8-e2bc85deb1ac req-272a98e7-e393-4239-9fb7-bb7270d9d2b1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.913215 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-fcb98136-c6bb-409a-a8f8-e2bc85deb1ac req-272a98e7-e393-4239-9fb7-bb7270d9d2b1 service nova] Creating event network-changed:9e589fce-f7b5-421f-9b10-bbd1e801d6e0 for instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 on n-h2-853316-12 Oct 17 14:04:12.919575 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-fcb98136-c6bb-409a-a8f8-e2bc85deb1ac req-272a98e7-e393-4239-9fb7-bb7270d9d2b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107668 Oct 17 14:04:12.920743 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4153/8006] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:04:12.974940 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a06549e6-4755-4c80-ba4b-67b5c306c8df tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 204 len: 0 microversion: 2.1 time: 0.165046 Oct 17 14:04:12.980024 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3854/8007] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:04:12 2022] DELETE /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:04:12.985965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:12.986709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:12.994391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.994926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.995332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.996079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.996542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.997586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:13.144761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:13.153068 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d02f271f-4bdc-4d60-9716-3241a6825806 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1687 microversion: 2.1 time: 0.171395 Oct 17 14:04:13.153865 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4154/8008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:12 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:14.181822 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:14.182915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:14.190977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:14.191487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:14.191942 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:14.192672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:14.193146 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:14.193590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:14.410734 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:14.420241 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2dc28827-0328-4eca-b806-e68ed8189b56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1687 microversion: 2.1 time: 0.244361 Oct 17 14:04:14.420827 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3855/8009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:14 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:15.445001 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:15.446235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cba0e80f-d252-49f1-8bcd-2674b20c99ce req-336e7998-c903-40fb-a1e5-2795f8db0182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542cc995-4db4-4f71-8b8a-5e1ebb247be9", "name": "network-vif-deleted", "tag": "9e589fce-f7b5-421f-9b10-bbd1e801d6e0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:15.446983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:15.456310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cba0e80f-d252-49f1-8bcd-2674b20c99ce req-336e7998-c903-40fb-a1e5-2795f8db0182 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:15.456953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cba0e80f-d252-49f1-8bcd-2674b20c99ce req-336e7998-c903-40fb-a1e5-2795f8db0182 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:15.457400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cba0e80f-d252-49f1-8bcd-2674b20c99ce req-336e7998-c903-40fb-a1e5-2795f8db0182 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:15.462568 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:15.463152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:15.463802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:15.464719 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:15.465395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:15.465776 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:15.471243 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cba0e80f-d252-49f1-8bcd-2674b20c99ce req-336e7998-c903-40fb-a1e5-2795f8db0182 service nova] Creating event network-vif-deleted:9e589fce-f7b5-421f-9b10-bbd1e801d6e0 for instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 on n-h2-853316-12 Oct 17 14:04:15.476442 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cba0e80f-d252-49f1-8bcd-2674b20c99ce req-336e7998-c903-40fb-a1e5-2795f8db0182 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Oct 17 14:04:15.477050 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3856/8010] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:15.539037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:15.547690 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-96db510c-a064-4ac2-83c2-3227f7f5f431 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 200 len: 1351 microversion: 2.1 time: 0.106608 Oct 17 14:04:15.548273 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4155/8011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:15 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:16.573307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:16.574081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 542cc995-4db4-4f71-8b8a-5e1ebb247be9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:16.580378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:16.580873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:16.581328 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:16.582028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:16.582553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:16.583024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:16.596499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] HTTP exception thrown: Instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 could not be found. Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Request method failure captured: Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 HTTP/1.1 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTWA7Iq30_ND7tSixL49OZ-6OVwEYrkH-KnArTMgX1Rml56KPmgBx6NXY8oHq9SY8pLkLLTM5u5MmRbS4QizO58DHjkNqbRMsnJb-wQEqFgkMNUEZm5qFcyorglemcrQ1itySDI27ZSvcaWi5fSQafEjdfCh0-OOnbSw2BoJQ6RGoaPU Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a1ad203407d497c985ec78825882b22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a1ad203407d497c985ec78825882b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 14d7820516264dd4adf769a5257e6524 Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 could not be found. Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '542cc995-4db4-4f71-8b8a-5e1ebb247be9'} Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 could not be found. Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 could not be found. Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:04:16.598127 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 could not be found. Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Returning 404 to user: Instance 542cc995-4db4-4f71-8b8a-5e1ebb247be9 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-745f6243-322b-404d-a37f-37204ae3d6c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9" status: 404 len: 111 microversion: 2.1 time: 0.032093 Oct 17 14:04:16.603239 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3857/8012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:16 2022] GET /compute/v2.1/servers/542cc995-4db4-4f71-8b8a-5e1ebb247be9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:04:19.728687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9c50330b-6b8b-4a34-89ae-be035e8cf62f tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '.version_select at 0x7fa81be30c10>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:19.754339 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9c50330b-6b8b-4a34-89ae-be035e8cf62f tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-812919778" status: 202 len: 0 microversion: 2.1 time: 0.033402 Oct 17 14:04:19.754969 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4156/8013] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 17 14:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-812919778 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:04:19.786025 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d152686a-5e44-40b9-bfd1-f15f459bd2d1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: .version_select at 0x7fa8250a4d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1296488426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGgfRlzsA5Uhhgn0s74o2GKTDpJviMbBfKQUPWw3F91QmD6EkUrWKN+WL0z9FF55hIbWJ75G1RXCaBgAAO6JSmfOoxAVueMbr72MmA7+8/2ta82XrUveS9bu2JL8YXMXg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:19.805965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d152686a-5e44-40b9-bfd1-f15f459bd2d1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:04:19.810752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d152686a-5e44-40b9-bfd1-f15f459bd2d1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:04:19.838504 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d152686a-5e44-40b9-bfd1-f15f459bd2d1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054667 Oct 17 14:04:19.839125 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3858/8014] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 14:04:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:25.891936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=18 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:25.897158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-802096816", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "97da6f3c-f157-4e7c-91bb-0540262212a9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1296488426", "security_groups": [{"name": "tempest-secgroup-smoke-910000153"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:26.018702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] validate_networks() for [('97da6f3c-f157-4e7c-91bb-0540262212a9', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:04:26.610040 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:04:26.610644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:04:26.611397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:04:26.612006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:04:26.612609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:04:26.624175 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.624665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.625345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:26.626119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.626620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.627067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:26.649838 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:04:26.657704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:04:26.674532 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:04:26.676878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:04:26.736988 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c34c6b57-2c0d-45c0-8d68-18171f829d39 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.846387 Oct 17 14:04:26.738054 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4157/8015] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:04:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:04:26.763101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-10b7f781-30a5-40ad-98e5-48accfda4d97 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:26.763751 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-10b7f781-30a5-40ad-98e5-48accfda4d97 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:26.774597 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:26.854264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-10b7f781-30a5-40ad-98e5-48accfda4d97 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:26.865833 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-10b7f781-30a5-40ad-98e5-48accfda4d97 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1266 microversion: 2.1 time: 0.117495 Oct 17 14:04:26.867012 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3859/8016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:26 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:27.891162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:27.891879 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:27.898884 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:27.900159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:27.900622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:27.901339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:27.901802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:27.902261 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:27.980358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:27.989595 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c79cf358-9551-438c-9b33-6570bf05fe0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1318 microversion: 2.1 time: 0.102545 Oct 17 14:04:27.990225 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4158/8017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:27 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1318 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:29.013707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:29.014940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:29.030584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:29.031271 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:29.032310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:29.036633 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:29.037139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:29.037607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:29.293811 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:29.303218 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5fe1b39e-e456-4754-ac52-f6ea64219ab1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1391 microversion: 2.1 time: 0.293411 Oct 17 14:04:29.303798 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3860/8018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:29 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1391 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:29.665923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-1f1add8d-42ce-4385-8390-2a8f8fd0cc87 req-51e4c3a5-d9a3-4e5d-8c3e-02f25d3e351a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fc4932-7910-4f4b-a58d-c5f36de815e2", "tag": "d454328f-882b-4e16-9511-c2ed71e5d54e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:29.678337 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1f1add8d-42ce-4385-8390-2a8f8fd0cc87 req-51e4c3a5-d9a3-4e5d-8c3e-02f25d3e351a service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:29.678961 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1f1add8d-42ce-4385-8390-2a8f8fd0cc87 req-51e4c3a5-d9a3-4e5d-8c3e-02f25d3e351a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:29.679398 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-1f1add8d-42ce-4385-8390-2a8f8fd0cc87 req-51e4c3a5-d9a3-4e5d-8c3e-02f25d3e351a service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:29.694215 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-1f1add8d-42ce-4385-8390-2a8f8fd0cc87 req-51e4c3a5-d9a3-4e5d-8c3e-02f25d3e351a service nova] Creating event network-changed:d454328f-882b-4e16-9511-c2ed71e5d54e for instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 on n-h1-853316-12 Oct 17 14:04:29.702261 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-1f1add8d-42ce-4385-8390-2a8f8fd0cc87 req-51e4c3a5-d9a3-4e5d-8c3e-02f25d3e351a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041336 Oct 17 14:04:29.703974 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4159/8019] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:30.326579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:30.327230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:30.334023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:30.334559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:30.335011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:30.335713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:30.336179 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:30.337509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:30.474723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:30.483335 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d174350-446b-46f1-8a26-1c42d9a3ebdd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1391 microversion: 2.1 time: 0.160808 Oct 17 14:04:30.483917 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3861/8020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:30 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:31.507453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:31.508146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:31.515533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:31.515997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:31.516434 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:31.517126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:31.517571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:31.517994 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:31.655895 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:31.663727 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-76f55d15-385b-4823-b330-6644e6421d80 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1391 microversion: 2.1 time: 0.160875 Oct 17 14:04:31.664308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4160/8021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:31 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:32.688257 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:32.688893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:32.695844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:32.698547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:32.699027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:32.699768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:32.700245 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:32.700689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:32.922907 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:32.936750 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9274c516-566c-4bc0-af0c-224b9b62d40a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1391 microversion: 2.1 time: 0.252372 Oct 17 14:04:32.938002 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3862/8022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:32 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:33.960231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:33.961639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:33.972311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:33.972311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:33.972311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:33.972311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:33.973256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:33.973256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:34.109035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:34.117117 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-31b08310-f21f-4e97-9971-b20ad19415f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1391 microversion: 2.1 time: 0.160786 Oct 17 14:04:34.117703 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4161/8023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:33 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:35.141283 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:35.141913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:35.148959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:35.150019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:35.150504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:35.151401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:35.151695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:35.152139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:35.296781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:35.304912 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fe5a6bb5-e5c6-4b08-8c2f-c9a372a2ea75 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1391 microversion: 2.1 time: 0.167491 Oct 17 14:04:35.305482 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3863/8024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:35 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:35.950737 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f78cdedc-de83-4b1b-b481-6fb95e9dded1 req-b640aff7-6923-4b01-b32b-013d85853473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fc4932-7910-4f4b-a58d-c5f36de815e2", "name": "network-vif-plugged", "status": "completed", "tag": "d454328f-882b-4e16-9511-c2ed71e5d54e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:35.956073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:35.963563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f78cdedc-de83-4b1b-b481-6fb95e9dded1 req-b640aff7-6923-4b01-b32b-013d85853473 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:35.964052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f78cdedc-de83-4b1b-b481-6fb95e9dded1 req-b640aff7-6923-4b01-b32b-013d85853473 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:35.964491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f78cdedc-de83-4b1b-b481-6fb95e9dded1 req-b640aff7-6923-4b01-b32b-013d85853473 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:35.978886 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-f78cdedc-de83-4b1b-b481-6fb95e9dded1 req-b640aff7-6923-4b01-b32b-013d85853473 service nova] Creating event network-vif-plugged:d454328f-882b-4e16-9511-c2ed71e5d54e for instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 on n-h1-853316-12 Oct 17 14:04:35.984308 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f78cdedc-de83-4b1b-b481-6fb95e9dded1 req-b640aff7-6923-4b01-b32b-013d85853473 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100328 Oct 17 14:04:35.984951 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4162/8025] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:36.327915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:36.328553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:36.335733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:36.336235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:36.337521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:36.338323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:36.338797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:36.339247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:36.475589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:36.484541 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-85bf4b46-6b6e-4ebf-9ba5-c444903993db tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1391 microversion: 2.1 time: 0.160615 Oct 17 14:04:36.485126 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3864/8026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:36 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:37.506893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:37.507611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:37.513710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:37.515103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:37.523447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:37.523948 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:37.524481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:37.525159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:37.525623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:37.526055 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:37.677558 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:37.686640 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b9fbabe-34f4-4961-bf5d-68453b66b7b6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1562 microversion: 2.1 time: 0.182245 Oct 17 14:04:37.687251 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4163/8027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:37 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:37.709272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:37.709868 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:37.712859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:37.719688 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:37.720182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:37.720627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:37.721364 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:37.721823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:37.722470 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:37.868737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:37.879090 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c328e806-df7c-4b46-b574-0ea513a54421 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1562 microversion: 2.1 time: 0.173756 Oct 17 14:04:37.879676 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3865/8028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:37 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:39.887240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:39.887868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:39.890967 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2877c9c9-b7c6-4f4a-8c06-4eebf082fbb5 req-3ba0e082-1e78-4faa-90d8-79d7e9f03f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fc4932-7910-4f4b-a58d-c5f36de815e2", "tag": "d454328f-882b-4e16-9511-c2ed71e5d54e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:39.895168 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:39.895668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:39.896116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:39.896844 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:39.897307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:39.897745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:39.904928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2877c9c9-b7c6-4f4a-8c06-4eebf082fbb5 req-3ba0e082-1e78-4faa-90d8-79d7e9f03f93 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:39.905714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2877c9c9-b7c6-4f4a-8c06-4eebf082fbb5 req-3ba0e082-1e78-4faa-90d8-79d7e9f03f93 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:39.906450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2877c9c9-b7c6-4f4a-8c06-4eebf082fbb5 req-3ba0e082-1e78-4faa-90d8-79d7e9f03f93 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:39.920135 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2877c9c9-b7c6-4f4a-8c06-4eebf082fbb5 req-3ba0e082-1e78-4faa-90d8-79d7e9f03f93 service nova] Creating event network-changed:d454328f-882b-4e16-9511-c2ed71e5d54e for instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 on n-h1-853316-12 Oct 17 14:04:39.926759 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2877c9c9-b7c6-4f4a-8c06-4eebf082fbb5 req-3ba0e082-1e78-4faa-90d8-79d7e9f03f93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039120 Oct 17 14:04:39.927903 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3866/8029] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:04:40.047849 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:40.056588 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0250c1b8-7832-428e-b21d-f872c89708ce tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1562 microversion: 2.1 time: 0.173694 Oct 17 14:04:40.057215 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4164/8030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:39 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:15.366363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:15.367776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=38 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:15.369044 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:05:15.369214 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 14:05:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action (ip 10.222.0.27) !!! Oct 17 14:05:15.376153 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:15.378456 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:15.388784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:15.389287 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:15.389743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:15.390491 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:15.390960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:15.391398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:15.451036 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-35d04fbd-626e-4118-b1d1-75c4629549a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action" status: 200 len: 24566 microversion: 2.1 time: 0.085742 Oct 17 14:05:15.451679 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3867/8031] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:05:15 2022] POST /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action => generated 24566 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:05:54.464334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=5 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:54.465079 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=36 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:54.470908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:54.473213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:54.480511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:54.480999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:54.481440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:54.482130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:54.482610 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:54.483042 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:54.524162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:54.530272 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Old instance type m1.heat2, new instance type m1.heat {{(pid=127540) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:05:54.537828 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:05:54.538277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:05:54.538752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:05:54.539159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:05:54.539566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:05:54.605174 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fd075273-2830-45ff-a4ab-2ba0b5543986 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action" status: 202 len: 0 microversion: 2.1 time: 0.142853 Oct 17 14:05:54.605786 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4165/8032] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:05:54 2022] POST /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:05:54.616860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:54.617578 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:54.619838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:54.620579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:54.627463 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:54.628187 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:54.628657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:54.629391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:54.629943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:54.630413 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:54.774925 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:54.783088 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3865e200-0c68-49b6-b4dc-8423bdf55493 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1690 microversion: 2.1 time: 0.170587 Oct 17 14:05:54.783668 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3868/8033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:54 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:55.808457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:55.809062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:55.816678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:55.817162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:55.817597 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:55.818321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:55.818771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:55.819190 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:55.951183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:55.959412 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bed06f2d-f11e-4b97-8be2-894f0fda88ea tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1690 microversion: 2.1 time: 0.155971 Oct 17 14:05:55.959977 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4166/8034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:55 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:56.983101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:56.983728 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:56.994360 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:56.994873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:56.995327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:56.996044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:56.996518 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:56.996960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:57.126338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:57.134023 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-229316b8-4413-45a3-9e8f-19fb49f496e4 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1690 microversion: 2.1 time: 0.155076 Oct 17 14:05:57.134630 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3869/8035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:56 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:58.158735 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:58.159382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:58.166100 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:58.166620 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:58.167050 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:58.167744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:58.168189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:58.168643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:58.309330 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:58.317851 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-93bbff05-405a-46bb-8b19-4eed901501c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1690 microversion: 2.1 time: 0.164072 Oct 17 14:05:58.318453 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4167/8036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:58 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:59.341197 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:59.341765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:59.349436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:59.349950 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:59.350432 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:59.351145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:59.351610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:59.352052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:59.573775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:59.582784 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-29a7f06d-8e93-45fb-ae66-c29ad5fa0888 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1690 microversion: 2.1 time: 0.245567 Oct 17 14:05:59.583556 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3870/8037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:59 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1690 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:00.606963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:00.607602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:00.614954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:00.615438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:00.615874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:00.616566 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:00.617023 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:00.617445 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:00.750426 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:00.759316 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1f1c8610-42c7-4be3-97a3-7184ef4c5a77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.156264 Oct 17 14:06:00.759890 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4168/8038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:00 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:01.783535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:01.784067 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:01.791246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:01.791740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:01.792192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:01.792899 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:01.793362 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:01.793797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:01.932791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:01.944049 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bdac76c2-efb1-4b22-bbc6-7034b6344121 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.164925 Oct 17 14:06:01.944638 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3871/8039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:01 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:02.968031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:02.968672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:02.976078 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:02.976563 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:02.977003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:02.977694 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:02.978153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:02.978603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:03.114778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:03.122467 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0061261c-12f8-412c-a555-e36d381fc76b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.158559 Oct 17 14:06:03.123032 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4169/8040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:02 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:04.145670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:04.146307 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:04.153192 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:04.153691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:04.154184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:04.154897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:04.155367 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:04.155807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:04.286833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:04.294552 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-167270bd-e6c4-4441-a7b0-8d1b995d8dd6 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.152961 Oct 17 14:06:04.295120 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3872/8041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:04 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:05.320007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:05.320617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:05.327615 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:05.328098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:05.328530 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:05.329295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:05.330628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:05.331061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:05.465244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:05.473221 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b22adab6-c606-4267-9d16-3e46af212d40 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.157378 Oct 17 14:06:05.473791 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4170/8042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:05 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:06.496336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:06.496894 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:06.504639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:06.505143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:06.505603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:06.506372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:06.506848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:06.507303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:06.643236 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:06.650941 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5d10de8c-443a-4825-b1c4-a40f167b7b27 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.158624 Oct 17 14:06:06.651503 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3873/8043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:06 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:07.675529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:07.676120 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:07.682920 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:07.683401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:07.683834 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:07.684520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:07.684970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:07.685481 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:07.816839 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:07.824630 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5a065dae-9b40-4f84-a4d8-7e5addcfb810 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.153649 Oct 17 14:06:07.825205 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4171/8044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:07 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:08.849416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:08.850038 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:08.856604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:08.857097 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:08.857545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:08.858489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:08.858722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:08.859229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:08.991082 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:08.998770 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0fc8d7d2-84a4-4509-9137-3729e9872341 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.154107 Oct 17 14:06:08.999344 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3874/8045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:08 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:10.024059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:10.024616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:10.031438 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:10.031923 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:10.032460 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:10.033059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:10.033514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:10.033943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:10.169868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:10.178939 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-04c5d9f3-b2c6-4abf-966a-c3b7a07f98b2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.158836 Oct 17 14:06:10.179523 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4172/8046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:10 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:11.202998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:11.203694 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:11.211430 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:11.211928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:11.212378 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:11.213088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:11.213553 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:11.213992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:11.352752 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:11.360452 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d65a8556-cbde-406c-85af-05018378ffc5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1695 microversion: 2.1 time: 0.161401 Oct 17 14:06:11.361224 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3875/8047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:11 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:12.317640 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-67954916-df3d-4dfc-92d0-c49e28035764 req-315bfcaa-ce80-4f9e-97bf-9408ff2a9693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fc4932-7910-4f4b-a58d-c5f36de815e2", "name": "network-vif-unplugged", "status": "completed", "tag": "d454328f-882b-4e16-9511-c2ed71e5d54e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:12.328541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-67954916-df3d-4dfc-92d0-c49e28035764 req-315bfcaa-ce80-4f9e-97bf-9408ff2a9693 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:12.329514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-67954916-df3d-4dfc-92d0-c49e28035764 req-315bfcaa-ce80-4f9e-97bf-9408ff2a9693 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:12.329936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-67954916-df3d-4dfc-92d0-c49e28035764 req-315bfcaa-ce80-4f9e-97bf-9408ff2a9693 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:12.346396 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-67954916-df3d-4dfc-92d0-c49e28035764 req-315bfcaa-ce80-4f9e-97bf-9408ff2a9693 service nova] Creating event network-vif-unplugged:d454328f-882b-4e16-9511-c2ed71e5d54e for instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 on n-h2-853316-12 Oct 17 14:06:12.352211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [req-67954916-df3d-4dfc-92d0-c49e28035764 req-315bfcaa-ce80-4f9e-97bf-9408ff2a9693 service nova] Instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127540) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:06:12.363923 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-67954916-df3d-4dfc-92d0-c49e28035764 req-315bfcaa-ce80-4f9e-97bf-9408ff2a9693 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050745 Oct 17 14:06:12.364764 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4173/8048] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:12.384233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:12.384856 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:12.392225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:12.392782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:12.393227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:12.393933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:12.394424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:12.394857 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:12.633375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:12.641173 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-898ac28b-5fee-4510-8b01-6d91ec3952c0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1694 microversion: 2.1 time: 0.260746 Oct 17 14:06:12.643282 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3876/8049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:12 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:13.665670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:13.666404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:13.674753 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:13.675239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:13.675678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:13.676370 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:13.676820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:13.677241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:13.810684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:13.818944 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-77985f36-df17-48e0-aed8-2194d378e6bb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1692 microversion: 2.1 time: 0.157592 Oct 17 14:06:13.819515 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4174/8050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:13 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:14.394665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-17ff7fca-650f-4863-ba20-bba710541680 req-edf94a92-dd99-4fd2-8e1a-704251b46e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fc4932-7910-4f4b-a58d-c5f36de815e2", "tag": "d454328f-882b-4e16-9511-c2ed71e5d54e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:14.404848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-17ff7fca-650f-4863-ba20-bba710541680 req-edf94a92-dd99-4fd2-8e1a-704251b46e7c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:14.405344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-17ff7fca-650f-4863-ba20-bba710541680 req-edf94a92-dd99-4fd2-8e1a-704251b46e7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:14.405789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-17ff7fca-650f-4863-ba20-bba710541680 req-edf94a92-dd99-4fd2-8e1a-704251b46e7c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:14.417500 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-17ff7fca-650f-4863-ba20-bba710541680 req-edf94a92-dd99-4fd2-8e1a-704251b46e7c service nova] Creating event network-changed:d454328f-882b-4e16-9511-c2ed71e5d54e for instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 on n-h2-853316-12 Oct 17 14:06:14.422695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [req-17ff7fca-650f-4863-ba20-bba710541680 req-edf94a92-dd99-4fd2-8e1a-704251b46e7c service nova] Instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853316-12', 'n-h1-853316-12'} {{(pid=127539) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:06:14.433622 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-17ff7fca-650f-4863-ba20-bba710541680 req-edf94a92-dd99-4fd2-8e1a-704251b46e7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043282 Oct 17 14:06:14.434233 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3877/8051] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:14.844972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:14.845724 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:14.853771 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:14.854393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:14.854911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:14.855727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:14.856263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:14.856848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:15.018750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:15.027392 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce0572f7-2311-45a0-845f-ab681c546d64 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1692 microversion: 2.1 time: 0.186363 Oct 17 14:06:15.027997 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4175/8052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:14 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:16.054139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:16.054882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:16.061465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.061999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.063030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.063282 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.063781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.064181 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.218040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:16.226293 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dfd5f4e6-aa22-410d-840c-b014bc04d7f9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1689 microversion: 2.1 time: 0.178756 Oct 17 14:06:16.226885 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3878/8053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:16 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:16.252013 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:16.252628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:16.259794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.260290 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.260732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.261439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.261899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.262363 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.335657 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-82899a2e-2045-449e-b1f5-ca6327c1ced2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action" status: 204 len: 0 microversion: 2.1 time: 0.087931 Oct 17 14:06:16.337998 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4176/8054] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:06:16 2022] POST /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:06:16.347234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:16.348020 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:16.355034 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.356750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.357233 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.358096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.358700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.359924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.596767 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:16.605786 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f4f2c0b8-0841-4017-96ee-b595d4377775 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1689 microversion: 2.1 time: 0.263388 Oct 17 14:06:16.606486 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3879/8055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:16 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:06:16.631410 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:16.632125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:16.638929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.639301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.639979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.640820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.641141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.643167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.795932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:16.807371 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b86334d-ab74-4462-a484-27877a265e8e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1689 microversion: 2.1 time: 0.182267 Oct 17 14:06:16.809005 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4177/8056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:16 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:17.834460 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:17.835139 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:17.842726 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:17.843231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:17.843685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:17.844450 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:17.845487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:17.845906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:17.980788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:17.988925 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0c01d82e-7f43-4a90-a594-fdfaea5f5b52 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1681 microversion: 2.1 time: 0.161101 Oct 17 14:06:17.989518 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3880/8057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:17 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:18.471790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-5b33441e-2822-45ca-a38b-23e409f2604e req-046ee6f5-b870-46b3-b254-2bc40d0dcdcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fc4932-7910-4f4b-a58d-c5f36de815e2", "name": "network-vif-plugged", "status": "completed", "tag": "d454328f-882b-4e16-9511-c2ed71e5d54e"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:18.484355 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5b33441e-2822-45ca-a38b-23e409f2604e req-046ee6f5-b870-46b3-b254-2bc40d0dcdcf service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:18.484922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5b33441e-2822-45ca-a38b-23e409f2604e req-046ee6f5-b870-46b3-b254-2bc40d0dcdcf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:18.486965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-5b33441e-2822-45ca-a38b-23e409f2604e req-046ee6f5-b870-46b3-b254-2bc40d0dcdcf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:18.499116 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-5b33441e-2822-45ca-a38b-23e409f2604e req-046ee6f5-b870-46b3-b254-2bc40d0dcdcf service nova] Creating event network-vif-plugged:d454328f-882b-4e16-9511-c2ed71e5d54e for instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 on n-h2-853316-12 Oct 17 14:06:18.507045 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-5b33441e-2822-45ca-a38b-23e409f2604e req-046ee6f5-b870-46b3-b254-2bc40d0dcdcf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040793 Oct 17 14:06:18.507840 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4178/8058] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:06:40.183392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=26 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:40.184147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=76 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:40.234754 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:40.237474 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:40.243601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:40.244103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:40.244560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:40.245293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:40.245763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:40.246227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:40.300359 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e20f35c6-c63c-4b3f-a53e-7ac0c80f8792 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action" status: 200 len: 24576 microversion: 2.1 time: 0.122248 Oct 17 14:06:40.301117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3881/8059] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:06:40 2022] POST /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2/action => generated 24576 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:06:47.345248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:47.347111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:47.352192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=32 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:47.353081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:47.360011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:47.360709 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:47.361255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:47.363295 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:47.364248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:47.365154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:47.395924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:06:47.405434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-aaa2c0e6-db08-4172-894b-d3e3c4fff430 req-d7fe20d5-067c-4fd8-8fe5-d5c2bffb22bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fc4932-7910-4f4b-a58d-c5f36de815e2", "tag": "d454328f-882b-4e16-9511-c2ed71e5d54e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:47.420116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-aaa2c0e6-db08-4172-894b-d3e3c4fff430 req-d7fe20d5-067c-4fd8-8fe5-d5c2bffb22bc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:47.420713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-aaa2c0e6-db08-4172-894b-d3e3c4fff430 req-d7fe20d5-067c-4fd8-8fe5-d5c2bffb22bc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:47.421162 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-aaa2c0e6-db08-4172-894b-d3e3c4fff430 req-d7fe20d5-067c-4fd8-8fe5-d5c2bffb22bc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:47.432544 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-aaa2c0e6-db08-4172-894b-d3e3c4fff430 req-d7fe20d5-067c-4fd8-8fe5-d5c2bffb22bc service nova] Creating event network-changed:d454328f-882b-4e16-9511-c2ed71e5d54e for instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 on n-h2-853316-12 Oct 17 14:06:47.440178 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-aaa2c0e6-db08-4172-894b-d3e3c4fff430 req-d7fe20d5-067c-4fd8-8fe5-d5c2bffb22bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095588 Oct 17 14:06:47.441582 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3882/8060] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:47.485885 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a51aab75-27e7-4dd1-907e-855ed6831bef tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 204 len: 0 microversion: 2.1 time: 0.144593 Oct 17 14:06:47.487692 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4179/8061] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:06:47 2022] DELETE /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:06:47.503104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:47.503858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:47.511093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:47.511713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:47.512248 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:47.513189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:47.513736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:47.514300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:47.650319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:47.658208 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-28c20e13-9f7f-41f3-a370-44c492ab55d9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1687 microversion: 2.1 time: 0.165511 Oct 17 14:06:47.659521 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3883/8062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:47 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:48.684343 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:48.685052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:48.692973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:48.693463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:48.693906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:48.694655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:48.695119 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:48.695548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:48.840696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:48.849199 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0b303d43-343a-4a62-97f6-d6e06e0ddbe2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 200 len: 1687 microversion: 2.1 time: 0.169087 Oct 17 14:06:48.858489 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4180/8063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:48 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:49.398591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-7714b483-29f3-4c77-823d-ca39fd39460a req-e0b69bdc-cd7b-478e-80e7-203af689c786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fc4932-7910-4f4b-a58d-c5f36de815e2", "name": "network-vif-deleted", "tag": "d454328f-882b-4e16-9511-c2ed71e5d54e"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:49.409657 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7714b483-29f3-4c77-823d-ca39fd39460a req-e0b69bdc-cd7b-478e-80e7-203af689c786 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:49.410149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7714b483-29f3-4c77-823d-ca39fd39460a req-e0b69bdc-cd7b-478e-80e7-203af689c786 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:49.410830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-7714b483-29f3-4c77-823d-ca39fd39460a req-e0b69bdc-cd7b-478e-80e7-203af689c786 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:49.422173 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-7714b483-29f3-4c77-823d-ca39fd39460a req-e0b69bdc-cd7b-478e-80e7-203af689c786 service nova] Creating event network-vif-deleted:d454328f-882b-4e16-9511-c2ed71e5d54e for instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 on n-h2-853316-12 Oct 17 14:06:49.427217 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-7714b483-29f3-4c77-823d-ca39fd39460a req-e0b69bdc-cd7b-478e-80e7-203af689c786 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033243 Oct 17 14:06:49.428070 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3884/8064] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:49.873132 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:49.873789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: e1fc4932-7910-4f4b-a58d-c5f36de815e2] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:49.881909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:49.882417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:49.882854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:49.883547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:49.883997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:49.884417 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:49.902059 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] HTTP exception thrown: Instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 could not be found. Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Request method failure captured: Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 HTTP/1.1 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTWA7Iq30_ND7tSixL49OZ-6OVwEYrkH-KnArTMgX1Rml56KPmgBx6NXY8oHq9SY8pLkLLTM5u5MmRbS4QizO58DHjkNqbRMsnJb-wQEqFgkMNUEZm5qFcyorglemcrQ1itySDI27ZSvcaWi5fSQafEjdfCh0-OOnbSw2BoJQ6RGoaPU Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a1ad203407d497c985ec78825882b22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a1ad203407d497c985ec78825882b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 14d7820516264dd4adf769a5257e6524 Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 could not be found. Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'e1fc4932-7910-4f4b-a58d-c5f36de815e2'} Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 could not be found. Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 could not be found. Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:06:49.903791 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 could not be found. Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Returning 404 to user: Instance e1fc4932-7910-4f4b-a58d-c5f36de815e2 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e8b0dd98-5e56-4fae-8ada-a7a76c92742d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2" status: 404 len: 111 microversion: 2.1 time: 0.036130 Oct 17 14:06:49.909451 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4181/8065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:49 2022] GET /compute/v2.1/servers/e1fc4932-7910-4f4b-a58d-c5f36de815e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:06:53.309594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9359b5ec-a0cb-4115-bf5d-0ebe93f0b9f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '.version_select at 0x7fa81be3d4c0>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:53.316724 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9359b5ec-a0cb-4115-bf5d-0ebe93f0b9f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [e842b619-549b-4674-b41f-316ff90c7a34] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:06:54.323602 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [None req-9359b5ec-a0cb-4115-bf5d-0ebe93f0b9f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [e842b619-549b-4674-b41f-316ff90c7a34] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46748. Oct 17 14:06:54.344497 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9359b5ec-a0cb-4115-bf5d-0ebe93f0b9f7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1296488426" status: 202 len: 0 microversion: 2.1 time: 1.041158 Oct 17 14:06:54.345106 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3885/8066] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 17 14:06:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1296488426 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:06:54.372202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3458f624-92d5-433b-91bb-16f65a625ffa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: .version_select at 0x7fa81be30550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-127210543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe5ob3wtXun4EWvxZQIEycYW/PyiXfXPy4CZ4pZLio5f6LGy6d9Wx7CzaN31t3pCQowM1A39Rnx4Ur3diTMPa0DGvZTreAD9lEqSj/G+hSUo3FH6wNOoyZkIL/vHYuLfg=="}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:54.389990 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3458f624-92d5-433b-91bb-16f65a625ffa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:06:54.396582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-3458f624-92d5-433b-91bb-16f65a625ffa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:06:54.409866 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3458f624-92d5-433b-91bb-16f65a625ffa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [4c3fbe62-4db7-4260-8e6c-d8e353583cb9] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:06:55.417318 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [None req-3458f624-92d5-433b-91bb-16f65a625ffa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [4c3fbe62-4db7-4260-8e6c-d8e353583cb9] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46752. Oct 17 14:06:55.432901 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3458f624-92d5-433b-91bb-16f65a625ffa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.064690 Oct 17 14:06:55.433500 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4182/8067] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 14:06:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:00.999614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=14 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:01.004434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1325922739", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "356a3007-52fc-4783-9ed2-07bf3daaaa80"}], "key_name": "tempest-TestNetworkAdvancedServerOps-127210543", "security_groups": [{"name": "tempest-secgroup-smoke-6315126"}]}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:01.153237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.network.neutron [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] validate_networks() for [('356a3007-52fc-4783-9ed2-07bf3daaaa80', None, None, None, None, None)] {{(pid=127539) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:07:01.616723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:07:01.617156 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image limits 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:07:01.617645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:07:01.618077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image pref 0:0:0 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:07:01.618610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.virt.hardware [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:07:01.628379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:01.628880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:01.629339 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:01.630090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:01.630592 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:01.631117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:01.649046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:07:01.655259 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:07:01.669148 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Going to run 1 instances... {{(pid=127539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:07:01.671604 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:07:01.725499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-41b41ca7-781d-4a84-88f7-50d805a82b77 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.728157 Oct 17 14:07:01.733295 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3886/8068] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:07:00 2022] POST /compute/v2.1/servers => generated 403 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:07:01.737124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:01.744910 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b276f6ae-dc6c-4679-8b05-98812b1ba664 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:01.745622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b276f6ae-dc6c-4679-8b05-98812b1ba664 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:01.817681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b276f6ae-dc6c-4679-8b05-98812b1ba664 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:01.825237 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b276f6ae-dc6c-4679-8b05-98812b1ba664 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1266 microversion: 2.1 time: 0.091389 Oct 17 14:07:01.826517 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4183/8069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:01 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:07:02.850990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:02.852227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:02.860279 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:02.861685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:02.862372 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:02.863366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:02.864011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:02.864620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:02.963707 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:02.980496 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ef07b6f-df46-40a1-8c2d-d1d7016110a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1326 microversion: 2.1 time: 0.135237 Oct 17 14:07:02.982533 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3887/8070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:02 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:04.005734 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:04.006586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:04.015025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:04.015548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:04.016076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:04.016810 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:04.017498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:04.017964 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:04.208872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:04.217300 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b6133bbf-4486-4aea-8e07-fb7d850e68a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1389 microversion: 2.1 time: 0.216244 Oct 17 14:07:04.217890 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4184/8071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:03 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1389 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:04.837095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-814a64d1-c6ae-4d7a-b779-0a181dd504bf req-da791ccb-ec27-4592-a586-7bc91ea19f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bcd4d2-3130-43e1-9ec5-1e07281a6038", "tag": "5fa0f15a-4522-434f-bfb0-797b438e5d98"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:04.848337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-814a64d1-c6ae-4d7a-b779-0a181dd504bf req-da791ccb-ec27-4592-a586-7bc91ea19f2d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:04.848924 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-814a64d1-c6ae-4d7a-b779-0a181dd504bf req-da791ccb-ec27-4592-a586-7bc91ea19f2d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:04.849435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-814a64d1-c6ae-4d7a-b779-0a181dd504bf req-da791ccb-ec27-4592-a586-7bc91ea19f2d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:04.862854 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-814a64d1-c6ae-4d7a-b779-0a181dd504bf req-da791ccb-ec27-4592-a586-7bc91ea19f2d service nova] Creating event network-changed:5fa0f15a-4522-434f-bfb0-797b438e5d98 for instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 on n-h2-853316-12 Oct 17 14:07:04.868026 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-814a64d1-c6ae-4d7a-b779-0a181dd504bf req-da791ccb-ec27-4592-a586-7bc91ea19f2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035766 Oct 17 14:07:04.868632 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3888/8072] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:05.242191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:05.242820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:05.250239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:05.250970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:05.251464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:05.253016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:05.253422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:05.253854 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:05.391362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:05.399548 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-090fc6b7-763e-475b-bda1-1f001ab9c316 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1389 microversion: 2.1 time: 0.162473 Oct 17 14:07:05.400125 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4185/8073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:05 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:06.424294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:06.425012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:06.431479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.431989 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.432444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.433163 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.433635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.434078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.598637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:06.606370 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ea351b0e-2315-4625-88f1-bd72132c9410 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1389 microversion: 2.1 time: 0.187367 Oct 17 14:07:06.606940 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3889/8074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:06 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1389 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:07.629581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:07.630216 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:07.637231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:07.637721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:07.638153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:07.638872 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:07.639321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:07.639743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:07.783541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:07.791813 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-be49c9c5-6c95-4d62-a8a8-0a38fa78be47 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1389 microversion: 2.1 time: 0.166545 Oct 17 14:07:07.792412 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4186/8075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:07 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:08.816500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:08.817164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:08.828574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:08.828574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:08.829124 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:08.830046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:08.830566 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:08.831021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:08.981632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:08.989511 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-dbde36c9-21dd-4adf-8bde-5f7aba7fd353 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1389 microversion: 2.1 time: 0.177459 Oct 17 14:07:08.990093 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3890/8076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:08 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1389 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:10.012019 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:10.012638 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:10.020051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:10.020536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:10.020972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:10.021657 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:10.022110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:10.022559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:10.161072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:10.168899 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6b6e468f-7152-4dcc-8f9f-28e28693f5e9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1389 microversion: 2.1 time: 0.160841 Oct 17 14:07:10.169489 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4187/8077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:10 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:10.745503 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-86d1faca-d432-4aae-ba93-a32768118721 req-cdc1a5ea-c885-4802-be57-6bd25d55ff36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bcd4d2-3130-43e1-9ec5-1e07281a6038", "name": "network-vif-plugged", "status": "completed", "tag": "5fa0f15a-4522-434f-bfb0-797b438e5d98"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:10.752044 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:10.759159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-86d1faca-d432-4aae-ba93-a32768118721 req-cdc1a5ea-c885-4802-be57-6bd25d55ff36 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:10.759646 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-86d1faca-d432-4aae-ba93-a32768118721 req-cdc1a5ea-c885-4802-be57-6bd25d55ff36 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:10.760088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-86d1faca-d432-4aae-ba93-a32768118721 req-cdc1a5ea-c885-4802-be57-6bd25d55ff36 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:10.774092 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-86d1faca-d432-4aae-ba93-a32768118721 req-cdc1a5ea-c885-4802-be57-6bd25d55ff36 service nova] Creating event network-vif-plugged:5fa0f15a-4522-434f-bfb0-797b438e5d98 for instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 on n-h2-853316-12 Oct 17 14:07:10.779264 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-86d1faca-d432-4aae-ba93-a32768118721 req-cdc1a5ea-c885-4802-be57-6bd25d55ff36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037448 Oct 17 14:07:10.779902 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3891/8078] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:11.192582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:11.193114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:11.201491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:11.202018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:11.202548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:11.203276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:11.203766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:11.204237 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:11.344320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:11.352888 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7a88837b-5869-4589-aa13-ea9fbe00dbba tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1389 microversion: 2.1 time: 0.164308 Oct 17 14:07:11.353470 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4188/8079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:11 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:07:12.373088 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:12.373955 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:12.379549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:12.380256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:12.386962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:12.387455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:12.387903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:12.388596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:12.389057 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:12.389500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:12.526830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:12.534956 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8ee6cfad-eca2-47b7-97bd-10b76bd1ef0c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1561 microversion: 2.1 time: 0.162859 Oct 17 14:07:12.535517 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3892/8080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:12 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:12.557131 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:12.557742 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:12.559669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:12.566051 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:12.566593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:12.567037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:12.567736 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:12.568195 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:12.568621 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:12.703594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:12.712524 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6c962939-c474-48ee-ba41-05ef69e04e90 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1561 microversion: 2.1 time: 0.159196 Oct 17 14:07:12.713098 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4189/8081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:12 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:14.306579 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:14.307209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:14.314611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:14.315194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:14.315596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-c1a8faeb-7eea-4d22-ac6b-28c76029891d req-ef06bbe2-f542-4e73-bb10-0d6d82e58390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bcd4d2-3130-43e1-9ec5-1e07281a6038", "tag": "5fa0f15a-4522-434f-bfb0-797b438e5d98"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:14.316083 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:14.316546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:14.317015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:14.317454 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:14.325952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1a8faeb-7eea-4d22-ac6b-28c76029891d req-ef06bbe2-f542-4e73-bb10-0d6d82e58390 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:14.326479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1a8faeb-7eea-4d22-ac6b-28c76029891d req-ef06bbe2-f542-4e73-bb10-0d6d82e58390 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:14.326911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-c1a8faeb-7eea-4d22-ac6b-28c76029891d req-ef06bbe2-f542-4e73-bb10-0d6d82e58390 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:14.339567 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-c1a8faeb-7eea-4d22-ac6b-28c76029891d req-ef06bbe2-f542-4e73-bb10-0d6d82e58390 service nova] Creating event network-changed:5fa0f15a-4522-434f-bfb0-797b438e5d98 for instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 on n-h2-853316-12 Oct 17 14:07:14.344902 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-c1a8faeb-7eea-4d22-ac6b-28c76029891d req-ef06bbe2-f542-4e73-bb10-0d6d82e58390 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032802 Oct 17 14:07:14.346341 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4190/8082] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:14.545338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:14.553980 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-97860305-9cae-402a-9e43-2e0a71b91666 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1561 microversion: 2.1 time: 0.251370 Oct 17 14:07:14.566366 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3893/8083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:14 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1561 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:35.803084 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:35.803837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=38 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:35.808930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:35.811265 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:35.820489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:35.820974 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:35.821413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:35.822112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:35.822608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:35.823031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:35.877140 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-0d6da8b4-299a-406a-b4c0-7fa594df64c8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action" status: 200 len: 24572 microversion: 2.1 time: 0.075946 Oct 17 14:07:35.877778 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4191/8084] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:07:35 2022] POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:07:46.886780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8a2cf0b4-c7c4-4d54-ae42-1ca68f1844fa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:46.889220 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=5 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:46.890127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=36 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:46.897609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2cf0b4-c7c4-4d54-ae42-1ca68f1844fa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:46.898147 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2cf0b4-c7c4-4d54-ae42-1ca68f1844fa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:46.898647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8a2cf0b4-c7c4-4d54-ae42-1ca68f1844fa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:46.924326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8a2cf0b4-c7c4-4d54-ae42-1ca68f1844fa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Going to try to stop instance {{(pid=127539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 14:07:46.968666 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8a2cf0b4-c7c4-4d54-ae42-1ca68f1844fa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action" status: 202 len: 0 microversion: 2.1 time: 0.085283 Oct 17 14:07:46.969260 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3894/8085] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:07:46 2022] POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:07:46.978405 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:46.979125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:46.981739 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:46.982537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:46.988411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:46.988901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:46.989340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:46.990118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:46.990668 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:46.991163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:47.129346 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:47.137229 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1e34fffb-6543-443a-ad27-7b58a9d89884 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.163205 Oct 17 14:07:47.137801 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4192/8086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:46 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:48.162878 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:48.163586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:48.170682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:48.171175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:48.171629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:48.172331 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:48.172792 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:48.173229 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:48.305506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:48.313143 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-894faaa5-625f-408a-827b-5dc15da249a9 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.155219 Oct 17 14:07:48.313713 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3895/8087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:48 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:49.337649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:49.338293 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:49.345868 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:49.346393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:49.347494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:49.348746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:49.348746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:49.349076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:49.483418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:49.493243 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-32c5be07-f959-4926-9868-c45c947b8859 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.159753 Oct 17 14:07:49.493825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4193/8088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:49 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:50.516874 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:50.517493 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:50.524933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:50.525429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:50.525886 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:50.526611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:50.527075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:50.527516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:50.663390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:50.671264 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b41acdd-1fab-4c83-8d83-f93415b9d441 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.158291 Oct 17 14:07:50.671835 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3896/8089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:50 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:51.693507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:51.694125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:51.700960 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:51.701442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:51.701877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:51.702602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:51.703057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:51.703482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:51.924553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:51.932483 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6ea7787d-e451-406f-8e91-58f26e0b46a1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.242935 Oct 17 14:07:51.933100 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4194/8090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:51 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:52.957145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:52.957761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:52.965619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:52.966108 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:52.966584 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:52.967286 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:52.967749 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:52.968184 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:53.103610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:53.111271 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-25e81e01-1ced-49ba-aa77-a90d19cc0c0e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.158505 Oct 17 14:07:53.111837 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3897/8091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:52 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:54.135288 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:54.135935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:54.142809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:54.143329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:54.143947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:54.144651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:54.145112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:54.145544 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:54.281077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:54.289488 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bdfd0030-eeb1-4d3e-acfc-5deb7f5ae9dc tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.158199 Oct 17 14:07:54.290057 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4195/8092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:54 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:55.312976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:55.313630 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:55.320960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:55.321451 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:55.321904 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:55.322627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:55.323095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:55.323542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:55.459077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:55.467091 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-94a6c7b7-eeee-431c-8479-6319f579b2b7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.158006 Oct 17 14:07:55.467662 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3898/8093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:55 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:56.490634 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:56.491258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:56.498255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:56.498746 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:56.499187 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:56.499890 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:56.500351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:56.500779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:56.632898 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:56.640657 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5024c036-c4d6-488d-b55f-314680afb769 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.154593 Oct 17 14:07:56.641229 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4196/8094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:56 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:57.663987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:57.664596 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:57.671502 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:57.671997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:57.672446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:57.673145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:57.673615 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:57.674052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:57.809133 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:57.818116 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9a04f9b9-9b3d-4f19-bd3a-394dcc6a2a8d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.158029 Oct 17 14:07:57.818714 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3899/8095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:57 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:58.841878 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:58.842509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:58.849652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:58.850140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:58.850609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:58.851304 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:58.851760 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:58.852188 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:58.986227 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:58.994057 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-456eb950-4b5c-4a10-a255-a6b7c5cd2722 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.156171 Oct 17 14:07:58.994663 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4197/8096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:58 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:00.020201 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:00.020829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:00.027668 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:00.028169 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:00.028622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:00.029330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:00.029802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:00.030273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:00.162511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:00.170145 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2b42bc91-4fa2-4b79-ba13-ff3487722c42 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.154740 Oct 17 14:08:00.170722 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3900/8097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:00 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:01.193816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:01.194485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:01.201411 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:01.201886 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:01.202360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:01.203059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:01.203514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:01.203940 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:01.335889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:01.343807 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b7010caa-9ffc-4e3f-904b-4aa7c22ba6e8 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1690 microversion: 2.1 time: 0.154536 Oct 17 14:08:01.344391 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4198/8098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:01 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:02.366870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:02.367516 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:02.374363 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:02.374854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:02.375301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:02.375995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:02.376455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:02.376889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:02.511393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:02.520160 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-494cb638-f3b7-4cb3-95c3-acb80a20f5c7 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1667 microversion: 2.1 time: 0.157171 Oct 17 14:08:02.520745 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3901/8099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:02 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:03.614142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:03.616358 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:03.623260 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:03.623745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:03.624185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:03.624881 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:03.625373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:03.625802 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:03.678423 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f70e7e11-baab-461c-be09-c035d0ebef6a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action" status: 200 len: 38386 microversion: 2.1 time: 0.068736 Oct 17 14:08:03.679071 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4199/8100] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:08:03 2022] POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action => generated 38386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:08:03.692202 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-efb6fb1d-436f-49b8-bfe2-e73ce1882afa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:03.699404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efb6fb1d-436f-49b8-bfe2-e73ce1882afa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:03.699938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efb6fb1d-436f-49b8-bfe2-e73ce1882afa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:03.700385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-efb6fb1d-436f-49b8-bfe2-e73ce1882afa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:03.723560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-efb6fb1d-436f-49b8-bfe2-e73ce1882afa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Going to try to start instance {{(pid=127539) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 14:08:03.766038 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-efb6fb1d-436f-49b8-bfe2-e73ce1882afa tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action" status: 202 len: 0 microversion: 2.1 time: 0.078311 Oct 17 14:08:03.766695 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3902/8101] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:08:03 2022] POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:08:03.775784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:03.776504 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:03.783791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:03.784376 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:03.784801 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:03.785522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:03.785973 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:03.786527 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:03.930056 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:03.937966 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2ceb03b2-6a00-4d2d-a9fa-cd968d88e3e0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1676 microversion: 2.1 time: 0.166468 Oct 17 14:08:03.938678 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4200/8102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:03 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:04.963884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:04.964600 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:04.970769 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:04.971888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:04.972317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:04.973039 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:04.973506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:04.973976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:05.115195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:05.123001 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-450f489c-a1df-41fd-9345-0640e1b526fd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1680 microversion: 2.1 time: 0.164495 Oct 17 14:08:05.123575 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3903/8103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:04 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:29.314680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:29.317060 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:29.319670 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=18 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:29.320311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=52 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:29.326148 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:29.326655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:29.327098 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:29.327793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:29.328247 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:29.328667 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:29.384237 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11a986ad-030f-4187-adcb-f1feb89e48a5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action" status: 200 len: 62948 microversion: 2.1 time: 0.073507 Oct 17 14:08:29.384806 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4201/8104] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:08:29 2022] POST /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038/action => generated 62948 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:08:36.745529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:36.746127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:36.748649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=20 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:36.749319 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:36.756388 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d55afe5b-6ff9-45c8-88bf-87ff2d0ff987 req-70bbc211-3ee4-4692-917c-bf222cd89c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bcd4d2-3130-43e1-9ec5-1e07281a6038", "tag": "5fa0f15a-4522-434f-bfb0-797b438e5d98"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:36.772880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:36.773394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:36.773849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:36.774612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:36.775096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:36.775525 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:36.779938 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d55afe5b-6ff9-45c8-88bf-87ff2d0ff987 req-70bbc211-3ee4-4692-917c-bf222cd89c04 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:36.780416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d55afe5b-6ff9-45c8-88bf-87ff2d0ff987 req-70bbc211-3ee4-4692-917c-bf222cd89c04 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:36.780845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d55afe5b-6ff9-45c8-88bf-87ff2d0ff987 req-70bbc211-3ee4-4692-917c-bf222cd89c04 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:36.797015 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d55afe5b-6ff9-45c8-88bf-87ff2d0ff987 req-70bbc211-3ee4-4692-917c-bf222cd89c04 service nova] Creating event network-changed:5fa0f15a-4522-434f-bfb0-797b438e5d98 for instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 on n-h2-853316-12 Oct 17 14:08:36.803287 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d55afe5b-6ff9-45c8-88bf-87ff2d0ff987 req-70bbc211-3ee4-4692-917c-bf222cd89c04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051800 Oct 17 14:08:36.804676 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4202/8105] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:08:36.817090 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:08:36.912440 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4576c049-301e-4350-9dc1-1ea71a5fb816 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 204 len: 0 microversion: 2.1 time: 0.169516 Oct 17 14:08:36.916280 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3904/8106] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:08:36 2022] DELETE /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:08:36.922409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:36.923125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:36.930596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:36.931104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:36.931548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:36.932806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:36.932806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:36.933206 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:37.074109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:37.082876 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4233e321-de40-42d1-9f39-9a401dbc5594 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1686 microversion: 2.1 time: 0.164916 Oct 17 14:08:37.083459 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4203/8107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:36 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:38.107948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:38.108670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:38.116448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:38.116953 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:38.117412 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:38.118130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:38.118628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:38.119074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:38.431536 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:38.440414 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c14878f-d81c-4fcd-aff0-ee2ef9e331ff tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 200 len: 1686 microversion: 2.1 time: 0.336693 Oct 17 14:08:38.441006 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3905/8108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:38 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 1686 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:38.960246 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-beafab57-2b0c-465b-adfe-7a6ef8fbbcce req-9b18138b-4a3e-4c42-b65d-947962ed9ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bcd4d2-3130-43e1-9ec5-1e07281a6038", "name": "network-vif-deleted", "tag": "5fa0f15a-4522-434f-bfb0-797b438e5d98"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:38.974403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-beafab57-2b0c-465b-adfe-7a6ef8fbbcce req-9b18138b-4a3e-4c42-b65d-947962ed9ae0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:38.974892 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-beafab57-2b0c-465b-adfe-7a6ef8fbbcce req-9b18138b-4a3e-4c42-b65d-947962ed9ae0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:38.975323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-beafab57-2b0c-465b-adfe-7a6ef8fbbcce req-9b18138b-4a3e-4c42-b65d-947962ed9ae0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:38.990031 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-beafab57-2b0c-465b-adfe-7a6ef8fbbcce req-9b18138b-4a3e-4c42-b65d-947962ed9ae0 service nova] Creating event network-vif-deleted:5fa0f15a-4522-434f-bfb0-797b438e5d98 for instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 on n-h2-853316-12 Oct 17 14:08:38.995999 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-beafab57-2b0c-465b-adfe-7a6ef8fbbcce req-9b18138b-4a3e-4c42-b65d-947962ed9ae0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039312 Oct 17 14:08:38.996612 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4204/8109] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:08:39.464965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:39.465759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 52bcd4d2-3130-43e1-9ec5-1e07281a6038] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:39.473606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:39.474045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:39.474539 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:39.475267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:39.475740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:39.476217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:39.490263 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] HTTP exception thrown: Instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 could not be found. Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Request method failure captured: Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 HTTP/1.1 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTWA7Iq30_ND7tSixL49OZ-6OVwEYrkH-KnArTMgX1Rml56KPmgBx6NXY8oHq9SY8pLkLLTM5u5MmRbS4QizO58DHjkNqbRMsnJb-wQEqFgkMNUEZm5qFcyorglemcrQ1itySDI27ZSvcaWi5fSQafEjdfCh0-OOnbSw2BoJQ6RGoaPU Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a1ad203407d497c985ec78825882b22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a1ad203407d497c985ec78825882b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 14d7820516264dd4adf769a5257e6524 Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 could not be found. Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '52bcd4d2-3130-43e1-9ec5-1e07281a6038'} Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 could not be found. Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 could not be found. Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:08:39.491864 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 could not be found. Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Returning 404 to user: Instance 52bcd4d2-3130-43e1-9ec5-1e07281a6038 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2404b2b9-47a0-48ea-9295-bdd8119b5459 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038" status: 404 len: 111 microversion: 2.1 time: 0.032874 Oct 17 14:08:39.496718 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3906/8110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:39 2022] GET /compute/v2.1/servers/52bcd4d2-3130-43e1-9ec5-1e07281a6038 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:08:43.083936 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b4228ef2-d7f6-4521-a6a0-e44f9788b231 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '.version_select at 0x7fa820aa65e0>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:43.109234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b4228ef2-d7f6-4521-a6a0-e44f9788b231 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-127210543" status: 202 len: 0 microversion: 2.1 time: 0.029549 Oct 17 14:08:43.109824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4205/8111] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 17 14:08:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-127210543 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:08:43.148001 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-16c4de5c-6f0a-4f75-b71a-7d57cf49faf1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: .version_select at 0x7fa8250cd5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-325696562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnYbn3YPaeNGIMfTX7CgDoxJzvLap7U+59tJQUJKUBIyqybfKX8H/79ZESnGhUeIVvI+3jee3REeixS8MvwI+SuR8JlCkohkHN6J/RiCVnKNK6r0QiCk/yfBiukVvWmTQ=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:43.167071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-16c4de5c-6f0a-4f75-b71a-7d57cf49faf1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:08:43.172440 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-16c4de5c-6f0a-4f75-b71a-7d57cf49faf1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:08:43.197727 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-16c4de5c-6f0a-4f75-b71a-7d57cf49faf1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053962 Oct 17 14:08:43.198549 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3907/8112] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 14:08:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:08:48.808697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1845331973", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "networks": [{"uuid": "dfea1dd0-ba9e-4a99-a85d-69045ba58689"}], "key_name": "tempest-TestNetworkAdvancedServerOps-325696562", "security_groups": [{"name": "tempest-secgroup-smoke-13466451"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:48.945822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] validate_networks() for [('dfea1dd0-ba9e-4a99-a85d-69045ba58689', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:08:48.980136 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=14 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:49.437245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:08:49.437579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:08:49.438073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:08:49.438531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:08:49.439870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:08:49.453790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:49.454333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:49.455511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:49.456549 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:49.457028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:49.457637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:49.483087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:08:49.494502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Getting quotas for user 14d7820516264dd4adf769a5257e6524 and project 1a1ad203407d497c985ec78825882b22. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:08:49.511939 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:08:49.515033 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:08:49.566799 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [ea64873f-0855-4521-8e24-2c7f045884cf] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:08:50.578077 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [ea64873f-0855-4521-8e24-2c7f045884cf] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46994. Oct 17 14:08:50.583479 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-a74f63ec-d07d-494a-ad27-b2045c6b8686 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.779708 Oct 17 14:08:50.584630 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4206/8113] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:08:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:08:50.596496 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:50.603697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-95ea3f8c-de18-4bd0-9f25-e3b9d19c1779 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:50.604443 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-95ea3f8c-de18-4bd0-9f25-e3b9d19c1779 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:50.669725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-95ea3f8c-de18-4bd0-9f25-e3b9d19c1779 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:50.679486 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-95ea3f8c-de18-4bd0-9f25-e3b9d19c1779 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1266 microversion: 2.1 time: 0.086203 Oct 17 14:08:50.680073 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3908/8114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:50 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:51.706048 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:51.708817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:51.729249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:51.730843 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:51.731513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:51.733325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:51.733862 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:51.734391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:51.823354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:51.832483 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2e30b0f7-5ef8-4536-bf78-dd91c2b1c240 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1336 microversion: 2.1 time: 0.134342 Oct 17 14:08:51.833343 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4207/8115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:51 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1336 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:52.856368 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:52.857087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:52.866310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:52.866310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:52.866310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:52.866310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:52.866872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:52.867214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:53.407225 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:53.416591 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ab66df00-bfd4-459a-9c90-7fa80b666a56 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1390 microversion: 2.1 time: 0.564189 Oct 17 14:08:53.417278 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3909/8116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:52 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1390 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:53.554281 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-0542de13-7503-4696-b9cd-1df20c211b05 req-6d1a5eb4-e4ac-4bf7-9d22-6220e83ce324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab7aced-9e57-4018-8210-3856d79f5a34", "tag": "6b2a692a-a314-43da-85f3-d6bcf58c03a0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:53.569658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0542de13-7503-4696-b9cd-1df20c211b05 req-6d1a5eb4-e4ac-4bf7-9d22-6220e83ce324 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:53.570200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0542de13-7503-4696-b9cd-1df20c211b05 req-6d1a5eb4-e4ac-4bf7-9d22-6220e83ce324 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:53.570637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-0542de13-7503-4696-b9cd-1df20c211b05 req-6d1a5eb4-e4ac-4bf7-9d22-6220e83ce324 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:53.584417 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-0542de13-7503-4696-b9cd-1df20c211b05 req-6d1a5eb4-e4ac-4bf7-9d22-6220e83ce324 service nova] Creating event network-changed:6b2a692a-a314-43da-85f3-d6bcf58c03a0 for instance 2ab7aced-9e57-4018-8210-3856d79f5a34 on n-h2-853316-12 Oct 17 14:08:53.589903 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-0542de13-7503-4696-b9cd-1df20c211b05 req-6d1a5eb4-e4ac-4bf7-9d22-6220e83ce324 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039794 Oct 17 14:08:53.590939 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4208/8117] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:08:54.440576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:54.441203 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:54.448289 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:54.448806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:54.449262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:54.449976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:54.450481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:54.450927 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:54.589340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:54.598593 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-169d6ddd-f05d-4c0e-a159-1df1188abb44 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1390 microversion: 2.1 time: 0.162021 Oct 17 14:08:54.599164 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3910/8118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:54 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:55.624422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:55.625727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:55.637761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:55.638300 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:55.638745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:55.639455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:55.639949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:55.640378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:55.775102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:55.783849 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-05df5131-8c72-43ad-bdc6-6399ffab5131 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1390 microversion: 2.1 time: 0.166640 Oct 17 14:08:55.784430 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4209/8119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:55 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:56.807954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:56.808595 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:56.815964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:56.816465 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:56.816913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:56.817626 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:56.818085 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:56.818544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:56.956531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:56.964773 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-211a6674-2efa-41e0-946f-0e0f792190ac tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1390 microversion: 2.1 time: 0.161034 Oct 17 14:08:56.965367 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3911/8120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:56 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:57.989199 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:57.990043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:57.996646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:57.997126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:57.997553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:57.998336 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:57.998787 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:57.999208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:58.135165 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:58.143325 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-51d7a8f5-882d-46b2-88ef-ad5e9939f1e2 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1390 microversion: 2.1 time: 0.158979 Oct 17 14:08:58.143908 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4210/8121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:57 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:59.158577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a4e5ec03-04fa-49bb-ab31-e26e965f2d59 req-6a2e0816-7b31-4af0-9d01-b28e2db5b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab7aced-9e57-4018-8210-3856d79f5a34", "name": "network-vif-plugged", "status": "completed", "tag": "6b2a692a-a314-43da-85f3-d6bcf58c03a0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:59.167845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:59.168449 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:59.169637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a4e5ec03-04fa-49bb-ab31-e26e965f2d59 req-6a2e0816-7b31-4af0-9d01-b28e2db5b5f5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:59.170140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a4e5ec03-04fa-49bb-ab31-e26e965f2d59 req-6a2e0816-7b31-4af0-9d01-b28e2db5b5f5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:59.170681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a4e5ec03-04fa-49bb-ab31-e26e965f2d59 req-6a2e0816-7b31-4af0-9d01-b28e2db5b5f5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:59.177072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:59.177540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:59.177966 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:59.178943 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:59.179601 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:59.180224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:59.183921 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a4e5ec03-04fa-49bb-ab31-e26e965f2d59 req-6a2e0816-7b31-4af0-9d01-b28e2db5b5f5 service nova] Creating event network-vif-plugged:6b2a692a-a314-43da-85f3-d6bcf58c03a0 for instance 2ab7aced-9e57-4018-8210-3856d79f5a34 on n-h2-853316-12 Oct 17 14:08:59.189105 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a4e5ec03-04fa-49bb-ab31-e26e965f2d59 req-6a2e0816-7b31-4af0-9d01-b28e2db5b5f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035330 Oct 17 14:08:59.190094 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3912/8122] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:08:59.334997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:59.343240 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-29084c63-f318-40da-bcc8-adc005e231ee tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1390 microversion: 2.1 time: 0.180074 Oct 17 14:08:59.343825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4211/8123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:59 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:00.369091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:00.369849 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:00.380312 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:00.380723 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:00.381213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:00.382000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:00.382507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:00.382971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:00.534408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:00.543717 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d3908472-4153-4849-853f-160b5abbf6ad tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1562 microversion: 2.1 time: 0.179931 Oct 17 14:09:00.544303 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3913/8124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:00 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:00.564108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:00.564874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:00.569712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:00.570395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:00.572200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:00.578499 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:00.578993 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:00.580107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:00.580816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:00.581274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:00.581705 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:00.724551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:00.732498 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86722360-b8d0-40b6-8eec-dcfa2b40c3eb tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1562 microversion: 2.1 time: 0.169203 Oct 17 14:09:00.733070 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4212/8125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:00 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:02.365687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:02.366356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:02.368319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-307dd5fc-e31c-447f-8b65-14ab7871f535 req-7cec545f-e45c-40ba-a443-11c8b1893dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab7aced-9e57-4018-8210-3856d79f5a34", "tag": "6b2a692a-a314-43da-85f3-d6bcf58c03a0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:02.370321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=6 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:02.379000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:02.379517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:02.379977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:02.380980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:02.381125 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-307dd5fc-e31c-447f-8b65-14ab7871f535 req-7cec545f-e45c-40ba-a443-11c8b1893dcc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:02.381457 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:02.381603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-307dd5fc-e31c-447f-8b65-14ab7871f535 req-7cec545f-e45c-40ba-a443-11c8b1893dcc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:02.382116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-307dd5fc-e31c-447f-8b65-14ab7871f535 req-7cec545f-e45c-40ba-a443-11c8b1893dcc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:02.382314 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:02.394812 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-307dd5fc-e31c-447f-8b65-14ab7871f535 req-7cec545f-e45c-40ba-a443-11c8b1893dcc service nova] Creating event network-changed:6b2a692a-a314-43da-85f3-d6bcf58c03a0 for instance 2ab7aced-9e57-4018-8210-3856d79f5a34 on n-h2-853316-12 Oct 17 14:09:02.400296 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-307dd5fc-e31c-447f-8b65-14ab7871f535 req-7cec545f-e45c-40ba-a443-11c8b1893dcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035776 Oct 17 14:09:02.401090 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4213/8126] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:02.608837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:02.623481 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa44c721-8469-4491-b243-1549d48716bd tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1562 microversion: 2.1 time: 0.261455 Oct 17 14:09:02.626403 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3914/8127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:02 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1562 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:23.886097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:23.886998 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=36 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:23.893155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:23.895440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:23.903537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:23.904018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:23.904453 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:23.905138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:23.905587 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:23.906007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:23.962920 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-77bb107c-28eb-4f12-8e2a-390f97066e61 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action" status: 200 len: 24571 microversion: 2.1 time: 0.078598 Oct 17 14:09:23.963651 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4214/8128] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:09:23 2022] POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:09:35.054241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:35.054777 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:35.056896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:35.057607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=32 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:35.063863 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:35.064350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:35.064797 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:35.065498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:35.065960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:35.066431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:35.090785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lazy-loading 'flavor' on Instance uuid 2ab7aced-9e57-4018-8210-3856d79f5a34 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:09:35.155639 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-79c7f4b6-99d8-49f1-ae75-a3cd18460fc0 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action" status: 202 len: 0 microversion: 2.1 time: 0.105296 Oct 17 14:09:35.156270 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3915/8129] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:09:35 2022] POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:09:35.166440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:35.167186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:35.170273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:35.170955 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=4 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:35.180929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:35.181420 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:35.181866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:35.182689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:35.183146 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:35.183576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:35.323254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:35.331252 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bac00fba-0401-4e86-a9cd-d0afc0e843a3 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1688 microversion: 2.1 time: 0.169581 Oct 17 14:09:35.331814 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4215/8130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:35 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:36.357273 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:36.358035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:36.365392 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:36.365883 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:36.366376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:36.367075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:36.367532 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:36.367968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:36.501424 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:36.509141 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-211dd364-a64f-48da-a6c7-d6c8eb984ada tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1671 microversion: 2.1 time: 0.157133 Oct 17 14:09:36.509711 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3916/8131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:36 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:37.604547 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:37.606684 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:37.613813 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.614333 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.614773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:37.615469 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.615954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.616382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:37.667572 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2a1c5862-7623-4027-9f29-cf3389457c2e tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action" status: 200 len: 38426 microversion: 2.1 time: 0.066882 Oct 17 14:09:37.668487 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4216/8132] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:09:37 2022] POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action => generated 38426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:09:37.680507 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:37.681046 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:37.688429 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.689014 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.689499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:37.690232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.690701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.691141 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:37.763173 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-82383bec-048d-4cb5-8629-27ec372a77e1 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action" status: 202 len: 0 microversion: 2.1 time: 0.086275 Oct 17 14:09:37.766227 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3917/8133] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:09:37 2022] POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:09:37.773003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:37.773761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:37.782395 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.784140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.784590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:37.785296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.786128 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.786583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:37.932071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:37.940692 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5b77cf61-9782-4071-ad6d-5ae3ee52485c tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1677 microversion: 2.1 time: 0.171989 Oct 17 14:09:37.941266 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4217/8134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:37 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:38.966127 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:38.966791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:38.973482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:38.973974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:38.974459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:38.975155 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:38.975617 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:38.976052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:39.112922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:39.120536 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a10fe089-fea4-45f8-9b3d-a55367bc832b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1677 microversion: 2.1 time: 0.159945 Oct 17 14:09:39.121099 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3918/8135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:38 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:40.145697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:40.146372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:40.154003 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:40.154531 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:40.154971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:40.155671 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:40.156155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:40.156651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:40.293368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:40.301362 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9eab6891-76ec-46da-9b40-032c4c9b525a tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1680 microversion: 2.1 time: 0.160473 Oct 17 14:09:40.301935 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4218/8136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:40 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:40.398482 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:40.400709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:40.408270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:40.408873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:40.409352 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:40.410061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:40.410576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:40.411013 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:40.451692 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-da6e4ea3-df65-4edf-9e25-a4bef69aeeb5 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action" status: 200 len: 38426 microversion: 2.1 time: 0.057110 Oct 17 14:09:40.452562 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3919/8137] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:09:40 2022] POST /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34/action => generated 38426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:09:41.443268 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:41.443752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:41.451183 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:41.451958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:41.452590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:41.453731 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:41.454220 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:41.455077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:41.483466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:09:41.524813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-47c2fb30-bdc8-41c5-89d7-3852ee45b8f1 req-7908d5e1-a655-4ab6-a39a-5fc312af60a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab7aced-9e57-4018-8210-3856d79f5a34", "tag": "6b2a692a-a314-43da-85f3-d6bcf58c03a0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:41.539500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-47c2fb30-bdc8-41c5-89d7-3852ee45b8f1 req-7908d5e1-a655-4ab6-a39a-5fc312af60a4 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:41.540327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-47c2fb30-bdc8-41c5-89d7-3852ee45b8f1 req-7908d5e1-a655-4ab6-a39a-5fc312af60a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:41.540998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-47c2fb30-bdc8-41c5-89d7-3852ee45b8f1 req-7908d5e1-a655-4ab6-a39a-5fc312af60a4 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:41.553478 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-47c2fb30-bdc8-41c5-89d7-3852ee45b8f1 req-7908d5e1-a655-4ab6-a39a-5fc312af60a4 service nova] Creating event network-changed:6b2a692a-a314-43da-85f3-d6bcf58c03a0 for instance 2ab7aced-9e57-4018-8210-3856d79f5a34 on n-h2-853316-12 Oct 17 14:09:41.559118 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-47c2fb30-bdc8-41c5-89d7-3852ee45b8f1 req-7908d5e1-a655-4ab6-a39a-5fc312af60a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112264 Oct 17 14:09:41.564323 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3920/8138] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:41.593898 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f9c47775-ddf6-4b46-a6be-2e6cfe8fc18d tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 204 len: 0 microversion: 2.1 time: 0.154299 Oct 17 14:09:41.594694 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4219/8139] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:09:41 2022] DELETE /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:09:41.604757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:41.606632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:41.615340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:41.617647 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:41.618575 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:41.619610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:41.620376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:41.621221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:41.771733 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:41.780948 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ac1a69ab-be86-4b4e-be45-fd2371c8b241 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1686 microversion: 2.1 time: 0.181536 Oct 17 14:09:41.782339 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3921/8140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:41 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:42.805702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:42.807039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:42.815122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:42.815616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:42.816062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:42.816779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:42.817240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:42.817673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:42.955953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:42.963996 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-479d84a4-ec8b-4c06-bf41-d524d1274d82 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1686 microversion: 2.1 time: 0.162717 Oct 17 14:09:42.964563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4220/8141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:42 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:43.988159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:43.988791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:43.995852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:43.996383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:43.996837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:43.997555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:43.998024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:43.998498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:44.075586 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-860962e2-53b9-4290-8cfb-d6a9dbe9b039 req-bea65760-faed-494e-8201-a7149fd4fa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab7aced-9e57-4018-8210-3856d79f5a34", "name": "network-vif-deleted", "tag": "6b2a692a-a314-43da-85f3-d6bcf58c03a0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:44.088594 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-860962e2-53b9-4290-8cfb-d6a9dbe9b039 req-bea65760-faed-494e-8201-a7149fd4fa06 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:44.089074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-860962e2-53b9-4290-8cfb-d6a9dbe9b039 req-bea65760-faed-494e-8201-a7149fd4fa06 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:44.089506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-860962e2-53b9-4290-8cfb-d6a9dbe9b039 req-bea65760-faed-494e-8201-a7149fd4fa06 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:44.095852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d7820516264dd4adf769a5257e6524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1ad203407d497c985ec78825882b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:44.105070 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5c48f941-9413-47a8-bf4a-0d26af2dc41b tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 200 len: 1502 microversion: 2.1 time: 0.120983 Oct 17 14:09:44.106022 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3922/8142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:43 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 1502 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:44.115267 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-860962e2-53b9-4290-8cfb-d6a9dbe9b039 req-bea65760-faed-494e-8201-a7149fd4fa06 service nova] Creating event network-vif-deleted:6b2a692a-a314-43da-85f3-d6bcf58c03a0 for instance 2ab7aced-9e57-4018-8210-3856d79f5a34 on n-h2-853316-12 Oct 17 14:09:44.124371 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-860962e2-53b9-4290-8cfb-d6a9dbe9b039 req-bea65760-faed-494e-8201-a7149fd4fa06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052543 Oct 17 14:09:44.125650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4221/8143] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:45.130101 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:45.130765 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] [instance: 2ab7aced-9e57-4018-8210-3856d79f5a34] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:45.136816 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:45.137316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:45.137772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:45.138504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:45.138975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:45.139417 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:45.153433 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] HTTP exception thrown: Instance 2ab7aced-9e57-4018-8210-3856d79f5a34 could not be found. Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Request method failure captured: Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 HTTP/1.1 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTWA7Iq30_ND7tSixL49OZ-6OVwEYrkH-KnArTMgX1Rml56KPmgBx6NXY8oHq9SY8pLkLLTM5u5MmRbS4QizO58DHjkNqbRMsnJb-wQEqFgkMNUEZm5qFcyorglemcrQ1itySDI27ZSvcaWi5fSQafEjdfCh0-OOnbSw2BoJQ6RGoaPU Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a1ad203407d497c985ec78825882b22", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a1ad203407d497c985ec78825882b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1ad203407d497c985ec78825882b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 1a1ad203407d497c985ec78825882b22 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-819372374 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 14d7820516264dd4adf769a5257e6524 Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestNetworkAdvancedServerOps-819372374-project Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 2ab7aced-9e57-4018-8210-3856d79f5a34 could not be found. Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '2ab7aced-9e57-4018-8210-3856d79f5a34'} Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab7aced-9e57-4018-8210-3856d79f5a34 could not be found. Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab7aced-9e57-4018-8210-3856d79f5a34 could not be found. Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:09:45.155132 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab7aced-9e57-4018-8210-3856d79f5a34 could not be found. Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Returning 404 to user: Instance 2ab7aced-9e57-4018-8210-3856d79f5a34 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e6feaa2a-989d-40e6-92bf-0c658ab1cf00 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34" status: 404 len: 111 microversion: 2.1 time: 0.031549 Oct 17 14:09:45.161542 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3923/8144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:45 2022] GET /compute/v2.1/servers/2ab7aced-9e57-4018-8210-3856d79f5a34 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:09:48.533627 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-80926de2-668a-488f-8969-f80732578464 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] Calling method '.version_select at 0x7fa81b7ddf70>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:48.560719 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-80926de2-668a-488f-8969-f80732578464 tempest-TestNetworkAdvancedServerOps-819372374 tempest-TestNetworkAdvancedServerOps-819372374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-325696562" status: 202 len: 0 microversion: 2.1 time: 0.030808 Oct 17 14:09:48.560719 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4222/8145] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 17 14:09:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-325696562 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:09:59.667768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=18 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:59.668991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:59.884104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d19cafad-1109-4089-95a4-b83be9642991 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Action: 'create', calling method: .version_select at 0x7fa81bb29c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1810933926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6kf5ZCYD4KzR5j87O3/ksmFIscpGUbn23OhiqshgtKi5X+JynsEqYNBYG/7XhOMxuFUCXqLHidC2qwB8OXz+LZkNibxh2osUOlzD/puHYWxFO4hU5enPzUgvQR7WnrWg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:59.905445 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d19cafad-1109-4089-95a4-b83be9642991 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Getting quotas for project 3ec310e12fd840aaaf7d2360f9795bce. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:09:59.912240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d19cafad-1109-4089-95a4-b83be9642991 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Getting quotas for user 0dddea54f1854d9a8c6a8f0a9723ee03 and project 3ec310e12fd840aaaf7d2360f9795bce. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:09:59.942807 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d19cafad-1109-4089-95a4-b83be9642991 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.276910 Oct 17 14:09:59.944142 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3924/8146] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 14:09:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:10:01.326502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2013993668", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1810933926", "security_groups": [{"name": "tempest-secgroup-smoke-1653603690"}], "networks": [{"uuid": "b343552a-bdc2-41b7-a38b-f79aa14ba047"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:01.337372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:01.338233 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:01.450011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] validate_networks() for [('b343552a-bdc2-41b7-a38b-f79aa14ba047', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:10:01.936876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:10:01.937400 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:10:01.937906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:10:01.938350 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:10:01.938763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:10:01.947639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:01.948118 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:01.948553 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:01.949305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:01.949766 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:01.950209 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:01.969840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Getting quotas for project 3ec310e12fd840aaaf7d2360f9795bce. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:10:01.975514 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Getting quotas for user 0dddea54f1854d9a8c6a8f0a9723ee03 and project 3ec310e12fd840aaaf7d2360f9795bce. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:10:01.988808 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:10:01.991201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:10:02.039486 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bd84d639-936f-41d2-b104-e11c1d7804ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716955 Oct 17 14:10:02.040140 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4223/8147] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:10:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:10:02.052423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bb32e23f-257a-4204-9d76-689378b02079 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:02.053210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bb32e23f-257a-4204-9d76-689378b02079 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:02.109727 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bb32e23f-257a-4204-9d76-689378b02079 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:02.116667 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bb32e23f-257a-4204-9d76-689378b02079 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1247 microversion: 2.1 time: 0.068436 Oct 17 14:10:02.117239 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3925/8148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:02 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1247 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:03.141559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d69abdd-e365-4158-9a2c-6123966bb7b4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:03.142571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d69abdd-e365-4158-9a2c-6123966bb7b4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:03.209365 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d69abdd-e365-4158-9a2c-6123966bb7b4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:03.218920 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d69abdd-e365-4158-9a2c-6123966bb7b4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1247 microversion: 2.1 time: 0.083170 Oct 17 14:10:03.219905 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4224/8149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:03 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:04.241776 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6a712c06-6f59-49bb-8b28-80e09d19b439 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:04.242531 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6a712c06-6f59-49bb-8b28-80e09d19b439 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:04.303318 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6a712c06-6f59-49bb-8b28-80e09d19b439 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:04.310660 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6a712c06-6f59-49bb-8b28-80e09d19b439 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1247 microversion: 2.1 time: 0.072696 Oct 17 14:10:04.311223 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3926/8150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:04 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:05.334880 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8018434a-0053-42a5-a406-867647858489 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:05.335751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8018434a-0053-42a5-a406-867647858489 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:05.410344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8018434a-0053-42a5-a406-867647858489 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:05.423011 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8018434a-0053-42a5-a406-867647858489 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1247 microversion: 2.1 time: 0.090648 Oct 17 14:10:05.423732 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4225/8151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:05 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:06.448622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:06.449321 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:06.458002 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:06.458535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:06.458982 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:06.459704 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:06.460168 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:06.460875 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:06.523873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:06.532328 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-bc4f46f4-28f9-4ea1-b3aa-ec885ccbadbe tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1251 microversion: 2.1 time: 0.087641 Oct 17 14:10:06.532837 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3927/8152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:06 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1251 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:07.555888 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:07.556522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:07.566327 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:07.566827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:07.567266 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:07.567968 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:07.568422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:07.568848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:07.644065 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:07.652238 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce9346ed-33bd-4564-9163-4bbd17840083 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1305 microversion: 2.1 time: 0.100245 Oct 17 14:10:07.653185 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4226/8153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:07 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:08.621294 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-30519231-c643-4f7a-8903-c885896369b9 req-8b6c153e-48be-4cb5-b112-8d676c87818e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:08.634152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30519231-c643-4f7a-8903-c885896369b9 req-8b6c153e-48be-4cb5-b112-8d676c87818e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:08.635114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30519231-c643-4f7a-8903-c885896369b9 req-8b6c153e-48be-4cb5-b112-8d676c87818e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:08.636005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-30519231-c643-4f7a-8903-c885896369b9 req-8b6c153e-48be-4cb5-b112-8d676c87818e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:08.649110 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-30519231-c643-4f7a-8903-c885896369b9 req-8b6c153e-48be-4cb5-b112-8d676c87818e service nova] Creating event network-changed:4e88dc39-84c2-4d01-907f-9b51f2c6810d for instance e4396d2a-e022-4d1f-bd9f-c85974a71373 on n-h2-853316-12 Oct 17 14:10:08.654298 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-30519231-c643-4f7a-8903-c885896369b9 req-8b6c153e-48be-4cb5-b112-8d676c87818e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037510 Oct 17 14:10:08.654912 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3928/8154] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:10:08.683741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:08.684345 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:08.692185 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:08.692675 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:08.693115 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:08.693833 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:08.694313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:08.694744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:08.845374 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:08.854014 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8b48e76e-0019-4b41-b6f9-fd66e1737595 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1373 microversion: 2.1 time: 0.174215 Oct 17 14:10:08.854637 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4227/8155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:08 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:09.879442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:09.880330 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:09.886798 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:09.887643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:09.888173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:09.888917 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:09.889393 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:09.889855 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:10.123778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:10.132032 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-09a99011-ef4a-4ccd-99e0-30cdfda7cd95 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1373 microversion: 2.1 time: 0.258031 Oct 17 14:10:10.132757 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3929/8156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:09 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1373 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:11.157562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:11.158329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:11.165404 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:11.165905 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:11.166380 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:11.167097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:11.167564 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:11.167996 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:11.307632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:11.316231 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4d9ff204-2085-4cd1-aa7d-0ae4bb02cc4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1373 microversion: 2.1 time: 0.165062 Oct 17 14:10:11.316811 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4228/8157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:11 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:12.343040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:12.343803 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:12.350717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:12.351216 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:12.351674 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:12.352448 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:12.352920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:12.353361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:12.492879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:12.501405 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1d8b253e-8a1a-4cd9-afd8-0c9c8bd88f3d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1373 microversion: 2.1 time: 0.162506 Oct 17 14:10:12.501997 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3930/8158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:12 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:13.503651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:13.524022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:13.524732 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:13.531827 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:13.532343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:13.532804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:13.533620 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:13.533987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:13.534461 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:13.569697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-06236f06-ed9f-45c3-b390-44c6d7477cea req-1285c227-d4d6-4587-b451-c2d160369c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "name": "network-vif-plugged", "status": "completed", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:13.579696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-06236f06-ed9f-45c3-b390-44c6d7477cea req-1285c227-d4d6-4587-b451-c2d160369c6e service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:13.580177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-06236f06-ed9f-45c3-b390-44c6d7477cea req-1285c227-d4d6-4587-b451-c2d160369c6e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:13.580606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-06236f06-ed9f-45c3-b390-44c6d7477cea req-1285c227-d4d6-4587-b451-c2d160369c6e service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:13.592381 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-06236f06-ed9f-45c3-b390-44c6d7477cea req-1285c227-d4d6-4587-b451-c2d160369c6e service nova] Creating event network-vif-plugged:4e88dc39-84c2-4d01-907f-9b51f2c6810d for instance e4396d2a-e022-4d1f-bd9f-c85974a71373 on n-h2-853316-12 Oct 17 14:10:13.598006 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-06236f06-ed9f-45c3-b390-44c6d7477cea req-1285c227-d4d6-4587-b451-c2d160369c6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099639 Oct 17 14:10:13.598642 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4229/8159] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:10:13.710703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:13.719946 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9151040f-b9b6-4070-88f3-4bb5441deb11 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1373 microversion: 2.1 time: 0.199682 Oct 17 14:10:13.720458 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3931/8160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:13 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1373 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:14.744516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:14.745242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:14.751997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:14.752478 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:14.752916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:14.753608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:14.754059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:14.754515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:14.897930 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:14.905725 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6800a8e9-1978-421f-b513-c69c058d43d7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1373 microversion: 2.1 time: 0.166324 Oct 17 14:10:14.906329 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4230/8161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:14 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:15.928636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:15.929264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:15.931256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:15.937049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:15.937545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:15.938537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:15.939239 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:15.939705 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:15.940145 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:16.081280 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:16.089418 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7abdf0bf-2ae0-4076-9917-36d81030b576 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1558 microversion: 2.1 time: 0.164897 Oct 17 14:10:16.090005 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3932/8162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:15 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:16.111432 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:16.112038 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:16.114011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:16.120228 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:16.120713 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:16.121151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:16.121848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:16.122342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:16.122772 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:16.258655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:16.267921 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88812985-247d-4a75-823e-3dfd0a6743de tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1558 microversion: 2.1 time: 0.160294 Oct 17 14:10:16.268518 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4231/8163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:16 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:17.977154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-b8942801-a73b-4e88-adea-811713ebf59c req-516e7025-dba3-4fbe-ba48-f0b24eb64633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:17.987384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b8942801-a73b-4e88-adea-811713ebf59c req-516e7025-dba3-4fbe-ba48-f0b24eb64633 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:17.987877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b8942801-a73b-4e88-adea-811713ebf59c req-516e7025-dba3-4fbe-ba48-f0b24eb64633 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:17.988323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-b8942801-a73b-4e88-adea-811713ebf59c req-516e7025-dba3-4fbe-ba48-f0b24eb64633 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:17.999383 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-b8942801-a73b-4e88-adea-811713ebf59c req-516e7025-dba3-4fbe-ba48-f0b24eb64633 service nova] Creating event network-changed:4e88dc39-84c2-4d01-907f-9b51f2c6810d for instance e4396d2a-e022-4d1f-bd9f-c85974a71373 on n-h2-853316-12 Oct 17 14:10:18.004779 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-b8942801-a73b-4e88-adea-811713ebf59c req-516e7025-dba3-4fbe-ba48-f0b24eb64633 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031403 Oct 17 14:10:18.005775 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3933/8164] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:12:12.025632 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:12:12.026884 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:12:12.027637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:12.028455 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=34 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:12.029801 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:12:12.029969 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 14:12:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373/action (ip 10.222.0.27) !!! Oct 17 14:12:12.036063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:12.036595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:12.049101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:12.049582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:12.050011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:12.050721 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:12.051164 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:12.051580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:12.074557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lazy-loading 'flavor' on Instance uuid e4396d2a-e022-4d1f-bd9f-c85974a71373 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:12:12.262614 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-26fc5503-0718-4638-a723-2a9c131f2a58 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "POST /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373/action" status: 202 len: 0 microversion: 2.1 time: 0.239685 Oct 17 14:12:12.263266 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4232/8165] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:12:12 2022] POST /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:12:12.270397 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:12:12.271505 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:12:12.271664 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 14:12:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 (ip 10.222.0.27) !!! Oct 17 14:12:12.273877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:12.274757 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=34 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:12.280272 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:12.281134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:12.294032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:12.294564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:12.295022 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:12.295742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:12.296212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:12.296651 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:12.431305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:12.438999 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ecbe13db-09ee-42c0-a750-84f7acce52a8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.171011 Oct 17 14:12:12.439568 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3934/8166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:12 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:13.465999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:13.466727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:13.476112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:13.477431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:13.478095 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:13.478624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:13.479083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:13.479513 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:13.483535 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47344. Oct 17 14:12:13.484227 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47342. Oct 17 14:12:13.620171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:13.627958 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e2a75353-c107-47e2-a20d-dc85d0fd5a48 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.169108 Oct 17 14:12:13.628522 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4233/8167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:13 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:14.652761 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:14.653383 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:14.666296 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47350. Oct 17 14:12:14.668404 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:14.668898 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:14.669343 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:14.670049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:14.670601 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:14.671037 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:14.809956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:14.818293 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-42a8be31-9c94-4728-a6c0-e96a3a702233 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.170565 Oct 17 14:12:14.818871 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3935/8168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:14 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:15.842248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:15.842852 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:15.849698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:15.850192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:15.850644 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:15.851323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:15.851773 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:15.852192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:15.986127 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:15.994053 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-bfe02f47-510e-4d83-935d-0b188b277a5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.156817 Oct 17 14:12:15.994650 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4234/8169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:15 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:17.017742 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:17.018353 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:17.025576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:17.026071 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:17.026920 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:17.027627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:17.028091 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:17.028526 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:17.158888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:17.166725 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-56f63db4-07c1-4fac-9fc6-61b89b74eddc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.153152 Oct 17 14:12:17.167318 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3936/8170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:17 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:18.190392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:18.190991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:18.197917 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:18.198429 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:18.198865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:18.199551 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:18.200000 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:18.200418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:18.336311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:18.344894 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-98d1adc0-c3d9-4c5b-81b5-45fc0c3914b3 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.158480 Oct 17 14:12:18.345469 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4235/8171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:18 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:19.368256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:19.368943 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:19.377500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:19.377997 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:19.378477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:19.379182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:19.379652 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:19.380093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:19.509079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:19.516773 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-00972d77-2598-412c-9e68-859487c8d636 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.152467 Oct 17 14:12:19.517348 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3937/8172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:19 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:20.540211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:20.541391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:20.548307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:20.548789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:20.549224 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:20.549913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:20.550409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:20.550836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:20.683809 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:20.691675 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-440f70f1-1f63-4bc3-ac70-06e84ac06c77 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.155424 Oct 17 14:12:20.692242 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4236/8173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:20 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:21.715300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:21.715959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:21.723365 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:21.723871 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:21.724327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:21.725048 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:21.725513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:21.725952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:21.866533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:21.874979 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c3506e2b-583a-4189-bd52-d26be6f27e9a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.164025 Oct 17 14:12:21.875555 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3938/8174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:21 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:22.898635 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:22.899248 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:22.906891 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:22.907373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:22.907804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:22.908485 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:22.908934 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:22.909353 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:23.044140 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:23.051899 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44a6bd25-2a15-4379-a29a-fc6082f9b45f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1703 microversion: 2.1 time: 0.157206 Oct 17 14:12:23.052477 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4237/8175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:22 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1703 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:24.075860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:24.076520 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:24.083940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:24.084444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:24.084888 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:24.085884 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:24.086376 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:24.086813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:24.269713 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:24.279111 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-708d4abf-9736-4f90-82ee-958e84b8c82e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1703 microversion: 2.1 time: 0.207852 Oct 17 14:12:24.280044 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3939/8176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:24 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1703 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:25.306876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:25.308296 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:25.315537 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:25.316284 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:25.316941 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:25.317856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:25.318637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:25.319466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:25.481659 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:25.490861 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-264cb1ce-168b-44eb-974e-f6158326f00e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1698 microversion: 2.1 time: 0.192490 Oct 17 14:12:25.491374 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4238/8177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:25 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1698 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:26.277408 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-cd49ba0c-6ac4-490f-ac70-0980b2e14197 req-cd2b1588-0818-425d-a7b8-9e5e01bd76ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "name": "network-vif-plugged", "status": "completed", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:26.294529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd49ba0c-6ac4-490f-ac70-0980b2e14197 req-cd2b1588-0818-425d-a7b8-9e5e01bd76ab service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:26.296023 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd49ba0c-6ac4-490f-ac70-0980b2e14197 req-cd2b1588-0818-425d-a7b8-9e5e01bd76ab service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:26.296488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-cd49ba0c-6ac4-490f-ac70-0980b2e14197 req-cd2b1588-0818-425d-a7b8-9e5e01bd76ab service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:26.311902 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-cd49ba0c-6ac4-490f-ac70-0980b2e14197 req-cd2b1588-0818-425d-a7b8-9e5e01bd76ab service nova] Creating event network-vif-plugged:4e88dc39-84c2-4d01-907f-9b51f2c6810d for instance e4396d2a-e022-4d1f-bd9f-c85974a71373 on n-h2-853316-12 Oct 17 14:12:26.318457 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-cd49ba0c-6ac4-490f-ac70-0980b2e14197 req-cd2b1588-0818-425d-a7b8-9e5e01bd76ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045919 Oct 17 14:12:26.320174 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3940/8178] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:12:26.516913 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:26.517526 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:26.525519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:26.526108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:26.526744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:26.527428 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:26.527912 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:26.528393 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:26.689656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:26.698971 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-86c3911c-997f-46e1-b72b-b55fa5fc7d72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1698 microversion: 2.1 time: 0.185979 Oct 17 14:12:26.699910 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4239/8179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:26 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:27.726993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:27.727716 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:27.736453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:27.736679 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:27.737093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:27.737813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:27.738303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:27.738743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:27.902375 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:27.911594 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-34cf1f01-299f-419f-8e83-22b8fa6856e7 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1698 microversion: 2.1 time: 0.189188 Oct 17 14:12:27.912546 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3941/8180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:27 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:28.942633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:28.943367 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:28.951297 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:28.951798 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:28.952245 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:28.952924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:28.953373 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:28.953797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:29.113171 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:29.122491 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d1e91b0-68f0-4d9c-a6d8-6b298c7daedf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1698 microversion: 2.1 time: 0.184498 Oct 17 14:12:29.123456 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4240/8181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:28 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:30.148235 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:30.148912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:30.157040 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:30.157548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:30.158031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:30.158806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:30.159270 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:30.159718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:30.309940 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:30.317904 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-240c7a04-a085-48d5-9776-c5ebf020fd5e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1698 microversion: 2.1 time: 0.173695 Oct 17 14:12:30.318510 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3942/8182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:30 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:31.342021 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:31.343408 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:31.350732 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:31.351536 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:31.352219 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:31.353080 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:31.354250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:31.354250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:31.507744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:31.516827 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1a988fbf-225b-475d-a677-ebaff382ea73 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1698 microversion: 2.1 time: 0.179118 Oct 17 14:12:31.517711 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4241/8183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:31 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:32.540180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:32.541832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:32.549824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:32.550756 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:32.551455 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:32.552416 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:32.553118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:32.553859 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:32.711911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:32.720825 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-69a145a0-c693-484d-8388-fd3180d5abb6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1698 microversion: 2.1 time: 0.184374 Oct 17 14:12:32.732985 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3943/8184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:32 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1698 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:33.748167 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:33.748791 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:33.756958 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:33.757448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:33.757885 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:33.758616 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:33.759068 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:33.759492 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:33.919014 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:33.927044 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c20a14e2-97ba-4c80-815d-93610adf4b8b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1698 microversion: 2.1 time: 0.183455 Oct 17 14:12:33.927825 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4242/8185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:33 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:34.950310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:34.950933 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:34.957736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:34.958266 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:34.958719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:34.959415 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:34.959879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:34.960315 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:35.095931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:35.104610 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-535132c6-6e3c-449a-93d7-e7c8aba9180f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1680 microversion: 2.1 time: 0.157440 Oct 17 14:12:35.105169 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3944/8186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:34 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:36.127919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:36.128596 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:36.135983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:36.136473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:36.136907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:36.137603 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:36.138054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:36.138508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:36.274562 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:36.282841 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f0a2275c-af95-4a54-a173-9d785df1d70e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1680 microversion: 2.1 time: 0.158760 Oct 17 14:12:36.283437 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4243/8187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:36 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:37.307837 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:37.308497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:37.315414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:37.315911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:37.316385 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:37.317089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:37.317555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:37.317995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:37.451068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:37.458835 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f6688e4d-36a0-456d-b601-155bd01b7d92 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1623 microversion: 2.1 time: 0.155014 Oct 17 14:12:37.459408 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3945/8188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:37 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1623 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:37.482058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:37.482676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:37.489368 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:37.489848 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:37.490313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:37.490997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:37.491447 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:37.491869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:37.533845 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127540) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 14:12:37.599842 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e47936ea-ffda-41cb-8f4f-0b5c1315b7ea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "POST /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373/action" status: 202 len: 0 microversion: 2.1 time: 0.121910 Oct 17 14:12:37.600462 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4244/8189] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:12:37 2022] POST /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:12:37.608545 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:37.609172 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:37.615075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:37.615572 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:37.616019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:37.616722 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:37.617186 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:37.618433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:37.761881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:37.769578 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-487df721-af9a-4e6a-a872-8f0ddac04c54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1631 microversion: 2.1 time: 0.164898 Oct 17 14:12:37.770131 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3946/8190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:37 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1631 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:38.299953 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-f5c070cc-defc-46d2-84f9-ac3cdd02d191 req-f6ab8c7e-5f50-4754-a4cd-a3909af2234d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "name": "network-vif-unplugged", "status": "completed", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:38.312696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f5c070cc-defc-46d2-84f9-ac3cdd02d191 req-f6ab8c7e-5f50-4754-a4cd-a3909af2234d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:38.313241 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f5c070cc-defc-46d2-84f9-ac3cdd02d191 req-f6ab8c7e-5f50-4754-a4cd-a3909af2234d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:38.313857 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-f5c070cc-defc-46d2-84f9-ac3cdd02d191 req-f6ab8c7e-5f50-4754-a4cd-a3909af2234d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:38.327576 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.server_external_events [req-f5c070cc-defc-46d2-84f9-ac3cdd02d191 req-f6ab8c7e-5f50-4754-a4cd-a3909af2234d service nova] Unable to find a host for instance e4396d2a-e022-4d1f-bd9f-c85974a71373. Dropping event network-vif-unplugged {{(pid=127540) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 14:12:38.328668 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-f5c070cc-defc-46d2-84f9-ac3cdd02d191 req-f6ab8c7e-5f50-4754-a4cd-a3909af2234d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032390 Oct 17 14:12:38.329452 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4245/8191] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 14:12:38.794284 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:38.795118 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:38.802065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:38.802665 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:38.803188 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:38.803968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:38.804441 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:38.804912 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:38.941802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:38.950155 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5f595d8b-e80b-4fdf-b672-dd37876a4706 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.161031 Oct 17 14:12:38.950738 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3947/8192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:38 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:39.977322 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:39.978077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:39.985525 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:39.986025 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:39.986491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:39.987201 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:39.987656 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:39.988085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:39.990481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-733cdf7c-1ea3-46b8-83f3-74ff7c1530fb req-2bf98359-a4d2-43f6-9aa4-e4f65de4cd56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:39.992308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:40.003681 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-733cdf7c-1ea3-46b8-83f3-74ff7c1530fb req-2bf98359-a4d2-43f6-9aa4-e4f65de4cd56 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.004574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-733cdf7c-1ea3-46b8-83f3-74ff7c1530fb req-2bf98359-a4d2-43f6-9aa4-e4f65de4cd56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.005472 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-733cdf7c-1ea3-46b8-83f3-74ff7c1530fb req-2bf98359-a4d2-43f6-9aa4-e4f65de4cd56 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.019877 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-733cdf7c-1ea3-46b8-83f3-74ff7c1530fb req-2bf98359-a4d2-43f6-9aa4-e4f65de4cd56 service nova] Creating event network-changed:4e88dc39-84c2-4d01-907f-9b51f2c6810d for instance e4396d2a-e022-4d1f-bd9f-c85974a71373 on n-h1-853316-12 Oct 17 14:12:40.029863 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-733cdf7c-1ea3-46b8-83f3-74ff7c1530fb req-2bf98359-a4d2-43f6-9aa4-e4f65de4cd56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040684 Oct 17 14:12:40.031038 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3948/8193] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:12:40.135655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:40.143849 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4ef42b35-94df-4b6e-a053-bbe6922ee7ad tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.172686 Oct 17 14:12:40.144502 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4246/8194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:39 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:41.173152 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:41.175095 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:41.183036 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:41.186096 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:41.186703 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:41.199213 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:41.199836 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:41.200529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:41.388782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:41.397608 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b5b69f2c-a203-4e2e-a7fb-ca3a7e25333a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.231434 Oct 17 14:12:41.415505 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3949/8195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:41 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:42.424494 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:42.425101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:42.427926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:42.434397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:42.434914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:42.435402 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:42.436112 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:42.436593 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:42.437256 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:42.589707 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:42.606585 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f45aa72c-7d66-4213-ae29-345c61fd0fe1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.185992 Oct 17 14:12:42.607911 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4247/8196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:42 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:43.630710 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:43.631411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:43.634263 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=33 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:43.640182 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:43.640842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:43.641300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:43.642019 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:43.642519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:43.642960 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:43.645971 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=89 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:43.788008 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:43.797223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-49406d31-2403-4524-962e-c494395a0ae2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.170426 Oct 17 14:12:43.798138 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3950/8197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:43 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:44.821331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:44.823609 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:44.830696 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:44.831276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:44.831818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:44.832614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:44.833173 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:44.833695 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:44.984559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:44.992499 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2f7626d2-8d3f-4823-bc52-00d8c2b2556e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.175170 Oct 17 14:12:44.993070 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4248/8198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:44 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:46.020446 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:46.021068 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:46.028848 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:46.029498 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:46.030079 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:46.030922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:46.031513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:46.032089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:46.188300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:46.196600 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e3ff4146-0f58-4389-894b-120cbbf67320 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.182937 Oct 17 14:12:46.197989 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3951/8199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:46 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:47.222030 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:47.222767 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:47.229901 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:47.230444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:47.230889 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:47.231598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:47.232052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:47.232477 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:47.411924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:47.421601 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-b3413bce-5faf-4257-bd27-c4c0e52e74cd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.203583 Oct 17 14:12:47.422194 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4249/8200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:47 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:48.444693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:48.445402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:48.453791 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:48.454405 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:48.454873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:48.455649 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:48.456117 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:48.456564 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:48.613544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:48.622582 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-94d43aa0-27b0-424d-88fb-12bad579163b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.181641 Oct 17 14:12:48.623179 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3952/8201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:48 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:49.647283 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:49.647926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:49.655740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:49.656229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:49.656672 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:49.657401 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:49.657859 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:49.658314 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:49.793529 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:49.801504 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f797e597-4b35-43f9-ad67-b634e0baab66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.158207 Oct 17 14:12:49.802109 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4250/8202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:49 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:50.824718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:50.825338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:50.832397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:50.832893 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:50.833342 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:50.834053 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:50.834549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:50.834983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:50.971768 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:50.980536 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5558bbf9-ddfb-49aa-abd3-d538902213ee tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.158770 Oct 17 14:12:50.981110 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3953/8203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:50 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:52.003413 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:52.004059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:52.011153 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:52.011643 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:52.012087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:52.012784 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:52.013240 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:52.013674 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:52.196744 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:52.204482 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1d8ced58-fedf-4b27-bf38-33fc6f90d885 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.205043 Oct 17 14:12:52.205054 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4251/8204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:51 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:53.228296 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:53.229065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:53.236475 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:53.236976 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:53.237427 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:53.238140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:53.238631 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:53.239074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:53.372689 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:53.380418 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f9c278c9-5573-49a5-9a09-a87a044eb849 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.156287 Oct 17 14:12:53.380996 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3954/8205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:53 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:54.404718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:54.405341 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:54.412229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:54.412740 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:54.413181 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:54.413871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:54.415081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:54.415081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:54.547111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:54.554846 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-90ab41ab-197f-4848-8af6-64ac29296147 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.154735 Oct 17 14:12:54.555407 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4252/8206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:54 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:55.576923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:55.577490 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:55.584585 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:55.585076 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:55.585521 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:55.586504 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:55.586966 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:55.587401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:55.721556 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:55.729383 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-53dabf61-0d37-4778-90da-1ba7e3f55d39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.156439 Oct 17 14:12:55.729958 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3955/8207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:55 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:56.752602 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:56.753152 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:56.760061 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:56.760733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:56.761315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:56.762010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:56.762502 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:56.762929 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:56.903071 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:56.910799 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-97972691-42e7-4c11-b35f-b075b61e26c8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.162133 Oct 17 14:12:56.911371 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4253/8208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:56 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:57.935594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:57.936214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:57.943157 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:57.943648 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:57.944094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:57.944794 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:57.945260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:57.945699 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:58.084058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:58.092754 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c7cd9a9-0554-4f80-b921-c0cce35dd497 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.161869 Oct 17 14:12:58.093322 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3956/8209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:57 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:58.403919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-a0b9f256-a20f-4a02-8cd0-66133be26d1e req-025854f6-009a-4e3f-8865-9a4616011048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "name": "network-vif-plugged", "status": "completed", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:58.414618 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a0b9f256-a20f-4a02-8cd0-66133be26d1e req-025854f6-009a-4e3f-8865-9a4616011048 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:58.415097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a0b9f256-a20f-4a02-8cd0-66133be26d1e req-025854f6-009a-4e3f-8865-9a4616011048 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:58.415522 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-a0b9f256-a20f-4a02-8cd0-66133be26d1e req-025854f6-009a-4e3f-8865-9a4616011048 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:58.427292 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-a0b9f256-a20f-4a02-8cd0-66133be26d1e req-025854f6-009a-4e3f-8865-9a4616011048 service nova] Creating event network-vif-plugged:4e88dc39-84c2-4d01-907f-9b51f2c6810d for instance e4396d2a-e022-4d1f-bd9f-c85974a71373 on n-h1-853316-12 Oct 17 14:12:58.432869 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-a0b9f256-a20f-4a02-8cd0-66133be26d1e req-025854f6-009a-4e3f-8865-9a4616011048 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033703 Oct 17 14:12:58.433301 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4254/8210] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:12:59.117748 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:59.118414 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:59.125221 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:59.125717 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:59.126247 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:59.126903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:59.127369 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:59.127807 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:59.259974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:59.268050 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4195372b-432f-4da0-bd44-b268385422a1 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.154217 Oct 17 14:12:59.268619 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3957/8211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:59 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:00.294486 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:00.295189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:00.302344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:00.302847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:00.303331 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:00.304063 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:00.304508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:00.304942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:00.441981 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:00.450990 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ba371e72-def2-476b-b5b5-db3a904febea tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1689 microversion: 2.1 time: 0.163009 Oct 17 14:13:00.451555 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4255/8212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:00 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:01.475784 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:01.477069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:01.485544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:01.486066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:01.486540 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:01.487277 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:01.487759 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:01.488226 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:01.956260 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:01.964909 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-fa1fea1c-7117-439a-af91-854f471dcc39 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1676 microversion: 2.1 time: 0.493554 Oct 17 14:13:01.965494 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3958/8213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:01 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1676 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:47.253527 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc894b96-3d0b-4113-a2db-27249feeb619] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:14:47.254218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:47.254606 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:47.256415 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=17 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:47.257289 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=54 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:47.260209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=17 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:47.261425 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=53 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:47.262926 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:14:47.263091 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 14:14:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 17 14:14:47.278614 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:47.279189 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:47.279689 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:47.280660 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:47.281339 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:47.281986 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:47.332255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:14:47.339517 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-dc0e8bc2-6db0-4ac9-bef6-24b077646741 req-bed1497c-8059-48c4-bca1-1846d57ce296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:47.366471 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dc0e8bc2-6db0-4ac9-bef6-24b077646741 req-bed1497c-8059-48c4-bca1-1846d57ce296 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:47.367327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dc0e8bc2-6db0-4ac9-bef6-24b077646741 req-bed1497c-8059-48c4-bca1-1846d57ce296 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:47.367973 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-dc0e8bc2-6db0-4ac9-bef6-24b077646741 req-bed1497c-8059-48c4-bca1-1846d57ce296 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:47.381606 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-dc0e8bc2-6db0-4ac9-bef6-24b077646741 req-bed1497c-8059-48c4-bca1-1846d57ce296 service nova] Creating event network-changed:4e88dc39-84c2-4d01-907f-9b51f2c6810d for instance e4396d2a-e022-4d1f-bd9f-c85974a71373 on n-h1-853316-12 Oct 17 14:14:47.388589 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-dc0e8bc2-6db0-4ac9-bef6-24b077646741 req-bed1497c-8059-48c4-bca1-1846d57ce296 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137450 Oct 17 14:14:47.389918 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3959/8214] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:47.434017 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7c854fe8-2057-4157-9a1e-471810f9824b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 204 len: 0 microversion: 2.1 time: 0.185733 Oct 17 14:14:47.434664 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4256/8215] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:14:47 2022] DELETE /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:14:47.444890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:47.445793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:47.452830 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:47.453394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:47.453990 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:47.455546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:47.456031 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:47.456554 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:47.659049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:47.666937 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-db85965d-9c87-4930-b637-624f55501169 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.227081 Oct 17 14:14:47.667517 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3960/8216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:47 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:48.692325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:48.693015 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:48.700154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:48.700655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:48.701081 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:48.701790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:48.702276 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:48.702701 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:48.853313 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:48.862977 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3a2de9ff-5cf6-4adb-b619-aaa02844438b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1682 microversion: 2.1 time: 0.175746 Oct 17 14:14:48.863597 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4257/8217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:48 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:49.735232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-399d6d93-aca0-4d3f-bb33-486a303a2dd6 req-90342def-a992-4f89-b948-92dbac9f6d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4396d2a-e022-4d1f-bd9f-c85974a71373", "name": "network-vif-deleted", "tag": "4e88dc39-84c2-4d01-907f-9b51f2c6810d"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:49.748189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-399d6d93-aca0-4d3f-bb33-486a303a2dd6 req-90342def-a992-4f89-b948-92dbac9f6d91 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:49.748685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-399d6d93-aca0-4d3f-bb33-486a303a2dd6 req-90342def-a992-4f89-b948-92dbac9f6d91 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:49.749134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-399d6d93-aca0-4d3f-bb33-486a303a2dd6 req-90342def-a992-4f89-b948-92dbac9f6d91 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:49.756911 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc894b96-3d0b-4113-a2db-27249feeb619] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47628. Oct 17 14:14:49.764809 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-399d6d93-aca0-4d3f-bb33-486a303a2dd6 req-90342def-a992-4f89-b948-92dbac9f6d91 service nova] Creating event network-vif-deleted:4e88dc39-84c2-4d01-907f-9b51f2c6810d for instance e4396d2a-e022-4d1f-bd9f-c85974a71373 on n-h1-853316-12 Oct 17 14:14:49.770659 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-399d6d93-aca0-4d3f-bb33-486a303a2dd6 req-90342def-a992-4f89-b948-92dbac9f6d91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 Oct 17 14:14:49.771274 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3961/8218] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:49.886646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:49.887262 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:49.894997 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:49.895421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:49.895861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:49.896559 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:49.897012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:49.897437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:49.930285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:49.930778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:49.931231 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:49.931661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lazy-loading 'fault' on Instance uuid e4396d2a-e022-4d1f-bd9f-c85974a71373 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:14:49.980129 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:49.988258 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-189c0c0f-5589-45db-b9ad-5de7a78b8399 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 200 len: 1337 microversion: 2.1 time: 0.106060 Oct 17 14:14:49.988833 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4258/8219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:49 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 1337 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:51.013298 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:51.014021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: e4396d2a-e022-4d1f-bd9f-c85974a71373] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:51.020348 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:51.020843 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:51.021293 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:51.021994 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:51.022486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:51.022934 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:51.035991 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] HTTP exception thrown: Instance e4396d2a-e022-4d1f-bd9f-c85974a71373 could not be found. Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Request method failure captured: Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 HTTP/1.1 Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTWIy1uOmuArQpmVRZSZk9tR2f0BHt-cTzkIDd1dZJWSc6SCizGKWVLBLukHawEuig0d9zvi5OkrxOpTd9_6kK9zYCdZxvUmBKWNBMDwJldkRwBDczj1bXLXnyulCCpzcR9v9kNU4Pa5l4wpGpScWXRScfVZ1P7NTxBzS-w_4Du2nFYg Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3ec310e12fd840aaaf7d2360f9795bce Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestShelveInstance-736693303 Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3ec310e12fd840aaaf7d2360f9795bce", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ec310e12fd840aaaf7d2360f9795bce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3ec310e12fd840aaaf7d2360f9795bce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ec310e12fd840aaaf7d2360f9795bce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestShelveInstance-736693303 Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3ec310e12fd840aaaf7d2360f9795bce Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestShelveInstance-736693303 Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestShelveInstance-736693303-project Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 0dddea54f1854d9a8c6a8f0a9723ee03 Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestShelveInstance-736693303-project Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance e4396d2a-e022-4d1f-bd9f-c85974a71373 could not be found. Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': 'e4396d2a-e022-4d1f-bd9f-c85974a71373'} Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4396d2a-e022-4d1f-bd9f-c85974a71373 could not be found. Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4396d2a-e022-4d1f-bd9f-c85974a71373 could not be found. Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:14:51.037637 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4396d2a-e022-4d1f-bd9f-c85974a71373 could not be found. Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Returning 404 to user: Instance e4396d2a-e022-4d1f-bd9f-c85974a71373 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f152fe52-12a5-4ebf-a334-33a0375b5c1b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373" status: 404 len: 111 microversion: 2.1 time: 0.030918 Oct 17 14:14:51.043164 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3962/8220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:51 2022] GET /compute/v2.1/servers/e4396d2a-e022-4d1f-bd9f-c85974a71373 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:14:51.204137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-99d6e89e-29c3-47c9-b42e-d6bd5f8451e4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '.version_select at 0x7fa81b7ad310>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:51.240893 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-99d6e89e-29c3-47c9-b42e-d6bd5f8451e4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1810933926" status: 202 len: 0 microversion: 2.1 time: 0.040838 Oct 17 14:14:51.241485 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4259/8221] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 17 14:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1810933926 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:14:51.267098 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d2fca2f7-5457-43ee-a62c-870e5e747f74 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Action: 'create', calling method: .version_select at 0x7fa81829bd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1498151794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpPgHvUw1Xf6yQ+KacNvO9UgfKvA9XBvAttgIW4/02zHi+6Z6RkzY80NqUU2lAZyjnJmna9eLWHRjM7gv7rx7TGymSYXpa5bbM0UJsgTTTGIthxpK/6LSsD2qtszxDYNw=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:51.284426 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d2fca2f7-5457-43ee-a62c-870e5e747f74 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Getting quotas for project 3ec310e12fd840aaaf7d2360f9795bce. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:14:51.289546 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-d2fca2f7-5457-43ee-a62c-870e5e747f74 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Getting quotas for user 0dddea54f1854d9a8c6a8f0a9723ee03 and project 3ec310e12fd840aaaf7d2360f9795bce. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:14:51.319442 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d2fca2f7-5457-43ee-a62c-870e5e747f74 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.056324 Oct 17 14:14:51.320063 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3963/8222] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 14:14:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:07.669543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:07.670361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:07.675685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1598998381", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1498151794", "security_groups": [{"name": "tempest-secgroup-smoke-97782655"}], "networks": [{"uuid": "b343552a-bdc2-41b7-a38b-f79aa14ba047"}], "block_device_mapping_v2": [{"uuid": "4168f18b-5d64-4a78-874f-350381589f43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:07.792712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] validate_networks() for [('b343552a-bdc2-41b7-a38b-f79aa14ba047', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:15:08.213685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:15:08.214113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:15:08.214624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:15:08.215029 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:15:08.215440 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:15:08.224277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:08.224751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:08.225179 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:08.225897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:08.226377 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:08.226795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:08.244983 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Getting quotas for project 3ec310e12fd840aaaf7d2360f9795bce. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:15:08.250108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Getting quotas for user 0dddea54f1854d9a8c6a8f0a9723ee03 and project 3ec310e12fd840aaaf7d2360f9795bce. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:15:08.308817 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:15:08.311041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4168f18b-5d64-4a78-874f-350381589f43',volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:15:08.437340 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [ea64873f-0855-4521-8e24-2c7f045884cf] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:15:09.446665 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [ea64873f-0855-4521-8e24-2c7f045884cf] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47796. Oct 17 14:15:09.451366 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d15f8318-0df8-4d8e-b1be-1952c8ac3b24 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.783320 Oct 17 14:15:09.452110 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4260/8223] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:15:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:15:09.462780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=12 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:09.463581 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:09.464285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:09.469030 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ba02dda8-17fe-4ec8-a19b-a367e73d2f8e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:09.470015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ba02dda8-17fe-4ec8-a19b-a367e73d2f8e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:09.527542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ba02dda8-17fe-4ec8-a19b-a367e73d2f8e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:09.535313 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ba02dda8-17fe-4ec8-a19b-a367e73d2f8e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1089 microversion: 2.1 time: 0.075354 Oct 17 14:15:09.535869 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3964/8224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:09 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:10.559836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4b3760f8-c8a8-4139-a86c-60bfc9f1228f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:10.560442 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4b3760f8-c8a8-4139-a86c-60bfc9f1228f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:10.619102 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4b3760f8-c8a8-4139-a86c-60bfc9f1228f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:10.626145 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4b3760f8-c8a8-4139-a86c-60bfc9f1228f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1089 microversion: 2.1 time: 0.070928 Oct 17 14:15:10.626743 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4261/8225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:10 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:11.648964 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4b13fd70-6475-4cc0-9050-8127d0bf65a4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:11.649576 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4b13fd70-6475-4cc0-9050-8127d0bf65a4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:11.703486 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4b13fd70-6475-4cc0-9050-8127d0bf65a4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:11.711485 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4b13fd70-6475-4cc0-9050-8127d0bf65a4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1089 microversion: 2.1 time: 0.066271 Oct 17 14:15:11.712124 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3965/8226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:11 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:12.734652 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d71a15de-9d94-4d68-aa3d-db3c2ea4aa94 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:12.735277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d71a15de-9d94-4d68-aa3d-db3c2ea4aa94 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:12.792647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d71a15de-9d94-4d68-aa3d-db3c2ea4aa94 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:12.799641 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d71a15de-9d94-4d68-aa3d-db3c2ea4aa94 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1089 microversion: 2.1 time: 0.068904 Oct 17 14:15:12.800575 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4262/8227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:12 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:13.823178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:13.823823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:13.831577 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:13.832167 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:13.832627 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:13.834303 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:13.834806 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:13.835310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:13.901081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:13.910895 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-cc66fd1e-b393-4cc6-a242-f3ddc1f85e0b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1139 microversion: 2.1 time: 0.091458 Oct 17 14:15:13.911597 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3966/8228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:13 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:14.933617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:14.934360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:14.940649 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:14.941342 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:14.941795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:14.942581 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:14.943074 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:14.943583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:15.011298 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:15.019241 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-41b53bf5-69f0-4557-8103-c7f710d0f415 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1205 microversion: 2.1 time: 0.089802 Oct 17 14:15:15.020008 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4263/8229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:14 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1205 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:16.037824 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-85696e9d-41ad-4e47-8ace-97c6efc6a10b req-2376e3ef-21ed-498f-ad34-1ad812eac44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5215c9-13e6-4628-b568-b33f19af5ac5", "tag": "e8e41a45-0bfd-4a66-ace4-e261a08a16f0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:16.043623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:16.044325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:16.051883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:16.052794 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:16.053366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:16.054155 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:16.054951 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:16.055081 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-85696e9d-41ad-4e47-8ace-97c6efc6a10b req-2376e3ef-21ed-498f-ad34-1ad812eac44d service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:16.055549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-85696e9d-41ad-4e47-8ace-97c6efc6a10b req-2376e3ef-21ed-498f-ad34-1ad812eac44d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:16.055952 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:16.056077 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-85696e9d-41ad-4e47-8ace-97c6efc6a10b req-2376e3ef-21ed-498f-ad34-1ad812eac44d service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:16.072646 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-85696e9d-41ad-4e47-8ace-97c6efc6a10b req-2376e3ef-21ed-498f-ad34-1ad812eac44d service nova] Creating event network-changed:e8e41a45-0bfd-4a66-ace4-e261a08a16f0 for instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 on n-h2-853316-12 Oct 17 14:15:16.078899 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-85696e9d-41ad-4e47-8ace-97c6efc6a10b req-2376e3ef-21ed-498f-ad34-1ad812eac44d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115993 Oct 17 14:15:16.080217 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3967/8230] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:16.209108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:16.217421 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7bd78436-620d-4cb6-93e8-b6bf515bd60f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1271 microversion: 2.1 time: 0.177570 Oct 17 14:15:16.218004 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4264/8231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:16 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:15:17.243175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:17.243788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:17.250035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:17.250561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:17.251012 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:17.251725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:17.252195 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:17.252638 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:17.395687 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:17.403514 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-3785b626-7a58-4e66-9a2c-583f528d3dbb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1271 microversion: 2.1 time: 0.166175 Oct 17 14:15:17.404101 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3968/8232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:17 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:18.425869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:18.426506 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:18.430067 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:18.435980 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:18.436491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:18.436922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:18.437648 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:18.438097 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:18.438545 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:18.598818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:18.607365 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7b94ff2-9abe-4043-bf33-007d1b87e5a5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1271 microversion: 2.1 time: 0.185430 Oct 17 14:15:18.607957 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4265/8233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:18 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:19.632015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:19.632653 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:19.643510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:19.643957 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:19.644419 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:19.645149 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:19.646178 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:19.646655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:19.782335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:19.790098 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-e2cdcbe0-f10d-4f54-9f85-d88b5c78456a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.162684 Oct 17 14:15:19.790765 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3969/8234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:19 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:20.812946 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:20.813466 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:20.820915 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:20.821396 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:20.821836 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:20.822548 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:20.822999 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:20.823418 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:20.956498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:20.966516 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3420a2f8-818d-4082-8ae8-8e35265d5577 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.157508 Oct 17 14:15:20.967088 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4266/8235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:20 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:21.989607 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:21.991336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:21.994094 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=4 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:21.999890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:22.000389 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:22.000835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:22.001533 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:22.001998 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:22.002459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:22.133877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:22.141563 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a8c6d40a-bb33-434c-9f42-f7b91c6d575a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.155988 Oct 17 14:15:22.142132 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3970/8236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:21 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:23.165106 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:23.165698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:23.168403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:23.173678 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:23.174177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:23.174611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:23.175294 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:23.175743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:23.176160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:23.310041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:23.317689 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-05ff1a6a-368f-4ad6-953d-ea6b2cfe163e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.157432 Oct 17 14:15:23.318398 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4267/8237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:23 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:15:24.340772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:24.341391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:24.348194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:24.348682 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:24.349222 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:24.350494 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:24.350959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:24.351394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:24.485598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:24.494671 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-aa21c6d1-d723-43b3-853c-4ad3003bbd78 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.157846 Oct 17 14:15:24.495241 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3971/8238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:24 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:25.518211 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:25.518822 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:25.526598 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:25.527083 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:25.527519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:25.528213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:25.528666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:25.529089 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:25.684682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:25.692598 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-67c13d6a-8c40-4367-8033-2340b59ce7db tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.178660 Oct 17 14:15:25.693288 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4268/8239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:25 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:26.716016 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:26.716655 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:26.723500 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:26.724028 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:26.724975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:26.725693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:26.726189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:26.726632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:26.861173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:26.869073 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f124931d-6ff6-429b-954b-54b42213350f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.156986 Oct 17 14:15:26.870013 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3972/8240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:26 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:27.891133 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:27.892354 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:27.901226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:27.901716 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:27.902154 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:27.902870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:27.903328 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:27.903755 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:28.039244 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:28.047056 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ce2d86fd-e5cb-4de9-9b94-4763e34a9d4c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.159855 Oct 17 14:15:28.047636 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4269/8241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:27 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:29.069819 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:29.070477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:29.077714 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:29.078144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:29.078619 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:29.079326 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:29.079788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:29.080227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:29.149423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-b0f70e0a-fb4c-41c4-9f6e-89c01a52eb15 req-531fd201-c93c-4b7b-9d95-8d8f885dd695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5215c9-13e6-4628-b568-b33f19af5ac5", "name": "network-vif-plugged", "status": "completed", "tag": "e8e41a45-0bfd-4a66-ace4-e261a08a16f0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:29.160108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b0f70e0a-fb4c-41c4-9f6e-89c01a52eb15 req-531fd201-c93c-4b7b-9d95-8d8f885dd695 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:29.160673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b0f70e0a-fb4c-41c4-9f6e-89c01a52eb15 req-531fd201-c93c-4b7b-9d95-8d8f885dd695 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:29.161116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-b0f70e0a-fb4c-41c4-9f6e-89c01a52eb15 req-531fd201-c93c-4b7b-9d95-8d8f885dd695 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:29.176036 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-b0f70e0a-fb4c-41c4-9f6e-89c01a52eb15 req-531fd201-c93c-4b7b-9d95-8d8f885dd695 service nova] Creating event network-vif-plugged:e8e41a45-0bfd-4a66-ace4-e261a08a16f0 for instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 on n-h2-853316-12 Oct 17 14:15:29.182149 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-b0f70e0a-fb4c-41c4-9f6e-89c01a52eb15 req-531fd201-c93c-4b7b-9d95-8d8f885dd695 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094250 Oct 17 14:15:29.182941 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4270/8242] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:29.226963 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:29.236646 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b97dc80f-6167-4973-bde9-7cae49386ddb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.171102 Oct 17 14:15:29.237296 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3973/8243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:29 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:30.262957 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:30.263900 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:30.270560 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:30.271135 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:30.272105 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:30.272825 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:30.273277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:30.273747 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:30.414103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:30.421980 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-1027f19a-110b-4d4f-9895-873807a510fa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1259 microversion: 2.1 time: 0.165089 Oct 17 14:15:30.422896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4271/8244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:30 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:31.444190 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:31.444813 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:31.451639 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:31.452129 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:31.452903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:31.453611 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:31.454072 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:31.454534 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:31.593035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:31.601938 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-845af02b-2a5b-4855-aac8-a5592859b93a tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1443 microversion: 2.1 time: 0.161970 Oct 17 14:15:31.602545 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3974/8245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:31 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:31.623543 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:31.624143 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:31.631162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:31.631641 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:31.632073 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:31.632756 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:31.633208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:31.633625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:31.769032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:31.777514 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-2127b2e7-a735-42fa-8cf7-8cfab6521f66 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1443 microversion: 2.1 time: 0.157788 Oct 17 14:15:31.778090 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4272/8246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:31 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:33.399975 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-a0adec95-491b-43f7-b726-568448d85f4b req-187876a1-9259-4cd1-ad2d-ba46c54f24fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5215c9-13e6-4628-b568-b33f19af5ac5", "tag": "e8e41a45-0bfd-4a66-ace4-e261a08a16f0"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:33.410355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a0adec95-491b-43f7-b726-568448d85f4b req-187876a1-9259-4cd1-ad2d-ba46c54f24fc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:33.410968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a0adec95-491b-43f7-b726-568448d85f4b req-187876a1-9259-4cd1-ad2d-ba46c54f24fc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:33.411499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-a0adec95-491b-43f7-b726-568448d85f4b req-187876a1-9259-4cd1-ad2d-ba46c54f24fc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:33.423210 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-a0adec95-491b-43f7-b726-568448d85f4b req-187876a1-9259-4cd1-ad2d-ba46c54f24fc service nova] Creating event network-changed:e8e41a45-0bfd-4a66-ace4-e261a08a16f0 for instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 on n-h2-853316-12 Oct 17 14:15:33.429840 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-a0adec95-491b-43f7-b726-568448d85f4b req-187876a1-9259-4cd1-ad2d-ba46c54f24fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033418 Oct 17 14:15:33.430478 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3975/8247] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:28.766255 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:17:28.767424 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:17:28.767972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:28.768827 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=58 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:28.770987 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:17:28.771320 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 14:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5/action (ip 10.222.0.27) !!! Oct 17 14:17:28.776302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:28.776877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:28.785792 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:28.786302 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:28.786745 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:28.788059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:28.788519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:28.788942 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:28.815991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lazy-loading 'flavor' on Instance uuid 3a5215c9-13e6-4628-b568-b33f19af5ac5 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:17:28.893314 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-931a6cca-54b3-4b9e-a09c-2295062384ef tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "POST /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5/action" status: 202 len: 0 microversion: 2.1 time: 0.128927 Oct 17 14:17:28.893909 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4273/8248] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:17:28 2022] POST /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:17:28.901804 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:17:28.906069 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:28.906802 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:28.908882 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=28 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:28.909511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=52 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:28.910617 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:17:28.910768 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 14:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 (ip 10.222.0.27) !!! Oct 17 14:17:28.922433 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:28.923402 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:28.924140 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:28.924880 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:28.925327 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:28.925763 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:29.062511 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:29.070321 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-d1c2ccd1-52a4-49ea-aa0f-ae73a5e77634 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.170531 Oct 17 14:17:29.070886 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3976/8249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:28 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:30.096375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:30.096992 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:30.104871 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:30.105351 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:30.105796 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:30.106508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:30.106965 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:30.107391 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:30.114811 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47918. Oct 17 14:17:30.116185 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47920. Oct 17 14:17:30.249493 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:30.257475 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d1bdb06a-e464-49eb-9662-c08f6038a5c0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.167185 Oct 17 14:17:30.258048 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4274/8250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:30 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:31.280335 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:31.281567 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:31.292958 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47928. Oct 17 14:17:31.297634 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:31.298134 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:31.298606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:31.299320 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:31.299876 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:31.300317 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:31.522394 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:31.530275 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c873d1c4-9d6c-436a-96c0-e7d3a4ceaadb tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.253773 Oct 17 14:17:31.531008 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3977/8251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:31 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:32.554495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:32.555109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:32.562255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:32.562741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:32.563178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:32.563867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:32.564319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:32.564741 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:32.697242 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:32.705114 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-69e1743b-1aaf-4c13-b06f-4d3374a4f4f2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.154652 Oct 17 14:17:32.705657 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4275/8252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:32 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:33.729045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:33.729606 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:33.736400 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:33.736896 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:33.737350 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:33.738050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:33.738542 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:33.738981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:33.872788 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:33.880418 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-21f91b8f-78b4-4f19-bda4-55b90940e798 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.155429 Oct 17 14:17:33.881693 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3978/8253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:33 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:34.904595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:34.905204 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:34.912321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:34.912799 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:34.913230 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:34.913916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:34.914394 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:34.914815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:35.053926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:35.061714 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ae125cf4-d48a-4f2c-b400-1da31eea22d4 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.161036 Oct 17 14:17:35.062308 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4276/8254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:34 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:36.084965 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:36.085513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:36.092755 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:36.093241 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:36.093685 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:36.094411 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:36.094873 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:36.095310 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:36.226922 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:36.234663 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9da481e6-292b-4b08-9d44-faabdc31dd72 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.154073 Oct 17 14:17:36.235234 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3979/8255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:36 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:37.257489 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:37.258088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:37.264932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:37.265422 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:37.265861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:37.266580 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:37.267036 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:37.267463 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:37.398662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:37.406541 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8fbfd365-8d42-4eff-9b21-c726ac6a38b2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.153571 Oct 17 14:17:37.407115 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4277/8256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:37 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:38.429479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:38.430130 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:38.436930 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:38.437431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:38.437881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:38.438612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:38.439114 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:38.439558 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:38.573208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:38.581216 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-2b6d2533-79d9-4a00-9193-0c4f197a3efa tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.155784 Oct 17 14:17:38.581786 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3980/8257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:38 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:39.606588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:39.607207 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:39.614088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:39.614611 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:39.615057 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:39.615906 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:39.616362 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:39.616797 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:39.752931 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:39.760880 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21cfb39a-2e88-4e69-ac53-7634fb07bc54 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.158269 Oct 17 14:17:39.761457 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4278/8258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:39 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:40.784254 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:40.784854 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:40.792864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:40.793355 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:40.793800 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:40.794530 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:40.794993 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:40.795459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:40.931995 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:40.940281 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9fb8396c-a6f4-43a8-8072-e2f3e641e4e6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.159841 Oct 17 14:17:40.940846 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3981/8259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:40 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:41.964308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:41.965160 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:41.972435 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:41.972926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:41.973360 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:41.974059 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:41.974535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:41.975725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.123305 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:42.132536 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-44911956-c7e1-4bee-88c1-9aa5776c0b3e tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.173121 Oct 17 14:17:42.133353 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4279/8260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:41 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:43.155305 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:43.156052 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:43.164075 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.164881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.165435 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.166256 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.166739 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.167185 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.305311 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:43.313132 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a75fe4b9-79f4-4b59-a3fe-67e5ee7b46ca tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1509 microversion: 2.1 time: 0.161782 Oct 17 14:17:43.313703 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3982/8261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:43 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:43.335727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:43.336321 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:43.343524 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.344009 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.344446 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.345137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.345592 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.346016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.375748 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127540) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 14:17:43.441843 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-88c29198-7cae-48ad-ae29-7001b98b7841 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "POST /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5/action" status: 202 len: 0 microversion: 2.1 time: 0.110442 Oct 17 14:17:43.442563 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4280/8262] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:17:43 2022] POST /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:17:43.450897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:43.451522 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:43.457972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.458537 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.459499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.460469 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.460937 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.461379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.597914 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:43.606817 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a7710528-c47d-49b9-b3e9-670168016884 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1517 microversion: 2.1 time: 0.159964 Oct 17 14:17:43.607563 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3983/8263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:43 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:43.704651 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-663b5085-ebe1-408c-9f51-3aec3e496f5c req-2c78aead-4255-4672-96f9-e59cab5f96e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5215c9-13e6-4628-b568-b33f19af5ac5", "name": "network-vif-unplugged", "status": "completed", "tag": "e8e41a45-0bfd-4a66-ace4-e261a08a16f0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:43.715752 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-663b5085-ebe1-408c-9f51-3aec3e496f5c req-2c78aead-4255-4672-96f9-e59cab5f96e0 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.716303 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-663b5085-ebe1-408c-9f51-3aec3e496f5c req-2c78aead-4255-4672-96f9-e59cab5f96e0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.716820 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-663b5085-ebe1-408c-9f51-3aec3e496f5c req-2c78aead-4255-4672-96f9-e59cab5f96e0 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.729720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.compute.server_external_events [req-663b5085-ebe1-408c-9f51-3aec3e496f5c req-2c78aead-4255-4672-96f9-e59cab5f96e0 service nova] Unable to find a host for instance 3a5215c9-13e6-4628-b568-b33f19af5ac5. Dropping event network-vif-unplugged {{(pid=127540) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 14:17:43.730741 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-663b5085-ebe1-408c-9f51-3aec3e496f5c req-2c78aead-4255-4672-96f9-e59cab5f96e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030768 Oct 17 14:17:43.731756 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4281/8264] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 14:17:44.630828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:44.631959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:44.638285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:44.638781 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:44.639253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:44.639936 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:44.640398 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:44.640834 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:44.775775 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:44.784221 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ceed1c9a-b30d-4b96-98c1-e2da6bc0da43 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1519 microversion: 2.1 time: 0.157127 Oct 17 14:17:44.784849 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3984/8265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:44 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:45.808590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:45.809282 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:45.816308 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:45.816793 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:45.817229 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:45.817928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:45.818496 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:45.818922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:45.956623 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:45.965720 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-67583e5c-c9ed-4390-bcdc-467fee60abc0 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1519 microversion: 2.1 time: 0.161176 Oct 17 14:17:45.966319 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4282/8266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:45 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:46.988959 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:46.989693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:46.997295 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.997789 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.998262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:46.998968 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.999431 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.999864 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:47.141571 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:47.150016 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-921218fe-266d-4674-9d0b-e37302adf2bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1519 microversion: 2.1 time: 0.164905 Oct 17 14:17:47.150850 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3985/8267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:46 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:48.173039 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:48.173642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:48.181186 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:48.181720 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:48.182104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:48.182829 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:48.183285 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:48.183710 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:48.319016 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:48.326877 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-cab0dc2a-4263-42f5-9b72-1b0dc01b41bf tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1519 microversion: 2.1 time: 0.157811 Oct 17 14:17:48.327452 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4283/8268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:48 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:49.350678 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:49.351217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:49.357962 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:49.358557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:49.359005 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:49.359708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:49.360175 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:49.360609 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:49.530926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:49.539022 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-afe7e24a-4f4b-4a28-bb34-adec7dcdd175 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.192668 Oct 17 14:17:49.539611 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3986/8269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:49 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:50.563104 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:50.563733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:50.571867 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:50.572386 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:50.572823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:50.573518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:50.573975 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:50.574431 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:50.710779 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:50.718907 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-56dc0265-64c4-4c0c-9851-3f45520e5456 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.159703 Oct 17 14:17:50.719498 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4284/8270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:50 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:51.741593 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:51.742237 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:51.748938 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:51.749436 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:51.749881 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:51.750696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:51.751159 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:51.751594 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:51.885513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:51.893311 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c8188b22-5eae-42e4-adf0-67908e0503c2 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.155866 Oct 17 14:17:51.893876 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3987/8271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:51 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:52.917508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:52.918126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:52.924972 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:52.925457 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:52.925899 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:52.926626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:52.927082 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:52.927509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:53.142816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:53.151750 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-dc850eaf-ac73-45dd-b72f-36ae72b9178d tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.238772 Oct 17 14:17:53.152461 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4285/8272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:52 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:54.175851 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:54.176477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:54.184050 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:54.184547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:54.185000 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:54.185706 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:54.186193 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:54.186670 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:54.574911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:54.582514 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4adec3da-5168-4a43-a9ab-2f7f1ca508bd tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.410557 Oct 17 14:17:54.583086 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3988/8273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:54 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:55.606541 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:55.607149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:55.614049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:55.614567 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:55.615007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:55.615702 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:55.616162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:55.617225 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:55.751991 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:55.760184 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49afe6d2-2bb8-4688-9b46-7f43ebcc4d88 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.157680 Oct 17 14:17:55.760769 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4286/8274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:55 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:56.783007 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:56.783565 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:56.790384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.790892 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.791340 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.792045 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.792513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.792956 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.926835 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:56.935020 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-a6cd22db-a567-49cb-a862-5dd8febbfd75 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.156064 Oct 17 14:17:56.935587 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3989/8275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:56 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:57.958712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:57.959320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:57.966637 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:57.967123 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:57.967557 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:57.968249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:57.968704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:57.969126 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:57.973006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:58.103277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:58.111351 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-55730c44-27fd-4d4f-88ec-bd4655edb2c6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.156613 Oct 17 14:17:58.111922 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4287/8276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:57 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:59.135586 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:59.136219 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:59.138945 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=29 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:59.145548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:59.146086 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:59.146614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:59.147329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:59.147842 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:59.148833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:59.151559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=85 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:59.280866 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:59.288833 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9cddb436-714f-4862-aa98-dffc1574f3b8 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.157823 Oct 17 14:17:59.289394 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3990/8277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:59 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:00.312344 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:00.312909 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:00.314718 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:00.320032 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:00.320510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:00.321725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:00.322617 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:00.323070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:00.323625 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:00.457403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:00.465752 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f8219657-daeb-4cdc-b6d7-a212de3557ac tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.157544 Oct 17 14:18:00.466360 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4288/8278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:00 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:01.488724 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:01.489354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:01.496344 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:01.496845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:01.497300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:01.498015 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:01.498509 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:01.498952 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:01.636891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:01.644668 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1961d470-b17d-41b0-a64b-b661f18f3290 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.160213 Oct 17 14:18:01.645237 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3991/8279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:01 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:01.836423 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d4b29607-87b7-47e7-aa02-49c05e60b729 req-441d2546-0c6c-4fb8-9ace-a701a0c4c88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5215c9-13e6-4628-b568-b33f19af5ac5", "name": "network-vif-plugged", "status": "completed", "tag": "e8e41a45-0bfd-4a66-ace4-e261a08a16f0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:01.848162 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d4b29607-87b7-47e7-aa02-49c05e60b729 req-441d2546-0c6c-4fb8-9ace-a701a0c4c88b service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:01.849250 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d4b29607-87b7-47e7-aa02-49c05e60b729 req-441d2546-0c6c-4fb8-9ace-a701a0c4c88b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:01.849685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d4b29607-87b7-47e7-aa02-49c05e60b729 req-441d2546-0c6c-4fb8-9ace-a701a0c4c88b service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:01.864234 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d4b29607-87b7-47e7-aa02-49c05e60b729 req-441d2546-0c6c-4fb8-9ace-a701a0c4c88b service nova] Creating event network-vif-plugged:e8e41a45-0bfd-4a66-ace4-e261a08a16f0 for instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 on n-h2-853316-12 Oct 17 14:18:01.870288 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d4b29607-87b7-47e7-aa02-49c05e60b729 req-441d2546-0c6c-4fb8-9ace-a701a0c4c88b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037360 Oct 17 14:18:01.871053 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4289/8280] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:02.668032 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:02.668711 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:02.675838 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:02.676354 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:02.676785 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:02.677487 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:02.677954 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:02.678434 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:02.812691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:02.820680 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-8d08a666-2dcd-4fce-b21c-423e1ad0a59c tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1575 microversion: 2.1 time: 0.157123 Oct 17 14:18:02.821880 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3992/8281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:02 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:03.845515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:03.846274 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:03.853385 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:03.853874 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:03.854352 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:03.855058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:03.855519 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:03.855949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:03.992804 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:04.000716 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-759e05f2-2a32-4284-b742-0a0e5d220ac6 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1562 microversion: 2.1 time: 0.159477 Oct 17 14:18:04.001289 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4290/8282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:03 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:20.432210 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=5 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:20.436310 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=5 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:20.437054 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=18 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:20.441815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-cd882d12-0187-463c-8310-dbadd22beee8 req-807f1941-b231-4c25-bfea-87722735e0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5215c9-13e6-4628-b568-b33f19af5ac5", "tag": "e8e41a45-0bfd-4a66-ace4-e261a08a16f0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:20.443011 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=17 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:20.443921 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:19:20.444095 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 14:19:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 (ip 10.222.0.27) !!! Oct 17 14:19:20.445947 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:19:20.446076 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 14:19:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 (ip 10.222.0.27) !!! Oct 17 14:19:20.454574 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:20.455397 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:20.466646 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cd882d12-0187-463c-8310-dbadd22beee8 req-807f1941-b231-4c25-bfea-87722735e0c5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:20.467062 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cd882d12-0187-463c-8310-dbadd22beee8 req-807f1941-b231-4c25-bfea-87722735e0c5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:20.467495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-cd882d12-0187-463c-8310-dbadd22beee8 req-807f1941-b231-4c25-bfea-87722735e0c5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:20.467889 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:20.468616 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:20.469285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:20.470246 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:20.470915 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:20.471610 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:20.480037 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-cd882d12-0187-463c-8310-dbadd22beee8 req-807f1941-b231-4c25-bfea-87722735e0c5 service nova] Creating event network-changed:e8e41a45-0bfd-4a66-ace4-e261a08a16f0 for instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 on n-h2-853316-12 Oct 17 14:19:20.485142 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-cd882d12-0187-463c-8310-dbadd22beee8 req-807f1941-b231-4c25-bfea-87722735e0c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050703 Oct 17 14:19:20.486118 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4291/8283] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:20.503845 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Going to try to terminate instance {{(pid=127539) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:19:20.598550 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0a0c87b6-b747-4081-8260-3a2042e19ff5 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 204 len: 0 microversion: 2.1 time: 0.168192 Oct 17 14:19:20.602655 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3993/8284] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:19:20 2022] DELETE /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:19:20.608865 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:20.609571 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:20.615832 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:20.616319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:20.616751 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:20.617448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:20.617932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:20.618383 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:20.758761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:20.767046 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d5ed6a29-1c9c-455b-86d7-576364f65375 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.163013 Oct 17 14:19:20.767619 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4292/8285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:20 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:21.790712 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:21.791489 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:21.798709 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:21.799208 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:21.799663 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:21.800379 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:21.800846 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:21.801285 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:22.007302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:22.016494 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-44df5f30-1695-48e8-8064-fbdbc1ac614b tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1568 microversion: 2.1 time: 0.230137 Oct 17 14:19:22.017079 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3994/8286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:21 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:22.884982 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-97e94e19-e16a-407b-8560-9518c966989f req-65228b1e-956b-4aba-b911-b139ef448cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5215c9-13e6-4628-b568-b33f19af5ac5", "name": "network-vif-deleted", "tag": "e8e41a45-0bfd-4a66-ace4-e261a08a16f0"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:22.895861 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-97e94e19-e16a-407b-8560-9518c966989f req-65228b1e-956b-4aba-b911-b139ef448cdf service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:22.896340 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-97e94e19-e16a-407b-8560-9518c966989f req-65228b1e-956b-4aba-b911-b139ef448cdf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:22.896763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-97e94e19-e16a-407b-8560-9518c966989f req-65228b1e-956b-4aba-b911-b139ef448cdf service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:22.909765 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-97e94e19-e16a-407b-8560-9518c966989f req-65228b1e-956b-4aba-b911-b139ef448cdf service nova] Creating event network-vif-deleted:e8e41a45-0bfd-4a66-ace4-e261a08a16f0 for instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 on n-h2-853316-12 Oct 17 14:19:22.914882 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-97e94e19-e16a-407b-8560-9518c966989f req-65228b1e-956b-4aba-b911-b139ef448cdf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033729 Oct 17 14:19:22.915492 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4293/8287] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:23.040253 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:23.041024 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:23.049329 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:23.049833 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:23.050323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:23.051063 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:23.051529 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:23.052087 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:23.116126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:23.125637 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-0ebcae41-4f3b-4dec-8e15-a60316cc4f02 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1220 microversion: 2.1 time: 0.089283 Oct 17 14:19:23.126231 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3995/8288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:23 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:24.149138 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:24.149979 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:24.157109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:24.157665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:24.158103 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:24.158806 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:24.159254 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:24.159673 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:24.226523 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:24.234660 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e66df999-802e-4c7e-9eb9-64d8aeb8b7cc tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1220 microversion: 2.1 time: 0.089711 Oct 17 14:19:24.235508 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4294/8289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:24 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:25.257987 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:25.258625 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:25.266548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:25.267058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:25.267506 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:25.268227 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:25.268691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:25.269132 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:25.337590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:25.346337 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-46476b7e-69ae-4e10-882c-bf5f91684d96 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1220 microversion: 2.1 time: 0.092320 Oct 17 14:19:25.346909 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3996/8290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:25 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:26.369113 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:26.369666 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:26.376599 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:26.377077 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:26.377508 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:26.378213 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:26.378669 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:26.379085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:26.441665 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dddea54f1854d9a8c6a8f0a9723ee03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec310e12fd840aaaf7d2360f9795bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:26.451936 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-19a60d20-e1a3-48c3-bc49-e51676a4b600 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 200 len: 1220 microversion: 2.1 time: 0.086744 Oct 17 14:19:26.452824 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4295/8291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:26 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:27.477234 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:27.477870 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] [instance: 3a5215c9-13e6-4628-b568-b33f19af5ac5] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:27.485049 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:27.485548 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:27.486224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.487338 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:27.487821 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:27.488267 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.503308 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] HTTP exception thrown: Instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 could not be found. Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Request method failure captured: Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 HTTP/1.1 Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTWIy1uOmuArQpmVRZSZk9tR2f0BHt-cTzkIDd1dZJWSc6SCizGKWVLBLukHawEuig0d9zvi5OkrxOpTd9_6kK9zYCdZxvUmBKWNBMDwJldkRwBDczj1bXLXnyulCCpzcR9v9kNU4Pa5l4wpGpScWXRScfVZ1P7NTxBzS-w_4Du2nFYg Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: 3ec310e12fd840aaaf7d2360f9795bce Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestShelveInstance-736693303 Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3ec310e12fd840aaaf7d2360f9795bce", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ec310e12fd840aaaf7d2360f9795bce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3ec310e12fd840aaaf7d2360f9795bce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3ec310e12fd840aaaf7d2360f9795bce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestShelveInstance-736693303 Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: 3ec310e12fd840aaaf7d2360f9795bce Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestShelveInstance-736693303 Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestShelveInstance-736693303-project Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 0dddea54f1854d9a8c6a8f0a9723ee03 Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestShelveInstance-736693303-project Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 could not be found. Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '3a5215c9-13e6-4628-b568-b33f19af5ac5'} Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 could not be found. Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 could not be found. Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:27.504992 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 could not be found. Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Returning 404 to user: Instance 3a5215c9-13e6-4628-b568-b33f19af5ac5 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f0a713f9-45c9-4260-8ad4-e0d409681a4f tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5" status: 404 len: 111 microversion: 2.1 time: 0.033980 Oct 17 14:19:27.513983 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3997/8292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:27 2022] GET /compute/v2.1/servers/3a5215c9-13e6-4628-b568-b33f19af5ac5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:19:27.671439 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-ed1d5b50-9e8d-46f7-adc8-9f7444827d03 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] Calling method '.version_select at 0x7fa81b76fa60>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:27.701386 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-ed1d5b50-9e8d-46f7-adc8-9f7444827d03 tempest-TestShelveInstance-736693303 tempest-TestShelveInstance-736693303-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1498151794" status: 202 len: 0 microversion: 2.1 time: 0.034676 Oct 17 14:19:27.709184 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4296/8293] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 17 14:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1498151794 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:19:45.910442 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:45.911555 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:46.118479 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-f92f09b9-0433-42b4-88f5-f99ef1b40bfa tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Action: 'create', calling method: .version_select at 0x7fa82508f310>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1013214086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl5/+zw/c1kQaLOgttSrYrySCxOHt5uevITl4sih4vrYAyQeOPCS9RCA9kHz7+ruzy79WKAt38BSiaaiSxcqCHE9CaLxn2quCODL29VD2MT4UZTH09vYlFitPnHDXBgCg=="}} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:46.136643 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f92f09b9-0433-42b4-88f5-f99ef1b40bfa tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Getting quotas for project b69a950e26684a7a9d1ddd1ee160326f. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:19:46.143337 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.quota [None req-f92f09b9-0433-42b4-88f5-f99ef1b40bfa tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Getting quotas for user 525a1e1922be41de8e7b16040316bf30 and project b69a950e26684a7a9d1ddd1ee160326f. Resources: {'key_pairs'} {{(pid=127539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:19:46.176434 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-f92f09b9-0433-42b4-88f5-f99ef1b40bfa tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.271382 Oct 17 14:19:46.177282 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3998/8294] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 14:19:45 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:47.174866 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1447142576", "imageRef": "c0b8bbed-67fa-4bc6-93c9-ab1f864c501f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1013214086", "security_groups": [{"name": "tempest-secgroup-smoke-1570947939"}], "networks": [{"uuid": "8859966e-668f-4759-bf8c-da478e3c52f8"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:47.185826 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=22 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:47.186487 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:47.295914 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] validate_networks() for [('8859966e-668f-4759-bf8c-da478e3c52f8', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:19:47.692682 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:19:47.693111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:19:47.693588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:19:47.694035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:19:47.694507 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:19:47.703733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:47.704221 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:47.704661 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:47.705390 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:47.705847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:47.706316 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:47.728191 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Getting quotas for project b69a950e26684a7a9d1ddd1ee160326f. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:19:47.734474 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Getting quotas for user 525a1e1922be41de8e7b16040316bf30 and project b69a950e26684a7a9d1ddd1ee160326f. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:19:47.748315 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:19:47.750686 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0b8bbed-67fa-4bc6-93c9-ab1f864c501f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:19:47.800111 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e3730db2-4c5c-4eda-86ab-c44ee277f8fb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.628906 Oct 17 14:19:47.800896 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4297/8295] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:19:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:19:47.814154 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-1b7917ca-4338-47fd-b04a-d2fa57c67947 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:47.815112 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-1b7917ca-4338-47fd-b04a-d2fa57c67947 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:47.988240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-1b7917ca-4338-47fd-b04a-d2fa57c67947 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:47.995619 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-1b7917ca-4338-47fd-b04a-d2fa57c67947 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1249 microversion: 2.1 time: 0.186270 Oct 17 14:19:48.010187 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 3999/8296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:47 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1249 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:49.019511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-11b86ff3-3f7b-4d62-b721-cbd9f17e965c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.020122 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-11b86ff3-3f7b-4d62-b721-cbd9f17e965c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:49.075926 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-11b86ff3-3f7b-4d62-b721-cbd9f17e965c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:49.083332 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-11b86ff3-3f7b-4d62-b721-cbd9f17e965c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1249 microversion: 2.1 time: 0.068543 Oct 17 14:19:49.083902 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4298/8297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:49 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1249 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:50.106549 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-5448546b-b30d-416d-9e80-5a0df7ca9ba4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:50.107123 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-5448546b-b30d-416d-9e80-5a0df7ca9ba4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:50.161104 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-5448546b-b30d-416d-9e80-5a0df7ca9ba4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:50.168949 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-5448546b-b30d-416d-9e80-5a0df7ca9ba4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1249 microversion: 2.1 time: 0.066711 Oct 17 14:19:50.169515 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4000/8298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:50 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:51.192520 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4879ea18-12a2-4616-adbe-2cad13e5c889 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:51.193049 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4879ea18-12a2-4616-adbe-2cad13e5c889 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:51.265837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-4879ea18-12a2-4616-adbe-2cad13e5c889 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:51.275907 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4879ea18-12a2-4616-adbe-2cad13e5c889 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1249 microversion: 2.1 time: 0.087246 Oct 17 14:19:51.277651 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4299/8299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:51 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:52.299612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:52.300170 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:52.307121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:52.307618 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:52.308986 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:52.309701 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:52.310189 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:52.310632 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:52.380562 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:52.388760 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-6b5e9043-f05c-4e39-9663-8dc21b5250e1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1253 microversion: 2.1 time: 0.093117 Oct 17 14:19:52.389357 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4001/8300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:52 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1253 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:53.411518 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:53.412158 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:53.419088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:53.419511 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:53.419949 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:53.420655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:53.421108 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:53.421535 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:53.488335 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:53.497208 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-01e74fd0-59d9-4c34-b53f-8d36268400f4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1307 microversion: 2.1 time: 0.089749 Oct 17 14:19:53.497802 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4300/8301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:53 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:54.295380 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-10406f91-4def-41c0-b312-2e57d26bca42 req-602d7612-4881-47a9-8624-8485d2866c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e12e08-14eb-4357-bd78-113500fc36d9", "tag": "2b2784a4-8d87-4c7d-b60c-592300af49dd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:54.308116 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10406f91-4def-41c0-b312-2e57d26bca42 req-602d7612-4881-47a9-8624-8485d2866c44 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:54.309126 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10406f91-4def-41c0-b312-2e57d26bca42 req-602d7612-4881-47a9-8624-8485d2866c44 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:54.309587 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-10406f91-4def-41c0-b312-2e57d26bca42 req-602d7612-4881-47a9-8624-8485d2866c44 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:54.326134 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-10406f91-4def-41c0-b312-2e57d26bca42 req-602d7612-4881-47a9-8624-8485d2866c44 service nova] Creating event network-changed:2b2784a4-8d87-4c7d-b60c-592300af49dd for instance d7e12e08-14eb-4357-bd78-113500fc36d9 on n-h2-853316-12 Oct 17 14:19:54.332192 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-10406f91-4def-41c0-b312-2e57d26bca42 req-602d7612-4881-47a9-8624-8485d2866c44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041187 Oct 17 14:19:54.332935 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4002/8302] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:54.521006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:54.522273 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:54.529795 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:54.530326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:54.530761 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:54.531462 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:54.531911 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:54.532329 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:54.666569 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:54.674742 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6cb40af8-d6c4-45ea-9f68-a5fb254b65c7 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1375 microversion: 2.1 time: 0.157565 Oct 17 14:19:54.676717 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4301/8303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:54 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:55.701060 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:55.701793 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:55.707980 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:55.708477 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:55.708931 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:55.709640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:55.710191 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:55.710636 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:55.933782 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:55.941538 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c97f3d01-a386-40bc-a944-7dfb2514d237 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1375 microversion: 2.1 time: 0.246331 Oct 17 14:19:55.942117 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4003/8304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:55 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1375 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:56.965046 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:56.965681 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:56.973052 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:56.973533 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:56.973970 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:56.974690 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:56.975149 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:56.975575 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:57.107788 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:57.115592 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-f7fe41e0-a9db-4f72-84df-035ea52a6074 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1375 microversion: 2.1 time: 0.154685 Oct 17 14:19:57.116164 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4302/8305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:56 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:58.138143 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:58.138832 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:58.145640 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:58.146144 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:58.146629 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:58.147345 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:58.147812 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:58.148288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:58.302103 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:58.309724 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-de39d660-35d3-43a5-baa5-57839c73e9a4 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1375 microversion: 2.1 time: 0.175761 Oct 17 14:19:58.310409 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4004/8306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:58 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:59.334116 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:59.334765 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:59.336622 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:59.344301 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:59.344789 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:59.345226 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:59.345924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:59.346488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:59.346919 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:59.484897 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:59.492625 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-934445ae-4256-4841-8234-2c74b3c7662b tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1375 microversion: 2.1 time: 0.162437 Oct 17 14:19:59.493189 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4303/8307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:59 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:00.300384 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-510fccac-2a90-4cac-843a-891ef2a8aac7 req-c753ac97-6d20-463d-98f9-2cd1204638c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e12e08-14eb-4357-bd78-113500fc36d9", "name": "network-vif-plugged", "status": "completed", "tag": "2b2784a4-8d87-4c7d-b60c-592300af49dd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:00.306262 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=8 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:00.314288 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-510fccac-2a90-4cac-843a-891ef2a8aac7 req-c753ac97-6d20-463d-98f9-2cd1204638c9 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:00.314823 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-510fccac-2a90-4cac-843a-891ef2a8aac7 req-c753ac97-6d20-463d-98f9-2cd1204638c9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:00.315316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-510fccac-2a90-4cac-843a-891ef2a8aac7 req-c753ac97-6d20-463d-98f9-2cd1204638c9 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:00.327658 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-510fccac-2a90-4cac-843a-891ef2a8aac7 req-c753ac97-6d20-463d-98f9-2cd1204638c9 service nova] Creating event network-vif-plugged:2b2784a4-8d87-4c7d-b60c-592300af49dd for instance d7e12e08-14eb-4357-bd78-113500fc36d9 on n-h2-853316-12 Oct 17 14:20:00.332752 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-510fccac-2a90-4cac-843a-891ef2a8aac7 req-c753ac97-6d20-463d-98f9-2cd1204638c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036052 Oct 17 14:20:00.333386 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4005/8308] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:00.515700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:00.516311 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:00.522325 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:00.522815 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:00.523253 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:00.523944 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:00.524403 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:00.524837 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:00.657427 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:00.665116 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-7b87204c-ab7b-4749-bc99-7fc16d441231 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1375 microversion: 2.1 time: 0.153661 Oct 17 14:20:00.665697 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4304/8309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:00 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:01.689484 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:01.690232 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:01.696492 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:01.697093 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:01.697560 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:01.698300 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:01.698773 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:01.699217 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:01.835205 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:01.843676 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-4c85c907-840f-47e6-a976-b9a59c625bad tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1559 microversion: 2.1 time: 0.159699 Oct 17 14:20:01.844251 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4006/8310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:01 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:01.866392 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:01.867012 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:01.868907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=10 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:01.875763 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:01.876255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:01.876698 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:01.877397 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:01.877856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:01.878320 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:02.014928 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:02.022561 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ae86000-2a34-455c-9742-ba207b995a42 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1559 microversion: 2.1 time: 0.160412 Oct 17 14:20:02.023147 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4305/8311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:01 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:03.971923 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-837a4f88-5ac7-4fc5-8017-1fa843a467c0 req-13f749c5-d785-4723-95a7-ec0f4c6101c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e12e08-14eb-4357-bd78-113500fc36d9", "tag": "2b2784a4-8d87-4c7d-b60c-592300af49dd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:03.982708 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-837a4f88-5ac7-4fc5-8017-1fa843a467c0 req-13f749c5-d785-4723-95a7-ec0f4c6101c5 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:03.984316 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-837a4f88-5ac7-4fc5-8017-1fa843a467c0 req-13f749c5-d785-4723-95a7-ec0f4c6101c5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:03.984780 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-837a4f88-5ac7-4fc5-8017-1fa843a467c0 req-13f749c5-d785-4723-95a7-ec0f4c6101c5 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:03.995978 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-837a4f88-5ac7-4fc5-8017-1fa843a467c0 req-13f749c5-d785-4723-95a7-ec0f4c6101c5 service nova] Creating event network-changed:2b2784a4-8d87-4c7d-b60c-592300af49dd for instance d7e12e08-14eb-4357-bd78-113500fc36d9 on n-h2-853316-12 Oct 17 14:20:04.003061 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-837a4f88-5ac7-4fc5-8017-1fa843a467c0 req-13f749c5-d785-4723-95a7-ec0f4c6101c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035626 Oct 17 14:20:04.003653 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4007/8312] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:59.501181 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:21:59.502085 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:21:59.502870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:59.503778 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=38 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:59.505406 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:21:59.505645 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 14:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9/action (ip 10.222.0.27) !!! Oct 17 14:21:59.507272 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:21:59.507428 n-d-853316-12 devstack@n-api.service[127540]: Mon Oct 17 14:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9/action (ip 10.222.0.27) !!! Oct 17 14:21:59.512840 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1892047078"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:59.515202 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:59.524679 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:59.524870 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:59.525235 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:59.525932 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:59.526409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:59.526847 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:00.005206 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9a3a1901-8f66-4e20-8937-488986b45627 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "POST /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9/action" status: 202 len: 0 microversion: 2.1 time: 0.505517 Oct 17 14:22:00.005855 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4306/8313] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:21:59 2022] POST /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 14:22:04.857522 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc894b96-3d0b-4113-a2db-27249feeb619] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:22:04.859258 n-d-853316-12 devstack@n-api.service[127539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:22:04.860513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:04.861589 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=30 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:04.863234 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:22:04.865263 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 14:22:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 17 14:22:04.951672 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-2eccab98-cd5e-4e36-adec-03ea7fd3e0f9 req-8efb599f-4742-46c5-8b5a-bb395c096082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e12e08-14eb-4357-bd78-113500fc36d9", "name": "network-vif-plugged", "status": "completed", "tag": "2b2784a4-8d87-4c7d-b60c-592300af49dd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:04.966214 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2eccab98-cd5e-4e36-adec-03ea7fd3e0f9 req-8efb599f-4742-46c5-8b5a-bb395c096082 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:04.967065 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2eccab98-cd5e-4e36-adec-03ea7fd3e0f9 req-8efb599f-4742-46c5-8b5a-bb395c096082 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:04.967588 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-2eccab98-cd5e-4e36-adec-03ea7fd3e0f9 req-8efb599f-4742-46c5-8b5a-bb395c096082 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:04.981935 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-2eccab98-cd5e-4e36-adec-03ea7fd3e0f9 req-8efb599f-4742-46c5-8b5a-bb395c096082 service nova] Creating event network-vif-plugged:2b2784a4-8d87-4c7d-b60c-592300af49dd for instance d7e12e08-14eb-4357-bd78-113500fc36d9 on n-h2-853316-12 Oct 17 14:22:04.987396 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-2eccab98-cd5e-4e36-adec-03ea7fd3e0f9 req-8efb599f-4742-46c5-8b5a-bb395c096082 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133351 Oct 17 14:22:04.988115 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4008/8314] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:13.569159 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:13.569916 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:13.575218 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1408315363", "imageRef": "a443a8e7-9f43-4811-925c-d7375035eaf8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1013214086", "security_groups": [{"name": "tempest-secgroup-smoke-1570947939"}], "networks": [{"uuid": "8859966e-668f-4759-bf8c-da478e3c52f8"}]}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:13.602801 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9d92276-631e-42e4-aa49-750aba25c3eb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48436. Oct 17 14:22:13.603589 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0a92b67-d979-4e3f-bf21-6fab59083093] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48434. Oct 17 14:22:13.687510 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.network.neutron [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] validate_networks() for [('8859966e-668f-4759-bf8c-da478e3c52f8', None, None, None, None, None)] {{(pid=127540) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:22:14.114658 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Flavor limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:22:14.115166 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Image limits 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:22:14.115636 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Flavor pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:22:14.116588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Image pref 0:0:0 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:22:14.116588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.virt.hardware [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:22:14.126006 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:14.126464 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:14.126908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:14.127642 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:14.128109 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:14.128539 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:14.147249 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Getting quotas for project b69a950e26684a7a9d1ddd1ee160326f. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:22:14.152633 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.quota [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Getting quotas for user 525a1e1922be41de8e7b16040316bf30 and project b69a950e26684a7a9d1ddd1ee160326f. Resources: {'instances', 'cores', 'ram'} {{(pid=127540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:22:14.165058 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Going to run 1 instances... {{(pid=127540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:22:14.167588 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a443a8e7-9f43-4811-925c-d7375035eaf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:22:14.213346 n-d-853316-12 devstack@n-api.service[127540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [ea64873f-0855-4521-8e24-2c7f045884cf] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:22:15.221451 n-d-853316-12 devstack@n-api.service[127540]: INFO oslo.messaging._drivers.impl_rabbit [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [ea64873f-0855-4521-8e24-2c7f045884cf] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48450. Oct 17 14:22:15.226737 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-fbb0c45b-8bdd-4064-909f-cb0e98f6d142 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.659270 Oct 17 14:22:15.227733 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4307/8315] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 14:22:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:22:15.236913 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:15.237695 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:15.242977 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-afa46174-4bef-4711-afcf-e4ed2b16457c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:15.243693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-afa46174-4bef-4711-afcf-e4ed2b16457c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:15.272850 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc894b96-3d0b-4113-a2db-27249feeb619] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48454. Oct 17 14:22:15.274967 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] [0034fcce-c041-4608-b277-6dda6f3a5fea] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48456. Oct 17 14:22:15.307497 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-afa46174-4bef-4711-afcf-e4ed2b16457c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:15.314993 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-afa46174-4bef-4711-afcf-e4ed2b16457c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1249 microversion: 2.1 time: 0.080394 Oct 17 14:22:15.315654 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4009/8316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:15 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:16.339495 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:16.340151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:16.348781 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:16.350583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:16.351041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:16.351749 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:16.352205 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:16.352632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:16.786043 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:16.794903 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c8902248-3872-41e9-800d-ef25ddafa3dc tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1319 microversion: 2.1 time: 0.461225 Oct 17 14:22:16.795500 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4308/8317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:16 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:16.918410 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-947fec32-c76a-4b72-bcb1-b3c6fe4539ea req-376b92f0-657d-4da2-8df4-5b3025f45bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e12e08-14eb-4357-bd78-113500fc36d9", "name": "network-vif-unplugged", "status": "completed", "tag": "2b2784a4-8d87-4c7d-b60c-592300af49dd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:16.931444 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-947fec32-c76a-4b72-bcb1-b3c6fe4539ea req-376b92f0-657d-4da2-8df4-5b3025f45bd6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:16.932382 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-947fec32-c76a-4b72-bcb1-b3c6fe4539ea req-376b92f0-657d-4da2-8df4-5b3025f45bd6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:16.933089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-947fec32-c76a-4b72-bcb1-b3c6fe4539ea req-376b92f0-657d-4da2-8df4-5b3025f45bd6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:16.948408 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-947fec32-c76a-4b72-bcb1-b3c6fe4539ea req-376b92f0-657d-4da2-8df4-5b3025f45bd6 service nova] Creating event network-vif-unplugged:2b2784a4-8d87-4c7d-b60c-592300af49dd for instance d7e12e08-14eb-4357-bd78-113500fc36d9 on n-h2-853316-12 Oct 17 14:22:16.954462 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-947fec32-c76a-4b72-bcb1-b3c6fe4539ea req-376b92f0-657d-4da2-8df4-5b3025f45bd6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039684 Oct 17 14:22:16.956000 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4010/8318] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:22:17.820785 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:17.826482 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:17.835076 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:17.835945 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:17.836632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:17.837687 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:17.838488 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:17.839416 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:17.908540 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:17.917311 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-c160d81b-a235-47ff-9f41-5a7d68e54127 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.101314 Oct 17 14:22:17.918081 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4309/8319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:17 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:18.941948 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:18.943719 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:18.951700 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:18.952860 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:18.953614 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:18.954787 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:18.955512 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:18.956029 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:19.040750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:19.049212 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ae756555-cd8d-4785-90fa-96ffaecbedcd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.112579 Oct 17 14:22:19.049964 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4011/8320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:18 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:20.073595 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:20.074243 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:20.081790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:20.082334 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:20.082790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:20.084178 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:20.084676 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:20.085111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:20.155378 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:20.164749 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-909ef5e1-d146-489d-a920-b4ac603584a1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.095033 Oct 17 14:22:20.165532 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4310/8321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:20 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:21.188336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:21.189064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:21.200061 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:21.200598 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:21.201058 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:21.202302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:21.202302 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:21.202702 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:21.273696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:21.283040 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9ea7c061-8519-4f25-b6c6-5a250a97f7b9 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.098815 Oct 17 14:22:21.297175 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4012/8322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:21 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:22.310041 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:22.310869 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:22.317743 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:22.318255 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:22.318907 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:22.319626 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:22.320088 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:22.320516 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:22.398031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:22.406015 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-21ac83cf-00d1-4ba0-8ad0-4d8b8376a53d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.100016 Oct 17 14:22:22.408699 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4311/8323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:22 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:23.429423 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:23.430035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:23.437814 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:23.438541 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:23.439074 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:23.439932 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:23.440453 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:23.440897 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:23.511459 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:23.519604 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-ff83f248-6a32-450a-892a-f978e411a8c8 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.094342 Oct 17 14:22:23.521545 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4013/8324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:23 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:24.542922 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:24.543639 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:24.546448 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:24.547319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell0:SELECT=6 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:24.553436 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:24.553935 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:24.554409 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:24.555151 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:24.555608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:24.556035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:24.622628 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:24.631274 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5599f193-6b1e-4be1-868b-5e62cc26d995 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.091596 Oct 17 14:22:24.632251 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4312/8325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:24 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:25.655911 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:25.656544 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:25.659428 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell0:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:25.665972 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:25.666510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:25.666974 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:25.667696 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:25.668173 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:25.668624 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:25.731559 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:25.739249 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c7dc5de2-f20e-44d1-a9e4-759a5f449ebb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.087443 Oct 17 14:22:25.739826 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4014/8326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:25 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:26.762263 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:26.762831 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:26.769414 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:26.769903 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:26.770372 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:26.772323 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:26.773010 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:26.773444 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:26.873750 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:26.881946 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-5dfbdd52-8c5b-4cd8-a647-e1894c965b05 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1307 microversion: 2.1 time: 0.123758 Oct 17 14:22:26.882554 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4313/8327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:26 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:27.904395 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:27.905035 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:27.912991 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:27.913391 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:27.913852 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:27.914603 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:27.915080 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:27.915528 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:28.049872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:28.058621 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9fec3dc6-a85b-41e0-ae79-b31245e2c0f0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1375 microversion: 2.1 time: 0.158155 Oct 17 14:22:28.059211 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4015/8328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:27 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:28.176555 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-3bda67ce-2fdb-4b06-86eb-92687f87ee1d req-254b8397-4cf3-434b-8546-3b70baeb6058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e293dea-383b-494b-8494-fe0a425e92a9", "tag": "dc77c3a5-ef66-48f6-932e-7cb3f494fd15"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:28.186612 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3bda67ce-2fdb-4b06-86eb-92687f87ee1d req-254b8397-4cf3-434b-8546-3b70baeb6058 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:28.187177 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3bda67ce-2fdb-4b06-86eb-92687f87ee1d req-254b8397-4cf3-434b-8546-3b70baeb6058 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:28.187680 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-3bda67ce-2fdb-4b06-86eb-92687f87ee1d req-254b8397-4cf3-434b-8546-3b70baeb6058 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:28.199501 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-3bda67ce-2fdb-4b06-86eb-92687f87ee1d req-254b8397-4cf3-434b-8546-3b70baeb6058 service nova] Creating event network-changed:dc77c3a5-ef66-48f6-932e-7cb3f494fd15 for instance 5e293dea-383b-494b-8494-fe0a425e92a9 on n-h1-853316-12 Oct 17 14:22:28.204659 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-3bda67ce-2fdb-4b06-86eb-92687f87ee1d req-254b8397-4cf3-434b-8546-3b70baeb6058 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099704 Oct 17 14:22:28.205271 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4314/8329] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:29.081501 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:29.082056 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:29.089301 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:29.089799 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:29.090274 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:29.090981 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:29.091449 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:29.091890 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:29.230084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:29.237853 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-88d009aa-39c5-4b7d-8e49-c7f6c9ddf0a2 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1375 microversion: 2.1 time: 0.160372 Oct 17 14:22:29.238466 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4016/8330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:29 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:30.263818 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:30.264509 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:30.272101 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:30.272590 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:30.273031 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:30.273727 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:30.274200 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:30.274632 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:30.413711 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:30.421507 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8d619040-24da-4f3a-baaa-f2c196f5b981 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1375 microversion: 2.1 time: 0.163175 Oct 17 14:22:30.422072 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4315/8331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:30 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:31.445194 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:31.445804 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:31.452673 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:31.453177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:31.453635 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:31.454390 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:31.454867 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:31.455323 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:31.589231 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:31.596972 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-481e16d1-79da-45ce-8a65-ca28110ba1dd tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1375 microversion: 2.1 time: 0.156490 Oct 17 14:22:31.597554 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4017/8332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:31 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:32.619714 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:32.620326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:32.627375 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:32.627876 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:32.628319 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:32.629018 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:32.629479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:32.629908 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:32.775963 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:32.783783 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d2297278-dc80-452e-a806-15a246b452b0 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1375 microversion: 2.1 time: 0.168069 Oct 17 14:22:32.784360 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4316/8333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:32 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:33.808078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:33.809322 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:33.816212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:33.816718 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:33.817177 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:33.817903 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:33.819151 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:33.820212 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:33.963877 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:33.971767 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-7c930fc7-e60c-4899-84f1-ce406012fbcb tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1375 microversion: 2.1 time: 0.168722 Oct 17 14:22:33.972327 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4018/8334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:33 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:34.994114 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:34.994722 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:35.001582 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:35.002070 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:35.002542 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:35.003239 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:35.003700 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:35.004124 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:35.144893 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:35.153363 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d349e328-bd7a-4e18-a6c9-7c246f120a3d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1375 microversion: 2.1 time: 0.163444 Oct 17 14:22:35.153969 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4317/8335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:34 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:35.224926 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6e8e0784-6a38-467d-ad17-4eee7475a945 req-6beb9df8-3171-4ac9-ad0e-92275400d2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e293dea-383b-494b-8494-fe0a425e92a9", "name": "network-vif-plugged", "status": "completed", "tag": "dc77c3a5-ef66-48f6-932e-7cb3f494fd15"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:35.236750 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6e8e0784-6a38-467d-ad17-4eee7475a945 req-6beb9df8-3171-4ac9-ad0e-92275400d2ae service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:35.237336 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6e8e0784-6a38-467d-ad17-4eee7475a945 req-6beb9df8-3171-4ac9-ad0e-92275400d2ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:35.237795 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6e8e0784-6a38-467d-ad17-4eee7475a945 req-6beb9df8-3171-4ac9-ad0e-92275400d2ae service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:35.250121 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6e8e0784-6a38-467d-ad17-4eee7475a945 req-6beb9df8-3171-4ac9-ad0e-92275400d2ae service nova] Creating event network-vif-plugged:dc77c3a5-ef66-48f6-932e-7cb3f494fd15 for instance 5e293dea-383b-494b-8494-fe0a425e92a9 on n-h1-853316-12 Oct 17 14:22:35.255260 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6e8e0784-6a38-467d-ad17-4eee7475a945 req-6beb9df8-3171-4ac9-ad0e-92275400d2ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034291 Oct 17 14:22:35.256749 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4019/8336] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:36.176361 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:36.176969 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:36.184028 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:36.184515 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:36.184954 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:36.185655 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:36.186110 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:36.186589 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:36.319717 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:36.327904 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-8ac4d6e1-df8c-428a-87dd-30606c0b8588 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1375 microversion: 2.1 time: 0.155492 Oct 17 14:22:36.328579 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4318/8337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:36 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:37.354778 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:37.355488 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:37.361691 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:37.362211 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:37.362661 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:37.363361 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:37.363828 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:37.364264 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:37.497240 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:37.504995 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-9489c0d7-aff0-49c8-ab24-b275d1e3dc79 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1559 microversion: 2.1 time: 0.155977 Oct 17 14:22:37.505559 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4020/8338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:37 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:37.527683 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:37.528307 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:37.535163 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:37.535647 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:37.536085 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:37.536774 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:37.537287 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:37.538480 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:37.672697 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:37.680568 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-49abf4c9-d447-4528-a551-4f7064ac8d81 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1559 microversion: 2.1 time: 0.156844 Oct 17 14:22:37.681136 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4319/8339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:37 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:39.342758 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6bd886ee-5757-45ee-aa7d-cc84a2926a8f req-7c8f269c-e383-472f-8880-62b6dc76837c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e293dea-383b-494b-8494-fe0a425e92a9", "tag": "dc77c3a5-ef66-48f6-932e-7cb3f494fd15"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:39.352988 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6bd886ee-5757-45ee-aa7d-cc84a2926a8f req-7c8f269c-e383-472f-8880-62b6dc76837c service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:39.353481 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6bd886ee-5757-45ee-aa7d-cc84a2926a8f req-7c8f269c-e383-472f-8880-62b6dc76837c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:39.353928 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6bd886ee-5757-45ee-aa7d-cc84a2926a8f req-7c8f269c-e383-472f-8880-62b6dc76837c service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:39.365146 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6bd886ee-5757-45ee-aa7d-cc84a2926a8f req-7c8f269c-e383-472f-8880-62b6dc76837c service nova] Creating event network-changed:dc77c3a5-ef66-48f6-932e-7cb3f494fd15 for instance 5e293dea-383b-494b-8494-fe0a425e92a9 on n-h1-853316-12 Oct 17 14:22:39.370562 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6bd886ee-5757-45ee-aa7d-cc84a2926a8f req-7c8f269c-e383-472f-8880-62b6dc76837c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102859 Oct 17 14:22:39.371169 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4021/8340] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:49.854264 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:49.855011 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=70 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:49.907366 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1862331501"}} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:49.909775 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:49.916583 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:49.917072 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:49.917512 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:49.918332 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:49.918685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:49.919111 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:50.309225 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-d8b0ef50-c2de-422a-967c-5b226c2d47f1 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "POST /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9/action" status: 202 len: 0 microversion: 2.1 time: 0.457727 Oct 17 14:24:50.310083 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4320/8341] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 14:24:49 2022] POST /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 14:24:57.971409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=28 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:57.972198 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=60 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:57.973450 n-d-853316-12 devstack@n-api.service[127539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:24:57.973681 n-d-853316-12 devstack@n-api.service[127539]: Mon Oct 17 14:24:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 17 14:24:57.981078 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-6923ad4d-85c5-4194-aacd-324e120e0dad req-f8eff0be-0cd0-4ea7-b2d2-25271b06145f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e293dea-383b-494b-8494-fe0a425e92a9", "name": "network-vif-plugged", "status": "completed", "tag": "dc77c3a5-ef66-48f6-932e-7cb3f494fd15"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:57.994772 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6923ad4d-85c5-4194-aacd-324e120e0dad req-f8eff0be-0cd0-4ea7-b2d2-25271b06145f service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:57.995278 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6923ad4d-85c5-4194-aacd-324e120e0dad req-f8eff0be-0cd0-4ea7-b2d2-25271b06145f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:57.995725 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-6923ad4d-85c5-4194-aacd-324e120e0dad req-f8eff0be-0cd0-4ea7-b2d2-25271b06145f service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:58.007429 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-6923ad4d-85c5-4194-aacd-324e120e0dad req-f8eff0be-0cd0-4ea7-b2d2-25271b06145f service nova] Creating event network-vif-plugged:dc77c3a5-ef66-48f6-932e-7cb3f494fd15 for instance 5e293dea-383b-494b-8494-fe0a425e92a9 on n-h1-853316-12 Oct 17 14:24:58.013048 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-6923ad4d-85c5-4194-aacd-324e120e0dad req-f8eff0be-0cd0-4ea7-b2d2-25271b06145f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043769 Oct 17 14:24:58.013846 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4022/8342] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:25:09.071107 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_api:SELECT=2 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:25:09.072605 n-d-853316-12 devstack@n-api.service[127540]: DEBUG dbcounter [-] [127540] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:25:09.074228 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_api:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:25:09.075209 n-d-853316-12 devstack@n-api.service[127539]: DEBUG dbcounter [-] [127539] Writing DB stats nova_cell1:SELECT=2 {{(pid=127539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:25:09.077971 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:09.078989 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:09.079693 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-8c863527-3a93-4013-86de-7ab1789778c9 req-4926a634-22b8-46cd-b29b-a77bbe61d8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e293dea-383b-494b-8494-fe0a425e92a9", "tag": "dc77c3a5-ef66-48f6-932e-7cb3f494fd15"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:25:09.088326 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:09.088823 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:09.089473 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:09.090692 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:09.091142 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:09.091579 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:09.092407 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8c863527-3a93-4013-86de-7ab1789778c9 req-4926a634-22b8-46cd-b29b-a77bbe61d8b6 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:09.093121 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8c863527-3a93-4013-86de-7ab1789778c9 req-4926a634-22b8-46cd-b29b-a77bbe61d8b6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:09.093737 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-8c863527-3a93-4013-86de-7ab1789778c9 req-4926a634-22b8-46cd-b29b-a77bbe61d8b6 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:09.105823 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-8c863527-3a93-4013-86de-7ab1789778c9 req-4926a634-22b8-46cd-b29b-a77bbe61d8b6 service nova] Creating event network-changed:dc77c3a5-ef66-48f6-932e-7cb3f494fd15 for instance 5e293dea-383b-494b-8494-fe0a425e92a9 on n-h1-853316-12 Oct 17 14:25:09.111134 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-8c863527-3a93-4013-86de-7ab1789778c9 req-4926a634-22b8-46cd-b29b-a77bbe61d8b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040261 Oct 17 14:25:09.111928 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4023/8343] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:25:09.121613 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:25:09.211831 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-e1d10238-20ff-4948-9b98-407ef1de50c6 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 204 len: 0 microversion: 2.1 time: 0.142408 Oct 17 14:25:09.216731 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4321/8344] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:25:09 2022] DELETE /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:25:09.223740 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:09.224591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:09.233858 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:09.234547 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:09.235006 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:09.235736 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:09.236204 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:09.236645 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:09.436918 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:09.445212 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-c9d9344a-a00d-4fc0-a269-f30ff109079c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1683 microversion: 2.1 time: 0.226045 Oct 17 14:25:09.447053 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4024/8345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:09 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:10.471137 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:10.471790 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:10.478947 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:10.479437 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:10.479877 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:10.480577 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:10.481035 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:10.481459 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:10.675624 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:10.684371 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-9d64ccfe-d1ab-4f51-ae27-86fa3f313c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1683 microversion: 2.1 time: 0.217588 Oct 17 14:25:10.684954 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4322/8346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:10 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:11.531743 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-572a5f4a-9f4e-40c7-b959-5aff1e909af0 req-7c8f73e6-8e60-4059-a9d9-eef3deb6b5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e293dea-383b-494b-8494-fe0a425e92a9", "name": "network-vif-deleted", "tag": "dc77c3a5-ef66-48f6-932e-7cb3f494fd15"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:25:11.543021 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-572a5f4a-9f4e-40c7-b959-5aff1e909af0 req-7c8f73e6-8e60-4059-a9d9-eef3deb6b5cc service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:11.543622 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-572a5f4a-9f4e-40c7-b959-5aff1e909af0 req-7c8f73e6-8e60-4059-a9d9-eef3deb6b5cc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:11.544084 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-572a5f4a-9f4e-40c7-b959-5aff1e909af0 req-7c8f73e6-8e60-4059-a9d9-eef3deb6b5cc service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:11.555988 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-572a5f4a-9f4e-40c7-b959-5aff1e909af0 req-7c8f73e6-8e60-4059-a9d9-eef3deb6b5cc service nova] Creating event network-vif-deleted:dc77c3a5-ef66-48f6-932e-7cb3f494fd15 for instance 5e293dea-383b-494b-8494-fe0a425e92a9 on n-h1-853316-12 Oct 17 14:25:11.560989 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-572a5f4a-9f4e-40c7-b959-5aff1e909af0 req-7c8f73e6-8e60-4059-a9d9-eef3deb6b5cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Oct 17 14:25:11.561595 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4025/8347] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:25:11.707654 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:11.708382 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:11.716007 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:11.716498 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:11.717037 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:11.717883 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:11.718491 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:11.718924 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:11.753421 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:11.753819 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:11.754277 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:11.754725 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.objects.instance [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lazy-loading 'fault' on Instance uuid 5e293dea-383b-494b-8494-fe0a425e92a9 {{(pid=127540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:25:11.799538 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.policy [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127540) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:11.809018 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-6df6c8fd-6b61-41c5-8e85-e7e39daf3a40 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 200 len: 1339 microversion: 2.1 time: 0.105330 Oct 17 14:25:11.809608 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4323/8348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:11 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:12.834612 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:12.835334 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: 5e293dea-383b-494b-8494-fe0a425e92a9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:12.841879 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:12.842409 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:12.842872 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:12.843590 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:12.844064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:12.844510 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:12.858223 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.wsgi [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] HTTP exception thrown: Instance 5e293dea-383b-494b-8494-fe0a425e92a9 could not be found. Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Request method failure captured: Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: request: GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 HTTP/1.1 Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: Accept: application/json Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: Accept-Encoding: identity Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: Connection: close Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: Content-Length: 0 Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: Content-Type: application/json Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: Host: 10.222.0.27 Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: Openstack-System-Scope: None Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: User-Agent: python-urllib3/1.26.12 Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Auth-Token: gAAAAABjTWR8v1QD_nerMN17NpB87tcZ3doHuxaPUH9NfSzgIRxVF3O72TyQDOJNccedurBHzWFf67GxvPpFqOkz9jIO07pQGhh2fXSSr6gkaLtyZItRoJ0PHJF-Q-IRKi5oPG_kqt9Y4rdq9Bp2j7XkWg-syPJ_loOlghcOtNj9OeQYfoIE5Hs Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Id: None Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Domain-Name: None Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Identity-Status: Confirmed Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Is-Admin-Project: True Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Id: default Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Domain-Name: Default Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Id: b69a950e26684a7a9d1ddd1ee160326f Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Project-Name: tempest-TestSnapshotPattern-1529968151 Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Role: reader,member Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Roles: reader,member Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b69a950e26684a7a9d1ddd1ee160326f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b69a950e26684a7a9d1ddd1ee160326f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b69a950e26684a7a9d1ddd1ee160326f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b69a950e26684a7a9d1ddd1ee160326f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant: tempest-TestSnapshotPattern-1529968151 Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Id: b69a950e26684a7a9d1ddd1ee160326f Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-Tenant-Name: tempest-TestSnapshotPattern-1529968151 Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-User: tempest-TestSnapshotPattern-1529968151-project Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Id: default Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-User-Domain-Name: Default Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-User-Id: 525a1e1922be41de8e7b16040316bf30 Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: X-User-Name: tempest-TestSnapshotPattern-1529968151-project Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: method: > Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: exception: Instance 5e293dea-383b-494b-8494-fe0a425e92a9 could not be found. Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: action_args: {'id': '5e293dea-383b-494b-8494-fe0a425e92a9'} Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e293dea-383b-494b-8494-fe0a425e92a9 could not be found. Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e293dea-383b-494b-8494-fe0a425e92a9 could not be found. Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:25:12.859906 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e293dea-383b-494b-8494-fe0a425e92a9 could not be found. Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: ERROR nova.api.openstack.wsgi Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Returning 404 to user: Instance 5e293dea-383b-494b-8494-fe0a425e92a9 could not be found. {{(pid=127539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-98750a24-9993-4f62-9c31-c629888ed356 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9" status: 404 len: 111 microversion: 2.1 time: 0.031952 Oct 17 14:25:12.865499 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4026/8349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:12 2022] GET /compute/v2.1/servers/5e293dea-383b-494b-8494-fe0a425e92a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:25:14.187685 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:14.188192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:14.188829 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [req-5ad626de-23b0-4318-b3b2-b2a97f6fd55b req-b478328c-2412-4ab6-85dc-a24da1c32c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e12e08-14eb-4357-bd78-113500fc36d9", "tag": "2b2784a4-8d87-4c7d-b60c-592300af49dd"}]} {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:25:14.195208 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:14.195816 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:14.196561 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:14.197271 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:14.197733 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:14.198192 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:14.200401 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ad626de-23b0-4318-b3b2-b2a97f6fd55b req-b478328c-2412-4ab6-85dc-a24da1c32c09 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:14.201004 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ad626de-23b0-4318-b3b2-b2a97f6fd55b req-b478328c-2412-4ab6-85dc-a24da1c32c09 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:14.201557 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [req-5ad626de-23b0-4318-b3b2-b2a97f6fd55b req-b478328c-2412-4ab6-85dc-a24da1c32c09 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:14.214905 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.compute.server_external_events [req-5ad626de-23b0-4318-b3b2-b2a97f6fd55b req-b478328c-2412-4ab6-85dc-a24da1c32c09 service nova] Creating event network-changed:2b2784a4-8d87-4c7d-b60c-592300af49dd for instance d7e12e08-14eb-4357-bd78-113500fc36d9 on n-h2-853316-12 Oct 17 14:25:14.220582 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [req-5ad626de-23b0-4318-b3b2-b2a97f6fd55b req-b478328c-2412-4ab6-85dc-a24da1c32c09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035840 Oct 17 14:25:14.221960 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4027/8350] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:25:14.225704 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Going to try to terminate instance {{(pid=127540) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:25:14.319497 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-3c12c493-5cfa-4b0f-9a67-cd75860710fe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 204 len: 0 microversion: 2.1 time: 0.135556 Oct 17 14:25:14.324202 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4324/8351] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 14:25:14 2022] DELETE /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:25:14.330628 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:14.331844 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:14.342224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:14.343066 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:14.343519 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:14.344276 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:14.344891 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:14.345356 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:14.505452 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:14.513843 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b3335c3a-5faf-4ac8-a983-ab9e888d9dfe tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1684 microversion: 2.1 time: 0.187654 Oct 17 14:25:14.514551 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4028/8352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:14 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:25:15.457441 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [req-d9ec57ba-98c0-4fe6-9e47-11b8179a4783 req-26fe3e5c-a249-440f-83a2-eaaffbf3add1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e12e08-14eb-4357-bd78-113500fc36d9", "name": "network-vif-deleted", "tag": "2b2784a4-8d87-4c7d-b60c-592300af49dd"}]} {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:25:15.468608 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9ec57ba-98c0-4fe6-9e47-11b8179a4783 req-26fe3e5c-a249-440f-83a2-eaaffbf3add1 service nova] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:15.469087 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9ec57ba-98c0-4fe6-9e47-11b8179a4783 req-26fe3e5c-a249-440f-83a2-eaaffbf3add1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:15.469712 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [req-d9ec57ba-98c0-4fe6-9e47-11b8179a4783 req-26fe3e5c-a249-440f-83a2-eaaffbf3add1 service nova] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:15.481089 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.compute.server_external_events [req-d9ec57ba-98c0-4fe6-9e47-11b8179a4783 req-26fe3e5c-a249-440f-83a2-eaaffbf3add1 service nova] Creating event network-vif-deleted:2b2784a4-8d87-4c7d-b60c-592300af49dd for instance d7e12e08-14eb-4357-bd78-113500fc36d9 on n-h2-853316-12 Oct 17 14:25:15.485841 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [req-d9ec57ba-98c0-4fe6-9e47-11b8179a4783 req-26fe3e5c-a249-440f-83a2-eaaffbf3add1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032471 Oct 17 14:25:15.486668 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4325/8353] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 14:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:25:15.540591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:15.542027 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.compute.api [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127539) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:15.551561 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:15.552064 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:15.552513 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:15.553230 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:15.553697 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:15.554180 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:15.587591 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:15.588089 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:15.588535 n-d-853316-12 devstack@n-api.service[127539]: DEBUG oslo_concurrency.lockutils [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:15.588999 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.objects.instance [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lazy-loading 'fault' on Instance uuid d7e12e08-14eb-4357-bd78-113500fc36d9 {{(pid=127539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:25:15.631224 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.policy [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525a1e1922be41de8e7b16040316bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69a950e26684a7a9d1ddd1ee160326f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127539) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:15.640527 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-eb491740-1004-469d-aabf-e3f2b84bed7c tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 200 len: 1339 microversion: 2.1 time: 0.107541 Oct 17 14:25:15.641113 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4029/8354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:15 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:16.664786 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '>' {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:16.665479 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.compute.api [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] [instance: d7e12e08-14eb-4357-bd78-113500fc36d9] Fetching instance by UUID {{(pid=127540) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:16.671662 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:16.672141 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:16.672573 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:16.673258 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Acquiring lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:16.673708 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:16.674130 n-d-853316-12 devstack@n-api.service[127540]: DEBUG oslo_concurrency.lockutils [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Lock "77ecd0a0-9d66-4c67-8ba1-a094c627ce98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:16.687430 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.wsgi [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] HTTP exception thrown: Instance d7e12e08-14eb-4357-bd78-113500fc36d9 could not be found. Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Request method failure captured: Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: request: GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 HTTP/1.1 Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: Accept: application/json Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: Accept-Encoding: identity Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: Connection: close Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: Content-Length: 0 Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: Content-Type: application/json Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: Host: 10.222.0.27 Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: Openstack-System-Scope: None Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: User-Agent: python-urllib3/1.26.12 Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Auth-Token: gAAAAABjTWR8v1QD_nerMN17NpB87tcZ3doHuxaPUH9NfSzgIRxVF3O72TyQDOJNccedurBHzWFf67GxvPpFqOkz9jIO07pQGhh2fXSSr6gkaLtyZItRoJ0PHJF-Q-IRKi5oPG_kqt9Y4rdq9Bp2j7XkWg-syPJ_loOlghcOtNj9OeQYfoIE5Hs Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Id: None Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Domain-Name: None Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Identity-Status: Confirmed Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Is-Admin-Project: True Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Id: default Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Domain-Name: Default Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Id: b69a950e26684a7a9d1ddd1ee160326f Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Project-Name: tempest-TestSnapshotPattern-1529968151 Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Role: reader,member Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Roles: reader,member Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b69a950e26684a7a9d1ddd1ee160326f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b69a950e26684a7a9d1ddd1ee160326f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b69a950e26684a7a9d1ddd1ee160326f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b69a950e26684a7a9d1ddd1ee160326f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}] Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant: tempest-TestSnapshotPattern-1529968151 Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Id: b69a950e26684a7a9d1ddd1ee160326f Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-Tenant-Name: tempest-TestSnapshotPattern-1529968151 Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-User: tempest-TestSnapshotPattern-1529968151-project Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Id: default Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-User-Domain-Name: Default Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-User-Id: 525a1e1922be41de8e7b16040316bf30 Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: X-User-Name: tempest-TestSnapshotPattern-1529968151-project Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: method: > Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: exception: Instance d7e12e08-14eb-4357-bd78-113500fc36d9 could not be found. Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: action_args: {'id': 'd7e12e08-14eb-4357-bd78-113500fc36d9'} Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: {{(pid=127540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e12e08-14eb-4357-bd78-113500fc36d9 could not be found. Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e12e08-14eb-4357-bd78-113500fc36d9 could not be found. Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:25:16.689064 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e12e08-14eb-4357-bd78-113500fc36d9 could not be found. Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: ERROR nova.api.openstack.wsgi Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: DEBUG nova.api.openstack.wsgi [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Returning 404 to user: Instance d7e12e08-14eb-4357-bd78-113500fc36d9 could not be found. {{(pid=127540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: INFO nova.api.openstack.requestlog [None req-4f8e7f33-f06f-470f-bba9-304fe0bb7c9d tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9" status: 404 len: 111 microversion: 2.1 time: 0.031021 Oct 17 14:25:16.694856 n-d-853316-12 devstack@n-api.service[127540]: [pid: 127540|app: 0|req: 4326/8355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:16 2022] GET /compute/v2.1/servers/d7e12e08-14eb-4357-bd78-113500fc36d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:25:16.860366 n-d-853316-12 devstack@n-api.service[127539]: DEBUG nova.api.openstack.wsgi [None req-b77832cb-e6bb-4127-8bb9-ab7ed51e9d43 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] Calling method '.version_select at 0x7fa822743550>' {{(pid=127539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:16.886061 n-d-853316-12 devstack@n-api.service[127539]: INFO nova.api.openstack.requestlog [None req-b77832cb-e6bb-4127-8bb9-ab7ed51e9d43 tempest-TestSnapshotPattern-1529968151 tempest-TestSnapshotPattern-1529968151-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1013214086" status: 202 len: 0 microversion: 2.1 time: 0.029547 Oct 17 14:25:16.886909 n-d-853316-12 devstack@n-api.service[127539]: [pid: 127539|app: 0|req: 4030/8356] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 17 14:25:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1013214086 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)